Opened 8 years ago

Closed 6 years ago

Last modified 5 years ago

#597 closed flight processing (fixed)

RANNIS15/28, flight day 242/2015, Hekla

Reported by: asm Owned by:
Priority: immediate Milestone: 2015 data processing completion
Component: Processing: general Keywords:
Cc: Other processors:

Description (last modified by dac)

Data location: ~arsf/arsf_data/2015/flight_data/iceland/RANNIS15_28-2015_242_Hekla

Data arrived from ARSF via SATA disk 8 on 28/09/2015.

Priority: Unknown

PI: Gro Pedersen

CAFAM code: R028

Sensors:

  • Fenix (requested)
  • Owl (requested - currently unfunded)
  • Leica LIDAR (requested)
  • RCD (requested)

Change History (56)

comment:1 Changed 8 years ago by asm

  • Milestone set to 2015 data processing completion

comment:2 Changed 8 years ago by asm

  • Description modified (diff)

comment:3 Changed 8 years ago by dac

  • Description modified (diff)

comment:4 Changed 8 years ago by asm

General Processing
-Logsheet generated.
-Engine times are approximate.

comment:5 Changed 8 years ago by asm

General Processing
Sent to PI ARSF data arrival notification for RANNIS15/28.

comment:6 Changed 8 years ago by asm

Navigation Processing

Started.
Needed to download base station information for this project. Used REYK
Basestation verification

Lat: 64 08 19.63090
Lon: -21 57 19.75497
Elipsoidal Height: 93.210 (metres)
Antenna Height: 0.057 (metres)

Could not find a suitable solution with Ipas TC, will try Ipas Pro.

comment:7 Changed 8 years ago by asm

Navigation Processing

Found a suitable solution using Ipas Pro. Also created sol file for camera processing.

comment:8 Changed 8 years ago by stgo

RCD processing
Starting camera processing.

comment:9 Changed 8 years ago by stgo

RCD processing

I've converted and tagged the images, creation of the delivery was fine but the readme is complaining that there are no rcd images in the generated KML file (?!) and that there has been a problem in the lidar sorting function. Looking in to this now.

comment:10 Changed 8 years ago by stgo

RCD delivery

ready for delivery check

comment:11 Changed 8 years ago by asm

RCD Delivery Check

Started.
-Google-earth is not loading any picture. Please double check cause could be a problem with the program installation.
-There are two additional thumbnails that are plots and do not correspond with any photograph and should not be included on the delivery (283, 284).
-Readme is missing pages at the end. It is missing pictures from 257 to 282 and general information about ARSF and copyright info.
-proj_tidy is complaning about every single file name but I can't see anything wrong, I suspect it is caused by a longer than usual project_code. Please re-check in any case.
-Some pictures are almost totally covered by clouds (217). If we are going to deliver those, a note about data quality will be beneficial on the readme file.

comment:12 Changed 8 years ago by dac

RCD

The path to the images in the KML were wrong, they were relative to the top level of the project rather than the delivery folder. Have fixed and checked under GoogleEarth.

Images completely covered by clouds should be removed.

comment:13 Changed 8 years ago by stgo

RCD

Fixed images and readme, new delivery created for checking

comment:14 Changed 8 years ago by asm

Fenix Hyperspectral Processing

Started.

Version 0, edited 8 years ago by asm (next)

comment:15 Changed 8 years ago by asm

RCD Delivery Check

All checks have been made. Everything seems correct. RCD is ready to delivery

comment:16 Changed 8 years ago by asm

Navigation Processing

Have re-done navigation with Ipas TC using PPP processing instead of GNSS differential. Have saved Ipas Pro output to a different directory in case of it is needed but will need to be tidied once archiving is needed.

comment:17 Changed 8 years ago by asm

Fenix Hyperspectral Processing

Found SCT values:

Flightline FENIX
1 0.94
2 1.06
3 0.91
4 0.95
5 1.04
6 0.98
7 0.97

Flightlines are fairly big on size, will split and create delivery.

comment:18 Changed 8 years ago by asm

Fenix Hyperspectral Processing

Have created the delivery and generated a readme file. Also realised that screenshots were mixed and did not match with its level3 and have renamed manually (also sct values were present on the name). Fenix is ready for Delivery Check.

comment:19 Changed 8 years ago by asm

Fenix Hyperspectral Processing

Solved some issues from delivery before DC also presented on 241a and noticed during DC.
-Removed fodis directoy
-Solved apl commands for bot config file and readme.

Last edited 8 years ago by asm (previous) (diff)

comment:20 Changed 8 years ago by dac

Delivery

Sent RCD to Gro Pederson (University of Iceland) on a hard drive (21/12/2015). Also placed on FTP server (arsf4) for early access.

comment:21 Changed 8 years ago by dac

PI prefers delivery by hard drive

Last edited 8 years ago by dac (previous) (diff)

comment:22 Changed 8 years ago by dac

Fenix

Have changed status back to processing as will need to be reprocessed once updated GPS basestaion data are available.

comment:23 Changed 8 years ago by dac

Marking as blocked - still waiting on GPS data from IMO.

comment:24 Changed 8 years ago by asm

Navigation processing

Navigation reprocessed with GPS data provided by Icelandic Met-office .
Basestation verification for FEDG:
Latitude 64 01 30.93098
Lon -19 41 22.05279
Ell Height 503.722
Ant Height 1.00 m, to L1-PC (TRM411249.00, MeasDist 0.929)
Which corresponds on decimal degrees to the values sent by Met-office: -19.68946006 64.02525821 503.73149445

Basestation verification for HESA:
Latitude 64 02 48.62714
Lon -19 33 38.08773
Ell Height 529.117
Ant Height 1.090 m, to L1-PC (TRM411249.00, MeasDist 1.019)
Also match data received: -19.56057992 64.04684073 529.08620580 HESA deltaz=0.244

Basestation verification for MJSK:
Latitude 63 55 58.59971
Lon -19 40 20.53000
Ell Height 770.562
Ant Height 1.050 m, to L1-PC (TRM411249.00, MeasDist 0.979)
Also match data received:-19.6723625459 63.9329479506 770.861162678

Best solution found using MJSK. Best solution found using MJSK. Copying files and will rename old basestation and ipas_honeywell to old_nav_basestation (Please clean after processing, before archiving).

comment:25 Changed 8 years ago by asm

Fenix

Creating a new hyperspectral delivery with the new navigation.

comment:26 Changed 8 years ago by asm

Fenix

Delivery and readme created. Awaiting delivery check. There is also an old delivery created with the old navigation that has not been checked and delivered. To be sorted out on the future.

Last edited 8 years ago by asm (previous) (diff)

comment:27 Changed 8 years ago by dac

Fenix Delivery Check

Starting delivery check.

comment:28 Changed 8 years ago by dac

Fenix Delivery Check

Generally looks good a couple of comments:

  • Need to remove old delivery
  • Lots of clouds and cloud shadow in data.
  • check_apl_cmd doesn't run - commands not defined in config file.
  • proj_tidy gave a lot of errors - I think due to length of project name.
  • Py6S script didn't find many vegetation pixels - the ones it did looked good though.
  • The readme lists f24207 as having 2 parts in the table with corresponding lines in the log sheet but there is only one part.

comment:29 Changed 8 years ago by asm

Fenix

All comments suggested during delivery check have been addressed.

comment:30 Changed 8 years ago by dac

Fenix

Marking as ready to delivery. Have started zipping mapped files.

comment:31 Changed 8 years ago by gej

Lidar Processing

Lack of features and high cloud cover so pitch and roll corrections difficult, found values of:
roll:-0.001
pitch:-0.0022

Classifying now.

comment:32 Changed 8 years ago by gej

Lidar Processing

Finished classification, creating delivery now.

comment:33 Changed 8 years ago by gej

Lidar Processing

Noticed that pitch and roll doesn't work well in some areas so am trying to find better values.

comment:34 Changed 8 years ago by gej

Lidar Processing

New pitch and roll values of
roll: -0.0010
pitch: -0.0020

Classifying now.

comment:35 Changed 8 years ago by gej

Lidar processing

Classified, creating delivery now

comment:36 Changed 8 years ago by gej

Lidar Processing

Delivery and Readme created

Ready for delivery check

comment:37 Changed 8 years ago by dac

LiDAR delivery check

Starting delivery check.

comment:38 Changed 8 years ago by dac

  • Clouds are classified well:
  • Output from demcompare (comparison with ASTER):
    Difference statistics:                                                          
    Min:            -465.749974609375                                               
    Max:            123.000025390625                                                
    Sum:            -1689738.32831479                                               
    Mean:           -9.07812332211263                                               
    Median:         -8.1895                                                         
    Absolute mean:  10.8730745807861                                                
    Std deviation:  19.8399810250404                                                
    Total cells:    6559705                                                         
    Non-null cells: 186133                                                          
    
  • Added some pagebreaks to fix pagination in readme
  • Ready to deliver.

(previous comment was for 241b)

Last edited 8 years ago by dac (previous) (diff)

comment:39 Changed 8 years ago by asm

Delivery

Lidar and Fenix data dispatched via hard drive on 23/02/2016.

comment:40 Changed 8 years ago by asm

RCD processing

Taking over this project. Will create new eventfile and tag photos.

comment:41 Changed 8 years ago by asm

RCD processing

Creating new delivery

comment:42 Changed 8 years ago by asm

RCD processing

Delivery and readme created. Awaiting delivery check.

comment:43 Changed 8 years ago by lah

RCD DC

  • Had to change read permissions for event file
  • proj_tidy doesn't recognise any of the files as it's "RANNIS", apart from that everything is fine.

Ready to deliver.

comment:44 Changed 8 years ago by asm

Delivery

Camera reprocessed with new navigation dispatched via hard drive on 03/03/2016. No more re-processing pending.

comment:45 Changed 6 years ago by dac

Archiving

Data uploaded to CEDA at request of PI.

comment:46 Changed 6 years ago by dac

  • Resolution set to fixed
  • Status changed from new to closed

Archiving

Data available from CEDA. Closing ticket.

comment:47 Changed 5 years ago by wja

Owl Processing

  • No darkframes
  • Separate calibration files

Data has no been stitched and is currently processing to level1 using the following calibration file for each line:

LineCal File
1T1042
2T1042
3T1116
4T1128
51139
61139
7T1149

comment:48 Changed 5 years ago by wja

Owl Processing
Processed to level1b.
Finding SCT values.
Line 6 is very short (1576 lines) and will not be processed further.

comment:49 Changed 5 years ago by wja

Owl Processing
SCT Values:

13.80
23.10
32.30
42.35
52.65
6N/A
73.15

'sensorid' in level1 headers has been changed to match the hyperspectral sensors CSV in order for line information XMLs to be produced.
Prcoessing to level3.

comment:50 Changed 5 years ago by wja

Owl Prcoessing
Flightlines have been split where appropriate to be consistent with data in hyperspectral delivery.
Creating delivery.

comment:51 Changed 5 years ago by wja

Owl Delivery
Owl delivery created. Logsheet has been generated by adding appropriate Owl information to the original hyperspectral delivery logsheet.
Ready for delivery check.

comment:52 Changed 5 years ago by dac

Owl Delivery Check

  • Should mention cloud cover and cloud shadows in readme as quite bad for this flight.
  • Removed an *aux.xml file left in mapped directory
  • The project name is listed in the logsheet as HEKLA RO28, R028 is just the identifier used by BAS it doesn't need to be in the project name. Has been used for previous deliveries so might as well keep for consistency though.
  • check_apl_cmd ran through OK
  • SCT values look good.

Zipping mapped files. Once note about cloud cover has been added to readme ready to deliver.

comment:53 Changed 5 years ago by wja

Owl Delivery
ReadMe updated.
Mapped files have been zipped.
Delivery placed on FTP slot 11.
Notification e-mail sent.
Delivery finalised.

comment:54 Changed 5 years ago by wja

Owl Archiving
Added to PostGIS.
Starting rsync to CEDA (15:18 31/05/2019).

comment:55 Changed 5 years ago by wja

Owl Archiving
rsync to CEDA complete (3/6/19).
E-mail sent to confirm it has been received.

comment:56 Changed 5 years ago by wja

Owl Archiving
CEDA has confirmed recepit of the reprocessed Owl data.
All data is now archived.

Note: See TracTickets for help on using tickets.