LAST CHANGED : 2017/04/13 19:52:11 CRUISE NAME(S) : tn188_transit CRUISE DATES : 2005/11/22 to 2005/12/03 SHIP NAME : Thomas G. Thompson PORTS : unspecified CHIEF SCIENTIST : unspecified DATABASE NAME : aship DATA FILES : tt2005_325_69562.raw to tt2005_336_45341.raw STATUS : to do done ------ ----------- averaged [ X ] loaded [ X ] NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ X ] calibration [ X ] edited [ X ] re-check heading correction [ X ] check editing [ X ] figures [ X ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2005/11/22 19:24:23 off 300 70 16 5 16 58.90 0.00 0001 HEADING : PRIMARY : heading from gyro CORRECTION : heading correction from posmv NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from gpsnav CALIBRATION : heading alignment: 58.9 additional rotation: 0.105 final transducer angle is: 58.795 (original transducer angle) - (rotate_angle) applied scale factor: 1 additional scale factor: 1.016 COMMENTS : gaps in heading correction scattering layers PROCESSOR : Dr. Thomas Roc --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): instname = os75 ## (determined from "sonar"): pingtype = nb badbeam None beamangle 30 configtype python cruisename tn188_transit datatype uhdas dbname aship ens_len 300 fixfile aship.gps hcorr_inst posmv pgmin 50 pingpref None proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar os75nb txy_file aship.gps xducer_dx 0 xducer_dy 0 yearbase 2005 ===================================================================================== Process UHDAS data using Python ============================================= In order to use all-python processing, we will generate the configuration file necessary from modern ship's settings and edit as needed. This file will be (a) consistent with all-python processing (b) guarantees newest file format (c) is more flexible (1a) get some information about this cruise: uhdas_info.py --overview --logfile uhdas_info.txt ./TN188_transit We see: - positions from gpsnav and posmv - headings from gyro and posmv - 132 files; all present (1b)# in tn188_transit_singlepingproc and run: mkdir config cp ../config/tn188_proc.py ./config/tn188_transit_proc.py # edited tn188_transit_proc.py yearbase = 2005 # usually year of first data logged uhdas_dir = '/home/troc/adcp_processing/cryosat/tn188_transit_singlepingproc/TN188_transit' # path to uhdas data directory shipname = 'Thomas G. Thompson' # for documentation cruiseid = 'tn188_transit' # for titles # go back one level cd .. (2) now we can use that file. # Set up the processing directory by typing: adcptree.py os75nb --datatype uhdas --cruisename tn188_transit (3) (a) change directories to ADCP processing directory just created cd os75nb (b) create a quick_adcp.py control file cat << EOF > q_py.cnt ####----- begin q_py.cnt------------ ## all lines after the first "#" sign are ignored ## python processing --yearbase 2005 --cruisename tn188_transit # used to identify configuration files # *must* match prefix of files in config dir --update_gbin ## NOTE: You should generally remake gbins ## - you are not sure ## - if parameters for averaging changed ## - various other reasons. ## ==> MAKE SURE you move the original gbin directory ## to another name first!! --py_gbindirbase gbin # (will put them adjacent to q_py.cnt) # The other option is to move the # original gbins out of the way, # to a new directory (eg. # gbin.orgimat) --configtype python ## <=== USE THE NEW FILE WE CREATED --sonar os75nb --dbname aship --datatype uhdas --ens_len 300 --ping_headcorr ## applies heading correction. ## settings found in config files --max_search_depth 3000 ## use topography for editing? ## 0 = "always use amplitude to guess the bottom; ## flag data below the bottom as bad ## -1 = "never search for the bottom" ## positive integer: use ADCP amp to autodetect ## the bottom. Only do this in "deep water", ## i.e. topo says bottom is deeper than this EOF (c) run quick_adcp.py: quick_adcp.py --cntfile q_py.cnt --------- (4) review the data (a) check calibration:heading correction device: figview.py cal/rotate/*png conclude: Big gap at the beginning of the cruise; need to run patch_hcorr.py cd cal/rotate/ patch_hcorr.py cd ../.. (b) check calibration: tail -20 cal/watertrk/adcpcal.out ------------------- ADCP watertrack calibration ## Number of edited points: 2 out of 3 amp = 1.0160 + -0.0000 (t - 332.4) phase = 0.10 + 0.5989 (t - 332.4) median mean std amplitude 1.0160 1.0160 0.0000 phase 0.1050 0.1050 0.0792 ------------------- TOO FEW POINTS TO USE; instead use values from the previous cruise (c) look at the data: dataviewer.py (5) edit "gautoedit" cd edit gautoedit.py -n5 #Notes: TR: Many scattering layers # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto # check editing -- looks OK dataviewer.py (6) Jules reviews # apply patch_hcorr.py and see if it's resolve the discrepencies between the two sets of data cd cal/rotate patch_hcorr.py (1) inspect the newhcorr*.png files: figview.py *.png (2) remove earlier time-dependent heading correction rotate unrotate.tmp (3) apply new heading correction rotate rotate_fixed.tmp (4) run navigation steps and inspect calibrations cd ../.. quick_adcp.py --steps2rerun navsteps:calib --auto check results # Re-apply editing and rotation quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto Apply calibrations from previous cruise: quick_adcp.py --steps2rerun rotate:navsteps:calib --rotate_amplitude 1.018 --auto catwt **watertrack** ------------ Number of edited points: 2 out of 2 amp = 1.0000 + -0.0000 (t - 332.4) phase = 0.00 + 0.5936 (t - 332.4) median mean std amplitude 1.0000 1.0000 0.0000 phase 0.0025 0.0025 0.0785 ------------ OK, done (7) make plots: quick_web.py --interactive (8) extract data adcp_nc.py adcpdb contour/os75nb tn188_transit os75nb quick_adcp.py --steps2rerun matfiles --auto done with processing. (9) Add os75nb/cruise_info.txt to the top of this file. # Edit with correct info # check data cd .. dataviewer.py -c os75bb/ os75nb/ quick_web.py --redo adcp_nc.py adcpdb contour/os75nb_short tn188_transit os75nb adcp_nc.py adcpdb contour/os75nb_long tn188_transit os75nb --long quick_adcp.py --steps2rerun matfiles --auto TR: Notes for Jules - done and reviewed