LAST CHANGED : 2013/07/29 01:53:18 CRUISE NAME(S) : P02W (mv1305) CRUISE DATES : 2013/03/21 to 2013/05/05 SHIP NAME : Melville PORTS : Yokohama, Japan to Honolulu, HI CHIEF SCIENTIST : Jim Swift DATABASE NAME : aship DATA FILES : mv2013_079_43611.raw to mv2013_124_57600.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2013/03/21 12:11:56 off 300 80 8 5 8 43.50 0.00 0001 2013/03/22 05:42:55 off 300 80 8 5 8 43.50 0.00 0001 2013/03/23 04:30:49 off 300 80 8 5 8 43.50 0.00 0001 2013/03/24 05:30:48 off 300 80 8 5 8 43.50 0.00 0001 2013/04/04 22:39:19 off 300 80 8 5 8 43.50 0.00 0001 2013/04/05 23:39:16 off 300 80 8 5 8 43.50 0.00 0001 2013/04/07 00:39:17 off 300 80 8 5 8 43.50 0.00 0001 2013/04/11 04:50:07 off 300 80 8 5 8 43.50 0.00 0001 2013/04/12 05:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/13 06:50:07 off 300 80 8 5 8 43.50 0.00 0001 2013/04/14 07:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/17 10:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/19 12:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/21 14:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/22 15:50:09 off 300 80 8 5 8 43.50 0.00 0001 2013/04/23 16:50:09 off 300 80 8 5 8 43.50 0.00 0001 2013/04/24 17:50:07 off 300 80 8 5 8 43.50 0.00 0001 2013/04/26 19:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/27 20:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/28 21:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/29 22:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/04/30 23:50:09 off 300 80 8 5 8 43.50 0.00 0001 2013/05/02 00:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/05/03 01:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/05/04 02:50:10 off 300 80 8 5 8 43.50 0.00 0001 2013/05/05 03:50:10 off 300 80 8 5 8 43.50 0.00 0001 HEADING : PRIMARY : gyro CORRECTION : coda_f185 POSITIONS : gps (specify more detail if available) CALIBRATION : check parameters for original heading alignment additional rotation 0 final transducer angle is: (original transducer angle) - (rotate_angle) original scale factor 1 additional scale factor (none) COMMENTS : gaps in heading correction? scattering layers? bubbles? underway bias? PROCESSOR : I.M. Persistent --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): pingtype = bb ## (determined from "sonar"): instname = os75 ## ping_headcorr is True ## hcorr_inst is coda_f185 beamangle 30 configtype python cruisename MV1305 datatype uhdas ens_len 300 fixfile None pgmin 50 proc_engine python ref_method refsm sonar os75bb yearbase 2013 Process UHDAS data using Python ============================================= In order to use all-python processing, we will generate the configuration file necessary from modern ship's settings and edit as needed. This file will be (a) consistent with all-python processing (b) guarantees newest file format (c) is more flexible (0) make a directory for processing, configuration, and notes: mkdir mv1305 cd mv1305 (1) # in mv1305 copy the config files: rsync -axl /home/data/uhdas_data_archive/melville/MV1305_legs/MV1305/proc/os75bb/config . verify that MV1305_proc.py is correct ### save file; exit editor # go back one level cd .. (2) now we can use that file. Set up the processing directory by typing: adcptree.py os75bb --datatype uhdas --cruisename MV1305 NOTE: Now there is no error message about missing configuration files (3) (a) change directories to ADCP processing directory just created cd os75bb NOTE: there is a "config" directory and it has a copy of the file mv1305_proc.py that we created in #2 (b) create a quick_adcp.py control file unix: this example is written as a bash "heredoc" for cut-and-past ease, but you can create q_py.cnt with an editor to have the parts between (or including) the comments cat << EOF > q_py.cnt ####----- begin q_py.cnt------------ ## all lines after the first "#" sign are ignored --yearbase 2013 --cruisename MV1305 # used to identify configuration files # *must* match prefix of files in config dir --update_gbin ## NOTE: You should generally remake gbins ## - you are not sure ## - if parameters for averaging changed ## - various other reasons. ## ==> MAKE SURE you move the original gbin directory ## to another name first!! #--py_gbindirbase gbin # (will put them adjacent to q_py.cnt) --configtype python ## <=== USE THE NEW FILE WE CREATED --sonar os75bb --dbname aship --datatype uhdas --ens_len 300 --ping_headcorr ## applies heading correction. ## settings found in config files --proc_engine python ## use python to do calculations --max_search_depth 3000 #if the topography says the ocean is deeper # than this, do not autodetect the bottom. # (reduces likelihood of shallow scattering # layers being identified as the bottom) EOF (c) run quick_adcp.py: quick_adcp.py --cntfile q_py.cnt --------- (4) review the data (a) check calibration:heading correction device: figview.py cal/rotate/*png ===> gaps need to be fixed (b) check calibration: ------------------- **watertrack** ------------ Number of edited points: 166 out of 182 amp = 1.0019 + 0.0000 (t - 105.3) phase = 0.13 + 0.0140 (t - 105.3) median mean std amplitude 1.0030 1.0019 0.0084 phase 0.2025 0.1350 0.5833 ------------ **transducer-gps offset** ------------ guessing ADCP (dx=startboard, dy=fwd) meters from GPS fixfile is aship.gps calculation done at 2013/06/22 22:45:59 xducer_dx = 1.143490 xducer_dy = -9.726617 signal = 3704.876385 ------------ (c) look at the data: dataviewer.py Now patch heading correction: cd cal/rotate patch_hcprr.py #used cleaner, write/exit figview.py *.png rotate unrotate.tmp rotate rotate_fixed.tmp cd ../.. quick_adcp.py --steps2rerun navsteps:calib --auto (5) edit "gautoedit" (go to "edit" directory with command line, type "gautoedit.py" # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto **watertrack** ------------ Number of edited points: 163 out of 171 amp = 1.0016 + 0.0000 (t - 105.4) phase = 0.10 + 0.0168 (t - 105.4) median mean std amplitude 1.0020 1.0016 0.0084 phase 0.1880 0.0963 0.5638 ------------ [jules@puu os75bb]$ catxy **transducer-gps offset** ------------ guessing ADCP (dx=startboard, dy=fwd) meters from GPS fixfile is aship.gps calculation done at 2013/08/02 04:03:01 xducer_dx = 0.187395 xducer_dy = -8.044228 signal = 3704.876385 (6) - check calibrations again still need scale factor: quick_adcp.py --steps2rerun rotate:navsteps:calib --rotate_angle 0.1 --xducer_dx 0 --xducer_dy -8 --auto ================================================================== OK, done (7) make plots: quick_web.py --interactive - view with a browser, look at webpy/index.html