LAST CHANGED : 2013/07/29 01:53:18 CRUISE NAME(S) : P02W (mv1305) CRUISE DATES : 2013/03/21 to 2013/05/05 SHIP NAME : Melville PORTS : Yokohama, Japan to Honolulu, HI CHIEF SCIENTIST : Jim Swift DATABASE NAME : aship DATA FILES : mv2013_079_43611.raw to mv2013_124_57600.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2013/03/21 12:11:56 off 300 60 16 5 8 43.50 0.00 0001 HEADING : PRIMARY : gyro CORRECTION : coda_f185 POSITIONS : gps (specify more detail if available) CALIBRATION : check parameters for original heading alignment additional rotation 0 final transducer angle is: (original transducer angle) - (rotate_angle) original scale factor 1 additional scale factor (none) COMMENTS : gaps in heading correction? scattering layers? bubbles? underway bias? PROCESSOR : I.M. Persistent --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): pingtype = nb ## (determined from "sonar"): instname = os75 ## ping_headcorr is True ## hcorr_inst is coda_f185 beamangle 30 configtype python cruisename mv1305 datatype uhdas ens_len 300 fixfile None pgmin 50 proc_engine python ref_method refsm sonar os75nb yearbase 2013 Process UHDAS data using Python ============================================= In order to use all-python processing, we will generate the configuration file necessary from modern ship's settings and edit as needed. This file will be (a) consistent with all-python processing (b) guarantees newest file format (c) is more flexible (0) make a directory for processing, configuration, and notes: mkdir mv1305 cd mv1305 (1) # in mv1305 copy the config files: rsync -axl /home/data/uhdas_data_archive/melville/MV1305_legs/MV1305/proc/os75nb/config . verify that MV1305_proc.py is correct ### save file; exit editor # go back one level cd .. (2) now we can use that file. Set up the processing directory by typing: adcptree.py os75nb --datatype uhdas --cruisename MV1305 NOTE: Now there is no error message about missing configuration files (3) (a) change directories to ADCP processing directory just created cd os75nb NOTE: there is a "config" directory and it has a copy of the file mv1305_proc.py that we created in #2 (b) create a quick_adcp.py control file unix: this example is written as a bash "heredoc" for cut-and-past ease, but you can create q_py.cnt with an editor to have the parts between (or including) the comments cat << EOF > q_py.cnt ####----- begin q_py.cnt------------ ## all lines after the first "#" sign are ignored --yearbase 2013 --cruisename MV1305 # used to identify configuration files # *must* match prefix of files in config dir --update_gbin ## NOTE: You should generally remake gbins ## - you are not sure ## - if parameters for averaging changed ## - various other reasons. ## ==> MAKE SURE you move the original gbin directory ## to another name first!! #--py_gbindirbase gbin # (will put them adjacent to q_py.cnt) --configtype python ## <=== USE THE NEW FILE WE CREATED --sonar os75nb --dbname aship --datatype uhdas --ens_len 300 --ping_headcorr ## applies heading correction. ## settings found in config files --proc_engine python ## use python to do calculations --max_search_depth 3000 #if the topography says the ocean is deeper # than this, do not autodetect the bottom. # (reduces likelihood of shallow scattering # layers being identified as the bottom) EOF (c) run quick_adcp.py: quick_adcp.py --cntfile q_py.cnt --------- (4) review the data (a) check calibration:heading correction device: (b) check calibration: **watertrack** ------------ Number of edited points: 171 out of 180 amp = 1.0014 + -0.0000 (t - 105.8) phase = 0.16 + 0.0163 (t - 105.8) median mean std amplitude 1.0020 1.0014 0.0059 phase 0.2510 0.1634 0.5018 ------------ **transducer-gps offset** ------------ guessing ADCP (dx=startboard, dy=fwd) meters from GPS fixfile is aship.gps calculation done at 2013/06/22 22:33:43 xducer_dx = -0.392582 xducer_dy = -7.723261 signal = 3704.802829 ------------ figview.py cal/rotate/*png ==> several gaps in coda_f185 (requires patch_hcorr.py) (b) patch heading correction cd cal/rotate patch_hcorr.py - inspect the newhcorr*.png files: figview.py *.png - remove earlier time-dependent heading correction rotate unrotate.tmp - apply new heading correction rotate rotate_fixed.tmp - run navigation steps and inspect calibrations cd ../.. quick_adcp.py --steps2rerun navsteps:calib --auto (c) re-check calibration: **watertrack** ------------ Number of edited points: 171 out of 180 amp = 1.0014 + -0.0000 (t - 105.8) phase = 0.15 + 0.0183 (t - 105.8) median mean std amplitude 1.0020 1.0014 0.0059 phase 0.2500 0.1540 0.4963 ------------ **transducer-gps offset** ------------ guessing ADCP (dx=startboard, dy=fwd) meters from GPS fixfile is aship.gps calculation done at 2013/08/01 18:43:13 xducer_dx = -0.355867 xducer_dy = -7.731964 signal = 3704.802829 ------------ (5) edit "gautoedit" (go to "edit" directory with command line, type "gautoedit.py" # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto dataviewer.py (6) - check calibrations again **watertrack** ------------ Number of edited points: 169 out of 178 amp = 1.0012 + -0.0000 (t - 105.6) phase = 0.16 + 0.0176 (t - 105.6) median mean std amplitude 1.0020 1.0012 0.0061 phase 0.2540 0.1615 0.4960 ------------ **transducer-gps offset** ------------ guessing ADCP (dx=startboard, dy=fwd) meters from GPS fixfile is aship.gps calculation done at 2013/08/02 03:32:50 xducer_dx = -1.505733 xducer_dy = -7.852775 signal = 3704.802829 ------------ quick_adcp.py --steps2rerun rotate:navsteps:calib --rotate_angle 0.2 \ --xducer_dx -1 --xducer_dy -8 --auto OK, done (7) make plots: mkdir webpy cp ../os75bb/webpy/sectinfo.txt webpy quick_web.py --redo - view with a browser, look at webpy/index.html (8) extract data # adcp_nc.py adcpdb contour/os75nb mv1305_os75nb os75nb quick_adcp.py --steps2rerun matfiles --auto