LAST CHANGED : 2016/01/27 21:35:11 CRUISE NAME(S) : ARC01 (hly1502) CRUISE DATES : 2015/09/11 to 2015/08/23 SHIP NAME : Healy PORTS : Dutch Harbor, AK to Dutch Harbor, AK CHIEF SCIENTIST : D.Kadko DATABASE NAME : aship DATA FILES : hly2015_220_77865.raw to hly2015_284_00000.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] NOTE: heading correction instrument exists NOTE: time-dependent heading corrections staged but NOT applied (see cal/rotate/hcorr.ang) --> check if applied using "rotate" check heading correction [ x ] see below calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os150 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2015/08/09 21:42:45 off 300 80 4 8 7 28.40 0.00 0001 HEADING : PRIMARY : heading from gyro39 CORRECTION : heading correction from ashpaq5 NOTE: time-dependent heading corrections staged but NOT applied (see cal/rotate/hcorr.ang) --> check if applied using "rotate" POSITIONS : gps positions from gpsnav CALIBRATION : (check original processing parameters) additional rotation 0 final transducer angle is: (original transducer angle) - (watertrack) 28.4 - (0.35) = 28.05 applied scale factor 1 additional scale factor (1.0043) COMMENTS : see notes below: POSMV and seapath were broken, ashtech had holes, gyro was MK39 (very good) but fell apart at 90N Lots of ice, poor scattering, some electrical bias PROCESSOR : D.Cardoso, J.Hummon --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 150 ## (determined from "sonar"): instname = os150 ## (determined from "sonar"): pingtype = nb badbeam None beamangle 30 configtype python cruisename hly1502 datatype uhdas dbname aship ens_len 300 fixfile aship.gps hcorr_inst ashpaq5 pgmin 50 pingpref None proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar os150nb txy_file aship.agt xducer_dx 0 xducer_dy 27 yearbase 2015 Process UHDAS data using Python ============================================= In order to use all-python processing, we will generate the configuration file necessary from modern ship's settings and edit as needed. This file will be (a) consistent with all-python processing (b) guarantees newest file format (c) is more flexible ***Special alteration of 'best' gbins in /home/data/hly1502/gbin/os150/time/*** - wrote a script to create a list of certain 'best' gbin files that have bad gyro data for 2 instruments os75/150 - 247.61, 253.1 are the dday times when Gyro data is bad, note Unix day is very similar to dd_day on this ship (ntp was working) - replaced this range of bad gyro data with Ashteck data - checked the ashteck data for bad flags which show up in the gbins as Nans and Interpolated to remove the Nans - wrote new gbins 'best' files - replace the bad data near the pole region [247.675, 249.172] with a constant heading of 90 **************************************************** (1) copy config directory from /home/data/hly1502/proc/os150nb/config edit hly1502_proc.py: change uhdas_dir to /home/cardoso/healy/hly1502_newgbins90 cd .. (2) now we can use that file. Set up the processing directory by typing: adcptree.py os150nb --datatype uhdas --cruisename hly1502 # using 'hly1502" will specify config/hly1502_proc.py) (3) (a) change directories to ADCP processing directory just created cd os150nb NOTE: there is a "config" directory and it has a copy of the file hly1502_proc.py that we created in #2 (b) create a quick_adcp.py control file cat << EOF > q_py.cnt ####----- begin q_py.cnt------------ ## all lines after the first "#" sign are ignored ## python processing --yearbase 2015 --cruisename hly1502 # --update_gbin ## see notes above: we are not updating these --configtype python ## <=== USE THE NEW FILE WE CREATED --sonar os150nb --dbname aship --datatype uhdas --ens_len 300 --xducer_dx 0 --xducer_dy 27 # --ping_headcorr # do not apply heading correction --max_search_depth 3000 ## use topography for editing? ## 0 = "always use amplitude to guess the bottom; ## flag data below the bottom as bad ## -1 = "never search for the bottom" ## positive integer: use ADCP amp to autodetect ## the bottom. Only do this in "deep water", ## i.e. topo says bottom is deeper than this EOF (c) run quick_adcp.py: quick_adcp.py --cntfile q_py.cnt --auto (4) switch to ref+method "uvship" quick_adcp.py --steps2rerun navsteps:calib --refuv_source uvship --auto save a copy of calibrated folder as os150nb_uvship look at the data: dataviewer.py -c os150nb_orig os150nb (c) look at the data: dataviewer.py (5) edit "gautoedit" on the os150nb_uvship data cd edit gautoedit.py -n5 # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto # check editing -- looks OK dataviewer.py (6) - check calibrations again **watertrack** ------------ Number of edited points: 106 out of 134 amp = 1.0047 + -0.0001 (t - 252.5) phase = 0.36 + 0.0008 (t - 252.5) median mean std amplitude 1.0040 1.0047 0.0136 phase 0.3295 0.3582 0.8369 ------------ ** guess_xducerxy** ------------ guessing ADCP (dx=startboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2016/01/30 02:09:22 xducer_dx = -0.368748 xducer_dy = 9.986316 signal = 8401.779163 ------------ still need scale factor: quick_adcp.py --steps2rerun rotate:navsteps:calib --rotate_amplitude 1.0043 --auto **watertrack** ------------ Number of edited points: 107 out of 136 amp = 1.0007 + -0.0001 (t - 252.3) phase = 0.37 + 0.0004 (t - 252.3) median mean std amplitude 1.0000 1.0007 0.0138 phase 0.3430 0.3726 0.8443 ------------ phase correction is very small: quick_adcp.py --steps2rerun rotate:navsteps:calib --rotate_angle 0.35 --auto **watertrack** ------------ Number of edited points: 107 out of 136 amp = 1.0008 + -0.0001 (t - 252.3) phase = 0.02 + 0.0004 (t - 252.3) median mean std amplitude 1.0000 1.0008 0.0139 phase -0.0030 0.0234 0.8442 ------------ (7) compare the os75 and os150 dataviewer.py -m5 -c os150nb_uvship os75nb_uvship (8)edit "gautoedit" on the os150nb_uvship data cd edit gautoedit.py -n5 # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto compare the os75 and os150 again # check editing -- looks OK dataviewer.py (9) - check calibrations again **watertrack** ------------ Number of edited points: 110 out of 138 amp = 1.0003 + -0.0001 (t - 252.6) phase = 0.05 + 0.0009 (t - 252.6) median mean std amplitude 0.9985 1.0003 0.0136 phase 0.0360 0.0484 0.8290 ------------ OK, done (10) make plots: quick_web.py --interactive - view with a browser, look at webpy/index.html (11) extract data adcp_nc.py adcpdb contour/os150nb hly1502_newgbins os150nb ## dbpath outfilebase cruisetitle sonar test your file by running adcp_ncdump.py contour/os150nb.nc quick_adcp.py --steps2rerun matfiles --auto ---- done with processing. Add os75nb/cruise_info.txt to the top of this file. Edit with correct info