LAST CHANGED : 2017/12/27 21:45:19 CRUISE NAME(S) : P06W (nbp1706) CRUISE DATES : 2017/07/03 to 2017/08/17 SHIP NAME : N.B. Palmer PORTS : Sydney, Australia to Papeete, Tahiti CHIEF SCIENTIST : S.Mecking DATABASE NAME : aship DATA FILES : np2017_183_04744.raw to np2017_228_21600.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2017/07/03 01:24:04 off 300 60 16 7 8 45.00 0.00 0001 HEADING : PRIMARY : heading from gyro CORRECTION : heading correction from seapath1 NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from seapath1 CALIBRATION : (check original processing parameters) additional rotation 0 final transducer angle is: 45.0 (original transducer angle) - (-0.05) (rotate_angle) = 45.05 original scale factor 1 applied additional scale factor: 1.01 dx,dy applied in q_py.cnt --xducer_dx 2 --xducer_dy 17 ## transducer offset correction! and additional adjustment: --xducer_dx -1 --xducer_dy 1 --rotate_amplitude 1.01 --rotate_angle -0.05 COMMENTS : NO gaps in heading correction PROCESSOR : U. Pinho --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): instname = os75 ## (determined from "sonar"): pingtype = nb badbeam None beamangle 30 configtype python cruisename nbp1706 datatype uhdas dbname aship ens_len 300 fixfile aship.gps hcorr_inst seapath1 pgmin 50 pingpref None proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar os75nb txy_file aship.agt xducer_dx 2 xducer_dy 17 yearbase 2017 #---- (1) Get some info: uhdas_info.py --overview --logfile uhdas_info.txt /home/data/NBP1706/ cat uhdas_info.txt ================================================================== ======= start of report for /home/data/NBP1706/ ===== ================================================================== ------raw------- raw: gpsnav 545 files (np2017_183_04744 - np2017_228_21600) raw: gyro 545 files (np2017_183_04744 - np2017_228_21600) raw: seapath1 545 files (np2017_183_04744 - np2017_228_21600) raw: seapath2 545 files (np2017_183_04744 - np2017_228_21600) raw: sndspd 3 files (np2017_183_04744 - np2017_203_40099) adcp: os75 .raw 545 files (np2017_183_04744 - np2017_228_21600) adcp: os75 .raw.log 545 files (np2017_183_04744 - np2017_228_21600) adcp: os75 .raw.log.bin 545 files (np2017_183_04744 - np2017_228_21600) adcp: os38 .raw 545 files (np2017_183_04744 - np2017_228_21600) adcp: os38 .raw.log 545 files (np2017_183_04744 - np2017_228_21600) adcp: os38 .raw.log.bin 545 files (np2017_183_04744 - np2017_228_21600) -----rbin------- rbin: gpsnav:gps 545 files (np2017_183_04744 - np2017_228_21600) rbin: gyro:hdg 545 files (np2017_183_04744 - np2017_228_21600) rbin: seapath1:gps_sea 545 files (np2017_183_04744 - np2017_228_21600) rbin: seapath1:sea 545 files (np2017_183_04744 - np2017_228_21600) rbin: seapath2:gps_sea 545 files (np2017_183_04744 - np2017_228_21600) rbin: seapath2:sea 545 files (np2017_183_04744 - np2017_228_21600) -----gbin------- gbin: os38 (seapath1,gyro,gpsnav,seapath2,time,sndspd) ------ database time ranges -------- proc: os38bb No database found proc: os38nb 183.058 - 228.301 (2017/07/03 to 2017/08/17) proc: os75bb No database found proc: os75nb 183.058 - 228.301 (2017/07/03 to 2017/08/17) ...BUT these were found: gbin.os38 gbin.seapath1 gbin.old gbin.gpsnav gbin.orig gbin.os75 ---------- end of report for /home/data/NBP1706/-------------- -------------------------------------------- --- already done for os38nb: from here: ---- (2) make config directory and CRUISENAME_proc.py mkdir config cd config # Make the configuration file: uhdas_proc_gen.py -s np # This creates a file called "np_proc.py" # copy to a new version for our cruise (use the cruisename "nbp1706"): cp np_proc.py nbp1706_proc.py # Edit the file and add these four (4) # lines to the top of nbp1706_proc.py # --- begin section to add --- # full path to uhdas data directory (do not use relative path) shipname = 'N.B.Palmer' cruiseid = 'nbp1706' yearbase = 2017 uhdas_dir = '/home/data/NBP1706' # --- end of section to add --- (3) change position to seapath1: emacs nbp1706_proc.py & ## FROM:---- # choose position instrument (directory and rbin message) pos_inst = 'gpsnav' pos_msg = 'gps' ## TO:---- # choose position instrument (directory and rbin message) pos_inst = 'seapath1' pos_msg = 'gps_sea' --- already done for os38nb: up to here. ---- --------------------------------------------- cd .. (4) now we can use that file. Set up the processing directory by typing: adcptree.py os75nb --datatype uhdas --cruisename nbp1706 (5) Check dx,dy in /home/data/NBP1706/proc/os75nb: **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_np.agt calculation done at 2017/08/17 07:17:24 xducer_dx = 2.304921 xducer_dy = 16.900834 signal = 6086.367996 ------------ (6) create q_py.cnt: cd os75nb cat << EOF > q_py.cnt ####----- begin q_py.cnt------------ ## all lines after the first "#" sign are ignored --yearbase 2017 --cruisename nbp1706 # used to identify configuration files # *must* match prefix of files in config dir --update_gbin ## NOTE: You should generally remake gbins ## - you are not sure ## - if parameters for averaging changed ## - various other reasons. ## ==> MAKE SURE you move the original gbin directory ## to another name first!! Default directory ## to make gbins is in uhdas_dir ## or... alternatively, use this parameter #--py_gbindirbase gbin # (will put them adjacent to q_py.cnt) --configtype python ## use km1001c_proc.py for configuration --sonar os75nb --dbname aship --datatype uhdas --ens_len 300 --ping_headcorr ## applies heading correction. ## this ONLY works if there is a heading ## correction device specified in the ## config/km1001c_proc.py file --max_search_depth 3000 #if the topography says the ocean is deeper # than this, do not autodetect the bottom. # (reduces likelihood of shallow scattering # layers being identified as the bottom) --xducer_dx 2 --xducer_dy 17 ## transducer offset correction! EOF (7) move gbin: mv /home/data/NBP1706/gbin /home/data/NBP1706/gbin.os38nb.uvship (a) run quick_adcp.py: quick_adcp.py --cntfile q_py.cnt --auto #---------------------------------------------------------------------------------------- ### POST-PROCESSING --------------------------------------------------------------------- cd os75nb plot_nav.py nav/aship.gps NB Palmer cruise from Sydney to Papeete, sailing along 30S parallel up to North of NZ from Auckland to Papeete sailing along parallel 32.5S in about 50 days. (8) review the data (a) check calibration:heading correction device: figview.py cal/rotate/*png conclude: no action needed figview.py . (b) check calibration: **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2017/12/27 21:45:18 xducer_dx = 1.288989 xducer_dy = 1.147385 signal = 6081.468019 ------------ **watertrack** ------------ Number of edited points: 266 out of 272 amp = 1.0110 + -0.0001 (t - 202.5) phase = -0.01 + -0.0003 (t - 202.5) median mean std amplitude 1.0110 1.0110 0.0064 phase -0.0475 -0.0097 0.3719 ------------ **bottomtrack** ------------ tail: cannot open 'cal/botmtrk/btcaluv.out' for reading: No such file or directory ------------ (c) look at the data: dataviewer.py (9) Applied quick_adcp.py uvship: quick_adcp.py --steps2rerun navsteps:calib --refuv_source uvship --auto (10) edit "gautoedit" cd edit gautoedit.py -n5 # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto # check editing -- looks OK dataviewer.py (11) - check calibrations again **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2017/12/28 00:20:25 xducer_dx = 1.166770 xducer_dy = 1.051069 signal = 6081.468019 ------------ quick_adcp.py --steps2rerun navsteps:calib --xducer_dx 1 --xducer_dy 1 --auto **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2017/12/28 00:22:37 xducer_dx = 0.227637 xducer_dy = 0.109378 signal = 6081.468019 ------------ **watertrack** ------------ Number of edited points: 266 out of 271 amp = 1.0108 + -0.0002 (t - 202.5) phase = -0.01 + -0.0003 (t - 202.5) median mean std amplitude 1.0105 1.0108 0.0064 phase -0.0510 -0.0108 0.3712 ------------ quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_amplitude 1.01 --rotate_angle 0.05 --auto **watertrack** ------------ Number of edited points: 266 out of 271 amp = 1.0008 + -0.0002 (t - 202.5) phase = -0.06 + -0.0004 (t - 202.5) median mean std amplitude 1.0000 1.0008 0.0064 phase -0.0955 -0.0607 0.3711 ------------ --- oops! wrong sign in angle rotation... fixing: quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_angle -0.1 --auto **watertrack** ------------ Number of edited points: 266 out of 271 amp = 1.0008 + -0.0002 (t - 202.5) phase = 0.04 + -0.0004 (t - 202.5) median mean std amplitude 1.0005 1.0008 0.0063 phase 0.0045 0.0394 0.3710 ------------ figview.py cal/watertrk/wtcal1.png (12) make web plots quick_web.py --interactive - view with a browser, look at webpy/index.html (13) Extract data: quick_adcp.py --steps2rerun matfiles --auto You can extract NetCDF files as well. adcp_nc.py adcpdb contour/os75nb_short NBP1706 os75nb adcp_nc.py --long adcpdb contour/os75nb_long NBP1706 os75nb To check netcdf file: ncdump -h contour/os75nb_short.nc # cat cruise_info.txt at the top of this file!