LAST CHANGED : 2018/01/03 01:35:52 CRUISE NAME(S) : P06E (nbp1707) CRUISE DATES : 2017/08/20 to 2017/09/30 SHIP NAME : N.B. Palmer PORTS : Papeete (Tahiti) to Chile CHIEF SCIENTIST : Kevin Speer and Lena Schulze (Co-Chief) DATABASE NAME : aship DATA FILES : np2017_232_00134.raw to np2017_271_50400.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2017/08/21 00:07:15 off 300 60 16 7 8 45.00 0.00 0001 HEADING : PRIMARY : heading from gyro CORRECTION : heading correction from seapath1 NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from seapath1 CALIBRATION : (check original processing parameters) additional rotation 0 final transducer angle is: 45.0 (original transducer angle) - 0.03 (rotate_angle) original scale factor 1 dx,dy applied in q_py.cnt --xducer_dx 2 --xducer_dy 17 ## transducer offset correction and additional adjustment: --xducer_dx 1 --xducer_dy 3 COMMENTS : No gaps in heading correction Just a few scattering layers Some underway bias at the first (superficial) layer was edited out. PROCESSOR : U. Pinho --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): instname = os75 ## (determined from "sonar"): pingtype = nb badbeam None beamangle 30 configtype python cruisename nbp1707 datatype uhdas dbname aship ens_len 300 fixfile aship.gps hcorr_inst seapath1 pgmin 50 pingpref None proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar os75nb txy_file aship.agt xducer_dx 2 xducer_dy 17 yearbase 2017 #---- (1) Get some info: uhdas_info.py --overview --logfile uhdas_info.txt /home/data/NBP1707Merg/NBP1707merged cat uhdas_info.txt ================================================================== ======= start of report for /home/data/NBP1707Merg/NBP1707merged ===== ================================================================== ------raw------- raw: gpsnav 478 files (np2017_232_00134 - np2017_271_50400) raw: gyro 478 files (np2017_232_00134 - np2017_271_50400) raw: seapath1 478 files (np2017_232_00134 - np2017_271_50400) raw: seapath2 478 files (np2017_232_00134 - np2017_271_50400) raw: sndspd 3 files (np2017_232_00134 - np2017_258_38659) adcp: os75 .raw 478 files (np2017_232_00134 - np2017_271_50400) adcp: os75 .raw.log 478 files (np2017_232_00134 - np2017_271_50400) adcp: os75 .raw.log.bin 478 files (np2017_232_00134 - np2017_271_50400) adcp: os38 .raw 478 files (np2017_232_00134 - np2017_271_50400) adcp: os38 .raw.log 478 files (np2017_232_00134 - np2017_271_50400) adcp: os38 .raw.log.bin 478 files (np2017_232_00134 - np2017_271_50400) -----rbin------- rbin: gpsnav:gps 478 files (np2017_232_00134 - np2017_271_50400) rbin: gyro:hdg 478 files (np2017_232_00134 - np2017_271_50400) rbin: seapath1:gps_sea 478 files (np2017_232_00134 - np2017_271_50400) rbin: seapath1:sea 478 files (np2017_232_00134 - np2017_271_50400) rbin: seapath2:gps_sea 478 files (np2017_232_00134 - np2017_271_50400) rbin: seapath2:sea 478 files (np2017_232_00134 - np2017_271_50400) -----gbin------- gbin: os75 (seapath1,gyro,gpsnav,seapath2,time,sndspd) ERROR no "proc" directory found (no "reports" directory found) ...BUT these were found: uhdas_info.txt gbin.os38nb ---------- end of report for /home/data/NBP1707Merg/NBP1707merged-------------- uhdas_info.py --overview --logfile uhdas_info.txt /home/data/NBP1707Merg/NBP1707_segments/NBP1707a cat uhdas_info.txt ================================================================== ======= start of report for /home/data/NBP1707Merg/NBP1707_segments/NBP1707a ===== ================================================================== ------raw------- raw: gpsnav 159 files (np2017_258_38659 - np2017_271_50400) raw: gyro 159 files (np2017_258_38659 - np2017_271_50400) raw: seapath1 159 files (np2017_258_38659 - np2017_271_50400) raw: seapath2 159 files (np2017_258_38659 - np2017_271_50400) raw: sndspd 1 files (np2017_258_38659 - np2017_258_38659) adcp: os75 .raw 159 files (np2017_258_38659 - np2017_271_50400) adcp: os75 .raw.log 159 files (np2017_258_38659 - np2017_271_50400) adcp: os75 .raw.log.bin 159 files (np2017_258_38659 - np2017_271_50400) adcp: os38 .raw 159 files (np2017_258_38659 - np2017_271_50400) adcp: os38 .raw.log 159 files (np2017_258_38659 - np2017_271_50400) adcp: os38 .raw.log.bin 159 files (np2017_258_38659 - np2017_271_50400) -----rbin------- rbin: gpsnav:gps 159 files (np2017_258_38659 - np2017_271_50400) rbin: gyro:hdg 159 files (np2017_258_38659 - np2017_271_50400) rbin: seapath1:gps_sea 159 files (np2017_258_38659 - np2017_271_50400) rbin: seapath1:sea 159 files (np2017_258_38659 - np2017_271_50400) rbin: seapath2:gps_sea 159 files (np2017_258_38659 - np2017_271_50400) rbin: seapath2:sea 159 files (np2017_258_38659 - np2017_271_50400) -----gbin------- gbin: os75 (seapath1,gyro,gpsnav,seapath2,time,sndspd) gbin: os38 (seapath1,gyro,gpsnav,seapath2,time,sndspd) ------ database time ranges -------- proc: os38bb No database found proc: os38nb 258.451 - 271.611 (2017/09/16 to 2017/09/29) proc: os75bb No database found proc: os75nb 258.451 - 271.611 (2017/09/16 to 2017/09/29) ---------- end of report for /home/data/NBP1707Merg/NBP1707_segments/NBP1707a-------------- (2) make config directory and CRUISENAME_proc.py mkdir config cd config # Make the configuration file: uhdas_proc_gen.py -s np # This creates a file called "np_proc.py" # copy to a new version for our cruise (use the cruisename "nbp1707"): cp np_proc.py nbp1707_proc.py # Edit the file and add these four (4) # lines to the top of nbp1707_proc.py # --- begin section to add --- # full path to uhdas data directory (do not use relative path) shipname = 'N.B.Palmer' cruiseid = 'nbp1707' yearbase = 2017 uhdas_dir = '/home/data/NBP1707Merg/NBP1707merged' # --- end of section to add --- (3) change position to seapath1: emacs nbp1707_proc.py & ## FROM:---- # choose position instrument (directory and rbin message) pos_inst = 'gpsnav' pos_msg = 'gps' ## TO:---- # choose position instrument (directory and rbin message) pos_inst = 'seapath1' pos_msg = 'gps_sea' cd .. (4) now we can use that file. Set up the processing directory by typing: adcptree.py os75nb --datatype uhdas --cruisename nbp1707 (5) Checking original dxdy on the segments: #------------------------------------------- /home/data/NBP1707Merg/NBP1707_segments/NBP1707a/proc/os75nb **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_np.agt calculation done at 2017/09/29 14:41:01 xducer_dx = 2.819922 xducer_dy = 1.378958 signal = 2070.854045 ------------ #------------------------------------------- /home/data/NBP1707Merg/NBP1707_segments/NBP1707/proc/os75nb **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_np.agt calculation done at 2017/09/16 10:34:30 xducer_dx = 3.997788 xducer_dy = 19.115376 signal = 2432.562141 ------------ (6) create q_py.cnt: cd os75nb cat << EOF > q_py.cnt ####----- begin q_py.cnt------------ ## all lines after the first "#" sign are ignored --yearbase 2017 --cruisename nbp1707 # used to identify configuration files # *must* match prefix of files in config dir --update_gbin ## NOTE: You should generally remake gbins ## - you are not sure ## - if parameters for averaging changed ## - various other reasons. ## ==> MAKE SURE you move the original gbin directory ## to another name first!! Default directory ## to make gbins is in uhdas_dir ## or... alternatively, use this parameter #--py_gbindirbase gbin # (will put them adjacent to q_py.cnt) --configtype python ## use km1001c_proc.py for configuration --sonar os75nb --dbname aship --datatype uhdas --ens_len 300 --ping_headcorr ## applies heading correction. ## this ONLY works if there is a heading ## correction device specified in the ## config/km1001c_proc.py file --max_search_depth 3000 #if the topography says the ocean is deeper # than this, do not autodetect the bottom. # (reduces likelihood of shallow scattering # layers being identified as the bottom) --xducer_dx 2 --xducer_dy 17 ## transducer offset correction! EOF (7) move gbin: mv /home/data/NBP1707Merg/NBP1707merged/gbin /home/data/NBP1707Merg/NBP1707merged/gbin.old (a) run quick_adcp.py: quick_adcp.py --cntfile q_py.cnt --auto #------------------------------------------------------------------------------------------------ ### POST-PROCESSING ----------------------------------------------------------------------------- cd os75nb plot_nav.py nav/aship.gps Summary: NB Palmer cruise from Papeete (Tahiti) to Chile, sailing along 32.5S parallel in about 40 days. .Reports about this cruise can be found in the following web sites: https://cchdo.ucsd.edu/cruise/320620170820 https://cchdo.ucsd.edu/data/13772/320620170820_do.pdf (8) review the data (a) check calibration:heading correction device: figview.py cal/rotate/*png conclude: no action needed figview.py . (b) check calibration: **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2018/01/03 01:35:51 xducer_dx = 0.876465 xducer_dy = 3.295480 signal = 4516.211097 ------------ **watertrack** ------------ Number of edited points: 202 out of 205 amp = 1.0106 + -0.0001 (t - 254.0) phase = 0.02 + -0.0013 (t - 254.0) median mean std amplitude 1.0100 1.0106 0.0048 phase 0.0310 0.0171 0.3629 ------------ **bottomtrack** ------------ tail: cannot open 'cal/botmtrk/btcaluv.out' for reading: No such file or directory ------------ (9) Applying dxdy adjustments, angle rotation and amplitude factor: quick_adcp.py --steps2rerun rotate:navsteps:calib --xducer_dx 1 --xducer_dy 3 --rotate_amplitude 1.01 --rotate_angle 0.03 --auto **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2018/01/03 19:52:19 xducer_dx = -0.416404 xducer_dy = 0.232629 signal = 4516.211097 ------------ **watertrack** ------------ Number of edited points: 201 out of 205 amp = 1.0006 + -0.0001 (t - 254.0) phase = -0.01 + -0.0011 (t - 254.0) median mean std amplitude 1.0000 1.0006 0.0047 phase -0.0020 -0.0105 0.3610 ------------ (c) look at the data: dataviewer.py (10) Applied quick_adcp.py uvship: quick_adcp.py --steps2rerun navsteps:calib --refuv_source uvship --auto (11) edit "gautoedit" cd edit gautoedit.py -n5 # apply editing: cd .. quick_adcp.py --steps2rerun apply_edit:navsteps:calib --auto # check editing -- looks OK dataviewer.py (12) - check calibrations again **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from aship.agt calculation done at 2018/01/03 20:44:37 xducer_dx = -0.221132 xducer_dy = 0.404396 signal = 4516.211097 ------------ **watertrack** ------------ Number of edited points: 201 out of 205 amp = 1.0001 + -0.0001 (t - 254.0) phase = -0.01 + -0.0010 (t - 254.0) median mean std amplitude 1.0000 1.0001 0.0047 phase -0.0160 -0.0123 0.3616 ------------ figview.py cal/watertrk/wtcal1.png (13) make web plots quick_web.py --interactive - view with a browser, look at webpy/index.html (14) Extract data: quick_adcp.py --steps2rerun matfiles --auto You can extract NetCDF files as well. adcp_nc.py adcpdb contour/os75nb_short nbp1707 os75nb adcp_nc.py --long adcpdb contour/os75nb_long nbp1707 os75nb To check netcdf file: ncdump -h contour/os75nb_short.nc # cat cruise_info.txt at the top of this file!