LAST CHANGED : 2021/04/13 01:26:34 CRUISE NAME(S) : A20_2021 (tn389) CRUISE DATES : 2021/03/16 to 2021/04/13 SHIP NAME : Thompson PORTS : Woods Hole, USA to St. Thomas, USVI CHIEF SCIENTIST : Ryan Woosley DATABASE NAME : a_tt DATA FILES : tt2021_074_64368.raw to tt2021_102_00000.raw STATUS : to do done ------ ----------- averaged [ X ] loaded [ X ] # loaded at sea NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2021/03/16 17:57:49 off 300 60 16 5 8 59.90 0.00 0001 HEADING : PRIMARY : heading from gyro1 CORRECTION : heading correction from posmv5 NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from posmv5 CALIBRATION : os75nb original alignment: 59.9 additional rotation 0.10 final transducer angle is: 59.8 (59.9) - (0.10) original scale factor: 1.0 additional scale factor (1.004) final scale factor: 1.004 COMMENTS : GO-SHIP cruise, line A20 from North to South. Calibrations from this cruise is used for TN388 (preceding cruise). There is some loss of data at the surface while on station presumably due to station keeping/bubbles under the ADCP. PROCESSOR : Joseph Gum --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): instname = os75 ## (determined from "sonar"): pingtype = nb beamangle 30 cruisename TN389 datatype uhdas ens_len 300 fixfile a_tt.gps frequency 75 hcorr_inst posmv5 instname os75 model os pingtype nb proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar os75nb txy_file a_tt.agt xducer_dx -3 xducer_dy 7 yearbase 2021 ================================================== PROCESSING STEPS: ================================================== # Processing commands start in the os75nb directory. ----------------------------- # 1. Check heading correction ----------------------------- Check that we have a good heading correction for all of the ADCP data. There should be no holes in the heading correction graphs, where good fixes are green circles and no fixes are red crosses. Gaps in the plots where there are no symbols are okay, no data was collected there. If there are red crosses on the heading correction graphs (cal/rotate/ens_hcorr_*.png) then they need to be patched in the cal/rotate dir using patch_hcorr.py. $ plot_nav.py nav/a_tt.gps $ figview.py The figures show the watertrack points are tighter after the beginning, once the Thompson has started traveling south down the line. We've got missing heading correction fixes that need to be interpolated using patch_hcorr.py. The initial big gap is lack of clearance to collect data in Canadian(?) waters. $ dataviewer.py There's a big hole for the big gap, otherwise looks stable. $ catwt **watertrack** ------------ Number of edited points: 172 out of 176 amp = 1.0046 + -0.0002 (t - 91.2) phase = 0.08 + 0.0037 (t - 91.2) median mean std amplitude 1.0050 1.0046 0.0070 phase 0.0820 0.0759 0.4653 ------------ $ cd cal/rotate $ patch_hcorr.py $ cd ../.. $ dataviewer.py -c . ../os75nb.orig It seems okay. --------------------- # 2. ADCP calibration --------------------- Calibrate the dataset in sum by checking the calibration values and applying a fix to the necessary categories if necessary. When looking at a water track or bottom track calibration, we want to see statistics inside the following values: median_tolerance amplitude 1.003 # 0.3% phase/angle 0.05 When looking at an xy calibration to adjust the relative location of the sonar to the currently known location we hope that the dx and dy values are as close to 0 as possible, and the signal is between 1000 and 5000. Less than 1000 means very little data, more than 5000 means too much change. If values are out of range we make a bulk correction to the entire dataset which should reduce the number of outliers to be edited out. If we make any changes to x or y they should be integers. $ catwt **watertrack** ------------ Number of edited points: 172 out of 176 amp = 1.0045 + -0.0002 (t - 91.2) phase = 0.08 + 0.0038 (t - 91.2) median mean std amplitude 1.0045 1.0045 0.0071 phase 0.0815 0.0758 0.4647 ------------ $ catbt **bottomtrack** ------------ tail: cannot open 'cal/botmtrk/btcaluv.out' for reading: No such file or directory ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/16 01:38:55 xducer_dx = 4.259809 xducer_dy = -5.930259 signal = 2341.973267 ------------ We'll apply small changes based on all cals to tune the dataset before editing. $ quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_angle 0.08 --rotate_amplitude 1.004 --xducer_dx 4 --xducer_dy -5 --auto $ catwt **watertrack** ------------ Number of edited points: 173 out of 176 amp = 1.0008 + -0.0003 (t - 91.1) phase = 0.01 + 0.0032 (t - 91.1) median mean std amplitude 1.0010 1.0008 0.0076 phase 0.0070 0.0069 0.4715 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/16 01:41:31 xducer_dx = 0.424330 xducer_dy = -1.183869 signal = 2341.973267 ------------ Calibrations are slightly better across the board. ------------------- # 3. Editing points ------------------- Edit out biased data or artifacts deeper than the range of the sonar in the dataset, or other problems. Use `dataviewer.py -e` to look for problems with the data and flag the bad data as bad. After editing out data we rerun the calibration to see if the changed dataset statistics have changed enough that a new calibration is needed. $ dataviewer.py -e Light editing was done, mostly trimming surface bins especially when on station. $ quick_adcp.py --steps2rerun navsteps:calib --auto $ catwt **watertrack** ------------ Number of edited points: 170 out of 173 amp = 1.0006 + -0.0002 (t - 91.3) phase = 0.02 + -0.0005 (t - 91.3) median mean std amplitude 1.0010 1.0006 0.0071 phase 0.0120 0.0242 0.4598 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/16 01:57:58 xducer_dx = 0.502621 xducer_dy = -1.188317 signal = 2341.973267 ------------ $ quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_angle 0.02 --xducer_dy -1 --auto $ catwt **watertrack** ------------ Number of edited points: 170 out of 173 amp = 1.0006 + -0.0002 (t - 91.3) phase = 0.01 + -0.0008 (t - 91.3) median mean std amplitude 1.0010 1.0006 0.0071 phase -0.0075 0.0063 0.4618 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/16 01:59:53 xducer_dx = 0.521064 xducer_dy = -0.254421 signal = 2341.973267 ------------ -------------------------------------------------- # 4. Re-check heading correction and other figures -------------------------------------------------- Check all figures again to make sure that any problems were addressed and no new problems have appeared after making changes to the dataset. $ figview.py The figures look fine. -------------------------------------------------------------- # 5. Check edited, calibrated dataset against original dataset -------------------------------------------------------------- Compare the edited, calibrated (or lack thereof) dataset against the original dataset to make sure all problems have been dealt with and no new problems have appeared. $ dataviewer.py -c . ../os75nb.orig We see larger biases when moving, but on station is okay. This is an acceptable tradeoff for a GO-SHIP cruise, where the focus is station work. ------------------------- # 6. Make plots and files ------------------------- Create the figures and data files needed to finish processing and make public/submit to a repository (JASADCP, if nowhere else). Make the plots needed for web viewing, matlab files (legacy), and netCDF files, then check that the netCDF files are readable. Plots should be in 3 to 5 day chunks for a cruise longer than one week, or divided by geographic features where it makes sense. $ mkdir webpy $ cp ../wh300/webpy/sectinfo.txt webpy/. $ quick_web.py --redo $ quick_adcp.py --steps2rerun matfiles --auto $ adcp_nc.py adcpdb contour/os75nb TN389 os75nb --ship_name Thompson $ ncdump contour/os75nb.nc -h