LAST CHANGED : 2021/04/13 01:29:34 CRUISE NAME(S) : A20_2021 (tn389) CRUISE DATES : 2021/03/16 to 2021/04/13 SHIP NAME : Thompson PORTS : Woods Hole, USA to St. Thomas, USVI CHIEF SCIENTIST : Ryan Woosley DATABASE NAME : a_tt DATA FILES : tt2021_074_64368.raw to tt2021_102_00000.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] # loaded at sea NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : wh300 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2021/03/16 17:54:48 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/17 03:54:49 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/17 13:54:49 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/19 08:06:22 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/19 18:06:22 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/20 04:06:22 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/21 20:06:22 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/22 07:03:11 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/22 17:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/23 03:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/23 13:03:11 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/23 23:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/25 05:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/25 15:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/03/29 19:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/04/02 23:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/04/08 19:03:12 off 120 70 2 5 2 -0.50 0.00 0001 2021/04/09 05:03:13 off 120 70 2 5 2 -0.50 0.00 0001 2021/04/09 15:03:13 off 120 70 2 5 2 -0.50 0.00 0001 HEADING : PRIMARY : heading from gyro1 CORRECTION : heading correction from posmv5 NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from posmv5 CALIBRATION : wh300 original alignment: -0.5 additional rotation -0.13 final transducer angle is: -0.37 (-0.5) - (-0.13) original scale factor: 1.0 additional scale factor (1.002) In addition a vertically-dependent scale factor was applied. COMMENTS : GO-SHIP cruise, line A20 from North to South. Calibrations from this cruise is used for TN388 (preceding cruise). There is some scarring throughout the dataset and loss of data at the surface while on station presumably due to station keeping/bubbles under the ADCP. PROCESSOR : Joseph Gum --- processing parameters ---------- ## (determined from "sonar"): model = wh ## (determined from "sonar"): frequency = 300 ## (determined from "sonar"): instname = wh300 ## (determined from "sonar"): pingtype = bb beamangle 20 cruisename TN389 datatype uhdas ens_len 120 fixfile a_tt.gps frequency 300 hcorr_inst posmv5 instname wh300 model wh pingtype bb proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar wh300 txy_file a_tt.gps xducer_dx 0 xducer_dy 0 yearbase 2021 ================================================== PROCESSING STEPS: ================================================== # Processing commands start in the wh300 directory. ----------------------------- # 1. Check heading correction ----------------------------- Check that we have a good heading correction for all of the ADCP data. There should be no holes in the heading correction graphs, where good fixes are green circles and no fixes are red crosses. Gaps in the plots where there are no symbols are okay, no data was collected there. If there are red crosses on the heading correction graphs (cal/rotate/ens_hcorr_*.png) then they need to be patched in the cal/rotate dir using patch_hcorr.py. $ plot_nav.py nav/a_tt.gps $ figview.py We've got missing heading correction fixes that need to be interpolated using patch_hcorr.py. The initial big gap is lack of clearance to collect data in Canadian(?) waters. $ dataviewer.py There's a big hole for the big gap, otherwise looks stable. $ catwt **watertrack** ------------ Number of edited points: 174 out of 176 amp = 1.0005 + -0.0001 (t - 90.9) phase = -0.14 + -0.0099 (t - 90.9) median mean std amplitude 1.0010 1.0005 0.0079 phase -0.1400 -0.1353 0.4969 ------------ $ cd cal/rotate $ patch_hcorr.py $ cd ../.. $ dataviewer.py -c . ../wh300.orig It seems okay. --------------------- # 2. ADCP calibration --------------------- Calibrate the dataset in sum by checking the calibration values and applying a fix to the necessary categories if necessary. When looking at a water track or bottom track calibration, we want to see statistics inside the following values: median_tolerance amplitude 1.003 # 0.3% phase/angle 0.05 When looking at an xy calibration to adjust the relative location of the sonar to the currently known location we hope that the dx and dy values are as close to 0 as possible, and the signal is between 1000 and 5000. Less than 1000 means very little data, more than 5000 means too much change. If values are out of range we make a bulk correction to the entire dataset which should reduce the number of outliers to be edited out. If we make any changes to x or y they should be integers. $ catwt **watertrack** ------------ Number of edited points: 173 out of 176 amp = 1.0010 + -0.0001 (t - 90.8) phase = -0.12 + -0.0113 (t - 90.8) median mean std amplitude 1.0020 1.0010 0.0084 phase -0.1330 -0.1227 0.4770 ------------ $ catbt **bottomtrack** ------------ tail: cannot open 'cal/botmtrk/btcaluv.out' for reading: No such file or directory ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.gps calculation done at 2021/09/14 00:05:46 xducer_dx = 2.614109 xducer_dy = -0.120765 signal = 1888.405363 ------------ We'll apply small changes based on all cals to tune the dataset before editing. $ quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_angle -0.13 --rotate_amplitude 1.002 --xducer_dx 2 --auto $ catwt **watertrack** ------------ Number of edited points: 173 out of 176 amp = 0.9990 + -0.0001 (t - 90.8) phase = 0.02 + -0.0106 (t - 90.8) median mean std amplitude 0.9990 0.9990 0.0084 phase -0.0160 0.0236 0.4750 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/14 00:24:49 xducer_dx = 0.610360 xducer_dy = -0.140480 signal = 1888.405363 ------------ Calibrations are slightly better across the board. ------------------- # 3. Editing points ------------------- Edit out biased data or artifacts deeper than the range of the sonar in the dataset, or other problems. Use `dataviewer.py -e` to look for problems with the data and flag the bad data as bad. After editing out data we rerun the calibration to see if the changed dataset statistics have changed enough that a new calibration is needed. $ dataviewer.py -e The top few bins of the dataset to ~25 meters is ripped off at the beginning. Lots of scarring at the beginning due to the bridge's speed log. Lots of data percent good questionable at 77.55, that might be salvagable. Unknown intrusion after 86.1. Nothing appears wrong in cruise log. This'll require more editing as we go along. $ quick_adcp.py --steps2rerun navsteps:calib --auto $ catwt **watertrack** ------------ Number of edited points: 173 out of 176 amp = 0.9990 + -0.0001 (t - 90.8) phase = 0.02 + -0.0105 (t - 90.8) median mean std amplitude 0.9990 0.9990 0.0084 phase -0.0160 0.0237 0.4750 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/14 01:29:23 xducer_dx = 0.558147 xducer_dy = -0.170601 signal = 1888.405363 ------------ Not much of a change in either. =================================================== Apply the depth-dependent scale factor to remove the surface bias. Scale factor of about 0.97 near the surface and slightly greater than below 130m. The resulting bulk scale factor hasn't changed much, but it has been redistributed. -------------------------------------------------- # 4. Re-check heading correction and other figures -------------------------------------------------- Check all figures again to make sure that any problems were addressed and no new problems have appeared after making changes to the dataset. $ figview.py The figures look fine. -------------------------------------------------------------- # 5. Check edited, calibrated dataset against original dataset -------------------------------------------------------------- Compare the edited, calibrated (or lack thereof) dataset against the original dataset to make sure all problems have been dealt with and no new problems have appeared. $ dataviewer.py -c . ../wh300.orig We see larger biases when moving, but on station is okay. This is an acceptable tradeoff for a GO-SHIP cruise, where the focus is station work. ------------------------- # 6. Make plots and files ------------------------- Create the figures and data files needed to finish processing and make public/submit to a repository (JASADCP, if nowhere else). Make the plots needed for web viewing, matlab files (legacy), and netCDF files, then check that the netCDF files are readable. Plots should be in 3 to 5 day chunks for a cruise longer than one week, or divided by geographic features where it makes sense. $ quick_web.py --interactive $ quick_adcp.py --steps2rerun matfiles --auto $ adcp_nc.py adcpdb contour/wh300 TN389 wh300 --ship_name Thompson $ ncdump contour/wh300.nc -h