LAST CHANGED : 2021/05/15 23:32:02 CRUISE NAME(S) : A22_2021 (tn390) CRUISE DATES : 2021/04/20 to 2021/05/15 SHIP NAME : Thompson PORTS : St. Thomas, USA to Woods Hole, USA CHIEF SCIENTIST : Viviane Menezes DATABASE NAME : a_tt DATA FILES : tt2021_109_50983.raw to tt2021_134_79200.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] # loaded at sea NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : wh300 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2021/04/20 14:11:44 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/06 20:11:44 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/08 12:11:44 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/10 14:11:45 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/13 02:11:45 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/13 12:11:45 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/14 18:11:45 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/15 04:11:45 off 120 70 2 5 2 -0.50 0.00 0001 2021/05/15 14:11:45 off 120 70 2 5 2 -0.50 0.00 0001 HEADING : PRIMARY : heading from gyro1 CORRECTION : heading correction from posmv5 NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from posmv5 CALIBRATION : wh300 original alignment: -0.5 additional rotation -0.06 final transducer angle is: -0.44 (-0.5) - (-0.06) original scale factor: 1.0 additional scale factor (1.003) final scale factor: 1.003 In addition a vertically-dependent scale factor was applied. COMMENTS : GO-SHIP cruise, line A22 from South to North. There is some loss of data at the surface while on station presumably due to station keeping/bubbles under the ADCP. PROCESSOR : Joseph Gum --- processing parameters ---------- ## (determined from "sonar"): model = wh ## (determined from "sonar"): frequency = 300 ## (determined from "sonar"): instname = wh300 ## (determined from "sonar"): pingtype = bb beamangle 20 cruisename TN390 datatype uhdas ens_len 120 fixfile a_tt.gps frequency 300 hcorr_inst posmv5 instname wh300 model wh pingtype bb proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar wh300 txy_file a_tt.gps xducer_dx 0 xducer_dy 0 yearbase 2021 ================================================== PROCESSING STEPS: ================================================== # Processing commands start in the wh300 directory. ----------------------------- # 1. Check heading correction ----------------------------- Check that we have a good heading correction for all of the ADCP data. There should be no holes in the heading correction graphs, where good fixes are green circles and no fixes are red crosses. Gaps in the plots where there are no symbols are okay, no data was collected there. If there are red crosses on the heading correction graphs (cal/rotate/ens_hcorr_*.png) then they need to be patched in the cal/rotate dir using patch_hcorr.py. $ plot_nav.py nav/a_tt.gps $ figview.py There are a few holes in the heading correction that need to be interpolated. $ dataviewer.py Points look stable. $ catwt **watertrack** ------------ Number of edited points: 154 out of 155 amp = 1.0025 + -0.0002 (t - 122.0) phase = -0.06 + -0.0042 (t - 122.0) median mean std amplitude 1.0030 1.0025 0.0072 phase -0.0630 -0.0584 0.4586 ------------ $ cd cal/rotate $ patch_hcorr.py $ cd ../.. $ dataviewer.py -c . ../wh300.orig It seems okay. --------------------- # 2. ADCP calibration --------------------- Calibrate the dataset in sum by checking the calibration values and applying a fix to the necessary categories if necessary. When looking at a water track or bottom track calibration, we want to see statistics inside the following values: median_tolerance amplitude 1.003 # 0.3% phase/angle 0.05 When looking at an xy calibration to adjust the relative location of the sonar to the currently known location we hope that the dx and dy values are as close to 0 as possible, and the signal is between 1000 and 5000. Less than 1000 means very little data, more than 5000 means too much change. If values are out of range we make a bulk correction to the entire dataset which should reduce the number of outliers to be edited out. If we make any changes to x or y they should be integers. $ catwt **watertrack** ------------ Number of edited points: 154 out of 155 amp = 1.0030 + -0.0002 (t - 122.0) phase = -0.06 + -0.0045 (t - 122.0) median mean std amplitude 1.0030 1.0030 0.0070 phase -0.0605 -0.0566 0.4584 ------------ $ catbt **bottomtrack** ------------ tail: cannot open 'cal/botmtrk/btcaluv.out' for reading: No such file or directory ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.gps calculation done at 2021/09/17 01:34:07 xducer_dx = 2.449747 xducer_dy = 0.229653 signal = 1880.023446 ------------ We'll apply small changes based on all cals to tune the dataset before editing. $ quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_angle -0.06 --rotate_amplitude 1.003 --xducer_dx 2 --auto $ catwt **watertrack** ------------ Number of edited points: 154 out of 155 amp = 0.9998 + -0.0001 (t - 122.0) phase = 0.03 + -0.0057 (t - 122.0) median mean std amplitude 1.0000 0.9998 0.0067 phase 0.0380 0.0322 0.4518 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/17 01:42:05 xducer_dx = 0.424489 xducer_dy = 0.240545 signal = 1880.023446 ------------ ------------------- # 3. Editing points ------------------- Edit out biased data or artifacts deeper than the range of the sonar in the dataset, or other problems. Use `dataviewer.py -e` to look for problems with the data and flag the bad data as bad. After editing out data we rerun the calibration to see if the changed dataset statistics have changed enough that a new calibration is needed. $ dataviewer.py -e Editing was done, including restoring some points at the surface. $ quick_adcp.py --steps2rerun navsteps:calib --auto $ catwt **watertrack** ------------ Number of edited points: 154 out of 155 amp = 0.9997 + -0.0002 (t - 122.0) phase = 0.03 + -0.0057 (t - 122.0) median mean std amplitude 1.0000 0.9997 0.0067 phase 0.0380 0.0300 0.4546 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/17 23:42:49 xducer_dx = 0.407259 xducer_dy = 0.237424 signal = 1880.023446 ------------ =================================================== Apply the depth-dependent scale factor to remove the surface bias. Scale factor of about 0.97 near the surface and slightly greater than below 130m. The resulting bulk scale factor hasn't changed much, but it has been redistributed. -------------------------------------------------- # 4. Re-check heading correction and other figures -------------------------------------------------- Check all figures again to make sure that any problems were addressed and no new problems have appeared after making changes to the dataset. $ figview.py The figures look fine. The watertrack plot shows a slight phase offset near the end of the cruise, so we won't adjust for that given the majority of the data is fine. -------------------------------------------------------------- # 5. Check edited, calibrated dataset against original dataset -------------------------------------------------------------- Compare the edited, calibrated (or lack thereof) dataset against the original dataset to make sure all problems have been dealt with and no new problems have appeared. $ dataviewer.py -c . ../wh300.orig We see larger biases when moving, but on station is okay. This is an acceptable tradeoff for a GO-SHIP cruise, where the focus is station work. ------------------------- # 6. Make plots and files ------------------------- Create the figures and data files needed to finish processing and make public/submit to a repository (JASADCP, if nowhere else). Make the plots needed for web viewing, matlab files (legacy), and netCDF files, then check that the netCDF files are readable. Plots should be in 3 to 5 day chunks for a cruise longer than one week, or divided by geographic features where it makes sense. $ quick_web.py --interactive $ quick_adcp.py --steps2rerun matfiles --auto $ adcp_nc.py adcpdb contour/wh300 TN390 wh300 --ship_name Thompson $ ncdump contour/wh300.nc -h