LAST CHANGED : 2021/05/15 23:30:22 CRUISE NAME(S) : A22_2021 (tn390) CRUISE DATES : 2021/04/20 to 2021/04/20 SHIP NAME : Thompson PORTS : St. Thomas, USVI to Woods Hole, USA CHIEF SCIENTIST : Viviane Menezes DATABASE NAME : a_tt DATA FILES : tt2021_109_50983.raw to tt2021_134_79200.raw STATUS : to do done ------ ----------- averaged [ x ] loaded [ x ] # loaded at sea NOTE: heading correction instrument exists NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) check heading correction [ x ] calibration [ x ] edited [ x ] re-check heading correction [ x ] check editing [ x ] figures [ x ] INSTRUMENT : os75 ACQUISITION : PROGRAM : uhdas PROCESSING: : python LOGGING : PARAMETERS : BT : bottom track mode (on or off) SI : sampling interval or averaging period for ensemble (sec) NB : number of bins BL : bin length (m) TD : transducer depth (m) BK : blanking length (m) HO : heading offset applied by DAS (deg) HB : heading bias (deg) CRPH : compensation for roll-pitch-heading, 1:on, 0:off) yy/mm/dd hh:mm:ss BT SI NB BL TD BK HO HB CRPH 2021/04/20 14:14:43 off 300 60 16 5 8 59.90 0.00 0001 HEADING : PRIMARY : heading from gyro1 CORRECTION : heading correction from posmv5 NOTE: time-dependent heading corrections applied IN the ensembles (see cal/rotate/ens_hcorr.ang) POSITIONS : gps positions from posmv5 CALIBRATION : os75nb original alignment: 59.9 additional rotation 0.06 final transducer angle is: 59.84 (59.9) - (0.06) original scale factor: 1.0 additional scale factor (1.005) final scale factor: 1.005 COMMENTS : GO-SHIP A22 cruise. This cruise tests a new algorithm to remove electrical noise from beyond the effective range of the OS75 when in deep water. Some data flags were reset that were inexplicably removed from the dataset near the end of the cruise. PROCESSOR : Joseph Gum --- processing parameters ---------- ## (determined from "sonar"): model = os ## (determined from "sonar"): frequency = 75 ## (determined from "sonar"): instname = os75 ## (determined from "sonar"): pingtype = nb beamangle 30 cruisename TN390 datatype uhdas ens_len 300 fixfile a_tt.gps frequency 75 hcorr_inst posmv5 instname os75 model os pingtype nb proc_engine python ref_method refsm refuv_smoothwin 3 refuv_source nav sonar os75nb txy_file a_tt.agt xducer_dx -3 xducer_dy 7 yearbase 2021 ================================================== PROCESSING STEPS: ================================================== # Processing commands start in the os75nb directory. ----------------------------- # 1. Check heading correction ----------------------------- Check that we have a good heading correction for all of the ADCP data. There should be no holes in the heading correction graphs, where good fixes are green circles and no fixes are red crosses. Gaps in the plots where there are no symbols are okay, no data was collected there. If there are red crosses on the heading correction graphs (cal/rotate/ens_hcorr_*.png) then they need to be patched in the cal/rotate dir using patch_hcorr.py. $ plot_nav.py nav/a_tt.gps $ figview.py There are a few heading correction fixes that need to be interpolated. $ dataviewer.py $ catwt **watertrack** ------------ Number of edited points: 159 out of 160 amp = 1.0047 + 0.0001 (t - 122.4) phase = 0.08 + 0.0083 (t - 122.4) median mean std amplitude 1.0040 1.0047 0.0058 phase 0.0680 0.0827 0.3257 ------------ $ cd cal/rotate $ patch_hcorr.py $ cd ../.. $ dataviewer.py -c . ../os75nb.orig It seems okay. --------------------- # 2. ADCP calibration --------------------- Calibrate the dataset in sum by checking the calibration values and applying a fix to the necessary categories if necessary. When looking at a water track or bottom track calibration, we want to see statistics inside the following values: median_tolerance amplitude 1.003 # 0.3% phase/angle 0.05 When looking at an xy calibration to adjust the relative location of the sonar to the currently known location we hope that the dx and dy values are as close to 0 as possible, and the signal is between 1000 and 5000. Less than 1000 means very little data, more than 5000 means too much change. If values are out of range we make a bulk correction to the entire dataset which should reduce the number of outliers to be edited out. If we make any changes to x or y they should be integers. $ catwt **watertrack** ------------ Number of edited points: 159 out of 160 amp = 1.0049 + 0.0001 (t - 122.4) phase = 0.08 + 0.0084 (t - 122.4) median mean std amplitude 1.0050 1.0049 0.0057 phase 0.0620 0.0817 0.3258 ------------ $ catbt **bottomtrack** ------------ tail: cannot open 'cal/botmtrk/btcaluv.out' for reading: No such file or directory ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/18 01:21:25 xducer_dx = 3.818432 xducer_dy = -6.180886 signal = 2140.061578 ------------ We'll apply small changes based on all cals to tune the dataset before editing. $ quick_adcp.py --steps2rerun rotate:apply_edit:navsteps:calib --rotate_angle 0.06 --rotate_amplitude 1.005 --xducer_dx 4 --xducer_dy -6 --auto $ catwt **watertrack** ------------ Number of edited points: 159 out of 160 amp = 1.0000 + 0.0001 (t - 122.4) phase = 0.03 + 0.0077 (t - 122.4) median mean std amplitude 0.9990 1.0000 0.0054 phase 0.0160 0.0334 0.3156 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/18 01:23:41 xducer_dx = -0.109978 xducer_dy = -0.536855 signal = 2140.061578 ------------ Calibrations are slightly better across the board. ------------------- # 3. Editing points ------------------- Edit out biased data or artifacts deeper than the range of the sonar in the dataset, or other problems. Use `dataviewer.py -e` to look for problems with the data and flag the bad data as bad. After editing out data we rerun the calibration to see if the changed dataset statistics have changed enough that a new calibration is needed. $ dataviewer.py -e There are strange blocks cut out near the end (day 134) that were restored. $ quick_adcp.py --steps2rerun navsteps:calib --auto $ catwt **watertrack** ------------ Number of edited points: 159 out of 160 amp = 1.0000 + 0.0001 (t - 122.4) phase = 0.03 + 0.0078 (t - 122.4) median mean std amplitude 0.9990 1.0000 0.0054 phase 0.0160 0.0320 0.3132 ------------ $ catxy **transducer-gps offset** ------------ guessing ADCP (dx=starboard, dy=fwd) meters from GPS positions from a_tt.agt calculation done at 2021/09/18 01:40:36 xducer_dx = -0.085877 xducer_dy = -0.499383 signal = 2140.061578 ------------ -------------------------------------------------- # 4. Re-check heading correction and other figures -------------------------------------------------- Check all figures again to make sure that any problems were addressed and no new problems have appeared after making changes to the dataset. $ figview.py The figures look fine. -------------------------------------------------------------- # 5. Check edited, calibrated dataset against original dataset -------------------------------------------------------------- Compare the edited, calibrated (or lack thereof) dataset against the original dataset to make sure all problems have been dealt with and no new problems have appeared. $ dataviewer.py -c . ../os75nb.orig We see larger biases when moving, but on station is okay. This is an acceptable tradeoff for a GO-SHIP cruise, where the focus is station work. $ dataviewer.py -c ../wh300 . The two datasets largely match up at the surface. ------------------------- # 6. Make plots and files ------------------------- Create the figures and data files needed to finish processing and make public/submit to a repository (JASADCP, if nowhere else). Make the plots needed for web viewing, matlab files (legacy), and netCDF files, then check that the netCDF files are readable. Plots should be in 3 to 5 day chunks for a cruise longer than one week, or divided by geographic features where it makes sense. $ mkdir webpy $ cp ../wh300/webpy/sectinfo.txt webpy/. $ quick_web.py --redo $ quick_adcp.py --steps2rerun matfiles --auto $ adcp_nc.py adcpdb contour/os75nb TN390 os75nb --ship_name Thompson $ ncdump contour/os75nb.nc -h