User Tools

Site Tools


operations:db_ncedc:dart_recover

NC feed:

If mnlodb1 dart is fed from the same system (mmnlons1 or mnlons2) as is feeding the NCEDC dart, you can just copy the files over. However, in this case, make sure they have new date-time-modified entries so that dart_archive will be forced to rearchive these days of data. eg create a tar file on mnlodb1 of the files you want, and restore them using

tar mxvf tarfile

DO NOT use the “p” option when restoring.

If not, you have to copy the files to a new subdir in /dart/tmp, merge the daily files with the files in the DART, and then replace the files in the DART with the merged files.

- Example where both DIP & MNLODB1 are archiving from the same mnlonsX:

mnlodb1% cd /data/db1_2/dart/
mnlodb1% touch /tmp/dart_mp.tar
mnlodb1% find data \( -name \*.340 -o -name \*.341 -o -name \*.342 \) -exec tar -rvf /tmp/dart_mp.tar {} \;
[For specific net/sta/day: tar cvf ncL_219.tar data/NC/L*.NC/*/*.2021.219]
FTP file over to dcmgr@dip /in /data/dart/
dip% cd /data/dart/
dip% tar mxvf dart_mp.tar

BK feed:

dip% ll /data/dart/data/BK/YBH.BK/BHE.00.D/YBH.BK.BHE.00.D.2017.340 
-rw-r--r--   1 dcmgr    dcmgr    4147712 Dec  6 23:43 /data/dart/data/BK/YBH.BK/BHE.00.D/YBH.BK.BHE.00.D.2017.340
moment% ll /data/aq11/all/YBH.BK/BHE.00.D/YBH.BK.BHE.00.D.2017.340.0000
-rw-r--r-- 1 ncss users 4286464 Dec  6 16:00 /data/aq11/all/YBH.BK/BHE.00.D/YBH.BK.BHE.00.D.2017.340.0000
moment% 

dip% cd /data/dart/
dip% mkdir recover
dip% cd recover
dip% mkdir data
dip% mkdir data/BK
dip% mkdir data/BP
dip% mkdir data/CI
dip% mkdir data/NN
dip% touch /data/dart/recover/data/BK/dart_data_BK.tar
dip% touch /data/dart/recover/data/BP/dart_data_BP.tar
dip% touch /data/dart/recover/data/CI/dart_data_CI.tar
dip% touch /data/dart/recover/data/NN/dart_data_NN.tar
dip% cd /data/aq11/all/
dip% find -L . \( -name \*.BK.\*.340.\* -o -name \*.BK.\*.341.\* -o -name \*.BK.\*.342.\* \) -exec tar -rvf /data/dart/recover/data/BK/dart_data_BK.tar {} \;
dip% find -L . \( -name \*.BP.\*.340.\* -o -name \*.BP.\*.341.\* -o -name \*.BP.\*.342.\* \) -exec tar -rvf /data/dart/recover/data/BP/dart_data_BP.tar {} \;
dip% find -L . \( -name \*.CI.\*.340.\* -o -name \*.CI.\*.341.\* -o -name \*.CI.\*.342.\* \) -exec tar -rvf /data/dart/recover/data/CI/dart_data_CI.tar {} \;
dip% find -L . \( -name \*.NN.\*.340.\* -o -name \*.NN.\*.341.\* -o -name \*.NN.\*.342.\* \) -exec tar -rvf /data/dart/recover/data/NN/dart_data_NN.tar {} \;

==> For each network:
   dip% cd /data/dart/recover/data/??
   dip% tar mxvf dart_data_??.tar
   dip% \rm -rf */*.L
   dip% \rm -rf */*.T
   dip% \rm -rf */*.E
   dip% \rm -rf */*.O
   dip% rmdir *

   [dip% \rm -rf BK02.BK/]
   [dip% \rm -rf BK03.BK/]
   [dip% \rm -rf BK04.BK/]

   dip% foreach i (*.??)
   foreach? cd $i
   foreach? foreach j (*.D)
   foreach? cd $j
   foreach? qmerge -b512 -o $i.$j.2017.340 $i.$j.2017.340.*
   foreach? qmerge -b512 -o $i.$j.2017.341 $i.$j.2017.341.*
   foreach? qmerge -b512 -o $i.$j.2017.342 $i.$j.2017.342.*
   foreach? cd ..
   foreach? end
   foreach? cd ..
   foreach? end
   dip% \rm */*/*.340.*
   dip% \rm */*/*.341.*
   dip% \rm */*/*.342.*
   dip% \rm dart_data_??.tar

dip% cd /data/dart/recover
dip% touch /data/dart/recover/dart_ucb.tar
dip% find data \( -name \*.340 -o -name \*.341 -o -name \*.342 \) -exec tar -rvf /data/dart/recover/dart_ucb.tar {} \;
dip% mv dart_ucb.tar ..
dip% cd /data/dart
dip% tar mxvf dart_ucb.tar
operations/db_ncedc/dart_recover.txt · Last modified: 2021/08/07 18:46 by stephane