Table of Contents
DART Data Input Procedures
The NCEDC DART is populated by a series of input procedures that receive data from remote systems and write to the NCEDC DART file system. Each data channel should be written to by at most one process, and in general, each net.station is written to by a single process.
DART rings:
- mnlons1.wr.usgs.gov:16000 (All channels - Seismic & Latency)
- mnlons2.wr.usgs.gov:16000 (All channels - Seismic & Latency)
- ucbns1.geo.berkeley.edu:16000 (Primary channels - Seismic)
- ucbns2.geo.berkeley.edu:16000 (Primary channels - Seismic)
- ucbns1.geo.berkeley.edu:16001 (All channels - Latency)
- ucbns2.geo.berkeley.edu:16001 (All channels - Latency)
dalitool & slinktool can be used query the ringservers. Rings support SEEDLINK (port 18000) & DALI (port 16000) protocols.
% dalitool -S ucbns1 % slinktool -Q ucbns1:18000
DART input processes:
- ringmsarchive: Process that connects to an IRIS ringserver, receives data from one or more SNCLs, and writes the MiniSEED records to daily files in the DART filesystem.
DART data sources:
- NCSS systems at USGS:
- mnlons1.wr.usgs.gov:16000 (All channels - Seismic & Latency)
- mnlons2.wr.usgs.gov:16000 (All channels - Seismic & Latency)
The USGS systems broadcasts all data channels in Earthworm TRACEBUF2 packets on the wavenet at MP. The network service computers mnlons1 and mnlons2 input all tracebufs into the MOS_EW2MSRING. On each computers, the program ew2msring reads all TRACEBUF2 buffers, converts and repacks the data into fully filled STEIM2 512-byte MiniSEED records, and writes the MiniSEED records into an IRIS ringserver on each machine. Since the ew2msring processes on each systems starts independently, the MiniSEED records for each data channel on each computer will have different start and end times.
The NCEDC DART system runs multiple ring2msarchive processes that connects to the ringserver on ONE of the network service computers at USGS, requests a subset of data from the ringserver, and writes the delivered MiniSEED records to the DART filesystem. The NCEDC runs separate processes for the specified data channels, specified by N_S_C_L/MSEED names:
CE_.*/MSEED CI_.*/MSEED GM_.*/MSEED GS_.*/MSEED NC_[A-G].*/MSEED NC_[H-K].*/MSEED NC_[L-M].*/MSEED NC_[N-Z].*/MSEED NN_.*/MSEED NP_.*/MSEED PG_.*/MSEED SB_.*/MSEED SF_.*/MSEED WR_.*/MSEED
During maintenance times for network service computers at USGS, the ring2msarchive processes at the NCEDC can be configured to connect to the ringserver on the other USGS network services computer. During each configuration change to a different network services computer , there WILL be a small amount of lost data from each data channel due to the different MiniSEED record boundaries for each data channel on the two network services computers.
- NCSS systems at UCB/BSL:
- ucbns1.geo.berkeley.edu:16000 (Primary channels - Seismic)
- ucbns2.geo.berkeley.edu:16000 (Primary channels - Seismic)
- ucbns1.geo.berkeley.edu:16001 (All channels - Latency)
- ucbns2.geo.berkeley.edu:16001 (All channels - Latency)
Data acquired directly by the two UCB/BSL network services systems ucbns1 and ucbns2 is written in MiniSEED format into a ringserver on the network service system that has PRIMARY responsibility for data acquisition of the data channel. Therefore, each data channel will be written to only one ringserver. The NCEDC DART system runs multiple ringmsarchive processes that connect to either ucbns1 or ucbns2, request a subset of the data from the ringserver, and writes the delivered MiniSEED records to the DART filesystem. The NCEDC runs separate processes for the specified data channels on EACH of the UCB/BSL network service computers:
BK_.*/MSEED BP_.*/MSEED CC_.*/MSEED CE_.*/MSEED CI_.*/MSEED NN_.*/MSEED UO_.*/MSEED UW_.*/MSEED
Since each data channel is recorded in only one ringserver, the same processes are run for each of the UCB/BSL network services systems in order to acquire all data channels received by UCB/BSL network services systems.
Note: For the latency data, all channels are written to BOTH ringservers. Therefore The NCEDC DART system runs multiple ring2msarchive processes that connects to the ringserver on ONE of the network service computers at UCB/BSL, requests a subset of data from the ringserver, and writes the delivered MiniSEED records to the DART filesystem. The NCEDC runs separate processes for the specified data channels, specified by N_S_C_L/MSEED names:
BK_.*/MSEED CE_.*/MSEED NN_.*/MSEED