BSRN Toolbox

The Baseline Surface Radiation Projects (BSRN) makes use of the so called station-to-archive format to share the data of one station for one month with the BSRN community. This format cannot be understood without reading the BSRN format manual. So the BSRN Toolbox was developed to convert this format to more readable dataset tables and for creating PANGAEA import files. These tables can be opened with a spreadsheet program like Microsoft Excel or OpenOffice and with PanPlot to visualize the data very easily. With a download manager users can download station-to-archive files from the BSRN ftp-server to the local computer system.

The recent version and reference of the BSRN Toolbox can be found at http://www.pangaea.de/software/UsefulTools/

BSRN Toolbox is licensed under the GNU General Public License (GPL) and is freely distributed. (Source-code of the BSRN Toolbox as zip-archive, 310 kB)

Reference and detailed description


Downloading station-to-archive files After starting the BSRN Toolbox choose Station-to-archive->Download Station-to-archive files.... The download manager will be opened (Fig. 1). The user can select the station(s), the month(s), and the year(s). The files from this selection will be downloaded to the directory selected under Download directory. With the options Decompress and Check after download the user can specify that the files will be decompressed with gunzip and checked with the BSRN f_check program automatically after download (gunzip and f_check are located in the BSRN Toolbox program directory). If Check availability only was chosen, the BSRN Toolbox will create one file per selected station. Each file contains a listing of the ftp server directory. Before the download can be started the account must be set. Ask [mailto:Gert.Koenig-Langlo@awi.de Gert König-Langlo] for the BSRN ftp-account.

Metadata Select an uncompressed station-to-archive file with File->Select File... or File->Select Folder... or by dragging the file onto the program window. Then choose one or all logical records included in the station-to-archive file with the menu Metadata. The BSRN Toolbox will extract the selected metadata. For each logical record a file will be created. Behind the metadata information the PANGAEA ID follows. If ID is equal to -999, no entry was found and the user has to edit the file named BSRN_IDs.txt on the PANGAEA web server. Only [mailto:Gert.Koenig-Langlo@awi.de Gert König-Langlo] and [mailto:rsieger@pangaea.de Rainer Sieger] have permission to change this file.

Data Select an uncompressed station-to-archive file and choose one or all logical records with the menu Data. For each logical record a file will be created. All time series files can be opened with PanPlot. The radiosonde profiles file can be visualized with Ocean Data View (ODV).

Import For the creation of PANGAEA import files the menu Import has to be used. Like the menu Data the BSRN Toolbox will create one file for each logical record. These files can be imported to PANGAEA by a curator with 4D. If Overwrite dataset was checked, the import files contain the ID of the dataset to overwrite. This does only work if all BSRN datasets are known in the file named BSRN_Dataset_IDs.txt on the PANGAEA web server. Only [mailto:Gert.Koenig-Langlo@awi.de Gert König-Langlo] and [mailto:rsieger@pangaea.de Rainer Sieger] have permission to change this file.



Tools The BSRN Toolbox provides some useful tools for managing plain text files.

Concatenate files If the user has selected more than one file, this tool concatenates all files. The new file is named ConcatenatedFiles.txt. Starting with the 2nd file a number of lines will be skipped at the beginning of each file. See fig. 2.

Convert Windows End-of-Line to UNIX Station-to-archive files must be in UNIX format. This tool converts the Windows End-of-Line characters to the UNIX End-of-Line character.

Convert MacOS 9 End-of-Line to UNIX Station-to-archive files must be in UNIX format. This tool converts the MacOS 9 End-of-Line character to the UNIX End-of-Line character.

Compress files with gzip</H4> Station-to-archive files must be compressed with gzip. This tool compresses all selected files with the program gzip.

Convert tab files to unformatted format</H4> Unformatted files are using a character for splitting fields. With a dialog the user can specify the field delimiter (comma, semicolon, space or tab stop) and the missing value for empty cells. The input file must be tab separated. See fig. 3.

Convert tab files to formatted format</H4> Formatted files are using columns with fixed width for splitting fields. With a dialog the user can specify the field alignment (left or right), the width of fields and the missing value for empty cells. The input file must be tab separated. See fig. 4.

Contact: Dr. Rainer Sieger, Alfred Wegener Institute, Bremerhaven