PanGet

The software PanGet is a special tool for the download of multiple data sets from PANGAEA. It uses the PANGAEA data set ID which is unique and part of the DOI. In a first step a list of ID's of those data sets to be downloaded must be created. There are three choices to define this individual collection of sets. Based on the ID list, the tool creates a script which is executed through a terminal to download the data sets. The program wget downloads each dataset specified by its ID. Between two calls of wget PanCheck checks the successfull download of the file before. Failed downloads are written to the file PanGet_script_failed.txt.

Installation

 * Download PanGet from the PANGAEA web server
 * for the Windows version please download wget from the Internet
 * move the programs wget and PanCheck to a directory in your path
 * MacOS X> /Applications/Utilities (Programme/Dienstprogramme)
 * Windows> C:\Windows

Create a list of dataset IDs
there are three choices:
 * a) create a list of IDs with the PANGAEA search engine
 * define a query which lists all data sets needed
 * change http://www.pangaea.de/search?count=xxx&... in the query-URL to xxx=number of datasets found
 * on  all hits (max. 500) will be listed on one HTML-page
 * Save the page as HTML-file (select "HTML only" as file type)
 * b) create a list of IDs with the 4D client
 * open the dataset table and configure the datset ID in the first column and the “Export filename” in the second one
 * search for the dataset selection you want with the search tab
 * save the resulting list as a text file. (Note: 4D can download a list with max. 30,000 data sets!)

Download
The resulting collection of files may be compiled and converted to other formats using the tool Pan2Applic.
 * Start PanGet and open the file just created
 * Browse to your download directory
 * Click  and give the shell script a name
 * MacOS X > start the program Terminal.app and drop the script file to the terminal window. Click into the terminal window and press return
 * Windows > start the script by doubleclicking the script icon
 * The script downloads all data sets sequentialy, progress is shown in the terminal window. The download time depends on the number and size of the datasets.

Development contact [mailto:rsieger@pangaea.de Rainer Sieger, AWI]