The software PanGet is a special tool for the download of multiple data sets from PANGAEA. It uses the PANGAEA data set ID which is unique and part of the DOI. In a first step a list of ID's of those data sets to be downloaded must be created. There are two choices to define this individual collection of sets. Based on the ID list, the tool will download the data sets. Failed downloads are written to the file *_failed.txt. The functionality of PanGet is also part of the program Pan2Applic (choose File > Download PANGAEA datasets...) and PanTool2 (choose Basic tools > Download PANGAEA datasets...).
Find the current version and reference of PanGet at doi:10.1594/PANGAEA.804562
Contact: Rainer Sieger. The software is provided as freeware under the (GNU General Public License (GPLv3) and is freely distributed without warranty by the Alfred Wegener Institute, Helmholtz Center for Polar and Marine Research, Bremerhaven.
Open doi:10.1594/PANGAEA.804562 and click on "View dataset as HTML". Download the current version of PanGet to your computer.
Double-click PanGet_Win.exe and follow the instructions. If the MSVCR120.dll is missing on your computer, you have to install the Visual C++ Redistributable Packages for Visual Studio 2013 from Microsoft.
Double-click PanGet_OSX.dmg and drag and drop the file PanGet.app onto the application folder icon.
Uncompress the archive to your user bin directory. Double-click PanGet.sh.
Create a list of PANGAEA dataset IDs
there are two choices:
- a) create a list of IDs with the PANGAEA search engine
- define a query which lists all data sets needed (e.g. https://pangaea.de/?q=Polarstern&f.project%5B%5D=AWI_PhyOce&f.device%5B%5D=CTD%2FRosette&f.pubyear%5B%5D=2016)
- copy and paste the URL into the "PANGAEA Query URL" field.
- b) sometimes the download of a single dat set can be useful. In this case the data set ID can added to the query field (try 123456 or dataset123456).
- c) create a list of IDs with the 4D client (for curators only, you need 4D)
- open the dataset table and configure the datset ID in the first column and the “Export filename” in the second one
- search for the dataset selection you want with the search tab
- save the resulting list as a text file. (Note: 4D can download a list with max. 30,000 data sets!)
Create a list of URLs
PanGet can also be used for downloading individual files from the Internet. Create a list with one or two columns. The first column has to be named "URL", the second "File name". If the second column is not given, PanGet will be extracted the filename from the URL.
To download several or all OFOS pictures from dataset doi:10.1594/PANGAEA.862082 at once, you have to create a list of URLs first. (Please be aware that a fast connection to the Internet is needed, because each image is about 10MB in size.)
- Download the dataset doi:10.1594/PANGAEA.862082 as tab-delimited text.
- Open the dataset with a spreadsheet program like Excel or LibreOffice and extract column 'URL image'. Save it as txt to a new file. Header of column must be 'URL'.
- Create a folder where the images should be downloaded into.
- Start PanGet. Browse for the txt file with the URL list (called 'ID List' in PanGet) and browse for the new folder (called 'Download directory' in PanGet), then click 'Go' – the image download will start immediately, but depending on the amount of images you are downloading it will take some time.
If you want to download images from more than one dataset (e.g. from a specific area) you can go to the PANGAEA search page (www.pangaea.de) and search for datasets (e.g. search for 'ANTofos' and additionally define a geographic bounding box (Google map on the right of the search page)). Or search for specific stations using the 'OR' quotation (e.g. 'PS96/001-4 OR PS96/007-1 OR PS96/008-2'). Then click on 'Data Warehouse' (right above the Google map of the search page, login needed). Here you can choose the parameters which you want to download. Choose 'Uniform resource locator/link to image' and press 'download'. Proceed with points 2 to 4 as described above.
- Start PanGet or Pan2Applic or PanTool (File > Download PANGAEA datasets...), copy and paste the URL into the "PANGAEA Query URL" field, and/or open the file just created
- Browse to your download directory
- Set the prefered encoding of data sets to be stored
- Set the extension of data sets to be stored
- Choose one or more download options (download data file, download citation, download metadata as xml)
- Click Go. PanGet downloads all data sets sequentialy, progress is shown. The download time depends on the number and size of the data sets.
The resulting collection of files may be compiled and converted to other formats using the tool Pan2Applic.
Development contact Rainer Sieger, AWI