Tag Archives: wget

Scraping GISS, CDIAC, NCDC / NCEI, and Me

A collection of information about site scraping and some ideas on sizes and commands for Climate Data related sites. Continue reading

Advertisements
Posted in AGW Science and Background, Earth Sciences, Tech Bits | Tagged , , , , | 20 Comments

Scraping NOAA and CDIAC

A reminder and script for how to scrape various web sites for temperature data, publications, etc. etc. Continue reading

Posted in AGW and GIStemp Issues, Tech Bits | Tagged , , , , , , , | 12 Comments

CDIAC Scrape Finished

The scrape of CDIAC has completed. Here I report on some sizes and such. Continue reading

Posted in AGW Science and Background, Earth Sciences, NCDC - GHCN Issues | Tagged , , , , , , | 13 Comments

Cloning USHCN Daily Data

How to clone a data archive in a one line script on a Linux machine that costs less than a nice dinner out. Continue reading

Posted in AGW and GIStemp Issues, GISStemp Technical and Source Code, Tech Bits | Tagged , , , , , , | 11 Comments