Tag Archives: wget

Scraping GISS, CDIAC, NCDC / NCEI, and Me

A collection of information about site scraping and some ideas on sizes and commands for Climate Data related sites. Continue reading

Posted in AGW Science and Background, Earth Sciences, Tech Bits | Tagged , , , , | 20 Comments

Scraping NOAA and CDIAC

A reminder and script for how to scrape various web sites for temperature data, publications, etc. etc. Continue reading

Posted in AGW and GIStemp Issues, Tech Bits | Tagged , , , , , , , | 12 Comments

CDIAC Scrape Finished

The scrape of CDIAC has completed. Here I report on some sizes and such. Continue reading

Posted in AGW Science and Background, Earth Sciences, NCDC - GHCN Issues | Tagged , , , , , , | 13 Comments

Cloning USHCN Daily Data

How to clone a data archive in a one line script on a Linux machine that costs less than a nice dinner out. Continue reading

Posted in AGW and GIStemp Issues, GISStemp Technical and Source Code, Tech Bits | Tagged , , , , , , | 11 Comments