Tag Archives: CDIAC

Scraping GISS, CDIAC, NCDC / NCEI, and Me

Posted on 22 February 2017 by E.M.Smith

A collection of information about site scraping and some ideas on sizes and commands for Climate Data related sites. Continue reading →

Posted in AGW Science and Background, Earth Sciences, Tech Bits | Tagged , , , , | 20 Comments

Scraping NOAA and CDIAC

Posted on 30 January 2017 by E.M.Smith

A reminder and script for how to scrape various web sites for temperature data, publications, etc. etc. Continue reading →

Posted in AGW and GIStemp Issues, Tech Bits | Tagged , , , , , , , | 12 Comments

CDIAC, Compression, Squashfs, And Oddities

Posted on 11 October 2015 by E.M.Smith

Some “Lessons Learned” in making a compressed easy to search archive via squashfs file systems and temperature data file trees. Continue reading →

Posted in AGW and GIStemp Issues, NCDC - GHCN Issues, Tech Bits | Tagged , , , , , , | 6 Comments

CDIAC Scrape Finished

Posted on 6 October 2015 by E.M.Smith

The scrape of CDIAC has completed. Here I report on some sizes and such. Continue reading →

Posted in AGW Science and Background, Earth Sciences, NCDC - GHCN Issues | Tagged , , , , , , | 13 Comments