NCEI Datasets

[janheuser]

Hello, I am with the North Carolina Institute for Climate Studies, a NOAA cooperative institute collocated with the National Centers for Environmental Information (NCEI). Myself and two coworkers, @parthk279 and @iype-eldho, are using the Earth2Studio API for downscaling experimentation. We have Earth2Studio Datasource classes for some NCEI datasets, which we are quite familiar with, that we would like to contribute to this repo. Please let us know the best path forward.

James

[NickGeneva]

Hi @janheuser

Thanks for reaching out. We are always looking for adding new connections to useful data sources and its great to hear that you already have something written! Exciting!

Normally I would suggest just opening a PR and typically someone from the engineering team (likely myself) will help support the merge.

But before that, can I ask about the accessibility and also the licensing of this data source. I'm not familiar with NCEI but generally we try to add sources for data that can be easily used by all and generally under open license.

Perhaps you can put a few links for the specifics you're working with at the moment?
Thanks!

[janheuser]

Excellent! Exciting, indeed!

Fortunately, NCEI data is entirely the public domain. You may view the policy at the below URL:
https://www.ncei.noaa.gov/archive#:~:text=Environmental%20data%20and%20information%20produced,or%20CC%20BY%204.0%20license.

Initially, we are looking at the nClimGrid and GHCN-daily datasets:

https://www.ncei.noaa.gov/products/land-based-station/nclimgrid-daily
https://www.ncei.noaa.gov/products/land-based-station/global-historical-climatology-network-daily

Take a look and let me know what you think.

Thank you!

[NickGeneva]

Awesome @janheuser

This looks really interesting, if you want to open two PRs I would be happy to jump into it as well.

Looking at it briefly seems nClimGrid-Daily is a standard rasterized data
While the second (GHCN-daily) seems to be more obs based data source?

[janheuser]

Excellent, I will have @parthk279 and @iype-eldho open the PRs if that's alright.

Yes---nClimGrid-Daily is a gridded observation dataset and GHCN-Daily is weather station data. There are other temporal resolutions for these datasets as well.