Skip to content

Instantly share code, notes, and snippets.

@jedsundwall
Last active April 16, 2019 19:59
Show Gist options
  • Save jedsundwall/e85bfca46f4b2ee5a985ec793c30725a to your computer and use it in GitHub Desktop.
Save jedsundwall/e85bfca46f4b2ee5a985ec793c30725a to your computer and use it in GitHub Desktop.
NOAA GFS and HRRR Model data on AWS

We are experimenting with providing Global Forecast System (GFS) Model and High-Resolution Rapid Refresh (HRRR) Model data publicly available on Amazon S3. This Gist describes where to find the data and how it's organized. To work with the data, use any of AWS's various SDKs or Command Line Interface.

GFS

A rolling four-week archive of 0.25 degree GFS data is available in s3://noaa-gfs-pds.

Browse the data in your browser at http://awsopendata.s3-website-us-west-2.amazonaws.com/noaa-gfs/

HRRR

A rolling one-week archive of HRRR data is available in s3://noaa-hrrr-pds.

Browse the data in your browser at http://awsopendata.s3-website-us-west-2.amazonaws.com/noaa-hrrr/

File structure

The key layout of data in both buckets is:

Parameter/Vertical Level/YYYYMMDD/HH00/FFF

FFF represents the forecast hour.

SNS Topics

We have set up public Amazon SNS topics that create a notification for every new object added to the Amazon S3 chunks and archive buckets for NEXRAD on AWS. To start, you can subscribe to these notifications using Amazon SQS and AWS Lambda. This means you can automatically add new real-time and near-real-time NEXRAD data into a queue or trigger event-based processing if the data meets certain criteria such as geographic location.

  • The Amazon Resource Name (ARN) for GFS: arn:aws:sns:us-east-1:104891172899:noaa-gfs-pds
  • The Amazon Resource Name (ARN) for HRRR: arn:aws:sns:us-east-1:104891172899:noaa-hrrr-pds

Documentation on subscribing to SNS topics.

Documentation on Amazon S3 event message structure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment