Skip to content

Instantly share code, notes, and snippets.

@jenningsanderson

jenningsanderson/Daily Editing Activity Per Mapper.ipynb

Created October 30, 2021 17:22
Show Gist options
  • Save jenningsanderson/2dce387a301c6ae26f264b32159554f3 to your computer and use it in GitHub Desktop.
Save jenningsanderson/2dce387a301c6ae26f264b32159554f3 to your computer and use it in GitHub Desktop.
Download ZIP
Display the source blob
Display the rendered blob
Raw
Daily Editing Activity Per Mapper.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@matkoniecz
Copy link

Use AWS Athena to get the data: https://registry.opendata.aws/osm/

maybe I am blind - but where is download link there?

@jenningsanderson
Copy link
Author

Hi @matkoniecz — Changeset data is made available weekly on S3. The actual files are available here:

s3://osm-pds/changesets/

aws --no-sign-request s3 ls s3://osm-pds/changesets/

2024-06-28 13:34:43 5555416369 changesets-latest.orc

As you can see, it's stored as 1 big orc file.

However, I don't recommend downloading the file directly — you can query the data in situ on AWS using Amazon Athena — more instructions on this can be found here: https://www.openstreetmap.org/user/Jennings%20Anderson/diary/394762 (there are good links on the Usage Examples section of https://registry.opendata.aws/osm/)

That said, it's out there to download directly and you could likely load it into a tool like Pandas for further analysis, which should be pretty fast because of the advantages of the ORC file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment