Skip to content

Instantly share code, notes, and snippets.

@stungeye

stungeye/data_sources.md

Last active February 27, 2024 21:09
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 3 You must be signed in to fork a gist
  • Save stungeye/afbf654810fe428832591358ecf591b1 to your computer and use it in GitHub Desktop.
Save stungeye/afbf654810fe428832591358ecf591b1 to your computer and use it in GitHub Desktop.
Download ZIP
Potential Data Source for the Intro to Rails Project
Raw
data_sources.md

Data From CSV versus API

In class (and in challenge U5) we covered CSV datasets. You can also gather data from JSON APIs or even from Web Scraping. I've got a video you can watch to learn about those techniques: JSON API Consumption And Web Scraping

List of Public APIs

Website: github.com/toddmotto/public-apis

A big list of categorized public APIs that you could pull data from. Easiest to pick one where the "Auth" property is set to "No" because then you won't need to sign up for an API key. However, signing up for an API key usually isn't very difficult.

A few of the most promising looking APIs you could use to gather data:

City of Winnipeg Open Data Portal

Website: data.winnipeg.ca

Datasets can be retrieved using a JSON API. Look for the "API" button. Some interesting datasets:

Kaggle Datasets

Website: kaggle.com/datasets

Interesting collection of large datasets used for Machine Learning experiments. I'd stick with the CSV based ones.

Government of Canada Open Data Portal

Website: open.canada.ca

A variety of datasets are available for download in CSV and XML formats.

A few other random APIs and JSON Datasources

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment