Skip to content

Instantly share code, notes, and snippets.

@sean-smith
Created April 5, 2017 14:16
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save sean-smith/4cfaa69b9c4d720fa93d5746621841f9 to your computer and use it in GitHub Desktop.
Save sean-smith/4cfaa69b9c4d720fa93d5746621841f9 to your computer and use it in GitHub Desktop.
Project Proposal for CS506 Spring 2017

Github Data Analysis

Sean Smith swsmith@bu.edu sean-smith

Ann Ming Samborski asambors@bu.edu asamborski

Data Source

We are going to scrape github.com for publically acessible github repositories and collect the following information:

  • stars
  • forks
  • followers
  • owner_id
  • org_name
  • primary_language
  • secondary_language
  • lines_of_code
  • num_contributors
  • first_commit
  • num_pull_requests
  • speaking_language
  • num_commits
  • commit_times
  • loc_per_comit
  • type_of_computer (.DS_Store ftw)

With this data we want to answer a bunch of questions.

  1. What are the most popular coding languages? How has this changed over time?
  2. Given commit times, can we predict number of stars?
  3. Does lines of code correlate with number of stars?
  4. Do number of contributors correlate with number of stars?
  5. What are the most popular repositories to contribute to?
  6. How does contributions vary by country? By time zone?
  7. Does number of commits correlate with lines of code?
  8. What repository has the most number of commits?
  9. Do organizations have less or more contributors? Lines of code?
  10. Do Chinese speaking people use github? Do they use it in China? (see great cannon for context)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment