Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Select an option

  • Save shsunmoonlee/3299cd1e8948390d25290e7f07e04086 to your computer and use it in GitHub Desktop.

Select an option

Save shsunmoonlee/3299cd1e8948390d25290e7f07e04086 to your computer and use it in GitHub Desktop.
Music Hackathon Ideas, Resources
https://blog.rapidapi.com/2017/01/31/microsoft-emotion-and-spotify-mood-music-project-api-smash/
https://developers.musimap.net/
https://umusic.app.box.com/s/wjpmxvvxbe2aoml00y574wv1q1gu40h4
Extract of streaming data (all kinds of platforms) for one week in April:
streams_11th_18th_April.csv (zipped)
sales_week,streaming_date,isrc,artist,title,distributor,division,release_date,genre,streams,upc
201815,20180415,ATA019500580,Wolfgang Puschnig,Purple Heart,Universal Vertrieb GmbH,UMI,20170825,Jazz,1,602557835199
201816,20180416,ATA019500590,Wolfgang Puschnig,Microphone Veteran,Universal Vertrieb GmbH,UMI,20170825,Jazz,1,602557835199
201815,20180414,ATA019500590,Wolfgang Puschnig,Microphone Veteran,Universal Vertrieb GmbH,UMI,20170825,Jazz,1,602557835199
201815,20180412,ATA019500590,Wolfgang Puschnig,Microphone Veteran,Universal Vertrieb GmbH,UMI,20170825,Jazz,1,602557835199
...
Spotify metadata for those artists listed in streams_11th_18th_April.csv
artists_popularity.csv (zipped)
artist_spotify_id,artist_name,genres,followers,first_image_url,second_image_url,popularity,uri
0hMmNWqJ9Q1iQlPSYuxZtG,Fameless,"",0,https://i.scdn.co/image/867f1800ec47221318e6bdfe645709f05970f0a4,https://i.scdn.co/image/44356139016e1c9aca6dbfab83adb3186a0f20b1,0,spotify:artist:0hMmNWqJ9Q1iQlPSYuxZtG
2533fj1QqNd0rvcLFzceqG,Ness,"",8,https://i.scdn.co/image/2a08648a05f7cf788652bad6db6c83731a2d7232,https://i.scdn.co/image/c8e2b4d2baf4209f8fb565bab2f3ca840ef50b26,0,spotify:artist:2533fj1QqNd0rvcLFzceqG
2EyJfzrJrl2T92tzznCQO0,Mariska,"",0,https://i.scdn.co/image/feaf296e8de0f3fc917dd76ff481a4742f02f1c4,https://i.scdn.co/image/26a4c99b36dca2698b530aa8a481bc84a06f2409,0,spotify:artist:2EyJfzrJrl2T92tzznCQO0
6IpzPqHBAlkoZmQzzzozOm,Reyno,"",423,https://i.scdn.co/image/bc9eda55567c9ffd6fb87ea1b0d3c969463b327e,https://i.scdn.co/image/7dcf8f6a5cdd5ddc485aaa14405cf169cc9bad1c,0,spotify:artist:6IpzPqHBAlkoZmQzzzozOm
7xZHrltZh8zIRvjimgABvj,Nina Hagen,"",28224,https://i.scdn.co/image/837e0ae4185b47b87fee1b88cdcaceac698105f2,https://i.scdn.co/image/ce4c4e9b192491063a41c4e1bf6b46ec3726d337,41,spotify:artist:7xZHrltZh8zIRvjimgABvj
...
Albums by artists listed in streams_11th_18th_April.csv
albums_by_artists.csv (zipped)
album_name,available_markets,first_artist_name,first_artist_spotify_id,num_artists,genres,first_image_url,second_image_url,label,num_tracks,popularity,release_date,spotify_album_id,upc,uri
Summer, Vol. 3,"AD,AR,AT,AU,BE,BG,BO,BR,CA,CH,CL,CO,CR,CY,CZ,DE,DK,DO,EC,EE,ES,FI,FR,GB,GR,GT,HK,HN,HU,ID,IE,IL,IS,IT,JP,LI,LT,LU,LV,MC,MT,MX,MY,NI,NL,NO,NZ,PA,PE,PH,PL,PT,PY,RO,SE,SG,SK,SV,TH,TR,TW,US,UY,VN,ZA",Michael Sanchez,6lV2JYF7fXkGRRS47NUXwK,1,,,,,,,,3qaH7UtIL4gBktiB96mUDa,,
House Music Lover, Vol. 3,"AD,AR,AT,AU,BE,BG,BO,BR,CA,CH,CL,CO,CR,CY,CZ,DE,DK,DO,EC,EE,ES,FI,FR,GB,GR,GT,HK,HN,HU,ID,IE,IL,IS,IT,JP,LI,LT,LU,LV,MC,MT,MX,MY,NI,NL,NO,NZ,PA,PE,PH,PL,PT,PY,RO,SE,SG,SK,SV,TH,TR,TW,US,UY,VN,ZA",Various Artists,0LyfQWJT6nXafLPZqxe9Of,1,,,,,,,,4F19VatYKh6JfGCeO6zZmB,4260057512222,
Crazy About You,"AD,AR,AT,AU,BE,BG,BO,BR,CA,CH,CL,CO,CR,CY,CZ,DE,DK,DO,EC,EE,ES,FI,FR,GB,GR,GT,HK,HN,HU,ID,IE,IL,IS,IT,JP,LI,LT,LU,LV,MC,MT,MX,MY,NI,NL,NO,NZ,PA,PE,PH,PL,PT,PY,RO,SE,SG,SK,SV,TH,TR,TW,US,UY,VN,ZA",Venom,5Gh2S0iOH3qj6qNqAJkF8g,1,,,,,,,,5XqYBKza5YsSfNeJPQVl4k,,
Marginal Body,"AD,AR,AT,AU,BE,BG,BO,BR,CA,CH,CL,CO,CR,CY,CZ,DE,DK,DO,EC,EE,ES,FI,FR,GB,GR,GT,HK,HN,HU,ID,IE,IL,IS,IT,JP,LI,LT,LU,LV,MC,MT,MX,MY,NI,NL,NO,NZ,PA,PE,PH,PL,PT,PY,RO,SE,SG,SK,SV,TH,TR,TW,US,UY,VN,ZA",SoMo,35egk5CzDFJ3qRJhlGRTUz,1,,,,,,,,0RnBJEEIVsbHCptZ2MGM7I,,
...
Tracks by artists listed in streams_11th_18th_April.csv
tracks_by_artists.csv (zipped)
isrc,duration_ms,first_artist_name,first_artist_spotify_id,track_popularity,preview_url,spotify_track_id,spotify_track_name
DEPZ61049148,101264,Caterina Valente,6U43w7qaIwFTlbJWuLiBrf,0,https://p.scdn.co/mp3-preview/1c24ebf510c0dce956bd1f2d58c09d3e01b06938?cid=b0ec715cabfd41ed89610b67ff148132,00Vt89u1h1BtBcoIXkKnC9,Boom
USRHD0610880,139240,Buck Owens,2FMZn5P3WATd7Il6FgPJNu,0,https://p.scdn.co/mp3-preview/9515c5e0a77084c2fd76c73b216a79982d91826d?cid=aee34f0714c94f0e9e9b369ef4ebde9a,0BbMMvPwanExnKLxThpr7h,Where Does The Good Times Go - 2006 Remastered Version
US5260710011,239480,Portugal. The Man,4kI8Ie27vjvonwaB2ePh8T,21,,0whEsyjbm0YWOxfvWnYin3,Sleeping Sleepers Sleep
GBAJC9801091,105706,Philharmonia Orchestra,09KZU0NsS7jRa5p0SflmGY,5,https://p.scdn.co/mp3-preview/860bc6bb87bc07dd4830eb4aa216cf58a1a5cb6e?cid=6065f3ede057465cb749e1fbad150ff1,6FTnToDvYTJbMgXLmZRfCP,Attempted Rape
DETS71542046,137711,Julia Fischer,2yOxbgNx5rlqrYTxjWcwMA,0,https://p.scdn.co/mp3-preview/b878f58f8dd724335fd76b611026ed9913dcb464?cid=d70ade76aacd4b758a8e956b08fcd6dc,6MI2dSwclPay9jEpi4tFoE,Kapitel 029_Die Galerie der Duefte
GBA076900040,259000,Bee Gees,1LZEQNv7sE11VDY3SdxQeN,14,,16B9VafGXnmZy9hPzNjeMr,You'll Never See My Face Again
USGF19600707,243530,Weezer,3jOstUTkEu2JkjvRdBA5Gu,54,,3g2gQMeeQAEPztiQKMlGSl,El Scorcho
USRH11602521,137209,Ray Charles,1eYhYunlNJlDoQhtYBvPsi,31,https://p.scdn.co/mp3-preview/14ef9590f08f35bc0d46163a6989a28f481f604e?cid=fb87186d138344ae96c99f8f88734597,1poW3AcKkDcJmzEqyKluIo,"Yes, Indeed! - 2016 Mono Remastered"
...
Genres for those tracks listed in tracks_by_artists.csv
gerne_tracks.csv (zipped)
isrc,company,major_label,sub_genre,gerne
BRUM71101575,Universal Music International Ltda.,UMG,Sertanejo,Brazilian
ZAUM70704636,Universal Music (Pty) Ltd.,UMG,Instrumental,Instrumental
BREMI9600246,EMI Brazil,UMG,Samba,Brazilian
JPTO00800021,Universal Music LLC,UMG,Kayokyoku,Kayokyoku
KRUM71700353,Universal Music,UMG,K-Pop,Pop
HKUM71000668,Cinepoly,UMG,Cantopop,Pop
BRUM71705277,EMI Music Brasil Ltda,UMG,Sertanejo,Brazilian
INUM70600343,Universal Music India Pvt Ltd.,UMG,Indian Pop,Indian
...
Spotifys similar artists for those artists listed in streams_11th_18th_April.csv
similar_artists_popularity.csv (zipped)
spotify_artist_id,spotify_sim_artist_id,sim_rank,sim_artist_name,sim_artist_follower,sim_artist_popularity
3urXv5FVtlg3VsvApwm9wp,000AK4sjc0Np5MbCQ6JC1U,15,Tony Camillo's Bazuka,11,0
1ZCpJLqJ5AIy3NeS36mB7l,000rOFFfUyGGzKmB8XYIuu,9,Milton Cross,65,0
5zu97JO2L5C08tcgceRGvH,004zPKdAd8NSrdVFDhqdOo,1,Hadeium,12,0
6EJ5JmmoFsyoGzDGGZVkKl,03GTycRDHFrv03w34V30h4,7,Internal Conflict,113,0
...
Galiboo:
“With this music intelligence API, you can get the emotions & acoustic info for any track, find similar songs based on seed tracks & artists, create live music recommendations that adapt to your user tastes & context in real-time, and much more!
Powered by cutting-edge artificial intelligence capable of understanding music like humans, our technology will create amazing musical experiences for your users that were simply impossible before.” http://www.galiboo.com/
· 20.000 exemplary tracks to discover with galiboo:
track_ids.csv
"5a3fac83d836490c186f1fab"
,"5a3fac96d836490c186f2024"
,"5a3fac9bd836490c186f2047"
….
· You can either look for the tracks or artists to find information about them:
tracks_artists_id.csv
(to read: Artist, spotify_artist_id, galiboo_artist_id, galiboo_track_id, title)
artist;spotify_id;galiboo_id;track_id;title
Philip Glass;69lxxQvsfAIoQbB20bEPFC;69lxxQvsfAIoQbB20bEPFC;"5a3fac16d836490c186f1ad7
";Dreaming of Fiji
Philip Glass;69lxxQvsfAIoQbB20bEPFC;69lxxQvsfAIoQbB20bEPFC;"5a3fac16d836490c186f1ae1
";Etude No. 5
Philip Glass;69lxxQvsfAIoQbB20bEPFC;69lxxQvsfAIoQbB20bEPFC;"5a3fac19d836490c186f1b4e
";Etude No. 9
Philip Glass;69lxxQvsfAIoQbB20bEPFC;69lxxQvsfAIoQbB20bEPFC;"5a3fac1bd836490c186f1b5d
";The Poet Acts
.....
Please note the Documentation is a little bit buggy (http://apidocs.galiboo.com/#music-meet-ai)
See file galiboo_example.txt attached to see exemplary script and outcome for a single track.
Artist Cluster
Some APIs (more information will follow next week):
- A UMG dataset for artists and clusters of similar artists: Artist Cluster (please read the pdf doc attached)
The Universal Music API provides three functions:
- The API provides a so-called gravity measurement assigned to an artist. The gravity of an artist is the probability of future success/growth of this artist.
- The API provides similar artists to an artist as well as an information to which cluster the artist belongs.
- The API provides brands and interests related to an artist.
The algorithms behind this information won’t be disclosed but you can use the results. ;)
You can search by the name of an artist or use the Spotify ID of an artist. We have added a set of SQL-like functions / logic to refine your queries. If you need the complete API documentation, please let us know and we will provide you with the details.
Some ideas:
- The gravity function allows you to search for unknown artists with a high probability of future success – why don’t you connect them to the Spotify API?
- Did you use the Sony API to analyze your YouTube Playlist? Why don’t you connect successful playlists to brands using the Universal API?
- Are you looking for similar artists to find similar tracks of the same mood using the Musimap API?
Gitlab
We have a repository for the Musicathon: https://gitlab.com/musicathon
There you find a docker image for a postgreSQL dump containing a subset of Universal’s artists’ and releases’ data. It’s also there to place your code.
Please also consider other free data sources:
https://developer.spotify.com/
https://developers.deezer.com/login?redirect=/api
https://developer.amazon.com/docs/smapi/ask-cli-intro.html#smapi-intro
https://developer.amazon.com/de/docs/smapi/intent-request-history.html
https://developer.twitter.com/en/docs
https://musicbrainz.org/doc/Development/XML_Web_Service/Version_2
Anything else I can prepare?
Yes, of course, turn on the radio, check in to your streaming account, go to a store and buy a CD/LP and get into mood :)
And of course, you can also think of creating test accounts like for Google Cloud, AWS, Heroku or whatever you prefer. Alexa will also be part of the team.
Or read some nice articles:
https://developer.amazon.com/de/alexa-skills-kit/alexa-skill-quick-start-tutorial
https://18.re-publica.com/de/topics/music-sovereignity
https://medium.com/s/story/spotifys-discover-weekly-how-machine-learning-finds-your-new-music-19a41ab76efe
http://www.asimovinstitute.org/analyzing-deep-learning-tools-music/
https://towardsdatascience.com/deep-learning-with-tensorflow-part-3-music-and-text-generation-8a3fbfdc5e9b
https://www.fastcompany.com/40503427/the-25-best-new-apps-of-2017
Questions?!
Contact us at MUSICATHON@universal-music.de
More interesting free APIs to check out:
https://theysaidso.com/api/
https://quotes.rest/
https://developers.deezer.com/
https://developer.spotify.com/
https://musicbrainz.org/doc/Development/XML_Web_Service/Version_2
--
Lee, Seunghun
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment