Skip to content

Instantly share code, notes, and snippets.

@kylemcdonald

kylemcdonald/Collect Parler Metadata.ipynb

Last active September 20, 2023 11:45
Show Gist options
  • Star 95 You must be signed in to star a gist
  • Fork 20 You must be signed in to fork a gist
  • Save kylemcdonald/8fdabd6526924012c1f5afe538d7dc09 to your computer and use it in GitHub Desktop.
Save kylemcdonald/8fdabd6526924012c1f5afe538d7dc09 to your computer and use it in GitHub Desktop.
Download ZIP
Collect video URLs and GPS data for Parler videos.
Raw
_readme.md

Parler video GPS data

My goal is to help people researching the spread of far-right movements, and trying to identify people tresspassing at the Capitol on January 6th. Do not contact me about doxxing someone, or leave comments attempting to doxx someone, just because they uploaded a video.

Download the collected CSV data here.

Using metadata collected by https://twitter.com/donk_enby

No rights reserved

image

How to view a video on Parler

Let's say you have a video ID, like wfy02V209EwU taken from this map

The link for the video kiBnNejo0JW0 is at https://video.parler.com/ki/Bn/kiBnNejo0JW0. Notice that the link is: https://video.parler.com/ followed by the first two characters of the video ID, then /, then the next two characters, another /, and the video ID.

But if you click on this, you will get an error.

This is because the Parler video servers are still running (as of January 12) but the Domain Name System (DNS) is not running.

That means that video.parler.com does not get mapped to the video server address correctly.

To fix this, you need to manually patch your system's DNS records. Then you can click on the link.

Mac

  1. Open the Terminal app.
  2. Type sudo nano /etc/hosts
  3. Type your password.
  4. Press the down arrow key until you are past the lines starting with #.
  5. Paste this line: 8.240.242.124 video.parler.com
  6. Type Ctrl+O to save.
  7. Type Ctrl+X to exit.

Windows

Follow these instructions and add the line 8.240.242.124 video.parler.com to your hosts file.

Errors

Some of the videos have been taken down. These will show a message saying "AllAccessDisabled".

Display the source blob
Display the rendered blob
Raw
Collect Parler Metadata.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@aurimasniekis
Copy link

the same CSV file but with just added URL for video https://gofile.io/d/Q9E5zT

@JamesHagerman
Copy link

Excel: = "https://video.parler.com/"&MID(D2,1,2)&"/"&MID(D2,3,2)&"/"&D2&".mp4"

Or just use ☝️ 😄

Copy link

ghost commented Jan 18, 2021

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

Screen Shot 2021-01-18 at 00 38 22

@philshem
Copy link

philshem commented Jan 18, 2021 •
edited

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

A week ago I found that only 5 of 35 videos taken in Switzerland were recoverable, and for the 30 that I couldn't download, I had a similar message. But the good news is that the Archive Team is working on processing the full archive.

You can monitor the progress here: https://www.archiveteam.org/index.php?title=Parler

@philshem
Copy link

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

The full data is now available for download: https://ddosecrets.com/wiki/Parler

and here is a command to download an individual video

aws s3 cp --request-payer requester s3://ddosecrets-parler/D2fovQB1v4M2 ./D2fovQB1v4M2.mp4

Copy link

ghost commented Jan 25, 2021

I'm trying to get video https://video.parler.com/D2/fo/D2fovQB1v4M2_small.mp4 and am having no such luck. Even the sample video above is blocked now. Any chance that any of the videos are still accessible?

The full data is now available for download: https://ddosecrets.com/wiki/Parler

and here is a command to download an individual video

aws s3 cp --request-payer requester s3://ddosecrets-parler/D2fovQB1v4M2 ./D2fovQB1v4M2.mp4

Thanks. Since I don't have a card, I'm unable to access the content. I'll just have to remember to get the data in the future when I do have a card.

@philshem
Copy link

Thanks. Since I don't have a card, I'm unable to access the content. I'll just have to remember to get the data in the future when I do have a card.

here you go: https://archive.org/details/parler-D2fovQB1v4M2

direct download link: https://archive.org/download/parler-D2fovQB1v4M2/D2fovQB1v4M2.mp4

Copy link

ghost commented Jan 27, 2021

Thanks! :)

@freedom-fighter2121
Copy link

Is it possible to hack into the bank accounts of Myanmar military generals (most likely in one of the Singaporean banks) and expose how much dirty money they have been stealing from the country? It would also be nice to expose the collaborations between China and General Min Aung Hlaing. Publishing ASEAN members' correspondence regarding Myanmar will also be of great value to the citizens fighting for democracy in Myanmar. Thanking you in advance for your invaluable assistance.

Copy link

ghost commented Mar 1, 2021

Is it possible to hack into the bank accounts of Myanmar military generals (most likely in one of the Singaporean banks) and expose how much dirty money they have been stealing from the country? It would also be nice to expose the collaborations between China and General Min Aung Hlaing. Publishing ASEAN members' correspondence regarding Myanmar will also be of great value to the citizens fighting for democracy in Myanmar. Thanking you in advance for your invaluable assistance.

???

This isn't the movies. Even if we knew how to do that, I wouldn't recommend doing that.

@freedom-fighter2121
Copy link

freedom-fighter2121 commented Mar 20, 2021 via email

@freedom-fighter2121
Copy link

freedom-fighter2121 commented Mar 21, 2021 via email

@abrahami
Copy link

abrahami commented Apr 7, 2021

Is there a way to connect the videos to users / usernames and their posts?

Did anyone find a way to do so?

@kylemcdonald
Copy link
Author

kylemcdonald commented Apr 10, 2021 •
edited

A few quick notes for anyone still following this. This original GoFile link has been taken down, but it might still be available at this magnet URL:

magnet:?xt=urn:btih:1723e27bc79186c4574ff056ddb458d771c26e2f&dn=metadata.tar.gz&tr=wss%3A%2F%2Ftracker.btorrent.xyz&tr=wss%3A%2F%2Ftracker.openwebtorrent.com&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Fexplodie.org%3A6969&tr=udp%3A%2F%2

The SHA256 is 66809d9ae0a5a6577a3c80bb623562274ceccd96b35519f15f568d09cefc56f8.

For connecting videos to usernames and posts, check this dataset from Aliapoulios et al. I've also done some plots of term frequency.

If you are specifically interested in posts from January 6/7 please check the massive JSON linked to by this tweet. (direct link to torrent)

This may be the same as the 18GB torrent provided by DDOSecrets but I haven't checked.

@jderekito
Copy link

Hello,
I have a couple of questions: 1) is there location data and 2) can you identify the users across locations?
Thanks,
Derek

@jderekito
Copy link

Is there a way to connect the videos to users / usernames and their posts?

Hello. I have this same question. Did you get it answered per chance? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment