This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
set -e -x | |
db_file=$(ls -a ~ | grep openwpm_results | head -n 1)/crawl-data.sqlite | |
python3 << EOF | |
import sqlite3 | |
from six.moves.urllib.parse import urlparse | |
conn = sqlite3.connect('${db_file}') |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from OpenWPM.automation import CommandSequence, TaskManager | |
# The list of sites that we wish to crawl | |
NUM_BROWSERS = 3 | |
sites = ['http://www.example.com', | |
'http://www.princeton.edu', | |
'http://citp.princeton.edu/'] | |
# Loads the manager preference and 3 copies of the default browser dictionaries |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
# https://github.com/mozilla/OpenWPM/blob/master/install.sh | |
set -e | |
if [[ $# -gt 1 ]]; then | |
echo "Usage: install.sh [--flash | --no-flash]" >&2 | |
exit 1 | |
fi | |
if [[ $# -gt 0 ]]; then |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# https://seleniumhq.github.io/selenium/docs/api/py/ | |
# https://www.seleniumhq.org/docs/04_webdriver_advanced.jsp | |
# https://intoli.com/tags/selenium/ | |
# | |
# mount the vm in the host | |
# mkdir -pv ~/selenium && sshfs -o reconnect,ServerAliveInterval=15,ServerAliveCountMax=3,port=2222,password_stdin user@localhost:/home/user/ ~/selenium <<<"password" | |
# but first install ssh-server (if not already) | |
# su -c 'apt-get install openssh-server' |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# https://github.com/mozilla/OpenWPM/blob/master/install.sh | |
# https://github.com/mozilla/openwpm-crawler | |
# https://github.com/mozilla/openwpm-webext-instrumentation/ | |
# https://github.com/mozilla/openwpm-firefox-webext | |
# | |
# flash needed? | |
# | |
su -c 'apt-get install openssh-server sudo mc git firefox-esr' | |
su -c "usermod -aG sudo user" |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.