archivebot reference

archivebot_reference.md

STOP!!

Are the extensions of the files correct?

Have you Validated the JSON?

Are there duplicate file URLs if there is a metadata file and a plaintext URLs file?

Use
transfer.archivete.am
for submitting plain text URL lists to
#hackint > #archivebot

#archivebot reference

https://www.google.com/search?q=archivebot https://wiki.archiveteam.org/?title=ArchiveBot https://wiki.archiveteam.org/?title=ArchiveTeam_Domains#archivebot.com http://archivebot.com/ http://archivebot.com/?showNicks=1 http://archivebot.com/3 http://archivebot.com/pipelines http://archivebot.com/pending http://archivebot.com/finished https://archivebot.readthedocs.io/ https://archive.fart.website/archivebot/viewer/ https://archive.fart.website/archivebot/viewer/items https://archive.fart.website/archivebot/viewer/jobs https://archive.fart.website/archivebot/viewer/domains https://archive.fart.website/archivebot/viewer/audit https://archive.fart.website/archivebot/viewer/costs https://archive.fart.website/archivebot/viewer/stats https://archive.fart.website/archivebot/viewer/faq

https://github.com/ArchiveTeam/grab-site grab-site dashboard http://localhost:29000/ some delays LINE ms delay COUNT ---------------------------- 0 | 2 9 | 1 109-209 | 1 110 | 1 250-375 | 64 259-369 | 7 309-509 | 1 400-600 | 1 500 | 2 500-700 | 1 500-1000 | 1 500-1500 | 2 600-900 | 4 900-1200 | 2 909-1209 | 1 1000 | 8 1000-1500 | 3 1000-2000 | 5 1000-3000 | 1 1009 | 1 1050 | 1 1200-1500 | 1 1500-2000 | 1 2000 | 4 2000-3000 | 1 3000-7000 | 4 5000 | 1 5000-7000 | 1 5000-10000 | 1 7000-12000 | 1 10000-15000 | 1 10000-20000 | 2 11000-15000 | 1 15000 | 1 15000-20000 | 2 15000-30000 | 1 20000-25000 | 1 20000-40000 | 1 25000-30000 | 1 30000 | 2 45000-75000 | 1 60000 | 2 60000-90000 | 1 70000-110000 | 1 90000 | 1 180000 | 2 300000 | 13 900000 | 1 1800000 | 1 ---------------------------- TOTAL LINES | 161 DISTINCT LINES | 49