dolphin278

Uses capped collection, tailable cursors and streams.

What's here?

• init.js recreates collection capped collection 'queue' on mongodb.
• writer.js spams queue with new messages
• worker.js processes all messages saved to queue,
• onceWorker.js processes only unprocessed messages, so you can spawn several of them and each of your messages will be processed by only one worker.

Steps

nikhilweee

import sys
import requests
from bs4 import BeautifulSoup, SoupStrainer

home_url = 'https://parivahan.gov.in/rcdlstatus/'
post_url = 'https://parivahan.gov.in/rcdlstatus/vahan/rcDlHome.xhtml'
# Everything before the last four digits: MH02CL
first = sys.argv[1]
# The last four digits: 0555
second = sys.argv[2]