This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import os | |
| import re | |
| import requests | |
| import lxml | |
| import multiprocessing | |
| from bs4 import BeautifulSoup | |
| def transform_cache_url(url): | |
| return re.sub(r"[^0-9a-zA-Z]", '_', url) |