#Selenium #Python #Scraping - wait

selenium-python-scraping.md

Scraping with Selenium/ Python

Wait to get an element on the page

    driver = webdriver.Firefox(firefox_options=options,
                               executable_path=geckodriver)

    driver.get(url)
    try:
        element = WebDriverWait(driver, 20).until(EC.visibility_of_element_located(
            (By.CSS_SELECTOR, ".tab-container")))
        a = []
        a = driver.find_elements_by_class_name("flex")
        for x in a:
            print(x.text, 'text of the element')
    finally:
        driver.quit()

Or Wait a certian amount of time

        driver = webdriver.Firefox()
        driver.implicitly_wait(30)  # seconds
        driver.get(url)
        a = []
        a = driver.find_elements_by_class_name("app-content-score")
        print(len(a), 'the len of A')