CoMPaTech
/ gist:f42a306dda106809f20d1cc6f8c16584
Created
March 20, 2018 21:18
— forked from simonw/gist:104413
Turn a BeautifulSoup form in to a dict of fields and default values - useful for screen scraping forms and then resubmitting them
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| def extract_form_fields(self, soup): | |
| "Turn a BeautifulSoup form in to a dict of fields and default values" | |
| fields = {} | |
| for input in soup.findAll('input'): | |
| # ignore submit/image with no name attribute | |
| if input['type'] in ('submit', 'image') and not input.has_key('name'): | |
| continue | |
| # single element nome/value fields | |
| if input['type'] in ('text', 'hidden', 'password', 'submit', 'image'): |