sysnucleus
sysnucleus
/ Sample HTML with Email
Created
July 2, 2015 05:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <div class="call-to-action "> | |
| <a title="Email" class="contact contact-main contact-email " | |
| href="mailto:info@canberraeyelaser.com.au?subject=Enquiry%2C%20sent%20from%20yellowpages.com.au& | |
| body=%0A%0A%0A%0A%0A------------------------------------------%0AEnquiry%20via%20yellowpages.com.au%0Ahttp%3A%2F%2Fyellowpages.com.au%2Fact%2Fphillip%2Fcanberra-eye-laser-15333167-listing.html%3Fcontext%3DbusinessTypeSearch" | |
| rel="nofollow" data-email="info@canberraeyelaser.com.au"> | |
| <span class="glyph icon-email border border-dark-blue with-text"></span><span class="contact-text">Email</span> | |
| </a> | |
| </div> |
sysnucleus
/ Sample Text 1.txt
Created
November 17, 2016 11:50
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| The Man in the High Castle Kindle Edition | |
| by | |
| Philip K. Dick (Author) |
sysnucleus
/ Commonly used Regular Expressions
Last active
January 30, 2022 12:00
Commonly used Regular Expressions, with WebHarvy
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (.*) | |
| Selects only first line from a block of text or HTML | |
| [\s]*(.*) | |
| Selects first line, ignoring the starting white-spaces, (spaces, line feeds and carriage returns). | |
| [\s]* matches all white-spaces till the first view-able character. | |
| href=”([^”]*) | |
| Gets the href link/URL from HTML. [^”]* matches till the next " character. |
sysnucleus
/ Amazon WebHarvy RegEx
Created
February 27, 2017 11:49
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| To collect 'Title' / 'Seller' / 'In Stock' | |
| 1. Click on the required text | |
| 2. Select More Options > Capture More Content 10 times (The objective here is to get the complete HTML source of the page) | |
| 3. Select More Options > Capture HTML | |
| 4. Select More Options > Apply Regular Expression. Paste any one of following RegEx string and Apply. | |
| id="productTitle">[\s]*([^<]*) | |
| by[\s\S]*?id="brand"[^>]*>[\s]*([^<]*) |
sysnucleus
/ gist:f91f8b8b84d918918b6857b3a7acff3a
Created
June 22, 2018 04:47
WebHarvy Amazon extraction regular expressions
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| src="([^_]*)_[^\.]*\.([^"]*) | |
| <div id="feature-bullets"[^>]*>([\s\S]*?)</div> |
sysnucleus
/ yellow pages egypt.js
Created
October 15, 2018 05:08
RegEx strings to extract listing name, telephone, website and address
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [\s]*(.*) | |
| tel: ([^"]*) | |
| title="Website"[\s\S]*?href="([^"]*) | |
| class="col-md-9 company_address"[^>]*>([^<]*) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| id="email"[\s\S]*?cell_value">([^<]*) | |
| id="phone_number"[\s\S]*?cell_value">([^<]*) |
sysnucleus
/ gist:84a0574cbf908813787d2d95b8a6c2ed
Created
August 20, 2020 13:22
JS code to configure pagination (scroll) in WebHarvy for Twitter scraping
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| groupEl = document.getElementsByTagName('article')[0].parentElement.parentElement.parentElement.parentElement; | |
| groupEl.children[groupEl.childElementCount-1].scrollIntoView(); |
sysnucleus
/ gist:436a2b0be80882f0ae61a391931abf5d
Created
August 31, 2020 13:55
RegEx strings to extract email, phone, website and address from yellowpages.com.au
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| data-email="([^"]*) | |
| tel:([^"]*) | |
| title="([^\s]*)\s*\(opens in a new window\) | |
| <p class="listing-address[^>]*>([^<]*) |
sysnucleus
/ tripadvisor
Created
September 3, 2020 03:51
Codes to extract reviewer submitted images from TripAdvisor using WebHarvy
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // RegEx to Follow links | |
| href="([^"]*) | |
| // More button click | |
| document.getElementsByClassName('moreBtn')[0].click(); | |
| // Get images block |