sysnucleus
sysnucleus
/ gist:f91f8b8b84d918918b6857b3a7acff3a
Created
June 22, 2018 04:47
WebHarvy Amazon extraction regular expressions
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| src="([^_]*)_[^\.]*\.([^"]*) | |
| <div id="feature-bullets"[^>]*>([\s\S]*?)</div> |
sysnucleus
/ Amazon WebHarvy RegEx
Created
February 27, 2017 11:49
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| To collect 'Title' / 'Seller' / 'In Stock' | |
| 1. Click on the required text | |
| 2. Select More Options > Capture More Content 10 times (The objective here is to get the complete HTML source of the page) | |
| 3. Select More Options > Capture HTML | |
| 4. Select More Options > Apply Regular Expression. Paste any one of following RegEx string and Apply. | |
| id="productTitle">[\s]*([^<]*) | |
| by[\s\S]*?id="brand"[^>]*>[\s]*([^<]*) |
sysnucleus
/ Commonly used Regular Expressions
Last active
January 30, 2022 12:00
Commonly used Regular Expressions, with WebHarvy
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (.*) | |
| Selects only first line from a block of text or HTML | |
| [\s]*(.*) | |
| Selects first line, ignoring the starting white-spaces, (spaces, line feeds and carriage returns). | |
| [\s]* matches all white-spaces till the first view-able character. | |
| href=”([^”]*) | |
| Gets the href link/URL from HTML. [^”]* matches till the next " character. |
sysnucleus
/ Sample Text 1.txt
Created
November 17, 2016 11:50
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| The Man in the High Castle Kindle Edition | |
| by | |
| Philip K. Dick (Author) |
sysnucleus
/ Sample HTML with Email
Created
July 2, 2015 05:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <div class="call-to-action "> | |
| <a title="Email" class="contact contact-main contact-email " | |
| href="mailto:info@canberraeyelaser.com.au?subject=Enquiry%2C%20sent%20from%20yellowpages.com.au& | |
| body=%0A%0A%0A%0A%0A------------------------------------------%0AEnquiry%20via%20yellowpages.com.au%0Ahttp%3A%2F%2Fyellowpages.com.au%2Fact%2Fphillip%2Fcanberra-eye-laser-15333167-listing.html%3Fcontext%3DbusinessTypeSearch" | |
| rel="nofollow" data-email="info@canberraeyelaser.com.au"> | |
| <span class="glyph icon-email border border-dark-blue with-text"></span><span class="contact-text">Email</span> | |
| </a> | |
| </div> |
sysnucleus
/ Sample HTML with URL
Created
July 2, 2015 05:42
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <div class="call-to-action "> | |
| <a title="Website (opens in a new window)" | |
| class="contact contact-main contact-url " href="http://www.canberraeyelaser.com.au" target="_blank" rel="nofollow"> | |
| <span class="glyph icon-website border border-dark-blue with-text"></span><span class="contact-text">Website</span> | |
| </a> | |
| </div> |
sysnucleus
/ Sample HTML
Created
July 2, 2015 05:34
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <address> | |
| 356, Street Name, City, Country | |
| </address> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Product Details | |
| Price: 99$ | |
| This product comes with absolutely no warranty . . |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <KeywordList> | |
| <string>keyword1</string> | |
| <string>keyword2</string> | |
| <string>keyword3</string> | |
| <!-- More keyword strings as required --> | |
| </KeywordList> |
sysnucleus
/ WebHarvy Category List.xml
Last active
December 16, 2015 22:39
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <CategoryList> | |
| <URLDATA> | |
| <name>URL1</name> | |
| <url>http://www.url1.com</url> | |
| </URLDATA> | |
| <URLDATA> | |
| <name>URL2</name> | |
| <url>http://www.url2.com</url> | |
| </URLDATA> | |
| <URLDATA> |