sysnucleus
sysnucleus
/ Sample Text 1.txt
Created
November 17, 2016 11:50
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| The Man in the High Castle Kindle Edition | |
| by | |
| Philip K. Dick (Author) |
sysnucleus
/ gist:f91f8b8b84d918918b6857b3a7acff3a
Created
June 22, 2018 04:47
WebHarvy Amazon extraction regular expressions
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| src="([^_]*)_[^\.]*\.([^"]*) | |
| <div id="feature-bullets"[^>]*>([\s\S]*?)</div> |
sysnucleus
/ yellow pages egypt.js
Created
October 15, 2018 05:08
RegEx strings to extract listing name, telephone, website and address
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [\s]*(.*) | |
| tel: ([^"]*) | |
| title="Website"[\s\S]*?href="([^"]*) | |
| class="col-md-9 company_address"[^>]*>([^<]*) |
sysnucleus
/ WebHarvy XML DataField
Last active
January 13, 2020 05:13
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <DATAFIELD> | |
| <type>Text</type> | |
| <name>Name</name> | |
| <selector> | |
| #hotellist_inner > DIV:nth-of-type(02) > DIV:nth-of-type(2) > DIV:nth-of-type(1) > DIV:nth-of-type(1) > DIV:nth-of-type(1) > H3 > A > SPAN:nth-of-type(1) | |
| </selector> | |
| <heading /> | |
| <pattern>true</pattern> | |
| <regex /> | |
| </DATAFIELD> |
sysnucleus
/ gist:84a0574cbf908813787d2d95b8a6c2ed
Created
August 20, 2020 13:22
JS code to configure pagination (scroll) in WebHarvy for Twitter scraping
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| groupEl = document.getElementsByTagName('article')[0].parentElement.parentElement.parentElement.parentElement; | |
| groupEl.children[groupEl.childElementCount-1].scrollIntoView(); |
sysnucleus
/ gist:436a2b0be80882f0ae61a391931abf5d
Created
August 31, 2020 13:55
RegEx strings to extract email, phone, website and address from yellowpages.com.au
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| data-email="([^"]*) | |
| tel:([^"]*) | |
| title="([^\s]*)\s*\(opens in a new window\) | |
| <p class="listing-address[^>]*>([^<]*) |
sysnucleus
/ tripadvisor
Created
September 3, 2020 03:51
Codes to extract reviewer submitted images from TripAdvisor using WebHarvy
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // RegEx to Follow links | |
| href="([^"]*) | |
| // More button click | |
| document.getElementsByClassName('moreBtn')[0].click(); | |
| // Get images block |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| els = document.getElementsByTagName('span'); | |
| for (var i = els.length - 1; i >= 0; i--) { | |
| if(els[i].innerText === 'Read more') { | |
| els[i].click(); | |
| } | |
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <MinerOptions> | |
| <MinLevelsUp>2</MinLevelsUp> | |
| <MinChildCount>10</MinChildCount> | |
| <SelAccuracy>2</SelAccuracy> | |
| </MinerOptions> |
sysnucleus
/ WebHarvy XML Version Info
Last active
September 9, 2021 02:46
WebHarvy XML Version Info
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <VersionInfo>6.3.0.189</VersionInfo> | |
| <RegInfo>SysNucleus</RegInfo> |