Created
April 21, 2020 18:01
-
-
Save svanschalkwyk/6ae9dfe8db317495078e2b573efaa78a to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
<?xml version='1.0' encoding='UTF-8'?> | |
<docs> | |
<doc-add> | |
<reference>https://grocery.walmart.com/ip/Fresh-Raspberries-12-oz/44390957</reference> | |
<metadata> | |
<meta name="p_short_description">Relish in the sweet, light flavor of Fresh Raspberries. Enjoy them for breakfast, lunch, dinner, or dessert. Use them as topping for decadent chocolate cake, bake them in mouthwatering scones, or create a tangy sauce and serve it over a grilled salmon fillet, or puree them for a sweet jam. They contain essential vitamins and nutrients like, vitamin C, vitamin K, iron, and manganese making them perfect for a healthy diet. Prior to serving simply gently wash them with cool water and enjoy the fresh taste. Refrigerate the berries to keep them fresh and ready for use. Pick up Fresh Raspberries today and savor the delectable flavor.</meta> | |
<meta name="p_sku">3000213284</meta> | |
<meta name="p_features">Raspberries</meta> | |
<meta name="p_features">Relish in the sweet, light flavor of Fresh Raspberries. Enjoy them for breakfast, lunch, dinner, or dessert. Use them as topping for decadent chocolate cake, bake them in mouthwatering scones, or create a tangy sauce and serve it over a grilled salmon fillet, or puree them for a sweet jam. They contain essential vitamins and nutrients like, vitamin C, vitamin K, iron, and manganese making them perfect for a healthy diet. Prior to serving simply gently wash them with cool water and enjoy the fresh taste. Refrigerate the berries to keep them fresh and ready for use. Pick up Fresh Raspberries today and savor the delectable flavor.</meta> | |
<meta name="p_features">Fresh Raspberries, 12 oz: Best when enjoyed at room temperature Light, refreshing taste Healthy sweet treat Prior to serving gently wash them with cool water Refrigerate your berries in the original container to maintain freshness, they should approximately last 3-5 days after purchase Keep dry for optimal freshness</meta> | |
<meta name="p_ingredients">Raspberries</meta> | |
<meta name="p_meta_last_modified">Tue, 21 Apr 2020 17:37:10 GMT</meta> | |
<meta name="p_meta_content_location">https://grocery.walmart.com/ip/Fresh-Raspberries-12-oz/44390957</meta> | |
<meta name="p_images">https://i5.walmartimages.com/asr/eda41ad1-ca39-45df-ac28-9f2df375156d_1.9d270b612b7896e3a54f48fe48a72b59.jpeg?odnHeight=450&odnWidth=450&odnBg=FFFFFF</meta> | |
<meta name="p_images">https://i5.walmartimages.com/asr/bf7b9ce6-41b1-4c6f-bed2-ceb09b1ba1f2_1.434a48e239b369afbaeb641d9a2f94a1.jpeg?odnHeight=450&odnWidth=450&odnBg=FFFFFF</meta> | |
<meta name="p_images">https://i5.walmartimages.com/asr/61ed8972-bb7e-43fd-95e1-349e9787c2f2_1.6ebf3486dee42ce6827af32fe8bd84ab.jpeg?odnHeight=450&odnWidth=450&odnBg=FFFFFF</meta> | |
<meta name="p_name">NAME</meta> | |
<meta name="p_meta_description">Fresh Raspberries, 12 oz</meta> | |
<meta name="p_meta_referrer">https://grocery.walmart.com/ip/Fresh-Raspberries-12-oz/44390957</meta> | |
</metadata> | |
<content> | |
Skip to Main ContentReserve a time slot | |
FavoritesSign inShop by Department | |
Grilling | |
Savings Spotlight | |
Fruits & Vegetables | |
Meat & Seafood | |
Eggs & Dairy | |
Deli | |
Bread & Bakery | |
Pantry | |
Snacks & Candy | |
Beverages | |
Frozen | |
Organic Shop | |
Household Essentials | |
Health & Nutrition | |
Beauty & Personal Care | |
Baby | |
Pets | |
Party Supplies & Crafts | |
Home, Kitchen & Dine | |
Office & Electronics | |
Garden & Tools | |
Sports & Outdoor | |
Toys | |
Clothing | |
Customer Service | |
Contact UsFAQsLegal | |
Shop Walmart.comShop by Department | |
Shop Walmart.com | |
Hello, Sign inYour AccountFavorites | |
$000 | |
0 | |
We're working to fulfill as many orders as possible. Check time slot availability before starting your order. | |
Pickup from | |
Walmart Shrewsbury Store, 7437 Watson Road | |
Change | |
Looks like this is your nearest store. If that’s not right, change the location to check delivery availability and see prices and inventory in your area. | |
Got it! | |
Reserve a time slot | |
Let us do the shopping for you | |
See times | |
NEWWant to save on grocery delivery? | |
Fresh Raspberries, 12 oz | |
Carousel Page 1 of 3 | |
active | |
Carousel Page 2 of 3 | |
click here to move to this page | |
Carousel Page 3 of 3 | |
click here to move to this page | |
4 dollars and 48 cents$448 | |
unit price is 37 dollars and 3 cents per ounce37.3cents/OZ | |
Add to Cartin your cart | |
3000213284 | |
Details | |
Nutrition | |
Ingredients | |
Raspberries | |
Product features | |
Relish in the sweet, light flavor of Fresh Raspberries. Enjoy them for breakfast, lunch, dinner, or dessert. Use them as topping for decadent chocolate cake, bake them in mouthwatering scones, or create a tangy sauce and serve it over a grilled salmon fillet, or puree them for a sweet jam. They contain essential vitamins and nutrients like, vitamin C, vitamin K, iron, and manganese making them perfect for a healthy diet. Prior to serving simply gently wash them with cool water and enjoy the fresh taste. Refrigerate the berries to keep them fresh and ready for use. Pick up Fresh Raspberries today and savor the delectable flavor. | |
Fresh Raspberries, 12 oz: Best when enjoyed at room temperature | |
Light, refreshing taste | |
Healthy sweet treat | |
Prior to serving gently wash them with cool water | |
Refrigerate your berries in the original container to maintain freshness, they should approximately last 3-5 days after purchase | |
Keep dry for optimal freshness | |
Show more | |
Similar Products | |
2 dollars and 78 cents$278 | |
unit price is 46 dollars and 3 cents per ounce(46.3 cents/OZ) | |
Fresh Raspberries, 6 oz | |
Add to Cartin your cart | |
00665290002037 | |
3 dollars and 96 cents$396 | |
unit price is 66 dollars and 0 cents per ounce(66.0 cents/OZ) | |
Fresh Organic Raspberries, 6 oz | |
Add to Cartin your cart | |
00715756100040 | |
4 dollars and 56 cents$456 | |
unit price is 76 dollars and 0 cents per ounces(76.0 cents/OUNCES) | |
Organic Blueberries, 6oz | |
Add to Cartin your cart | |
00812049009209 | |
4 dollars and 24 cents$424 | |
unit price is 23 dollars and 6 cents per ounce(23.6 cents/OZ) | |
Fresh Blueberries, 18 oz | |
Add to Cartin your cart | |
00812049006604 | |
1 dollar and 98 cents$198 | |
unit price is 33 dollars and 0 cents per ounce(33.0 cents/OZ) | |
Fresh Blackberries, 6 oz | |
Add to Cartin your cart | |
00033383240268 | |
1 dollar and 73 cents$173 | |
unit price is 10 dollars and 8 cents per ounce(10.8 cents/OZ) | |
Fresh Strawberries, 1 lb | |
Add to Cartin your cart | |
00071430007525 | |
3 dollars and 46 cents$346 | |
unit price is 10 dollars and 8 cents per ounces(10.8 cents/OUNCES) | |
Fresh Strawberries, 2 lb | |
Add to Cartin your cart | |
00780353784047 | |
2 dollars and 68 cents$268 | |
unit price is 24 dollars and 4 cents per ounce(24.4 cents/OZ) | |
Fresh Blueberries, 11 oz, or 1 Pint | |
Add to Cartin your cart | |
00665290050434 | |
3 dollars and 16 cents$316 | |
unit price is 52 dollars and 7 cents per ounce(52.7 cents/OZ) | |
Fresh Organic Blackberries, 6 oz | |
Add to Cartin your cart | |
08554720020913 | |
3 dollars and 78 cents$378 | |
unit price is 31 dollars and 5 cents per ounce(31.5 cents/OZ) | |
Fresh Blackberries, 12 oz | |
Add to Cartin your cart | |
00033383240015 | |
3 dollars and 28 cents$328 | |
unit price is 20 dollars and 5 cents per ounce(20.5 cents/OZ) | |
Fresh Organic Strawberries, 1 lb | |
Add to Cartin your cart | |
00033383200385 | |
View Collection 1 | |
View Collection 2 | |
View Collection 3 | |
View Collection 4 | |
View Collection 5 | |
View Collection 6 | |
View Collection 7 | |
View Collection 8 | |
View Collection 9 | |
View Collection 10 | |
View Collection 11 | |
Disclaimer | |
While we strive to obtain accurate product information, we cannot guarantee or ensure the accuracy, completeness or timeliness of any product information. We recommend that you do not solely rely on the information presented on this website and that you always read labels, warnings, and directions and other information provided with the product before using or consuming a product. For additional information about a product, please contact the manufacturer. Walmart.com assumes no liability for inaccuracies or misstatements about products. Information and statements regarding dietary supplements have not been evaluated by the Food and Drug Administration and are not intended to diagnose, treat, cure or prevent any disease or health condition. Content on this website is for reference purposes only and is not intended to substitute for advice given by a physician, pharmacist or other licensed healthcare professional. You should not use this information as self-diagnosis or for treating a health problem or disease. Contact your health-care provider immediately if you suspect that you have a medical problem. | |
Show more | |
Electrode, Comp-692919785, DC-prod-dfw8, ENV-prod-alpha, PROF-PROD, VER-1.0.0-20200417_183430.a0e4ca189, SHA-a01f4e5630df1ac23feacf3be337de28c1b72a42, CID-63c225c0-7a6-1719dda9646dae | |
Customer Service | |
Help | |
Refunds | |
Recalls | |
Contact Us | |
Walmart Grocery | |
Corporate Website | |
Shop Walmart.com | |
Pickup Locations | |
Delivery Locations | |
Earn 5% back with the Walmart Credit Card | |
Tax Exempt Program | |
Your Account | |
Your Account Details | |
Your Orders | |
Legal | |
Privacy & Security | |
Terms of Use | |
Calif. Privacy Rights | |
Do not sell my personal information | |
Request my personal information | |
© 2020 Walmart. All Rights Reserved.Back to Top | |
<h4>JavaScript is Disabled</h4> | |
<p>Sorry, this webpage requires JavaScript to function correctly.</p> | |
<p>Please enable JavaScript in your browser and reload the page.</p> | |
</content> | |
</doc-add> | |
<doc-add> | |
<reference>https://grocery.walmart.com/ip/Asparagus-Bunch/44390952</reference> | |
<metadata> | |
<meta name="p_short_description">Provide your family with a healthy serving of nutritious vegetables when you serve up a steaming hot dish of Asparagus. This asparagus is loaded with nutrients and has a great fresh taste. This versatile vegetable can be prepared in a myriad of different ways. Saute the spears with olive oil, salt, pepper, and a hint of lemon juice for a healthy and flavorful vegetable side that will pair well with a wide array of main dishes. Add these asparagus spears to pasta, salads, casseroles, and other inventive meal options. You can even incorporate them into quiches and frittatas for brunch. Get creative in the kitchen while fueling your body with nutrient-dense vegetables when you bring home a bunch of Asparagus.</meta> | |
<meta name="p_sku">1022890</meta> | |
<meta name="p_features">ASPARAGUS ASPERGES</meta> | |
<meta name="p_features">Provide your family with a healthy serving of nutritious vegetables when you serve up a steaming hot dish of Asparagus. This asparagus is loaded with nutrients and has a great fresh taste. This versatile vegetable can be prepared in a myriad of different ways. Saute the spears with olive oil, salt, pepper, and a hint of lemon juice for a healthy and flavorful vegetable side that will pair well with a wide array of main dishes. Add these asparagus spears to pasta, salads, casseroles, and other inventive meal options. You can even incorporate them into quiches and frittatas for brunch. Get creative in the kitchen while fueling your body with nutrient-dense vegetables when you bring home a bunch of Asparagus.</meta> | |
<meta name="p_features">Asparagus, Bunch: Loaded with nutrients and have a great fresh taste Saute them with olive oil, salt, pepper, and a hint of lemon juice for a healthy and flavorful vegetable side that will pair well with a wide array of main dishes Get creative in the kitchen Add these asparagus spears to pasta, salads, casseroles, and other inventive meal options Add to quiches and frittatas for brunch</meta> | |
<meta name="p_features">About 1 X 5 Ct</meta> | |
<meta name="p_ingredients">ASPARAGUS ASPERGES</meta> | |
<meta name="p_meta_last_modified">Tue, 21 Apr 2020 17:38:47 GMT</meta> | |
<meta name="p_meta_content_location">https://grocery.walmart.com/ip/Asparagus-Bunch/44390952</meta> | |
<meta name="p_name">NAME</meta> | |
<meta name="p_meta_description">Asparagus, Bunch</meta> | |
<meta name="p_meta_referrer">https://grocery.walmart.com/ip/Asparagus-Bunch/44390952</meta> | |
</metadata> | |
<content> | |
Skip to Main ContentReserve a time slot | |
FavoritesSign inShop by Department | |
Grilling | |
Savings Spotlight | |
Fruits & Vegetables | |
Meat & Seafood | |
Eggs & Dairy | |
Deli | |
Bread & Bakery | |
Pantry | |
Snacks & Candy | |
Beverages | |
Frozen | |
Organic Shop | |
Household Essentials | |
Health & Nutrition | |
Beauty & Personal Care | |
Baby | |
Pets | |
Party Supplies & Crafts | |
Home, Kitchen & Dine | |
Office & Electronics | |
Garden & Tools | |
Sports & Outdoor | |
Toys | |
Clothing | |
Customer Service | |
Contact UsFAQsLegal | |
Shop Walmart.comShop by Department | |
Shop Walmart.com | |
Hello, Sign inYour AccountFavorites | |
$000 | |
0 | |
We're working to fulfill as many orders as possible. Check time slot availability before starting your order. | |
Pickup from | |
Walmart Shrewsbury Store, 7437 Watson Road | |
Change | |
Looks like this is your nearest store. If that’s not right, change the location to check delivery availability and see prices and inventory in your area. | |
Got it! | |
Reserve a time slot | |
Let us do the shopping for you | |
See times | |
NEWWant to save on grocery delivery? | |
Asparagus, Bunch | |
1 dollar and 98 cents$198 | |
unit price is 1 dollar and 98 cents per pound$1.98/LB | |
Final cost based on weight | |
Add to Cartin your cartFinal cost based on weight | |
1022890 | |
Details | |
Nutrition | |
Ingredients | |
ASPARAGUS ASPERGES | |
Product features | |
Provide your family with a healthy serving of nutritious vegetables when you serve up a steaming hot dish of Asparagus. This asparagus is loaded with nutrients and has a great fresh taste. This versatile vegetable can be prepared in a myriad of different ways. Saute the spears with olive oil, salt, pepper, and a hint of lemon juice for a healthy and flavorful vegetable side that will pair well with a wide array of main dishes. Add these asparagus spears to pasta, salads, casseroles, and other inventive meal options. You can even incorporate them into quiches and frittatas for brunch. Get creative in the kitchen while fueling your body with nutrient-dense vegetables when you bring home a bunch of Asparagus. | |
Asparagus, Bunch: Loaded with nutrients and have a great fresh taste | |
Saute them with olive oil, salt, pepper, and a hint of lemon juice for a healthy and flavorful vegetable side that will pair well with a wide array of main dishes | |
Get creative in the kitchen | |
Add these asparagus spears to pasta, salads, casseroles, and other inventive meal options | |
Add to quiches and frittatas for brunch | |
Net Quantity of Content | |
About 1 X 5 Ct | |
Show more | |
Similar Products | |
3 dollars and 33 cents$333 | |
unit price is 41 dollars and 6 cents per ounce(41.6 cents/OZ) | |
Birds Eye Steamfresh Asparagus Spears, Frozen Vegetable, 8 OZ | |
Add to Cartin your cart | |
1450001351 | |
Disclaimer | |
While we strive to obtain accurate product information, we cannot guarantee or ensure the accuracy, completeness or timeliness of any product information. We recommend that you do not solely rely on the information presented on this website and that you always read labels, warnings, and directions and other information provided with the product before using or consuming a product. For additional information about a product, please contact the manufacturer. Walmart.com assumes no liability for inaccuracies or misstatements about products. Information and statements regarding dietary supplements have not been evaluated by the Food and Drug Administration and are not intended to diagnose, treat, cure or prevent any disease or health condition. Content on this website is for reference purposes only and is not intended to substitute for advice given by a physician, pharmacist or other licensed healthcare professional. You should not use this information as self-diagnosis or for treating a health problem or disease. Contact your health-care provider immediately if you suspect that you have a medical problem. | |
Show more | |
Electrode, Comp-824260073, DC-prod-dfw01, ENV-prod-alpha, PROF-PROD, VER-1.0.0-20200417_183430.a0e4ca189, SHA-a01f4e5630df1ac23feacf3be337de28c1b72a42, CID-3a45470f-a0e-1719ddac8d23c4 | |
Customer Service | |
Help | |
Refunds | |
Recalls | |
Contact Us | |
Walmart Grocery | |
Corporate Website | |
Shop Walmart.com | |
Pickup Locations | |
Delivery Locations | |
Earn 5% back with the Walmart Credit Card | |
Tax Exempt Program | |
Your Account | |
Your Account Details | |
Your Orders | |
Legal | |
Privacy & Security | |
Terms of Use | |
Calif. Privacy Rights | |
Do not sell my personal information | |
Request my personal information | |
© 2020 Walmart. All Rights Reserved.Back to Top | |
<h4>JavaScript is Disabled</h4> | |
<p>Sorry, this webpage requires JavaScript to function correctly.</p> | |
<p>Please enable JavaScript in your browser and reload the page.</p> | |
</content> | |
</doc-add> | |
<doc-add> | |
<reference>https://grocery.walmart.com/ip/Beets-bunch/44391071</reference> | |
<metadata> | |
<meta name="p_sku">3000023700</meta> | |
<meta name="p_features">BEETS, RAW</meta> | |
<meta name="p_features">Beets Bunch</meta> | |
<meta name="p_ingredients">BEETS, RAW</meta> | |
<meta name="p_meta_last_modified">Tue, 21 Apr 2020 17:49:35 GMT</meta> | |
<meta name="p_meta_content_location">https://grocery.walmart.com/ip/Beets-bunch/44391071</meta> | |
<meta name="p_name">NAME</meta> | |
<meta name="p_meta_description">Beets, bunch</meta> | |
<meta name="p_meta_referrer">https://grocery.walmart.com/ip/Beets-bunch/44391071</meta> | |
</metadata> | |
<content> | |
Skip to Main ContentReserve a time slot | |
FavoritesSign inShop by Department | |
Grilling | |
Savings Spotlight | |
Fruits & Vegetables | |
Meat & Seafood | |
Eggs & Dairy | |
Deli | |
Bread & Bakery | |
Pantry | |
Snacks & Candy | |
Beverages | |
Frozen | |
Organic Shop | |
Household Essentials | |
Health & Nutrition | |
Beauty & Personal Care | |
Baby | |
Pets | |
Party Supplies & Crafts | |
Home, Kitchen & Dine | |
Office & Electronics | |
Garden & Tools | |
Sports & Outdoor | |
Toys | |
Clothing | |
Customer Service | |
Contact UsFAQsLegal | |
Shop Walmart.comShop by Department | |
Shop Walmart.com | |
Hello, Sign inYour AccountFavorites | |
$000 | |
0 | |
We're working to fulfill as many orders as possible. Check time slot availability before starting your order. | |
Pickup from | |
Walmart Shrewsbury Store, 7437 Watson Road | |
Change | |
Looks like this is your nearest store. If that’s not right, change the location to check delivery availability and see prices and inventory in your area. | |
Got it! | |
Reserve a time slot | |
Let us do the shopping for you | |
See times | |
NEWWant to save on grocery delivery? | |
Beets, bunch | |
2 dollars and 47 cents$247 | |
Add to Cartin your cart | |
3000023700 | |
Details | |
Nutrition | |
Ingredients | |
BEETS, RAW | |
Product features | |
Beets Bunch | |
Disclaimer | |
While we strive to obtain accurate product information, we cannot guarantee or ensure the accuracy, completeness or timeliness of any product information. We recommend that you do not solely rely on the information presented on this website and that you always read labels, warnings, and directions and other information provided with the product before using or consuming a product. For additional information about a product, please contact the manufacturer. Walmart.com assumes no liability for inaccuracies or misstatements about products. Information and statements regarding dietary supplements have not been evaluated by the Food and Drug Administration and are not intended to diagnose, treat, cure or prevent any disease or health condition. Content on this website is for reference purposes only and is not intended to substitute for advice given by a physician, pharmacist or other licensed healthcare professional. You should not use this information as self-diagnosis or for treating a health problem or disease. Contact your health-care provider immediately if you suspect that you have a medical problem. | |
Show more | |
Electrode, Comp-692917190, DC-prod-cdc01, ENV-prod-alpha, PROF-PROD, VER-1.0.0-20200417_183430.a0e4ca189, SHA-a01f4e5630df1ac23feacf3be337de28c1b72a42, CID-27a830cd-1b4-1719ddadf06a4a | |
Customer Service | |
Help | |
Refunds | |
Recalls | |
Contact Us | |
Walmart Grocery | |
Corporate Website | |
Shop Walmart.com | |
Pickup Locations | |
Delivery Locations | |
Earn 5% back with the Walmart Credit Card | |
Tax Exempt Program | |
Your Account | |
Your Account Details | |
Your Orders | |
Legal | |
Privacy & Security | |
Terms of Use | |
Calif. Privacy Rights | |
Do not sell my personal information | |
Request my personal information | |
© 2020 Walmart. All Rights Reserved.Back to Top | |
<h4>JavaScript is Disabled</h4> | |
<p>Sorry, this webpage requires JavaScript to function correctly.</p> | |
<p>Please enable JavaScript in your browser and reload the page.</p> | |
</content> | |
</doc-add> | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
https://grocery.walmart.com/ip/Fresh-Raspberries-12-oz/44390957 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
<?xml version="1.0" encoding="UTF-8" ?> | |
<!DOCTYPE xml> | |
<!-- | |
Copyright 2010-2017 Norconex Inc. | |
Licensed under the Apache License, Version 2.0 (the "License"); | |
you may not use this file except in compliance with the License. | |
You may obtain a copy of the License at | |
http://www.apache.org/licenses/LICENSE-2.0 | |
Unless required by applicable law or agreed to in writing, software | |
distributed under the License is distributed on an "AS IS" BASIS, | |
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | |
See the License for the specific language governing permissions and | |
limitations under the License. | |
--> | |
<!-- This configuration shows the minimum required and basic recommendations | |
to run a crawler. | |
--> | |
<httpcollector id="Minimum Config HTTP Collector"> | |
<!-- Decide where to store generated files. --> | |
<progressDir>./walmart/progress</progressDir> | |
<logsDir>./walmart/logs</logsDir> | |
<crawlers> | |
<crawler id="walmart Minimum"> | |
<httpClientFactory> | |
<cookiesDisabled>false</cookiesDisabled> | |
<trustAllSSLCertificates>true</trustAllSSLCertificates> | |
<connectionTimeout>10000</connectionTimeout> | |
<socketTimeout>10000</socketTimeout> | |
<headers> | |
<header name="Accept">text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8</header> | |
<header name="Accept-Language">en-US,en;q=0.9</header> | |
<header name="Cache-Control">no-cache</header> | |
<header name="Connection">keep-alive</header> | |
<header name="Pragma">no-cache</header> | |
<header name="Upgrade-Insecure-Requests">1</header> | |
<header name="User-Agent-Encoding">User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.75 Safari/537.36</header> | |
</headers> | |
</httpClientFactory> | |
<robotsTxt ignore="false" /> | |
<robotsMeta ignore="false" /> | |
<documentFetcher class="com.norconex.collector.http.fetch.impl.PhantomJSDocumentFetcher" detectContentType="true" detectCharset="true" screenshotEnabled="false"> | |
<exePath>/home/steph/Projects/norconex-collector-http-2.9.0/phantomjs/bin/phantomjs</exePath> | |
<renderWaitTime>15000</renderWaitTime> | |
<referencePattern>^https://grocery.walmart.com/.p/.*</referencePattern> | |
<validStatusCodes>200,302</validStatusCodes> | |
<!-- <screenshotDimensions>1024 x 768</screenshotDimensions> --> | |
</documentFetcher> | |
<documentFilters> | |
<filter class="com.norconex.collector.core.filter.impl.RegexReferenceFilter" onMatch="include">.*/ip/.*</filter> | |
</documentFilters> | |
<keepDownloads>false</keepDownloads> | |
<startURLs stayOnDomain="true" stayOnPort="true" stayOnProtocol="false"> | |
<url>https://grocery.walmart.com/cp/Fruits%20and%20Vegetables/1255027787131</url> | |
</startURLs> | |
<workDir>./walmart</workDir> | |
<maxDepth>-1</maxDepth> | |
<maxDocuments>-1</maxDocuments> | |
<sitemapResolverFactory ignore="true" /> | |
<delay default="1000" /> | |
<linkExtractors> | |
<extractor class="com.norconex.collector.http.url.impl.GenericLinkExtractor" ignoreNofollow="true"> | |
<extractSelector>#shoppingContent</extractSelector> | |
<extractSelector>div.js-content</extractSelector> | |
<tags> | |
<tag name="a" attribute="href" /> | |
<tag name="frame" attribute="src" /> | |
<tag name="iframe" attribute="src" /> | |
<tag name="img" attribute="src" /> | |
<tag name="meta" attribute="http-equiv" /> | |
<tag name="script" attribute="src" /> | |
</tags> | |
</extractor> | |
</linkExtractors> | |
<importer> | |
<preParseHandlers> | |
<tagger class="com.norconex.importer.handler.tagger.impl.DOMTagger" parser="html"> | |
<dom selector="body" toField="p_main" extract="outerHtml" /> | |
</tagger> | |
<tagger class="com.norconex.importer.handler.tagger.impl.DOMTagger" parser="html"> | |
<dom toField="p_serving_size" selector="[class^=NutritionFacts__ssRowTwo]" extract="text" /> | |
<dom toField="p_servings_per" selector="[class^=NutritionFacts__ssRowOne]" extract="text" /> | |
<dom toField="p_calories" selector="span.NutritionFacts__calories___vQPc7" extract="html" /> | |
<dom toField="p_nutrition_table" selector="[class^=NutritionFacts__nutrientTable___]" extract="html" /> | |
<dom toField="p_price_per" selector="span.ProductPage__pricePerUnitOG___7fJIU" extract="html" /> | |
</tagger> | |
<tagger class="com.norconex.importer.handler.tagger.impl.DOMTagger" parser="html"> | |
<dom toField="p_name" selector="[class^=ProductPage__title___]" extract="text" defaultValue="NAME" /> | |
<dom toField="p_price" selector=".Price__salePrice___3YEJa.Price__salePriceItemDetail___3zgGh" extract="text" /> | |
<dom toField="p_ingredients" selector="[data-automation-id=ingredients] div" extract="text" /> | |
<dom toField="p_similar_products" selector=".productTile__productTileImageLink___1k1Vd" extract="attr(href)" /> | |
<dom toField="p_images" selector="img.prod-HeroImageCarousel-image" extract="attr(src)" /> | |
<dom toField="p_sku" selector=".productTile__details___3lfva .productTile__hiddenSku___fT5S0" extract="html" /> | |
<dom toField="p_features" selector=".ProductAttribute__value2___1VnqJ" extract="text" /> | |
<dom toField="p_short_description" selector="[data-automation-id=productAttributeShortDescription]" extract="text" /> | |
</tagger> | |
<tagger class="com.norconex.importer.handler.tagger.impl.ConstantTagger" onConflict="add"> | |
<restrictTo caseSensitive="false" field="p_similar_products"> | |
.* | |
</restrictTo> | |
<constant name="source">https://grocery.walmart.com</constant> | |
</tagger> | |
</preParseHandlers> | |
<postParseHandlers> | |
<!-- Add "apple" to a "fruit" metadata field: --> | |
<!-- <tagger class="com.norconex.importer.handler.tagger.impl.ScriptTagger" engineName="lua"> | |
<script><![CDATA[metadata:addString('p_similar_products', {'apple'}); | |
]]></script> | |
</tagger> | |
--> | |
<!-- <tagger class="com.norconex.importer.handler.tagger.impl.MergeTagger"> | |
<merge toField="p_similar_products" deleteFromFields="false" singleValue="false" singleValueSeparator=""> | |
<fromFields>source,p_similar_products</fromFields> | |
</merge> | |
</tagger> | |
--> | |
<!-- <transformer class="com.norconex.importer.handler.transformer.impl.ReplaceTransformer"> | |
<restrictTo caseSensitive="false" field="p_similar_products"> | |
.* | |
</restrictTo> | |
<replace> | |
<fromValue>^\/ip\/.*</fromValue> | |
<toValue>https://grocery.walmart.com/ip/</toValue> | |
</replace> | |
</transformer> | |
--> | |
<!-- <transformer class="com.norconex.importer.handler.transformer.impl.ReplaceTransformer"> | |
<replace> | |
<fromValue>\n</fromValue> | |
<toValue>" "</toValue> | |
</replace> | |
</transformer> | |
--> | |
<transformer class="com.norconex.importer.handler.transformer.impl.ReduceConsecutivesTransformer"> | |
<reduce>\n</reduce> | |
</transformer> | |
<tagger class="com.norconex.importer.handler.tagger.impl.CopyTagger"> | |
<copy fromField="description" toField="p_meta_description" overwrite="true" /> | |
<copy fromField="document.reference" toField="p_meta_referrer" overwrite="true" /> | |
<copy fromField="Last-Modified" toField="p_meta_last_modified" overwrite="true" /> | |
<copy fromField="Content-Location" toField="p_meta_content_location" overwrite="true" /> | |
</tagger> | |
<tagger class="com.norconex.importer.handler.tagger.impl.FieldReportTagger" maxSamples="2" file="./walmart/field-report.csv" /> | |
<!-- If your target repository does not support arbitrary fields, | |
make sure you only keep the fields you need. --> | |
<tagger class="com.norconex.importer.handler.tagger.impl.KeepOnlyTagger"> | |
<fields> | |
p_name,p_price,p_price_per, | |
p_ingredients,p_similar_products,p_images, | |
p_sku,p_features, | |
p_short_description, | |
p_serving_size,p_servings_per,p_calories, | |
p_nutrition_table, | |
p_meta_description, | |
p_meta_referrer, | |
p_meta_last_modified, | |
p_meta_content_location | |
</fields> | |
</tagger> | |
</postParseHandlers> | |
</importer> | |
<!-- | |
<committer class="com.norconex.committer.elasticsearch.ElasticsearchCommitter"> | |
<nodes>http://localhost:9200</nodes> | |
<indexName>...</indexName> | |
<typeName>...</typeName> | |
<sourceReferenceField>p_meta_referrer</sourceReferenceField>> | |
<targetContentField>content</targetContentField> | |
</committer> | |
--> | |
<committer class="com.norconex.committer.core.impl.XMLFileCommitter"> | |
<directory>./walmart/xml</directory> | |
<pretty>true</pretty> | |
<docsPerFile>1000</docsPerFile> | |
<compress>false</compress> | |
<splitAddDelete>true</splitAddDelete> | |
</committer> | |
</crawler> | |
</crawlers> | |
</httpcollector> |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment