Usage: python parser.py --input /your/input/directory --output /your/output/directory --sleep 5 --step 500
Output example:
---
layout: 'single-product'
categories: 'SaksFifthAvenue-UK Kids Toys-and-Books'
merchantName: 'Saks Fifth Avenue - UK'
manufacturer_name: 'Janod'
sku_number: '0405148128850'
product_id: '110013244684007288214612306030'
name: 'Barbecue Trolley'
primary: 'Kids'
secondary: 'Toys and Books'
product: 'http://click.linksynergy.com/link?id=v3EaLjWOvJQ&offerid=268285.110013244684007288214612306030&type=15&murl=http%3A%2F%2Fwww.saksfifthavenue.com%2Fmain%2FProductDetail.jsp%3FFOLDER%253C%253Efolder_id%3D2534374306439561%26PRODUCT%253C%253Eprd_id%3D845524446623895'
productImage: 'http://image.s5a.com/is/image/saks/0405148128850_396x528.jpg'
short: 'Your budding chef will cook up a storm on this rolling barbecue trolley, complete with one magnetic spatula, one magnetic barbecue fork, one piece of pork, two sausages, one fish, three tomatoes and one piece of beef.;Wheeled bottom;12.8" X 12.8" X 17.3";Recommended for ages 18 months and up;Assembly required;Wood;Wipe clean;Imported'
long: 'Your budding chef will cook up a storm on this rolling barbecue trolley, complete with one magnetic spatula, one magnetic barbecue fork, one piece of pork, two sausages, one fish, three tomatoes and one piece of beef.;Wheeled bottom;12.8" X 12.8" X 17.3";Recommended for ages 18 months and up;Assembly required;Wood;Wipe clean;Imported'
currency: 'GBP'
type: 'amount'
sale: '65.91'
retail: '65.91'
brand: 'Janod'
information: '5 - 14 business days'
availability: 'in stock'
keywords: 'Janod'
pixel: 'http://ad.linksynergy.com/fs-bin/show?id=v3EaLjWOvJQ&bids=268285.110013244684007288214612306030&type=15&subid=0'
class_id: '60'
Misc: 'No'
Age: 'Adult'
---
I tested this out and it doesn't seem to get all of the info in each row. For each row I need something like this
/---
layout: single-product
merchantName: Saks Fifth Avenue
product_id: 110004345291240158904534387623
name: Bailey Weekender Bag
sku_number: 0415766562790
manufacturer_name: Storksak
part_number: 1689949378855549
primary: Kids
secondary: Baby (0 24 Months)~~Baby Bags
product: http://click.linksynergy.com/link?id=v3EaLjWOvJQ&offerid=268285.110004345291240158904534387623&type=15&murl=http%3A%2F%2Fwww.saksfifthavenue.com%2Fmain%2FProductDetail.jsp%3FFOLDER%253C%253Efolder_id%3D2534374306418231%26PRODUCT%253C%253Eprd_id%3D845524446685088
productImage: http://image.s5a.com/is/image/saks/0415766562790_396x528.jpg
short: A roomy, versatile tote in durable cotton canvas outfitted with all the necessities for moms on the go.;Double top handles, 8" drop;Adjustable shoulder strap, 16"-25" drop;Top zip closure;Two outside magnetic pockets;Two inside pockets;Three elasticized compartments;Changing pad;Wipe-clean canvas;11"W X 17.5"H X 6"D;Imported
long: A roomy, versatile tote in durable cotton canvas outfitted with all the necessities for moms on the go.;Double top handles, 8" drop;Adjustable shoulder strap, 16"-25" drop;Top zip closure;Two outside magnetic pockets;Two inside pockets;Three elasticized compartments;Changing pad;Wipe-clean canvas;11"W X 17.5"H X 6"D;Imported
currency: GBP
type: amount
sale: 164.77
retail: 164.77
brand: Storksak
information: 5 - 14 business days
availability: available
keywords: Storksak
pixel: http://ad.linksynergy.com/fs-bin/show?id=v3EaLjWOvJQ&bids=268285.110004345291240158904534387623&type=15&subid=0
class_ids: 60
misc: No
color: BLUE, CORAL
age: Kids
/---
btw I need the triple dash - - - on top and below