Skip to content

Instantly share code, notes, and snippets.

View victorevector's full-sized avatar

Victor E F victorevector

View GitHub Profile
[
{
"name": "Fruits & Vegetables",
"aisle_path": "1255027787131",
"value": "1255027787131",
"uid": "UjiLSzje",
"children": [
{
"name": "Fresh Fruit",
"aisle_path": "1255027787131_1255027788181",
{
"finished":[
{
"date_from":"2019-09-10",
"date_to":null,
"frequency":"hourly",
"keywords":"[\"song\", \"NOT\", \"dance\", \"OR\", \"music\"]",
"schedule":85,
"target":"4chan"
},
2019-11-10 16:49:56 [scrapy.utils.log] INFO: Scrapy 1.7.3 started (bot: siscrapy)
2019-11-10 16:49:56 [scrapy.utils.log] INFO: Versions: lxml 4.4.1.0, libxml2 2.9.9, cssselect 1.1.0, parsel 1.5.2, w3lib 1.21.0, Twisted 19.7.0, Python 3.5.2 (default, Oct 8 2019, 13:06:37) - [GCC 5.4.0 20160609], pyOpenSSL 19.0.0 (OpenSSL 1.0.2g 1 Mar 2016), cryptography 2.7, Platform Linux-4.4.0-1090-aws-x86_64-with-Ubuntu-16.04-xenial
2019-11-10 16:49:56 [scrapy.crawler] INFO: Overridden settings: {'CONCURRENT_REQUESTS': 10, 'LOG_LEVEL': 'INFO', 'LOG_FORMATTER': 'siscrapy.pipelines.PoliteLogFormatter', 'NEWSPIDER_MODULE': 'siscrapy.spiders', 'SPIDER_MODULES': ['siscrapy.spiders'], 'LOG_FILE': '/etc/scrapyd/logs/siscrapy/4chanspider/125.log', 'BOT_NAME': 'siscrapy'}
2019-11-10 16:49:56 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.logstats.LogStats',
'scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.memusage.MemoryUsage']
2019-11-10 16:49:56 [scrapy.middleware] INFO: Enabled downloader middlew
@victorevector
victorevector / kroger_product_details.json
Created October 19, 2019 01:51
This is the JSON response that Kroger API returns when you request product details
{
"products": [
{
"brandName": "Reddi Wip",
"clickListItem": true,
"countryOfOrigin": null,
"customerFacingSize": "13 oz",
"description": "Reddi Wip Original Dairy Whipped Cream Topping",
"forceSize": null,
"homeDeliveryItem": true,
@victorevector
victorevector / sample_kroger_product_obj.json
Created October 19, 2019 01:49
This is how Kroger represents its product object
{
"brandName":"Reddi Wip",
"clickListItem":true,
"countryOfOrigin":null,
"customerFacingSize":"13 oz",
"description":"Reddi Wip Original Dairy Whipped Cream Topping",
"forceSize":null,
"homeDeliveryItem":true,
"images":[
{
@victorevector
victorevector / walmart_eggs_and_dairy.json
Last active October 19, 2019 01:46
This is the JSON response that Walmart API returns when you filter products by the "Egg and Dairy" category
{
"products": [
{
"USItemId": "11964942",
"offerId": "3CDF5359005946B8B42E69B9D9CF5A10",
"sku": "1015074",
"basic": {
"salesUnit": "Each",
"name": "COFFEE MATE French Vanilla Liquid Coffee Creamer 64 Fl. Oz. Bottle | Non-dairy, Lactose Free, Gluten Free Creamer",
"image": {
@victorevector
victorevector / sample_walmart_product_obj.json
Last active October 19, 2019 01:47
This is how Walmart represents its product object.
{
"USItemId": "23984452",
"offerId": "E5A1F0E0F32C4AFFB555CF01B6CF7B46",
"sku": "3000620874",
"basic": {
"salesUnit": "Each",
"name": "Chobani, Flip Almond Coco Loco Low-Fat Greek Yogurt, 5.3 oz",
"image": {
"thumbnail": "http://i5.walmartimages.com/asr/8b61b639-5192-43d1-87bf-2437bae95576_4.303607132d494c64bab184e3912d4661.jpeg?odnHeight=150&odnWidth=150&odnBg=ffffff"
},
@victorevector
victorevector / ethereum_101.md
Last active September 6, 2017 16:57
Ethereum explanation for Julian

Hi Julian,

I hope this helps to elucidate the inner workings of Ethereum. I have chosen to focus on 2 concepts: accounts and contracts. This should provie a platform on which to converse and grow our understanding. There are many more terms associated with the blockchain, such as cryptographic economics, tokens, protocols, etc. I'd be happy to discuss with these you if you're keen.

Accounts

First let's cover the concept of accounts. There are 2 types of accounts in ethereum: Contract and Externally Owned (EO) accounts. Both account types have 2 important features:

  1. An address
    1. The means by which accounts are identified on the blockchain. This makes it possible for accounts to communicate with each other.