Skip to content

Instantly share code, notes, and snippets.

@allienna
allienna / import_product_sets_function
Created November 9, 2020 20:47
Cloud Function to import product set with bulk import after catalog pushed on GCS
import os
import re
from google.cloud import vision
def call_product_search_vision_api(event, context):
if bool(re.search('output/product_sets-[\d]+-of-[\d]+\.csv', event['name'])):
gcs_uri = f'gs://{event["bucket"]}/{event["name"]}'
_import_product_sets(project_id=os.environ['GCP_PROJECT'], gcs_uri=gcs_uri)
@allienna
allienna / header
Created November 9, 2020 20:41
Product Set header
image-uri,image-id,product-set-id,product-id,product-category,product-display-name,labels,bounding-poly
@allienna
allienna / transform_catalog_to_product_set.py
Last active November 29, 2020 15:06
Transform catalog to product set and bulk import
import json
import logging
import re
from typing import Tuple
import apache_beam as beam
from apache_beam import Pipeline
from apache_beam.options.pipeline_options import PipelineOptions
from httplib2 import Http
@allienna
allienna / JsonPath to json schema
Last active September 21, 2018 07:39
Jsonpath to json schema requirement
I would like to generate a json schema from a list of jsonpath.
Example:
For this kind of input,
```
$.firstName
$.lastName
$.address.streetAddress
$.address.city
$.address.postalCode