I became interested in string clustering through developing fpos, a set of Python scripts for graphing my spending habits. In a clear failure of research I missed the existance of libraries like:
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
const { google } = require('googleapis'); | |
const dataflow = google.dataflow('v1b3'); | |
const TEMPLATE_BUCKET = `your-bucket`; | |
module.exports.kickOffDataflow = async (event, event_description) => { // Check if the file was put in 'input/' folder | |
if (!event['id'].includes('/input/')){ | |
return | |
} | |
const input = 'gs://' + event['id'].split('/').slice(0, -1).join('/') | |
const jobName = `citiesonbigquery`; | |
const tmpLocation = `gs://${TEMPLATE_BUCKET}/tmp`; |