Skip to content

Instantly share code, notes, and snippets.

@h3xagn
Created May 7, 2022 12:51
Show Gist options
  • Save h3xagn/72c5d30cadb26f842f8c129fd5408eb6 to your computer and use it in GitHub Desktop.
Save h3xagn/72c5d30cadb26f842f8c129fd5408eb6 to your computer and use it in GitHub Desktop.
Build ETL from device to cloud: https://h3xagn.com
//one time export of dimension tables
.export async to table dimSiteEqmt <| meta_site_eqmt
.export async to table dimSystemTag <| meta_system_tag
//continuous export of data
.create-or-alter continuous-export ParquetExport over (raw_oil_data) to table factOilData
with
(intervalBetweenRuns=1h, sizeLimit=104857600)
<| raw_oil_data
| parse TagName with Site: string '.' System: string '.' EqmtIp: string '.' Tag: string
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment