Skip to content

Instantly share code, notes, and snippets.

View MrMauricioLeite's full-sized avatar

Mauricio Romano Leite MrMauricioLeite

  • Mobly
  • Jundiaí - SP
View GitHub Profile
@omarish
omarish / Load_CSV_to_Vertica.md
Last active December 8, 2019 02:44
Quick primer on loading a large CSV file into a Vertica Database.

Load a Large CSV into Vertica

Here's an efficient way to load a dataset into Vertica by splitting it up into multiple pieces and then parallelizing the load process.

Note that this only makes sense if your Vertica cluster is a single node. If it's running more nodes, there are definitely more efficient ways of doing this.

For this example, the large CSV file will be called large_file.csv. If your file is under 1GB, it probably makes sense to load it using a single COPY command.