create TFRecords
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
lumi dataset transform --type csv --data-dir data/ --output-dir tfdata/ --split train --split val --only-classes=table |
Hi @jyoti59n,
There is a problem with the given train.csv
and val.csv
files. The header rows are missing because of which you get the missing columns error(Check the _check_csv
function of the csv_reader in luminoth here).
Add the following to the first line of both the flies:
image_id,xmin,ymin,xmax,ymax,label
It should work after this change.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I'm unable to run the above luminoth script - trying to replicate the run on the same set of train/val images that you have used. I get the following message:
'Columns missing from CSV: {}'.format(missing_keys)
luminoth.tools.dataset.readers.base_reader.InvalidDataDirectory: Columns missing from CSV: {'xmin', 'ymax', 'xmax', 'image_id', 'label', 'ymin'}
Also notice that this error throws up for a random order of the csv columns for different runs. e.g. in an earlier run the message was
luminoth.tools.dataset.readers.base_reader.InvalidDataDirectory: Columns missing from CSV: {'xmax', 'ymin', 'image_id', 'xmin', 'ymax', 'label'}
Would you be able to suggest what I'm doing wrong here? Thanks.