create TFRecords

create_records.sh

lumi dataset transform --type csv --data-dir data/ --output-dir tfdata/ --split train --split val --only-classes=table

Hi,

I'm unable to run the above luminoth script - trying to replicate the run on the same set of train/val images that you have used. I get the following message:

'Columns missing from CSV: {}'.format(missing_keys)
luminoth.tools.dataset.readers.base_reader.InvalidDataDirectory: Columns missing from CSV: {'xmin', 'ymax', 'xmax', 'image_id', 'label', 'ymin'}

Also notice that this error throws up for a random order of the csv columns for different runs. e.g. in an earlier run the message was
luminoth.tools.dataset.readers.base_reader.InvalidDataDirectory: Columns missing from CSV: {'xmax', 'ymin', 'image_id', 'xmin', 'ymax', 'label'}

Would you be able to suggest what I'm doing wrong here? Thanks.

Hi @jyoti59n,

There is a problem with the given train.csv and val.csv files. The header rows are missing because of which you get the missing columns error(Check the _check_csv function of the csv_reader in luminoth here).

Add the following to the first line of both the flies:

image_id,xmin,ymin,xmax,ymax,label

It should work after this change.