psuedo bin code yo

gistfile1.txt

START

    id   keyword
    --------------
    123  acid and base
    456  acid and bases
    567  acids and bases
    890  koalas

END

    id   keyword
    --------------
    123  acid and base
    890  koalas

### PSEUDO STUFF

shortestItems = {}

For each record in table:

  parts = record.keywords.split(" ")
  newparts = []
  for each part in parts
    newparts << part.stem
  end
  stem = newparts.join(" ")

  if shortestItems[stem] does not exist
    shortestItems[stem] = record
  else
    if record.keywords.length < shortestItems[stem].keywords.length
      DELETE FROM DATABASE shortestItems[stem].id
      shortestItems[stem] = record
    else
      DELETE FROM DATABASE record.id
    end
  end

End