Skip to content

Instantly share code, notes, and snippets.

@aravindpai

aravindpai/bpe_8.py

Last active May 22, 2020
Embed
What would you like to do?
#merge the frequent pair in corpus
corpus = merge_vocab(best, corpus)
print("After Merging:", corpus)
#convert a tuple to a string
best = "".join(list(best))
#append to merge list and vocabulary
merges = []
merges.append(best)
vocab.append(best)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment