Skip to content

Instantly share code, notes, and snippets.

@pablovv72

pablovv72/tokeniza.py

Last active February 19, 2018 00:54
Show Gist options
  • Save pablovv72/b27e53dca769ce2577b410cca4016957 to your computer and use it in GitHub Desktop.
Save pablovv72/b27e53dca769ce2577b410cca4016957 to your computer and use it in GitHub Desktop.
Download ZIP
tokeniza.py
Raw
tokeniza.py
def tokeniza(cadena):
"""Devuelve una lista de listas, siendo los elementos de estas ultimas las
palabras que aparecen en cada una de las lineas."""
return[linea.split() for linea in cadena.splitlines()]
print(tokeniza(
'Esta es la primera linea.\nEsta la segunda.\nEsta la tercera.'))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment