Skip to content

Instantly share code, notes, and snippets.

@abhishek-shrm

abhishek-shrm/IR-W2V-1.py

Last active August 5, 2020 06:37
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save abhishek-shrm/4caea57ca577f43ddc297403c4e7d687 to your computer and use it in GitHub Desktop.
Save abhishek-shrm/4caea57ca577f43ddc297403c4e7d687 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
IR-W2V-1.py
!wget https://msmarco.blob.core.windows.net/msmarcoranking/msmarco-docs.tsv.gz
!wget https://msmarco.blob.core.windows.net/msmarcoranking/msmarco-doctrain-queries.tsv.gz
!wget https://msmarco.blob.core.windows.net/msmarcoranking/msmarco-doctrain-top100.gz
!gzip -d msmarco-docs.tsv.gz
!gzip -d msmarco-doctrain-queries.tsv.gz
!gzip -d msmarco-doctrain-top100.gz
import pandas as pd
import numpy as np
import dask.dataframe as dd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment