Skip to content

Instantly share code, notes, and snippets.

@Hironsan
Last active May 19, 2024 04:46
Show Gist options
  • Save Hironsan/1f1cc629613cbd7de042a7ce269b91d6 to your computer and use it in GitHub Desktop.
Save Hironsan/1f1cc629613cbd7de042a7ce269b91d6 to your computer and use it in GitHub Desktop.
@Hironsan
Copy link
Author

残念ながら、amazon_reviews_multiも公開停止になってしまいました。現時点では、SetFit/amazon_reviews_multi_jaから似たような形式のデータセットをダウンロードすることは可能です。

from datasets import load_dataset

dataset = load_dataset("SetFit/amazon_reviews_multi_ja")
dataset.set_format(type="pandas")
df = dataset["train"][:]
df.head()

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment