Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
from transformers import pipeline
pipe = pipeline("image-classification", model=model, feature_extractor=feature_extractor, device=-1)
for batch_size in [1, 8, 32, 64, 128]:
print("-" * 30)
print(f"Streaming batch_size={batch_size}")
for out in tqdm(pipe(dataset, batch_size=batch_size), total=len(dataset)):
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment