Skip to content

Instantly share code, notes, and snippets.

Avatar
:octocat:
Learn, unlearn and relearn.

Sayak Paul sayakpaul

:octocat:
Learn, unlearn and relearn.
View GitHub Profile
@sayakpaul
sayakpaul / feather-tf-poc-bytes.ipynb
Last active Jun 25, 2022
Demonstrates the compatibility between Feather and TensorFlow with a real dataset.
View feather-tf-poc-bytes.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@sayakpaul
sayakpaul / setup_big_vision_for_imagenet1k_training.md
Last active May 11, 2022
Notes for setting up a TPU v3-8 VM with `big_vision` for training on ImageNet-1k
View setup_big_vision_for_imagenet1k_training.md

Useful variables

export NAME="big_vision_exp"
export ZONE="us-central1-a"
export REGION="us-central1"
export GS_BUCKET_NAME="big_vision_exp"
View aritra_sayak_vit_works.md
Work Details
Augmenting convnets with aggregated attention Tutorial by Aritra
Train a Vision Transformer on small datasets Tutorial by Aritra
MobileViT Tutorial by Sayak
Compact Convolutional Transformers Tutorial by Sayak
Data efficient image transformers TF implementation, TF pre-trained models, tutorial by Sayak
Class attention image transformers TF implementation, TF pre-trained models by Sayak
Masked Autoencoders TF implementation, tutorial by Aritra and Sayak,
Contribution to Hugging Face Transformers by Aritra and Sayak
Probing the representation of ViTs
View deit_models.py
"""
Reference:
https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/deit.py
"""
import tensorflow as tf
from tensorflow.keras import layers
from .vit_models import ViTClassifier
View bucket-lengths.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
View beam_arxiv.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
View bing_downloader.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
View requirements.txt
pygments>=2.7.4
jinja2
markdown
requests
mdx_truly_sane_lists
sphinx~=3.0.3
black==19.10b0
pathlib
tensorflow-gpu==2.6.0
PyYAML
View new_etci_order_2.csv
0 redrivernorth_20190104t002247_x-0_y-0
1 redrivernorth_20190104t002247_x-0_y-1
2 redrivernorth_20190104t002247_x-0_y-10
3 redrivernorth_20190104t002247_x-0_y-11
4 redrivernorth_20190104t002247_x-0_y-2
5 redrivernorth_20190104t002247_x-0_y-3
6 redrivernorth_20190104t002247_x-0_y-4
7 redrivernorth_20190104t002247_x-0_y-5
8 redrivernorth_20190104t002247_x-0_y-6
9 redrivernorth_20190104t002247_x-0_y-7
View new_etci_order.csv
0 redrivernorth_20190104t002247_x-0_y-12
1 redrivernorth_20190104t002247_x-0_y-13
2 redrivernorth_20190104t002247_x-0_y-14
3 redrivernorth_20190104t002247_x-0_y-15
4 redrivernorth_20190104t002247_x-0_y-16
5 redrivernorth_20190104t002247_x-0_y-17
6 redrivernorth_20190104t002247_x-0_y-18
7 redrivernorth_20190104t002247_x-0_y-19
8 redrivernorth_20190104t002247_x-0_y-20
9 redrivernorth_20190104t002247_x-0_y-21