sayakpaul

Machine information

Parameter	Value
OS	Ubuntu 20.04.5
Python	3.8.10
CUDA	11.8
TensorFlow	2.10.1
TensorRT	8.5.1

sayakpaul

sayakpaul

sayakpaul

import tensorflow as tf
from tensorflow.keras import layers

model = tf.keras.Sequential([
	layers.Conv2D(32, kernel_size=(3, 3),activation='relu',
	layers.MaxPool2D((2, 2)),
	layers.Conv2D(64,kernel_size=(3, 3), activation='relu'),
	layers.MaxPool2D((2, 2)),
	layers.Dropout(0.2),
	layers.GlobalAveragePooling2D(),

sayakpaul

sayakpaul

sayakpaul

sayakpaul

sayakpaul

Useful variables

export NAME="big_vision_exp"
export ZONE="us-central1-a"
export REGION="us-central1"
export GS_BUCKET_NAME="big_vision_exp"

sayakpaul

Work	Details
Augmenting convnets with aggregated attention	Tutorial by Aritra
Train a Vision Transformer on small datasets	Tutorial by Aritra
MobileViT	Tutorial by Sayak
Compact Convolutional Transformers	Tutorial by Sayak
Data efficient image transformers	TF implementation, TF pre-trained models, tutorial by Sayak
Class attention image transformers	TF implementation, TF pre-trained models by Sayak
Masked Autoencoders	TF implementation, tutorial by Aritra and Sayak, Contribution to Hugging Face Transformers by Aritra and Sayak
Probing the representation of ViTs