Skip to content

Instantly share code, notes, and snippets.

@mehdidc

mehdidc/openclip_results.csv

Last active October 14, 2022 16:44
Show Gist options
  • Save mehdidc/c6ae62ffd4e21fdbc91f3ce743089002 to your computer and use it in GitHub Desktop.
Save mehdidc/c6ae62ffd4e21fdbc91f3ce743089002 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
openclip_results.csv
model_fullname model_fullname_pretty model_arch samples_seen gmacs_per_sample gmacs_total upstream_dataset downstream_dataset acc1 acc5 mean_per_class_recall image_retrieval_recall@5 text_retrieval_recall@5
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab+ 0.5654112282297443 0.8329414582676622 0.56279878057792
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/caltech101 0.8522353714661407 0.963346482577252 0.944284654839904
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B imagenet1k 0.76664 0.9485 0.76656
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/cifar100 0.8391 0.9729 0.8388
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B imagenetv2 0.6961 0.9086 0.6957000000000001
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B stl10 0.985875 0.99975 0.9864999999999998
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/diabetic_retinopathy 0.4342160768689946 1.0 0.2167811161586062
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B imagenet-a 0.5710666666666666 0.8348 0.5639196371233688
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/smallnorb_label_elevation 0.1134156378600823 0.5579423868312757 0.1146512139135114
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B renderedsst2 0.6457990115321252 0.6459400874297956
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/clevr_count_all 0.3319333333333333 0.9534 0.3193231509666999
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/flowers 0.7760611481541714 0.9046999512115792 0.7813275676765017
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B imagenet-r 0.8865 0.9695666666666668 0.8748158307459671
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/dtd 0.6813829787234043 0.925531914893617 0.6829787234042553
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B imagenet_sketch 0.6521841655367565 0.8748649020416986 0.6524090196078433
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B mscoco_captions 0.7239903807640076 0.853600025177002
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B flickr8k 0.7296255230903625 0.8460017442703247
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/smallnorb_label_azimuth 0.0588477366255144 0.268395061728395 0.0601925439678357
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B gtsrb 0.4973871733966746 0.7704671417260491 0.4655936453259506
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/pets 0.9427636958299264 0.9983646770237122 0.9434000102313552
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B voc2007_multilabel
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B objectnet 0.6746527403897922 0.8668030580381177 0.6650572756513145
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/resisc45 0.7171428571428572 0.958095238095238 0.7258469461953507
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/eurosat 0.647962962962963 0.9805555555555556 0.6445566610022502
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/clevr_closest_object_distance 0.1772666666666666 0.7803333333333333 0.2270014558851883
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/dsprites_label_x_position 0.035400390625 0.1624348958333333 0.0364155761076967
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B fgvc_aircraft 0.378037803780378 0.8028802880288028 0.3781639928698752
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B mnist 0.6904 0.9518 0.6833555055021581
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B flickr30k 0.9348000288009644 0.99099999666214
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/cifar10 0.9705 0.9994 0.9711
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/svhn 0.6033343577135832 0.8973570989551322 0.5683458085959752
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/kitti_closest_vehicle_distance 0.1462728551336146 0.1818997858588953
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/dmlab 0.1901913349461183 0.8472839234660215 0.1733383864929211
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/dsprites_label_orientation 0.0307752821180555 0.1437852647569444 0.0304426618193977
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B fer2013 0.4657286152131513 0.9445528002229032 0.4812190866355833
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B vtab/pcam 0.5509033203125 0.5508520491113902
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B sun397 0.7540228405391985 0.9617025580668296 0.7523924485563404
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B cars 0.9277453053102848 0.9983832856609874 0.9288577913034778
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B voc2007 0.8102964743589743 0.9655448717948718 0.8579252085748035
ViT-g-14 /fsx/rom1504/open_clip/good_models/g_90.pt g/14 2B ViT-g-14 12208147020 290.74 3549396664594.8003 LAION-2B country211 0.2872511848341232 0.542085308056872 0.2880094786729857
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab+ 0.5643146274147648 0.8362355507068666 0.5722016106049133
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B sun397 0.7521562425290105 0.9608106368501388 0.7512820500659019
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B fer2013 0.5175536361103371 0.9651713569239344 0.5055924943171644
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/eurosat 0.7174074074074074 0.9561111111111112 0.7202760268647987
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B gtsrb 0.5844813935075218 0.820744259699129 0.5442606899522975
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/cifar100 0.8468 0.9733 0.8471000000000001
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B voc2007_multilabel
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B imagenet1k 0.77972 0.95216 0.77952
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/pets 0.9438539111474517 0.9986372308530936 0.9434557685576204
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B renderedsst2 0.6408566721581549 0.6410094956864107
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B imagenet_sketch 0.665743087897188 0.8816640138340309 0.6655023529411764
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B voc2007 0.7761084401709402 0.9418402777777778 0.8508423918048074
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B imagenetv2 0.7082 0.9169 0.709
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B mscoco_captions 0.734306275844574 0.8604000210762024
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B cars 0.9345852505907224 0.9988807362268376 0.9351484667320789
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B mnist 0.7294 0.9415 0.7332910901261492
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/dsprites_label_orientation 0.0260687934027777 0.1259223090277778 0.0268337475785376
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/caltech101 0.8504273504273504 0.953155818540434 0.9440706929933655
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B stl10 0.984375 0.999875 0.9849999999999998
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/smallnorb_label_elevation 0.111275720164609 0.5548971193415638 0.1102182875784799
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/diabetic_retinopathy 0.2380126552613077 1.0 0.233320813717688
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/dsprites_label_x_position 0.0313856336805555 0.1553955078125 0.0307666564982354
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/dmlab 0.1419837255333186 0.8292060699362217 0.16573619863836
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/kitti_closest_vehicle_distance 0.1111111111111111 0.2722929936305732
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B flickr30k 0.9409999847412108 0.9929999709129332
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B imagenet-a 0.5922666666666667 0.8565333333333334 0.5810468077571583
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/svhn 0.5612707437000615 0.8849492931776275 0.5565312569182044
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/clevr_closest_object_distance 0.1676666666666666 0.8819333333333333 0.1954414937508546
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/resisc45 0.6957142857142857 0.9571428571428572 0.706242238089474
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B flickr8k 0.745371401309967 0.8561364412307739
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/clevr_count_all 0.2784 0.8929333333333334 0.2563239722391655
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/flowers 0.8020816392909416 0.9253537160513904 0.7985485908748879
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B objectnet 0.697049639280715 0.877516959190266 0.6846202591899297
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B imagenet-r 0.8932 0.9735333333333334 0.8804663010091829
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/pcam 0.53631591796875 0.53614377703907
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/dtd 0.6787234042553192 0.923936170212766 0.6813829787234043
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/smallnorb_label_azimuth 0.0549794238683127 0.2670781893004115 0.0559609415916413
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B vtab/cifar10 0.9742 0.9994 0.9742999999999998
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B fgvc_aircraft 0.4275427542754275 0.8361836183618362 0.4260962566844919
ViT-H-14 /fsx/rom1504/open_clip/good_models/h_256.pt H/14 2B ViT-H-14 34725395968 190.97 6631508868008.96 LAION-2B country211 0.3000947867298578 0.556872037914692 0.2994312796208531
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab+ 0.546345087664638 0.8199550143440342 0.5505264926886714
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab+ 0.5179729260464788 0.8024756513105532 0.522170731863021
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B gtsrb 0.5609659540775931 0.8069675376088677 0.5169427663206733
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/pets 0.9321340964840557 0.9978195693649496 0.9313974108097984
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/cifar10 0.9467 0.999 0.9466
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/dtd 0.6031914893617021 0.8867021276595745 0.6042553191489363
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B country211 0.2636018957345971 0.5149289099526067 0.2629857819905213
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M gtsrb 0.5 0.7502771179730799 0.4499584478173962
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/pcam 0.485626220703125 0.4856418903784925
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M flickr8k 0.6753677129745483 0.8063279986381531
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/flowers 0.758985200845666 0.8894129126687266 0.7455642498757189
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M mscoco_captions 0.6805678009986877 0.8216000199317932
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/smallnorb_label_elevation 0.1094650205761317 0.5571193415637861 0.1098932195729559
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/resisc45 0.6666666666666666 0.941904761904762 0.6759805529181834
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/svhn 0.4630454824830977 0.817340196681008 0.4869931863892911
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/dmlab 0.1856168902573125 0.82608313173521 0.1925396140565279
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/caltech101 0.8504273504273504 0.9681130834976988 0.9394300669046936
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M flickr30k 0.9082000255584716 0.977999985218048
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M imagenet1k 0.72734 0.9293 0.72694
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M fer2013 0.5009752020061299 0.932153803287824 0.449919123283142
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/diabetic_retinopathy 0.210639793766112 1.0 0.2335698910327324
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/clevr_count_all 0.2424666666666666 0.7876 0.2312503165591237
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B objectnet 0.6550016151609777 0.8503284160654678 0.6433184742666794
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/cifar100 0.7744 0.9471 0.7737999999999998
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/kitti_closest_vehicle_distance 0.2081575246132208 0.1791674645508319
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B imagenetv2 0.6769 0.9012 0.6781
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M voc2007 0.7555422008547008 0.9489182692307692 0.830992972154603
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M objectnet 0.5989555292344136 0.8103262625174976 0.586320244179702
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M renderedsst2 0.5634266886326195 0.5635892536622082
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B flickr8k 0.7120504379272461 0.8223952651023865
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/diabetic_retinopathy 0.0715256620576517 1.0 0.2196341124982623
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M country211 0.2307582938388625 0.4708056872037914 0.2308530805687204
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M sun397 0.7259778950659286 0.9500616069294004 0.7127784763377728
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M imagenet-a 0.4661333333333333 0.7688 0.4728184257301568
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/clevr_closest_object_distance 0.1486 0.9095333333333332 0.1443124682607226
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/dtd 0.6276595744680851 0.9069148936170212 0.6324468085106383
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M fgvc_aircraft 0.2505250525052505 0.6012601260126013 0.2483244206773618
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/resisc45 0.6730158730158731 0.938095238095238 0.6781338184038964
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B imagenet-a 0.5388 0.8212 0.5362716338708938
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/smallnorb_label_elevation 0.1097119341563786 0.5409053497942387 0.1081320376350696
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B voc2007 0.805221688034188 0.9551282051282052 0.8491537874687232
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/cifar100 0.8336 0.9666 0.8325000000000001
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/dsprites_label_orientation 0.0200330946180555 0.1053195529513889 0.0222572574909185
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/pcam 0.5526123046875 0.5526478181769814
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/flowers 0.7537811026183119 0.8923402179216132 0.7256696912813558
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/eurosat 0.6514814814814814 0.9551851851851852 0.6638062361650154
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M imagenet-r 0.8475333333333334 0.9550666666666666 0.8331685531673508
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B imagenet_sketch 0.6327693607655879 0.8639588123170037 0.6325447058823529
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M mnist 0.764 0.9231 0.7589335620721703
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B fgvc_aircraft 0.3693369336933693 0.744974497449745 0.3649286987522281
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B sun397 0.743319785938908 0.9583279695459478 0.7348385903018446
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B mnist 0.5487 0.8411 0.5430718178404617
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M voc2007_multilabel
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/dmlab 0.2242797448867385 0.8738508906971629 0.1816019549723685
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/kitti_closest_vehicle_distance 0.2292545710267229 0.3081761474014508
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B cars 0.9261285909712722 0.9976371098122124 0.9261518670531818
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B fer2013 0.537057676232934 0.9492894956812482 0.5338791359180816
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/svhn 0.381760909649662 0.7632913337430854 0.4057750407393451
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/eurosat 0.6177777777777778 0.957037037037037 0.6299267597724122
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/dsprites_label_x_position 0.0315348307291666 0.1596544053819444 0.0323590170008084
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/pets 0.9185064050149904 0.9956391387298992 0.9161666963118203
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B flickr30k 0.929199993610382 0.9869999885559082
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B voc2007_multilabel
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B imagenet1k 0.75202 0.94252 0.7526400000000001
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M cars 0.8959084690958836 0.9960203954732 0.8961635505798664
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/clevr_closest_object_distance 0.161 0.9128666666666668 0.1739135544326629
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/caltech101 0.841715976331361 0.940828402366864 0.9341112975275198
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M imagenet_sketch 0.5961406197803062 0.8388060288077973 0.5956784313725489
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/smallnorb_label_azimuth 0.0562962962962962 0.274156378600823 0.0567608380809354
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B stl10 0.988625 0.999875 0.988625
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/dsprites_label_x_position 0.0298394097222222 0.1414794921875 0.0308127750442299
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/clevr_count_all 0.3109333333333333 0.8006 0.3066391557930237
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B renderedsst2 0.5930807248764415 0.5925413265010712
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/smallnorb_label_azimuth 0.0516872427983539 0.2725925925925926 0.0526600212836742
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M imagenetv2 0.6559 0.8854 0.6541
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B imagenet-r 0.8741 0.9655666666666668 0.8599962924086103
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B mscoco_captions 0.7107957005500793 0.8399999737739563
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M vtab/dsprites_label_orientation 0.0257297092013888 0.1208224826388889 0.0259727501505128
ViT-L-14 laion400m_e32 L/14 400M ViT-L-14 13034626688 87.73 1143527799338.24 LAION-400M stl10 0.980125 0.999875 0.980875
ViT-L-14 /fsx/rwightman/epoch_160.pt L/14 2B ViT-L-14 32000000000 87.73 2807360000000.0 LAION-2B vtab/cifar10 0.9664 0.9987 0.9665
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab+ 0.4928579086091836 0.7795719444617056 0.5004366949742134
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M fer2013 0.4460852605182502 0.9469211479520758 0.3940612716631316
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/svhn 0.3628226797787339 0.6565765212046711 0.4033487053539641
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M fgvc_aircraft 0.1854185418541854 0.4452445244524452 0.1875846702317291
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M flickr8k 0.6441478133201599 0.7916203141212463
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/flowers 0.7105220361034315 0.8590014636526264 0.6857234783638442
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M sun397 0.6981352410026298 0.9398183055335896 0.6849982147927691
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/smallnorb_label_elevation 0.1080658436213991 0.5204115226337449 0.108510287776451
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M voc2007_multilabel
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M country211 0.1884360189573459 0.4163507109004739 0.1883412322274882
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M imagenetv2 0.6137 0.8644 0.6146999999999999
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/kitti_closest_vehicle_distance 0.2841068917018284 0.4076831334000694
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M imagenet1k 0.6909 0.91432 0.69156
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M stl10 0.96875 0.99975 0.9695
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/diabetic_retinopathy 0.1316147176001874 1.0 0.230780955782727
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M mnist 0.5699 0.8279 0.5675693520579019
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/cifar10 0.9272 0.9988 0.9272000000000002
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M renderedsst2 0.5782537067545305 0.5785203520352036
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M flickr30k 0.8894000053405762 0.9710000157356262
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M mscoco_captions 0.6620951890945435 0.8101999759674072
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/smallnorb_label_azimuth 0.0550617283950617 0.2645267489711934 0.055379474051494
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/pets 0.9037884982284 0.9970019078768056 0.9039815014388496
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/dsprites_label_x_position 0.0427924262152777 0.1601019965277778 0.0430371102717507
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/dsprites_label_orientation 0.0259874131944444 0.1214463975694444 0.0262399607702056
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M imagenet_sketch 0.5442040519562185 0.8052231327005837 0.5451807843137254
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M imagenet-r 0.8039 0.9392333333333334 0.7907448605291261
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M imagenet-a 0.3677333333333333 0.7024 0.3814206048810433
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/clevr_closest_object_distance 0.1594666666666666 0.8705333333333334 0.1702024394180443
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/caltech101 0.8328402366863905 0.952827087442472 0.9177765781998192
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M voc2007 0.7626201923076923 0.9526575854700856 0.815718996924191
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/pcam 0.543701171875 0.5435553179465629
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/eurosat 0.5796296296296296 0.9525925925925924 0.5888803943202612
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M objectnet 0.5381177990739744 0.7715085603531818 0.5274232792623416
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/resisc45 0.613015873015873 0.91 0.6150226494017114
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M cars 0.8441736102474816 0.9912946150976246 0.8456794155511405
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/cifar100 0.7372 0.9338 0.7372000000000001
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/dmlab 0.1485814822960193 0.8129316032548933 0.1482313831309264
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/clevr_count_all 0.2315333333333333 0.805 0.2332901934437162
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M vtab/dtd 0.5569148936170213 0.8558510638297873 0.5542553191489361
ViT-B-16-plus-240 laion400m_e32 B/16+ 400M ViT-B-16-plus 13034626688 28.41 370313744206.08 LAION-400M gtsrb 0.4948535233570863 0.7578780680918448 0.4319824074083427
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab+ 0.4839465731748074 0.7791486525764005 0.4879494537160219
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/pcam 0.605010986328125 0.605165824864527
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M flickr8k 0.6204919219017029 0.7667778730392456
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M gtsrb 0.4345209817893903 0.707680126682502 0.400638686800972
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/dtd 0.5132978723404256 0.7787234042553192 0.5095744680851063
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/cifar10 0.9172 0.9975 0.9172
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M mscoco_captions 0.6364254355430603 0.7961999773979187
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/dmlab 0.1508247195953375 0.8088849791071036 0.1720986035113953
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/clevr_count_all 0.2877333333333333 0.9075333333333332 0.2821869879006831
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M fer2013 0.4286709389802173 0.898300362217888 0.392124222029496
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M imagenet1k 0.67002 0.90424 0.67026
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M flickr30k 0.881600022315979 0.9679999947547911
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M renderedsst2 0.5469522240527183 0.5464163192635053
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M objectnet 0.5149133196941962 0.7512652094325402 0.5017005288059357
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M voc2007 0.7683627136752137 0.952590811965812 0.8035754023986389
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/cifar100 0.7101 0.9209 0.7106999999999999
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/kitti_closest_vehicle_distance 0.189873417721519 0.2568338943834677
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M country211 0.1812322274881516 0.4011374407582938 0.181563981042654
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/diabetic_retinopathy 0.087368174361378 1.0 0.2520359622114083
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/resisc45 0.5853968253968254 0.896984126984127 0.5932699170625959
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M fgvc_aircraft 0.1746174617461746 0.45004500450045 0.1753386809269162
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/clevr_closest_object_distance 0.2450666666666666 0.8254 0.1666666666666666
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M sun397 0.6960663515824705 0.9390183349577946 0.6804128851625355
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M imagenet-a 0.3318666666666666 0.6664 0.3409181030776702
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/smallnorb_label_elevation 0.0984362139917695 0.5293827160493827 0.0977694426163014
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M mnist 0.6659 0.9224 0.6665327286676481
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M imagenet-r 0.779 0.9289333333333334 0.7643246651538985
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/flowers 0.6929582045861116 0.8668076109936576 0.6668176645957112
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M voc2007_multilabel
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/svhn 0.3860633066994468 0.8061232329440688 0.3685311302620919
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M cars 0.8368362144011939 0.987439373212287 0.8375394945435981
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/pets 0.8923412373943854 0.9967293540474244 0.8919759072052595
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/eurosat 0.5031481481481481 0.92 0.5110567650187513
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/dsprites_label_x_position 0.0311008029513888 0.1568060980902778 0.0321637232587243
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M imagenet_sketch 0.5230010414824422 0.7913694511584036 0.5233670588235293
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/caltech101 0.8353057199211046 0.9546351084812624 0.9005042720791782
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/dsprites_label_orientation 0.0303819444444444 0.1311170789930555 0.0332405586865836
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M imagenetv2 0.5958 0.8547 0.5955999999999999
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M vtab/smallnorb_label_azimuth 0.0590123456790123 0.279835390946502 0.0603763349553147
ViT-B-16 laion400m_e32 B/16 400M ViT-B-16 13034626688 20.57 268122270972.16 LAION-400M stl10 0.96975 0.999875 0.96975
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab+ 0.4805518373033898 0.7779520355650965 0.48411302914666254
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab+ 0.4581281152133625 0.7567237368827066 0.45886858373649386
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/dmlab 0.1889597536837475 0.819793270288102 0.1681683759314615
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M flickr30k 0.8546000123023987 0.9409999847412108
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/kitti_closest_vehicle_distance 0.2883263009845288 0.3645688070267072
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/flowers 0.6828752642706131 0.8578630671653927 0.6628139602370955
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B fgvc_aircraft 0.2304230423042304 0.5295529552955296 0.2319696969696969
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M imagenetv2 0.5512 0.8156 0.5509
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/eurosat 0.5016666666666667 0.959074074074074 0.511474800858698
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B imagenet-r 0.7590333333333333 0.9128666666666668 0.7444515544684158
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/smallnorb_label_elevation 0.0972839506172839 0.5397530864197531 0.0973286727349915
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/dsprites_label_x_position 0.0293918185763888 0.150390625 0.0306791200330755
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B voc2007_multilabel
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/cifar100 0.7021 0.9244 0.703
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/eurosat 0.5155555555555555 0.9201851851851852 0.526225901185735
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/clevr_closest_object_distance 0.1593333333333333 0.9299333333333332 0.1673057808855792
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/caltech101 0.8310322156476002 0.9529914529914528 0.903296243135675
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B imagenetv2 0.5716 0.8386 0.5721
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/pcam 0.503753662109375 0.5035515136049098
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B mscoco_captions 0.6467413306236267 0.7950000166893005
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/dtd 0.5404255319148936 0.8398936170212766 0.5367021276595745
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M voc2007 0.7567441239316239 0.9461805555555556 0.7914514618991711
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/dsprites_label_x_position 0.0313313802083333 0.1560872395833333 0.031335128135504
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/cifar100 0.7524 0.9418 0.7528999999999999
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B imagenet-a 0.2618666666666667 0.5721333333333334 0.2839019082932269
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M imagenet_sketch 0.4932893159621922 0.7566861207726621 0.4940521568627451
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M imagenet1k 0.62918 0.87652 0.6289
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M cars 0.7920656634746922 0.9787339883099117 0.7926165075935756
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M country211 0.1469194312796208 0.3500473933649289 0.1470142180094787
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B imagenet_sketch 0.5293285385839769 0.78944369117098 0.5286741176470588
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B voc2007 0.7889957264957265 0.9573317307692308 0.8054447759101763
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B flickr8k 0.621826708316803 0.7605981826782227
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M gtsrb 0.4199524940617577 0.6838479809976247 0.393417229364651
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M voc2007_multilabel
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/cifar10 0.9401 0.9992 0.9405
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M imagenet-a 0.2166666666666666 0.5310666666666667 0.2348332752565157
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B mnist 0.6367 0.9218 0.6276012948452819
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/pets 0.8934314527119106 0.9956391387298992 0.8906060208128682
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M fer2013 0.4267205349679576 0.9361939258846476 0.3989364402674789
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M mscoco_captions 0.6084766387939453 0.7675999999046326
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/kitti_closest_vehicle_distance 0.1659634317862166 0.3247233185334074
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/dsprites_label_orientation 0.0193684895833333 0.1180826822916666 0.0197744129948227
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M mnist 0.3742 0.7294 0.3706020613065869
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/resisc45 0.546031746031746 0.902063492063492 0.5542849348347576
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/svhn 0.3852181929932391 0.7822295636140135 0.379296565517112
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/dsprites_label_orientation 0.0268283420138888 0.1092258029513889 0.025387675404758
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B stl10 0.9645 0.999375 0.965125
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/clevr_count_all 0.1633333333333333 0.7125333333333334 0.1575975877364315
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/pets 0.8683565004088307 0.9934587080948488 0.8661667839491306
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/caltech101 0.8328402366863905 0.94543063773833 0.9085289082247568
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/svhn 0.2786954517516902 0.7308312845728334 0.2795999671407248
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/diabetic_retinopathy 0.2699554722287321 1.0 0.2211405088000341
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M renderedsst2 0.5255354200988468 0.5258471570841294
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/pcam 0.545867919921875 0.5459467330999297
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/dtd 0.5430851063829787 0.8356382978723405 0.5473404255319149
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/resisc45 0.6174603174603175 0.921904761904762 0.624279367877562
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M stl10 0.955 0.9995 0.955375
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/smallnorb_label_azimuth 0.0517695473251028 0.2697942386831276 0.0537673960190341
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B flickr30k 0.8812000155448914 0.9639999866485596
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M objectnet 0.4393776246365888 0.684612899752342 0.4268760394558317
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/cifar10 0.9078 0.9977 0.9083
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/dmlab 0.1721574664614031 0.8585001099626127 0.1577427840925754
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M flickr8k 0.5787171125411987 0.7392163872718811
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/clevr_count_all 0.1979333333333333 0.8076 0.1820160989597282
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/clevr_closest_object_distance 0.1674 0.8695333333333334 0.1827530663763387
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B objectnet 0.487670937870141 0.7249919241951115 0.4750858280106649
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B renderedsst2 0.5370675453047776 0.5373060332349024
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B fer2013 0.4774310392867094 0.9402340484814712 0.4649079545536754
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M imagenet-r 0.7341666666666666 0.9035 0.7214778957504825
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/smallnorb_label_elevation 0.1087242798353909 0.540164609053498 0.1086253991970707
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B imagenet1k 0.65528 0.894 0.6563199999999999
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B country211 0.1650710900473933 0.3788625592417061 0.164218009478673
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M fgvc_aircraft 0.168016801680168 0.4119411941194119 0.1658110516934046
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/smallnorb_label_azimuth 0.0454320987654321 0.2672427983539094 0.0450240211431134
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B cars 0.8415619947767691 0.9900509886829996 0.8435641961196442
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M vtab/diabetic_retinopathy 0.337965783923131 1.0 0.2591163084325771
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B gtsrb 0.3651623119556611 0.7007917656373713 0.3512103003164681
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B sun397 0.684701252367729 0.9328576420177648 0.6783238400960281
ViT-B-32 laion2b_e16 B/32 2B ViT-B-32 34725396128 7.4 256967931347.2 LAION-2B vtab/flowers 0.6885672467067816 0.8466417303626605 0.6732279033655394
ViT-B-32-quickgelu laion400m_e32 B/32 400M ViT-B-32 13034626688 7.4 96456237491.20001 LAION-400M sun397 0.6696489324530592 0.9273222134358275 0.6609448269493161
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment