Skip to content

Instantly share code, notes, and snippets.

@nofreewill42
Last active September 4, 2020 04:38
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nofreewill42/84d9fb31d06d123879143f8b3699f1c3 to your computer and use it in GitHub Desktop.
Save nofreewill42/84d9fb31d06d123879143f8b3699f1c3 to your computer and use it in GitHub Desktop.
SimCLR self-supervised pre-training
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@nofreewill42
Copy link
Author

nofreewill42 commented Mar 16, 2020

After pre-training for 50 epochs on ImageNet, I got 92% accuracy on ImageNette with the same training settings.

The first filters the network came up with:

Screenshot from 2020-03-16 08-30-48

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment