matthewchung74/snippet.py

Created February 5, 2021 23:46

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/matthewchung74/95412dd16bcdab3e59ab9c363d0c7974.js"></script>
Save matthewchung74/95412dd16bcdab3e59ab9c363d0c7974 to your computer and use it in GitHub Desktop.

Download ZIP

Raw

	x = self.patch_embed(x)
	cls_tokens = self.cls_token.expand(B, -1, -1)
	x = torch.cat((cls_tokens, x), dim=1)
	x = x + self.pos_embed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment