Skip to content

Instantly share code, notes, and snippets.

@ebsmothers
Created October 23, 2023 18:53
Show Gist options
  • Save ebsmothers/03ea9728df2e905a1ad52b1ca193f6c8 to your computer and use it in GitHub Desktop.
Save ebsmothers/03ea9728df2e905a1ad52b1ca193f6c8 to your computer and use it in GitHub Desktop.
_IncompatibleKeys(missing_keys=['classifier.model.0.weight', 'classifier.model.0.bias', 'classifier.model.3.weight', 'classifier.model.3.bias'], unexpected_keys=['image_codebook.encoder.blocks.input.w', 'image_codebook.encoder.blocks.input.b', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_1.block_1.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_1.block_2.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_2.block_1.id_path.w', 'image_codebook.encoder.blocks.group_2.block_1.id_path.b', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_2.block_1.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_2.block_2.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_3.block_1.id_path.w', 'image_codebook.encoder.blocks.group_3.block_1.id_path.b', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_3.block_1.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_3.block_2.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_4.block_1.id_path.w', 'image_codebook.encoder.blocks.group_4.block_1.id_path.b', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_4.block_1.res_path.conv_4.b', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_1.w', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_1.b', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_2.w', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_2.b', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_3.w', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_3.b', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_4.w', 'image_codebook.encoder.blocks.group_4.block_2.res_path.conv_4.b', 'image_codebook.encoder.blocks.output.conv.w', 'image_codebook.encoder.blocks.output.conv.b', 'loss.contrastive_loss.logit_scale', 'loss.mlm_loss.cls.bias', 'loss.mlm_loss.cls.dense.weight', 'loss.mlm_loss.cls.dense.bias', 'loss.mlm_loss.cls.layer_norm.weight', 'loss.mlm_loss.cls.layer_norm.bias', 'loss.mlm_loss.cls.decoder.weight', 'loss.mlm_loss.cls.decoder.bias', 'loss.mim_loss.cls.bias', 'loss.mim_loss.cls.dense.weight', 'loss.mim_loss.cls.dense.bias', 'loss.mim_loss.cls.layer_norm.weight', 'loss.mim_loss.cls.layer_norm.bias', 'loss.mim_loss.cls.decoder.weight', 'loss.mim_loss.cls.decoder.bias', 'loss.mmm_loss.mlm.cls.bias', 'loss.mmm_loss.mlm.cls.dense.weight', 'loss.mmm_loss.mlm.cls.dense.bias', 'loss.mmm_loss.mlm.cls.layer_norm.weight', 'loss.mmm_loss.mlm.cls.layer_norm.bias', 'loss.mmm_loss.mlm.cls.decoder.weight', 'loss.mmm_loss.mlm.cls.decoder.bias', 'loss.mmm_loss.mim.cls.bias', 'loss.mmm_loss.mim.cls.dense.weight', 'loss.mmm_loss.mim.cls.dense.bias', 'loss.mmm_loss.mim.cls.layer_norm.weight', 'loss.mmm_loss.mim.cls.layer_norm.bias', 'loss.mmm_loss.mim.cls.decoder.weight', 'loss.mmm_loss.mim.cls.decoder.bias', 'loss.itm_loss.pooler.dense.weight', 'loss.itm_loss.pooler.dense.bias', 'loss.itm_loss.cls.seq_relationship.weight', 'loss.itm_loss.cls.seq_relationship.bias'])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment