Skip to content

Instantly share code, notes, and snippets.

Created April 21, 2022 15:43
What would you like to do?
Code to soup two models in pytorch
def soup_two_models(model, second_model):
souped_model = copy.deepcopy(model)
for param in souped_model.named_parameters():
name = param[0]
param[1].data = (model.state_dict()[name] + second_model.state_dict()[name]) / 2
return souped_model
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment