| {'Overall-Art and Design': {'num': 120, 'mmmu_acc': 0.25}, 'Art': {'num': 30, 'mmmu_acc': 0.333}, 'Art_Theory': {'num': 30, 'mmmu_acc': 0.233}, 'Design': {'num': 30, 'mmmu_acc': 0.167}, 'Music': {'num': 30, 'mmmu_acc': 0.267}, 'Overall-Business': {'num': 150, 'mmmu_acc': 0.233}, 'Accounting': {'num': 30, 'mmmu_acc': 0.4}, 'Economics': {'num': 30, 'mmmu_acc': 0.233}, 'Finance': {'num': 30, 'mmmu_acc': 0.167}, 'Manage': {'num': 30, 'mmmu_acc': 0.133}, 'Marketing': {'num': 30, 'mmmu_acc': 0.233}, 'Overall-Science': {'num': 150, 'mmmu_acc': 0.193}, 'Biology': {'num': 30, 'mmmu_acc': 0.267}, 'Chemistry': {'num': 30, 'mmmu_acc': 0.1}, 'Geography': {'num': 30, 'mmmu_acc': 0.2}, 'Math': {'num': 30, 'mmmu_acc': 0.233}, 'Physics': {'num': 30, 'mmmu_acc': 0.167}, 'Overall-Health and Medicine': {'num': 150, 'mmmu_acc': 0.227}, 'Basic_Medical_Science': {'num': 30, 'mmmu_acc': 0.3}, 'Clinical_Medicine': {'num': 30, 'mmmu_acc': 0.2}, 'Diagnostics_and_Laboratory_Medicine': {'num': 30, 'mmmu_acc': 0.133}, 'Pharmacy': {'num': |
Command:
podman run --security-opt=no-new-privileges --cap-drop=ALL --security-opt label=type:nvidia_container_t --hooks-dir=/usr/share/containers/oci/hooks.d/ -v /home/nihalani/Downloads/val2017:/images -v /home/nihalani/Downloads/cocoface/:/annotations --rm -it --ipc=host odtk:latest
Instructions: