Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Average |
---|---|---|---|---|---|---|---|
mera-mix-4x7B-v1 | 46.67 | 69.64 | 39.65 | 46.78 | 68.27 | 2.73 | 45.62 |
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
arc_challenge | 1 | acc,none | 0.44 | ||
acc_stderr,none | 0.01 | ||||
acc_norm,none | 0.47 |
Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Average |
---|---|---|---|---|---|---|---|
mera-mix-4x7B-v1 | 46.67 | 69.64 | 39.65 | 46.78 | 68.27 | 2.73 | 45.62 |
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
arc_challenge | 1 | acc,none | 0.44 | ||
acc_stderr,none | 0.01 | ||||
acc_norm,none | 0.47 |
Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Average |
---|---|---|---|---|---|---|---|
mera-mix-4x7B | 72.01 | 88.82 | 63.67 | 77.45 | 84.61 | 71.65 | 76.37 |
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
arc_challenge | 1 | acc,none | 0.70 | ||
acc_stderr,none | 0.01 | ||||
acc_norm,none | 0.72 |
Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
---|---|---|---|---|---|---|
mera-mix-4x7B | 65.7 | 84.73 | Error: File does not exist | 51.03 | 79.48 | 66.34 |
Task | Version | Metric | Value | Stderr | |
---|---|---|---|---|---|
arc_challenge | 1 | acc,none | 0.62 | ||
acc_stderr,none | 0.01 | ||||
acc_norm,none | 0.66 |
Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
---|---|---|---|---|---|---|
mera-mix-4x7B | Error: File does not exist | Error: File does not exist | Error: File does not exist | Error: File does not exist | Error: File does not exist | Error: File does not exist |
Average: Error: File does not exist%
Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
---|---|---|---|---|---|---|
mera-mix-4x7B | Error: File does not exist | Error: File does not exist | Error: File does not exist | Error: File does not exist | Error: File does not exist | Error: File does not exist |
Average: Error: File does not exist%
struct node{ | |
int val; | |
struct node* next; | |
}; | |
/*@ | |
list<> == self=null or self::node<_,q> * q::list<>; | |
*/ | |
int length(struct node* p) |
struct node{ | |
int val; | |
struct node* next; | |
}; | |
/*@ | |
list<> == self=null or self::node<_,q> * q::list<>; | |
*/ | |
int length(struct node* p) |
default-src 'self'; font-src 'self' https://maxcdn.bootstrapcdn.com; form-action 'self'; frame-ancestors 'none'; report-uri https://report-uri.io/report/camjackson; script-src 'self' https://oss.maxcdn.com; style-src 'self' https://maxcdn.bootstrapcdn.com https://cdn.jsdelivr.net |
import java.lang.reflect.InvocationTargetException; | |
import java.lang.reflect.Method; | |
public class Reflection { | |
public static void vulnerableMethod() { | |
} | |
public void reflectVulnerableMethod() throws ClassNotFoundException, NoSuchMethodException, SecurityException, |
public class Main { | |
public static void main(String[] args) { | |
VulnerableClass a = new VulnerableClass(1); | |
VulnerableClass b = new VulnerableClass(2); | |
a.equals(b); | |
HarmlessClass ha = new HarmlessClass(1); | |
HarmlessClass hb = new HarmlessClass(2); | |
ha.equals(hb); | |
Object oa = new VulnerableClass(1); |