Skip to content

Instantly share code, notes, and snippets.

@cneill
Last active August 24, 2016 23:45
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save cneill/a511451284a0c5f33295477150bd94d4 to your computer and use it in GitHub Desktop.
Save cneill/a511451284a0c5f33295477150bd94d4 to your computer and use it in GitHub Desktop.

Top-Level

{
  "errors": [ ErrorObjects ],
  "failures": [ FailureObjects ],
  "stats": {
    "severity": {
      "HIGH": 0,
      "MEDIUM": 0,
      "LOW": 0,
      "UNDEFINED": 0
    }
  }
}

ErrorObject

{
  "error": "text",
  "test": "test"
}

FailureObject

{
  "url": "host.com/blah",
  "type": "500_error",
  "description": "500 errors r bad, mkay?",
  "failure_id": 1234,
  "instances": [
    {
      "confidence": "HIGH",
      "param": {
        "location": "headers",
        "method": "POST",
        "variables": [
          "Content-Type"
        ]
      },
      "strings": [
        "derp"
      ],
      "severity": "LOW",
      "signals": {
        "diff_signals": [],
        "init_signals": [],
        "test_signals": []
      }
    }
  ]
}
@rahulunair
Copy link

ccneill this look good.. way better.. , I have a question, do we need to have some sort of key: value for failures.. so that parsing them based on some identifier would be easier..?

@rahulunair
Copy link

rahulunair commented Aug 24, 2016

also , we can add the diff/comparison of SignalsHolders to the result as well.. i suppose..?

@cneill
Copy link
Author

cneill commented Aug 24, 2016

Updated to add "test_id" as a key

I think we can do without the separate SignalHolder diff for the moment; I think it's mostly useful for us to make our determinations about confidence, but since we print out the contents of both SignalHolders it's easy enough to see the differences yourself in the results at this point. We might update this if the list of signals gets too long to easily compare them though

@cneill
Copy link
Author

cneill commented Aug 24, 2016

Updated to use "failure_id" instead of "test_id"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment