armenzg

{
    "scopes": [
        "queue:define-task:buildbot-bridge/buildbot-bridge", 
        "queue:route:tc-treeherder.try.a904ceceacd413be16a524f5c1cb7bcd15dcec5f", 
        "queue:route:tc-treeherder-stage.try.a904ceceacd413be16a524f5c1cb7bcd15dcec5f"
    ], 
    "tasks": [
        {
            "task": {
                "workerType": "buildbot-bridge", 

armenzg

{
    "scopes": [
        "queue:define-task:buildbot-bridge/buildbot-bridge", 
        "queue:route:tc-treeherder.try.a904ceceacd413be16a524f5c1cb7bcd15dcec5f", 
        "queue:route:tc-treeherder-stage.try.a904ceceacd413be16a524f5c1cb7bcd15dcec5f"
    ], 
    "tasks": [
        {
            "reruns": 0, 
            "taskId": "qJ8wKhOHQp2CK5WxZsze8w", 

armenzg

virtualenv -p `which python` --no-site-packages ~/venv/fx_ui_tests
source ~/venv/fx_ui_tests/bin/activate
python setup.py develop

(fx_ui_tests)armenzg@armenzg-thinkpad:~/repos/firefox-ui-tests$ pip freeze
You are using pip version 7.1.0, however version 7.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
blessings==1.6
browsermob-proxy==0.7.1
-e git+https://github.com/armenzg/firefox-ui-tests.git@b196f5bdd3445e8599089fee5a00bcfd7391ada0#egg=firefox_ui_tests-master

armenzg

GLOBAL_VARIABLE = None

def foo():
  global GLOBAL_VARIABLE # This allows setting a variable outside of this method
  
  if GLOBAL_VARIABLE is None:
    GLOBAL_VARIABLE = "value:
  else:
    return GLOBAL_VARIABLE

armenzg

{
  "message": "Internal Server Error",
  "error": {
    "info": "Ask administrator to lookup incidentId in log-file",
    "incidentId": "f8a6fe3b-3a82-4e2e-9a8a-a4db258b9d84"
  }
}

armenzg

diff --git a/pulse_actions/worker.py b/pulse_actions/worker.py
index 2194e0b..a9ceabd 100644
--- a/pulse_actions/worker.py
+++ b/pulse_actions/worker.py
@@ -59,6 +59,7 @@ def run_pulse(exchanges, topics, event_handler, topic_base, dry_run):
     def handler_with_dry_run(data, message):
         # Skip heartbeats until current issue is gone
         if data.get('payload') and data['payload'].get('what') == 'This is a heartbeat':
+            message.ack()
             return

armenzg

value={
echo "R"
exit 1
echo "5"
#exit_code=0
#return 0
} 2>&1 | tee my_file.txt

armenzg

Is there anything on your end that can be done to improve the situation?
We're going to improve our set up, however, it used to work before the outage in August.
Has it been investigated if the new hardware or APIs are under-performing?
The last hop shows a 14% [1] to 27% [2]packet loss. That is very bad in itself.

Can you use please use AWS's east coast region? It would cut 40ms from ord to sjc.
Or do you have a collocation?

[1]
 18  134ms    24/ 100 = 24%     0/ 100 =  0%  ...

armenzg

 Oct 29 00:26:49 pulse-actions app/worker1.1: mozci	 INFO:	 BACKFILL-END:80bcd16f_Ubuntu VM 12.04 x64 mozilla-inbound debug test media-tests will backfill [u'80bcd16f00ab']. 
Oct 29 00:28:08 pulse-actions app/worker1.1: mozci	 INFO:	 BACKFILL-END:593bccc5_Ubuntu VM 12.04 x64 mozilla-inbound pgo test web-platform-tests-e10s-4 will backfill [u'593bccc56191']. 
Oct 29 00:30:53 pulse-actions app/worker1.1: mozci	 INFO:	 BACKFILL-END:b4c32383_Ubuntu VM 12.04 x64 mozilla-inbound debug test web-platform-tests-e10s-3 will backfill [u'b4c323832f31']. 
Oct 29 00:33:43 pulse-actions app/worker1.1: mozci	 INFO:	 BACKFILL-END:4ffc022c_Ubuntu VM 12.04 mozilla-inbound opt test mochitest-e10s-devtools-chrome-4 will backfill [u'4ffc022ce436', u'e8610a7c6b3e']. 
Oct 29 00:34:53 pulse-actions app/worker1.1: mozci	 INFO:	 BACKFILL-END:f4ad9da5_Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-push will backfill [u'f4ad9da5ed94']. 
Oct 29 00:36:20 pulse-actions app/worker1.1: mozci	 INFO:	 BACKFILL-END:b4c32383_Ubuntu VM 1

armenzg

{
    "scopes": [
        "queue:define-task:buildbot-bridge/buildbot-bridge", 
        "scheduler:create-task-graph"
    ], 
    "tasks": [
        {
            "reruns": 0, 
            "taskId": "Udt0F1fATX6C9ayeGgyN4g", 
            "task": {