Skip to content

Instantly share code, notes, and snippets.

Avatar

Sagar Patwardhan sagar8192

  • Yelp
  • San Francisco, CA
View GitHub Profile
View gist:32f0f17afb24a8cc809cec89d29c6b44
make all-am
make[1]: Entering directory `/nail/home/sagarp/mesos/dcos-mesos-modules/build'
depbase=`echo journald/lib_journald.lo | sed 's|[^/]*$|.deps/&|;s|\.lo$||'`;\
/bin/bash ./libtool --tag=CXX --mode=compile g++ -DPACKAGE_NAME=\"dcos-mesos-modules\" -DPACKAGE_TARNAME=\"dcos-mesos-modules\" -DPACKAGE_VERSION=\"0.2\" -DPACKAGE_STRING=\"dcos-mesos-modules\
0.2\" -DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"dcos-mesos-modules\" -DVERSION=\"0.2\" -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_ME
MORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DHAVE_DLFCN_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_CXX11=1 -DHAVE_ZOOKEEPER_H=1 -DHAVE_OPENSSL_SSL_H=1 -DHAVE_BOOST_LEXICAL_
CAST_HPP=1 -DHAVE_BOOST_FUNCTIONAL_HASH_HPP=1 -I. -I.. -I/nail/home/sagarp/mesos/include -I/nail/home/sagarp/mesos/src -I/nail/home/sagarp/mesos/3rdparty/libprocess/include -I/nail/home/sagarp/mesos/3rdp
arty/stout/include -I/nail/home/sag
View gist:da8f39e04366372815583677dd48c9c5
Traceback (most recent call last):
File "/opt/venvs/paasta-tools/lib/python3.6/site-packages/pymesos/process.py", line 148, in read
self._callback.process_event(event)
File "/opt/venvs/paasta-tools/lib/python3.6/site-packages/pymesos/process.py", line 226, in process_event
self.on_event(event)
File "/opt/venvs/paasta-tools/lib/python3.6/site-packages/pymesos/scheduler.py", line 491, in on_event
func(event)
File "/opt/venvs/paasta-tools/lib/python3.6/site-packages/pymesos/scheduler.py", line 434, in on_offers
self, [self._dict_cls(offer) for offer in offers]
File "/opt/venvs/paasta-tools/lib/python3.6/site-packages/task_processing/plugins/mesos/execution_framework.py", line 515, in resourceOffers
View gist:bb98d0b479b3cf1afcf09785529471fd
diff --git a/task_processing/plugins/mesos/retrying_executor.py b/task_processing/plugins/mesos/retrying_executor.py
index 689a47b..5fe443f 100644
--- a/task_processing/plugins/mesos/retrying_executor.py
+++ b/task_processing/plugins/mesos/retrying_executor.py
@@ -1,5 +1,6 @@
import logging
import time
+import uuid
from operator import sub
from threading import Lock
View gist:bcd4b37dba03bde0a942b5b972004e8a
2017-08-10 23:25:25,134 - task_processing.plugins.mesos.execution_framework - INFO - registered - Registered with framework ID 707c1fd1-4c7c-4ba1-a572-f0aa0df17bbb-0000 and role *
2017-08-10 23:25:55,152 - task_processing.plugins.mesos.execution_framework - INFO - get_tasks_to_launch - Received offer 707c1fd1-4c7c-4ba1-a572-f0aa0df17bbb-O0 with cpus: 32.0, mem: 244830.0, disk: 252769.0 gpus: 0 role: *
2017-08-10 23:25:55,161 - task_processing.plugins.mesos.execution_framework - INFO - get_tasks_to_launch - Received offer 707c1fd1-4c7c-4ba1-a572-f0aa0df17bbb-O1 with cpus: 36.0, mem: 59358.0, disk: 252769.0 gpus: 0 role: *
2017-08-10 23:25:55,164 - task_processing.plugins.mesos.execution_framework - INFO - resourceOffers - Offers declined because no tasks: 707c1fd1-4c7c-4ba1-a572-f0aa0df17bbb-O1
2017-08-10 23:25:55,164 - task_processing.plugins.mesos.execution_framework - INFO - resourceOffers - Offers accepted: offer: 707c1fd1-4c7c-4ba1-a572-f0aa0df17bbb-O0 agent: 707c1fd1-4c7c-4ba1-a572-f0aa0df17bbb-S0 tasks:
View gist:1b341ef2271dde11d276974a27109426
nohup: ignoring input
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0810 23:24:38.254606 57881 main.cpp:243] Build: 2017-08-10 16:03:31 by sagarp
I0810 23:24:38.254688 57881 main.cpp:244] Version: 1.1.0
I0810 23:24:38.254693 57881 main.cpp:247] Git tag: 1.1.0
I0810 23:24:38.254696 57881 main.cpp:251] Git SHA: a44b077ea0df54b77f05550979e1e97f39b15873
I0810 23:24:38.260366 57881 containerizer.cpp:200] Using isolation: posix/cpu,posix/mem,filesystem/posix,network/cni
I0810 23:24:38.265803 57881 linux_launcher.cpp:150] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
I0810 23:24:38.271095 57915 slave.cpp:208] Mesos agent started on (1)@10.40.21.26:5052
I0810 23:24:38.271114 57915 slave.cpp:209] Flags at startup: --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_
View gist:3a83364b1f5ffc63902a80c728647f31
nohup: ignoring input
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0810 23:24:25.610741 119141 main.cpp:243] Build: 2017-08-10 16:03:31 by sagarp
I0810 23:24:25.610826 119141 main.cpp:244] Version: 1.1.0
I0810 23:24:25.610831 119141 main.cpp:247] Git tag: 1.1.0
I0810 23:24:25.610836 119141 main.cpp:251] Git SHA: a44b077ea0df54b77f05550979e1e97f39b15873
I0810 23:24:25.617823 119141 containerizer.cpp:200] Using isolation: posix/cpu,posix/mem,filesystem/posix,network/cni
I0810 23:24:25.624280 119141 linux_launcher.cpp:150] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
I0810 23:24:25.629873 119173 slave.cpp:208] Mesos agent started on (1)@10.40.19.239:5052
I0810 23:24:25.629897 119173 slave.cpp:209] Flags at startup: --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" -
View gist:91888419fdf8284e33ebd58351131203
nohup: ignoring input
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0810 23:24:19.041831 118971 main.cpp:263] Build: 2017-08-10 16:03:31 by sagarp
I0810 23:24:19.041926 118971 main.cpp:264] Version: 1.1.0
I0810 23:24:19.041934 118971 main.cpp:267] Git tag: 1.1.0
I0810 23:24:19.041937 118971 main.cpp:271] Git SHA: a44b077ea0df54b77f05550979e1e97f39b15873
I0810 23:24:19.045302 118971 main.cpp:370] Using 'HierarchicalDRF' allocator
I0810 23:24:19.057184 118971 replica.cpp:776] Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
I0810 23:24:19.059078 118986 recover.cpp:451] Starting replica recovery
I0810 23:24:19.059612 118986 recover.cpp:477] Replica is in EMPTY status
View gist:fb65170240dd32a53f27e6985c549df0
{
"windows" : [
{
"machine_ids" : [
{ "hostname" : "10-40-19-239-uswest1cdevc.dev.yelpcorp.com", "ip" : "10.40.19.239" }
],
"unavailability" : {
"start" : { "nanoseconds" : 1502430504000000000 },
"duration" : { "nanoseconds" : 3600000000000 }
}
View gist:42ca055720549c5ff3067b1e6c7c68b3
diff --git a/src/master/http.cpp b/src/master/http.cpp
index 959091c..beaa56f 100644
--- a/src/master/http.cpp
+++ b/src/master/http.cpp
@@ -4412,10 +4412,14 @@ Future<Response> Master::Http::___updateMaintenanceSchedule(
// having it in two places results in more conditionals to handle.
if (unavailabilities.contains(id)) {
if (master->machines[id].info.mode() == MachineInfo::UP) {
+ LOG(WARNING) << "(sagarp):This machine is already up: "
+ << id;
View gist:8858e7cb59a23e8e1762a27571824118
I0810 22:48:38.425060 79634 master.cpp:6767] Removing unavailability of agent 58f6a965-3e9b-4c9c-9a62-53d00df59d77-S1 at slave(1)@10.40.21.26:5052 (10-40-21-26-uswest1cdevc.dev.yelpcorp.com)
I0810 22:48:38.425911 79634 master.cpp:6767] Removing unavailability of agent 58f6a965-3e9b-4c9c-9a62-53d00df59d77-S0 at slave(1)@10.40.19.239:5052 (10-40-19-239-uswest1cdevc.dev.yelpcorp.com)