Skip to content

Instantly share code, notes, and snippets.

View mconcas's full-sized avatar
:octocat:

Matteo Concas mconcas

:octocat:
View GitHub Profile
#!/bin/bash
#Version 0.1.1
#A simple script to verify which nodes in a list, are active on the same network, even if you don't have network administration rights.
#Written by Matteo Concas | email: mett1990@gmail.com
#Homepage: http://newton.ph.unito.it/~concas
#The mechanism is based on the assumption that if the ping command, with just one package sent (ping -c1 <hostname>), returns 0 it will labeled as "active".
#Obviously is quite reductive as assumption, a node could be active even ping can't reach it, or moreover ping is not enable on network.
@mconcas
mconcas / LIST
Last active August 29, 2015 13:59
ainfa01
ainfa02
ainfa03
ainfa04
ainfa05
ainfa06
ainfa07
ainfa08
ainfb01
ainfb02
#!/bin/bash
export NAME=ScientificCERNSLC
export VERSION_ID=6.6
@mconcas
mconcas / 00-docker-worker.config
Last active August 29, 2015 14:25
Condor configuration for a working container. Assuming CONDOR_HOST = ali53xl.to.infn.it
DAEMON_LIST = MASTER, STARTD
CONDOR_HOST = ali53xl.to.infn.it
CCB_ADDRESS = $(CONDOR_HOST)
START = TRUE
SUSPEND = FALSE
PREEMPT = FALSE
KILL = FALSE
## for testing more than one w.c. (worker container <.< ) on the same host ##
NUM_CPUS = 1
@mconcas
mconcas / 10-common-docker.config
Last active August 29, 2015 14:25
Condor common configuration for a working container. Assuming CONDOR_HOST = ali53xl.to.infn.it
CONDOR_ADMIN = root@$(CONDOR_HOST)
UID_DOMAIN = *
TRUST_UID_DOMAIN = TRUE
SOFT_UID_DOMAIN = TRUE
QUEUE_SUPER_USERS = root, condor
LOWPORT = 40000
HIGHPORT = 60000
SHARED_PORT_ARGS = -p 9618
DAEMON_LIST = $(DAEMON_LIST), SHARED_PORT
USE_SHARED_PORT = TRUE
@mconcas
mconcas / 20-common-schedd-docker.config
Last active August 29, 2015 14:25
Condor common configuration for a working container. Assuming CONDOR_HOST = ali53xl.to.infn.it
COLLECTOR_MAX_FILE_DESCRIPTORS = 1000000
HISTORY =
NEGOTIATOR_CONSIDER_PREEMPTION = FALSE
JOB_START_COUNT = 50
JOB_START_DELAY = 5
NEGOTIATOR_INTERVAL = 21
@mconcas
mconcas / 99-common-debug-docker.config
Last active August 29, 2015 14:25
Condor common configuration for a working container. Assuming CONDOR_HOST = ali53xl.to.infn.it
MASTER_DEBUG = D_FULLDEBUG
SHARED_PORT_DEBUG = D_FULLDEBUG

Turin, Wed 5 Aug - 2015

### Goals prefixed:

  1. Centos6/SCL6 based containers parrot+CVMFS aware, capable to run the experiment software.
  2. Condor cluster using containers as workers.
  3. A python script (daemon API based) capable to:
    1. perform a continuous check of resource availability on the bare metal host, and take decisions applying specific policies.
  4. pull always-up-to-date images.
@mconcas
mconcas / T20150930.md
Last active September 30, 2015 08:41

Turin, Wed 30 Sep - 2015

Deliverables:

  • We currently are able to deploy plancton daemon on every docker-compatible host (at least Python2.7 is required).
  • We currently can upgrade/modify plancton daemon and its configuration without access the hosts.

Goals achieved:

  1. Centos6/SCL6 based containers parrot+CVMFS aware, capable to have access to the experiment software.
  2. Condor cluster using containers as workers.
  3. An easily deployable daemonized python script capable to:
#!/bin/env python
import json
import time
from datetime import datetime
from elasticsearch import Elasticsearch
ncpus = 8
dummy_string = {'host': { 'ip': '193.205.66.55',
'hostname': 'ali55xl.to.infn.it',