Skip to content

Instantly share code, notes, and snippets.

[root@gratiav2-1 ~]# curl -XPUT 'localhost:9200/_snapshot/red_hdfs?pretty' -H 'Content-Type: application/json' -d'
> {
> "type": "hdfs",
> "settings": {
> "uri": "hdfs://hadoop-name.red.hcc.unl.edu:9000/",
> "path": "/archive/gracc"
> }
> }'
{
"error" : {
[root@gratiav2-1 ~]# curl -XPOST 'localhost:9200/_aliases' -d '
> {
> "actions" : [
> { "add" :
> {
> "index" : "gracc.osg.summary3-2017",
> "alias" : "gracc.osg.summary-test",
> }
> }
> ]
@zvada
zvada / xrdcl-setfs.patch
Created October 23, 2017 19:32
Merged patches from 08d4646 and cd33790
From cc44f9cc5145beb84b2f8a15afb7c686bc815c0f Mon Sep 17 00:00:00 2001
From: Georgios Bitzes <georgios.bitzes@cern.ch>
Date: Fri, 20 Oct 2017 11:11:46 +0200
Subject: [PATCH 1/2] [XrdCl] Fix error checking when setting sec.uid, sec.gid
Previously, I was calling setfsuid(-1) to check if the
previous call had succeeded, since this syscall will
always return the current fsuid, whether the syscall
itself succeeded or not. There's no way to check
other than calling setfsuid again, since there's no
@zvada
zvada / hcc-gracc
Last active October 30, 2017 21:29
Notes to install new GRACC Frontend
0. Create new instance on Anvil (VCPU: 8; RAM: memory-2xlarge; floating IP)
* `ssh -l centos 10.71.106.217`
1. Install `puppet5-release` RPM
2. Install `puppet-agent` from yum
3. Ensure node is assigned a role in the puppet configuration: `manifests/red-infrastructure.pp`
4. Run the agent to generate a certificate request: `puppet agent --test --server red-puppet.unl.edu`
5. Login to red-puppet and sign the certificate request: `puppet cert sign hcc-gracc.unl.edu`
6. Run puppet on the node: `puppet agent --test --server red-puppet.unl.edu`
After puppet has been run once, it _should_ (for some values of should) update the node configuration to point at red-puppet.unl.edu.
@zvada
zvada / Dockerfile.xrootd
Created December 11, 2017 22:58
Dockerfile for XRootD
FROM centos:centos6
RUN yum -y install http://repo.grid.iu.edu/osg/3.4/osg-3.4-el6-release-latest.rpm && \
yum -y install epel-release \
yum-plugin-priorities && \
yum -y install xrootd xrootd-lcmaps xrootd-client osg-ca-certs \
gdb yum-utils
<mock-chroot> sh-4.2# git diff v5.6.5
diff --git a/plugins/repository-hdfs/build.gradle b/plugins/repository-hdfs/build.gradle
index 3824a65..9774dd7 100644
--- a/plugins/repository-hdfs/build.gradle
+++ b/plugins/repository-hdfs/build.gradle
@@ -32,23 +32,32 @@ esplugin {
apply plugin: 'elasticsearch.vagrantsupport'
versions << [
- 'hadoop2': '2.8.1'
[1249] gfactory@gfactory-2 ~$ condor_q -g -const 'JobStatus=?=5 && owner=?="feosgflock"' -af HoldReason | sort | uniq -c
38 CE job in status 1 put on hold by SYSTEM_PERIODIC_HOLD due to non-existent route in JOB_ROUTER_ENTRIES or route job limit.
45 Error connecting to schedd ce01.cmsaf.mit.edu: SECMAN:2010:Received "DENIED" from server for user flock.opensciencegrid.org@daemon.opensciencegrid.org using method GSI.|AUTHENTICATE:1004:Failed to authenticate using FS
104 Error connecting to schedd crane-gw1.unl.edu: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using GSI|GSI:5002:Failed to authenticate because the remote (server) side was not able to acquire its credentials.|AUTHENTICATE:1004:Failed to authenticate using FS
82 Error connecting to schedd hadoop-osg.rcac.purdue.edu: SECMAN:2010:Received "DENIED" from server for user flock.opensciencegrid.org@daemon.opensciencegrid.org using method GSI.|AUTHENTICATE:1004:Failed to authenticate u