Skip to content

Instantly share code, notes, and snippets.

import redis
import time
import random
def load_file(fp, fpKey, r, expiry):
with open(fp, "rb") as f:
data = f.read()
p = r.pipeline()
p.set(fpKey, data)
// Lets keep only last 10 builds
MAX_BUILDS = 10
def jobs = Jenkins.instance.items;
println "Total Jobs" + jobs.size()
for (job in jobs) {
println "Job: " + job.name
try {
if(job instanceof jenkins.branch.MultiBranchProject) {
@pmanvi
pmanvi / OffsetCommand
Last active July 26, 2019 13:37
For resetting offset command
import java.util.Arrays;
import java.util.HashMap;
import java.util.Map;
import java.util.Properties;
import org.apache.kafka.clients.consumer.KafkaConsumer;
import org.apache.kafka.clients.consumer.OffsetAndMetadata;
import org.apache.kafka.common.TopicPartition;
import org.apache.kafka.common.serialization.StringDeserializer;
import org.zeroturnaround.exec.ProcessExecutor;
Production is awesome place to learn and know about the system. Team should feel lucky to work on those systems.
Make sure to have these parameters defined
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=<path>
lets say that you are experiencing OOM, but you still don't determine the root cause of the issue,
You might probably need to restart as soon as you see performance issues or even better daily thats perfectly fine & taking heap
dump will not practical. try to take heap dumpl.
export JAVA_HOME=$(/usr/libexec/java_home)
export GRADLE_HOME=/opt/gradle
export M2_HOME=/opt/maven
export M2=$M2_HOME/bin
export PATH=$M2:$PATH:$GRADLE_HOME/bin
export MYSQL_HOME=/usr/local/bin/mysql
export PATH=$PATH:$MYSQL_HOME/bin
alias ll="ls -lptr"
alias cd..="cd .."
@pmanvi
pmanvi / dateStringToDate
Created December 22, 2015 17:57
utility to extract date from unknown format
public static LocalDate getLocalDateWithUnknownFormat(String dString) {
LocalDate[] localDate = {null};
Arrays.asList("yyyy-MM-dd'T'HH:mm:ss'Z'", "yyyy-MM-dd'T'HH:mm:ssZ",
"yyyy-MM-dd'T'HH:mm:ss", "yyyy-MM-dd'T'HH:mm:ss.SSS'Z'",
"yyyy-MM-dd'T'HH:mm:ss.SSSZ", "yyyy-MM-dd HH:mm:ss",
"MM/dd/yyyy HH:mm:ss", "MM/dd/yyyy'T'HH:mm:ss.SSS'Z'",
"MM/dd/yyyy'T'HH:mm:ss.SSSZ", "MM/dd/yyyy'T'HH:mm:ss.SSS",
"MM/dd/yyyy'T'HH:mm:ssZ", "MM/dd/yyyy'T'HH:mm:ss",
"yyyy:MM:dd HH:mm:ss", "yyyyMMdd")
.stream().parallel().forEach(f-> {
@pmanvi
pmanvi / test.java
Created August 2, 2015 17:05
java-8-blog-even-numbers
List<Integer> numbers = asList(1, 2, 3, 4, 5);
List<Integer> even_numbers = numbers.stream().filter(num -> num % 2 == 0).collect(Collectors.toList());
System.out.println(even_numbers)
// will print [2,4]
@pmanvi
pmanvi / aggregate_results.json
Created October 18, 2014 17:54
enron_size by count
buckets: [
{
key: 0KB to 1KB
from: 0
from_as_string: 0.0
to: 1024
to_as_string: 1024.0
doc_count: 124181
}
{
@pmanvi
pmanvi / enron_email_size_aggregator.json
Created October 18, 2014 17:28
enron_email_size_aggregator ES query
{
"aggs": {
"enron_size_ranges": {
"range": {
"field": "content_size_in_bytes",
"ranges": [
{
"key": "0KB to 1KB",
"from": 0,
"to": 1024
@pmanvi
pmanvi / enron_email_searcher.py
Last active August 29, 2015 14:07
Searching enron mails with ES
__author__ = 'pmanvi'
from elasticsearch import Elasticsearch
from elasticsearch_dsl import Search, Q
es = Elasticsearch([{'host': 'localhost'},{'port': 9200}])
count = Search(using=es).index("enron-email").count()
print(count)