Skip to content

Instantly share code, notes, and snippets.

View ntkog's full-sized avatar

Jorge Barrachina Gutiérrez ntkog

View GitHub Profile
@ntkog
ntkog / index.js
Last active January 3, 2020 17:33
Scraping Tweets from a user
const puppeteer = require('puppeteer');
const {writeFile} = require('jsonfile');
const TWITTER_USER = process.argv[2] || "congosto";
const TWEETS_TO_FETCH = process.argv[3] || 100;
function extractItems() {
return [...document.querySelectorAll('.tweet')]
.map(el => ({
metadata : {...el.dataset},
@ntkog
ntkog / keybase.md
Created March 14, 2020 11:29
keybase.md

Keybase proof

I hereby claim:

  • I am ntkog on github.
  • I am ntkog (https://keybase.io/ntkog) on keybase.
  • I have a public key ASCJCwrSDSTmbpY1fbLUJbV-v2zM2buBDM5J0EUjCoyujQo

To claim this, I am signing this object:

@ntkog
ntkog / covid19.sh
Created March 19, 2020 15:05
Bash function para descargarse el último informe de COVID-19 en España y convertir los datos a CSV
function covid19 () {
# Descargar informe
curl -sS -k $1 -O
PDF_FILENAME=`echo "$1" | cut -d'/' -f 10`
CSV_FILENAME=`echo $PDF_FILENAME | sed -r 's/\.pdf//'`
NOW=`date +%d_%m_%Y_%Hh`
# Convertir a texto
pdftotext -f 1 -l 1 -layout ${PDF_FILENAME}
# Convertir a CSV
@ntkog
ntkog / now.json
Last active December 16, 2020 10:14
IVOOX RSS feed fixer for Spotify
{
"version": 2,
"builds": [{ "src": "server.js", "use": "@now/node-server" }],
"routes": [
{
"src": "/",
"dest": "/server.js",
"methods": ["GET"]
}
]
@ntkog
ntkog / get_issues.sh
Last active March 20, 2024 15:31
Utilidad sencilla para recorrer los issues de los Observatorios y generar un json a partir de los issues.
parallel -j+0 --eta curl -sSLk -o "files/issues_{}.json" "https://api.github.com/repos/JaimeObregon/observatoriospublicos.es/issues?page={}&q=is%3Aissue+is%3Aopen" :::: <(seq 1 6)
cat *.json | jq -s 'add' - > all_issues.json
@ntkog
ntkog / descarga.sh
Last active March 24, 2024 02:37
Lista de Entidades publicadas en INVENTE
mkdir entidades_json
parallel -j+0 --eta --delay 1 --retries 3 --joblog parallel.log ./igae.sh {} "entidades_json/{}.json" :::: <(cat ids.txt)