Skip to content

Instantly share code, notes, and snippets.

🎯
Focusing

Jinxu imfht

🎯
Focusing
Block or report user

Report or block imfht

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
@imfht
imfht / httpdns.go
Created Sep 4, 2018 — forked from fangdingjun/httpdns.go
use dnspod's httpdns service to query dns
View httpdns.go
package main
import (
"bytes"
"fmt"
"github.com/miekg/dns"
"io/ioutil"
"log"
"net/http"
)
@imfht
imfht / gist:af5970a3799b6064964fd5294499ec06
Created Aug 19, 2018 — forked from evilpacket/gist:3628941
Top 1000 from Alexa Top 1million
View gist:af5970a3799b6064964fd5294499ec06
wget -q http://s3.amazonaws.com/alexa-static/top-1m.csv.zip;unzip top-1m.csv.zip; awk -F ',' '{print $2}' top-1m.csv|head -1000 > top-1000.txt; rm top-1m.csv*
@imfht
imfht / setup.md
Created Jun 30, 2018 — forked from xrstf/setup.md
Nutch 2.3 + ElasticSearch 1.4 + HBase 0.94 Setup
View setup.md

Info

This guide sets up a non-clustered Nutch crawler, which stores its data via HBase. We will not learn how to setup Hadoop et al., but just the bare minimum to crawl and index websites on a single machine.

Terms

  • Nutch - the crawler (fetches and parses websites)
  • HBase - filesystem storage for Nutch (Hadoop component, basically)
View ssurt.py
#!/usr/bin/python3
# coding=utf-8
import re
SSURT_RE = r"""
\A
(?P<scheme> [a-zA-Z] [a-zA-Z0-9+.-]* : )?
(?P<authority>
(?P<slashes> /* )
@imfht
imfht / dnsmasq.conf
Created Aug 29, 2017 — forked from aa65535/dnsmasq.conf
dnsmasq config
View dnsmasq.conf
# 并发查询所有上游DNS服务器
all-servers
# 本地DNS缓存最小有效期
min-cache-ttl=3600
# 本地DNS缓存数目
cache-size=65535
# 上游DNS服务器, 可设置多个
server=8.8.4.4
#server=8.8.8.8
server=114.114.114.114
@imfht
imfht / gist:341468d410155b5be35c66acbb103d7f
Created Jul 27, 2017 — forked from hest/gist:8798884
Fast SQLAlchemy counting (avoid query.count() subquery)
View gist:341468d410155b5be35c66acbb103d7f
def get_count(q):
count_q = q.statement.with_only_columns([func.count()]).order_by(None)
count = q.session.execute(count_q).scalar()
return count
q = session.query(TestModel).filter(...).order_by(...)
# Slow: SELECT COUNT(*) FROM (SELECT ... FROM TestModel WHERE ...) ...
print q.count()
@imfht
imfht / captcha.py
Created Jul 3, 2017 — forked from liberize/captcha.py
简单验证码识别
View captcha.py
#!/usr/bin/env python
# coding: utf-8
import os
import sys
from PIL import Image, ImageChops
templates = []
@imfht
imfht / fofa_rule.sql
Created May 30, 2017 — forked from Tr3jer/fofa_rule.sql
fofa_rule.sql
View fofa_rule.sql
/*
Navicat Premium Data Transfer
Source Server : localhost
Source Server Type : MySQL
Source Server Version : 50542
Source Host : localhost
Source Database : rule
Target Server Type : MySQL
You can’t perform that action at this time.