Skip to content

Instantly share code, notes, and snippets.

View Loveforkeeps's full-sized avatar
🐶
Meow~

EMoDevil Loveforkeeps

🐶
Meow~
View GitHub Profile
@Loveforkeeps
Loveforkeeps / dns.sh
Created October 17, 2017 03:05
DNS查询ip
#!/bin/bash
for name in `cat domian.txt`;
do
nslookup $name| grep -E 'Add|Nam' |awk -v awk_var="$name" '!/#/{printf awk_var" "$2"\n"}' >> dns.txt
done
awk '{if(NR%2==0){printf $2 "\n"}else{printf "%s ",$0}}' dns.txt > ipoder.txt
#sort -k 3 ipoder.txt -o dns.txt
#rm -f ipoder.txt
awk '{printf "%-40s|%-60s|%-20s\n", $1, $2, $3;}' dns.txt > order.txt
@Loveforkeeps
Loveforkeeps / extractDomain.sh
Last active October 25, 2017 08:09
Ubuntu和Mac平台,PDNS数据处理,样例数据:ali1.rabbitpre.com.|117.169.81.237:27|117.169.81.219:29|117.169.81.217:25|117.169.81.236:20|117.169.81.218:38|223.82.136.179:9|223.82.136.174:8|223.82.136.178:10|223.82.136.177:12|223.82.136.176:14|223.82.136.175:15|117.169.81.221:30|223.82.136.228:15|117.169.81.220:32|223.82.136.229:18|117.169.81.222:25|
#!/bin/bash
# Mac 上 readlink -f 无法使用的替代代码
TARGET_FILE=$0
cd `dirname $TARGET_FILE`
TARGET_FILE=`basename $TARGET_FILE`
while [ -L "$TARGET_FILE" ]
do
@Loveforkeeps
Loveforkeeps / checkmd.sh
Created October 18, 2017 07:43
MD文档格式更正,###后无空格则添加空格
#!/bin/bash
for index in `cat -n $1 | grep -vE '#+\s'| grep -E '#+' | awk '{print $1}'`;
do
echo "第"$index"行";
arg="sed -i '.bak' '${index}s/\#\{1,\}/& /g' $1"
echo $arg | sh
done
@Loveforkeeps
Loveforkeeps / ChinaAlexa.py
Last active April 24, 2018 05:44
获取指定数目国内Alexa排行域名
#!/bin/python
# -*- coding=utf-8 -*-
#
# Author:EMo
import requests
import re
import io
import os
import sys
@Loveforkeeps
Loveforkeeps / mearg.py
Created November 10, 2017 02:53
合并文件
# 去除domainArchive的无效文件,保证数据合理性
cmd = "find . -name \"*\" -type f -size 0c | xargs -n 1 rm -f"
sub = subprocess.call(cmd,shell=True)
if sub == 0:
print("Clear vaild file success!")
# 获取domainArchive中的domain文件列表
cmd = "ls | grep '[0-9]'"
stdout = subprocess.check_output(cmd,shell=True)
@Loveforkeeps
Loveforkeeps / split.sh
Created January 17, 2018 07:42
按指定行分割文件,并返回割裂的子文件路径。如: bash split.sh /Users/King/Desktop/zonefile/833.txt 100
#!/bin/bash
# Author: ErDog
# 为了协调Mac上readlink -f无法使用,与脚本功能无关
TARGET_FILE=$0
cd `dirname $TARGET_FILE`
TARGET_FILE=`basename $TARGET_FILE`
while [ -L "TARGET_FILE" ]
do
TARGET_FILE=`readlink TARGET_FILE`
@Loveforkeeps
Loveforkeeps / uniq_set.py
Created January 18, 2018 08:08
文件按行去重
# encoding:utf-8
import io
import sys
import os
def uniq_set(file):
u_set = set()
@Loveforkeeps
Loveforkeeps / random.sh
Created January 23, 2018 09:13
生成一个指定范围内的随机数。
#!/bin/sh
if [[ $# < 2 ]];then
echo "please assign Minnum and Maxnums!"
exit 0
fi
min=$1;
max=$2-$1;
num=$RANDOM
((retnum=num%max+min))
echo $retnum;
@Loveforkeeps
Loveforkeeps / switch.py
Created March 20, 2018 09:17
python lambda 实现switch
# 根据IP和PORT的csv文件,生成URL
def targetUrl(filename):
urllist = list()
with open(filename,"rU") as f:
reader = csv.DictReader(f)
for row in reader:
geturl = {
'443': lambda :"https://{}".format(row['IP']),
'8080': lambda :"http://{}:{}".format(row['IP'],row["PORT"]),
@Loveforkeeps
Loveforkeeps / geturl.py
Last active May 23, 2018 06:58
判断域名是http还是https
#!/usr/bin/python3
# coding: utf-8
# Author: EMo
import http.client,sys
def get_url(host):
""" 将域名转换为URL(是否协议与WWW判断) """
global datas
conn = http.client.HTTPConnection(host,timeout=3)