hankcs

## 词性标记.md

      
              1 file
            
          
              3 forks
            
          
              1 comment
            
          
              3 stars
            
          
                hankcs
                / 词性标记.md
            
            
              Created
              May 10, 2014 11:02
                — forked from luw2007/词性标记.md
            
          
    词的分类


实词：名词、动词、形容词、状态词、区别词、数词、量词、代词
虚词：副词、介词、连词、助词、拟声词、叹词。

ICTPOS3.0词性标记集

n 名词

nr 人名

  
## bdcurl.sh
#!/bin/bash

# Baidu Yun Command Line Interface

# Depends: bash, curl, grep, awk, sed, od
# (They are basicly builtin tools of any *nix system.)
# Additionally, fastupload depends: head, wc, md5sum or md5, cksum
# (Which are also builtin tools)

#### Variables ####

## gist:53a20ef3cd5f246b9dd1
# coding=utf-8
# 反向传播神经网络
#
# Written in Python.  See http://www.python.org/
# Placed in the public domain.
# Neil Schemenauer <nas@arctrix.com>

import math
import random

## alpha blend图层合并算法
int clamp(int val) {
  if (val < 0) return 0;
  if (val > 255) return 255;
  return val;
}

unsigned char layerMerge(unsigned char **layers, unsigned int layerCount, unsigned int layerWidth, unsigned int layerHeight) {
	if (1 >= layerCount) return 0;
	unsigned char isNewLayer = 0;
	unsigned int i, j, byteCount;

## iso2usb.sh
#!/bin/bash

##
# AUTHOR: Andy Savage <andy@savage.hk>
# GITHUB: www.github.com/hongkongkiwi
# DESCRIPTION: This script is for converting ISO files and burning them to a USB drive
##

HELP="USAGE: iso2usb blah.iso /dev/disk#"

## cmake优化
cmake -DCMAKE_BUILD_TYPE=RELEASE ..
make

## OOV.py
# -*- coding:utf-8 -*-
# Filename: OOV.py
# Author：hankcs
# Date: 2017-11-21 17:51

def load_words(path, dict):
    with open(path) as src:
        for line in src:
            dict.update(line.split())

## restore_collapse_edges.py
# -*- coding:utf-8 -*-


def load_conll_to_str(path):
    """
    Load a conll file to a list of strings, each string represents a sentence in conll format
    :rtype: list
    """
    with open(path) as src:
        text = src.read()

## compile_coref_data.sh
#!/bin/bash

# This script downloads and compiles the Ontonotes 2012 data in a helpful format
# for co-reference resolution. It generates 3 files: {train, dev, test}.english.v4_gold_conll,
# as well as a directory 'conll-2012' which contains the raw extracted data.
# The script downloads and runs some python scripts which require python 2.X.

ONTONOTES_PATH=$1

if [ ! -n "$ONTONOTES_PATH" ] ; then

## ontonotes_to_conll.sh
#!/bin/bash

# This script downloads and compiles the Ontonotes 2012 data in a helpful format
# for co-reference resolution. It generates 3 files: {train, dev, test}.english.v4_gold_conll,
# as well as a directory 'conll-2012' which contains the raw extracted data.
# The script downloads and runs some python scripts which require python 2.X.

ONTONOTES_PATH=$1
LANGUAGE=$2
	#!/bin/bash

	# Baidu Yun Command Line Interface

	# Depends: bash, curl, grep, awk, sed, od
	# (They are basicly builtin tools of any *nix system.)
	# Additionally, fastupload depends: head, wc, md5sum or md5, cksum
	# (Which are also builtin tools)

	#### Variables ####
	# coding=utf-8
	# 反向传播神经网络
	#
	# Written in Python. See http://www.python.org/
	# Placed in the public domain.
	# Neil Schemenauer <nas@arctrix.com>

	import math
	import random
	int clamp(int val) {
	if (val < 0) return 0;
	if (val > 255) return 255;
	return val;
	}

	unsigned char layerMerge(unsigned char **layers, unsigned int layerCount, unsigned int layerWidth, unsigned int layerHeight) {
	if (1 >= layerCount) return 0;
	unsigned char isNewLayer = 0;
	unsigned int i, j, byteCount;
	#!/bin/bash

	##
	# AUTHOR: Andy Savage <andy@savage.hk>
	# GITHUB: www.github.com/hongkongkiwi
	# DESCRIPTION: This script is for converting ISO files and burning them to a USB drive
	##

	HELP="USAGE: iso2usb blah.iso /dev/disk#"
	# -- coding:utf-8 --
	# Filename: OOV.py
	# Author：hankcs
	# Date: 2017-11-21 17:51

	def load_words(path, dict):
	with open(path) as src:
	for line in src:
	dict.update(line.split())
	# -- coding:utf-8 --


	def load_conll_to_str(path):
	"""
	Load a conll file to a list of strings, each string represents a sentence in conll format
	:rtype: list
	"""
	with open(path) as src:
	text = src.read()
	#!/bin/bash

	# This script downloads and compiles the Ontonotes 2012 data in a helpful format
	# for co-reference resolution. It generates 3 files: {train, dev, test}.english.v4_gold_conll,
	# as well as a directory 'conll-2012' which contains the raw extracted data.
	# The script downloads and runs some python scripts which require python 2.X.

	ONTONOTES_PATH=$1

	if [ ! -n "$ONTONOTES_PATH" ] ; then