Skip to content

Instantly share code, notes, and snippets.

@kscanne
Created April 25, 2021 13:46
Show Gist options
  • Save kscanne/4d4288aae7506f5e202b5a9d5e907e12 to your computer and use it in GitHub Desktop.
Save kscanne/4d4288aae7506f5e202b5a9d5e907e12 to your computer and use it in GitHub Desktop.
Permitted UPOS/Feature combinations for Irish treebank
$ egrep -h '^[0-9]+' *.conllu | cut -f 6 | egrep '..' | tr "|" "\n" | sed 's/=.*//' | sort -u | while read x; do echo; echo "$x..."; egrep "^[0-9]+.*[^A-Za-z]$x=" *.conllu | cut -f 4 | sort | uniq -c | sort -r -n; done
Abbr...
300 PROPN
101 NOUN
18 ADV
18 ADJ
5 X
4 SYM
4 NUM
Aspect...
298 VERB
Case...
28644 NOUN
3759 PROPN
3432 ADJ
2332 DET
Definite...
12691 NOUN
7521 DET
5351 PROPN
Degree...
2110 ADJ
Dialect...
42 DET
20 VERB
18 ADP
17 PRON
13 NOUN
7 PART
1 PROPN
1 AUX
1 ADV
Foreign...
349 X
322 PROPN
64 NOUN
4 ADJ
3 DET
2 SYM
2 PRON
2 ADP
Form...
9937 NOUN
4511 VERB
2324 PART
1443 PROPN
924 ADJ
261 NUM
180 AUX
66 PRON
61 DET
33 ADP
7 SCONJ
6 ADV
2 X
Gender...
28042 NOUN
5189 PROPN
3452 ADJ
2412 DET
1775 ADP
1736 PRON
9 AUX
Mood...
8642 VERB
67 AUX
24 PART
NounType...
1199 NOUN
1054 ADJ
284 PROPN
Number...
28740 NOUN
8333 DET
5199 PROPN
5115 ADP
3462 ADJ
2619 PRON
518 VERB
9 AUX
3 PART
NumType...
669 NUM
PartType...
6818 PART
Person...
3254 ADP
2577 PRON
1912 VERB
1070 DET
9 AUX
Polarity...
659 VERB
553 PART
291 AUX
Poss...
1070 DET
907 ADP
PrepForm...
1006 ADP
1000 NOUN
PronType...
8952 DET
2308 PART
2144 ADP
853 PRON
598 VERB
124 AUX
41 ADV
Reflex...
255 PRON
6 PROPN
Tense...
8114 VERB
1530 AUX
298 PART
17 SCONJ
1 ADV
Typo...
157 NOUN
33 ADJ
22 VERB
18 PROPN
9 CCONJ
9 ADP
5 PRON
3 DET
3 ADV
2 NUM
1 PART
VerbForm...
4100 NOUN
1555 AUX
915 ADJ
80 SCONJ
20 PART
3 PRON
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment