如何在 nltk 中使用 hunpos 标记文本文件？

Question

有人可以帮我解决在 nltk 中标记语料库的 hunpos 语法吗？

1. 我要为 hunpos.HunPosTagger 模块？

2. 如何对语料库进行 HunPosTag？请参阅下面的代码。

---

import nltk 
from nltk.corpus import PlaintextCorpusReader  
from nltk.corpus.util import LazyCorpusLoader  

corpus_root = './'  
reader = PlaintextCorpusReader (corpus_root, '.*')  

ntuen = LazyCorpusLoader ('ntumultien', PlaintextCorpusReader, reader)  
ntuen.fileids()  
isinstance (ntuen, PlaintextCorpusReader)  


# So how do I hunpos tag `ntuen`? I can't get the following code to work.
# please help me to correct my python syntax errors, I'm new to python 
# but i really need this to work. sorry
##from nltk.tag import hunpos.HunPosTagger
ht = HunPosTagger('english.model')
for sentence in ntu.sent() ##looping through the no. of sentence
     ht.tag(ntusent()[i])

Answer 1

import nltk 
from nltk.tag.hunpos import HunposTagger
from nltk.tokenize import word_tokenize

corpus = "so how do i hunpos tag my ntuen ? i can't get the following code to work."
#please help me to correct my python syntax errors, i'm new to python 
#but i really need this to work. sorry
##from nltk.tag import hunpos.HunPosTagger
ht = HunposTagger('en_wsj.model')
print ht.tag(word_tokenize(corpus))

我觉得问题是你没有对单词进行标记，但代码可能无法工作还有其他原因（是 HunposTagger，而不是 HunPosTagger）。我根据你的问题做了这个简化的例子。如果您还有其他疑问，请发表评论。

我从这里获取了所有内容：http://code.google.com/p/hunpos/

python hunpos.py

[('so', 'RB'), ('如何', 'WRB'), ('do', 'VBP'), ('i', 'FW'), ('hunpos', ' NN'), ('标签', 'NN'), ('我的', 'PRP$'), ('ntuen', 'NN'), ('?', '.'), ('i', 'FW'), ('ca', 'MD'), ('n't', 'RB'), ('get', 'VB'), ('the', 'DT'), ('以下', 'JJ'), ('代码', 'NN'), ('到', 'TO'), ('工作', 'VB'), ('.', '.')]