从语料库中删除特定单词
在此过程之后,如何从 myDfm 语料库中删除特定单词?
dflemma <-
spacy_parse(structure(df2$term, names = df2$id), lemma = TRUE, pos = FALSE) %>%
group_by(id = sub("(.+)-(.+)", "\\1", doc_id)) %>%
summarise(text = paste(lemma, collapse = " "))
myCorpus <- corpus(dflemma[["text"]], docnames = dflemma[["id"]])
mystopwords <- c("can")
myDfm <- myCorpus %>%
tokens(remove_punct = TRUE, remove_numbers = TRUE, remove_symbols = TRUE) %>%
tokens_remove(pattern = c(stopwords(source = "smart"), mystopwords)) %>%
dfm(verbose = FALSE)
After this process how is it possible to remove specific words from myDfm corpus?
dflemma <-
spacy_parse(structure(df2$term, names = df2$id), lemma = TRUE, pos = FALSE) %>%
group_by(id = sub("(.+)-(.+)", "\\1", doc_id)) %>%
summarise(text = paste(lemma, collapse = " "))
myCorpus <- corpus(dflemma[["text"]], docnames = dflemma[["id"]])
mystopwords <- c("can")
myDfm <- myCorpus %>%
tokens(remove_punct = TRUE, remove_numbers = TRUE, remove_symbols = TRUE) %>%
tokens_remove(pattern = c(stopwords(source = "smart"), mystopwords)) %>%
dfm(verbose = FALSE)
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
你想要
You want