想要最常用的英语单词
我想要最常用的英语单词。基本上,我正在处理维基百科文本,即使在删除停用词后,我仍会遇到很多单词。我尝试用谷歌搜索常用词,但得到了以下链接。
http://en.wiktionary.org/wiki/Wiktionary:Frequency_lists#English
我必须手动从这些链接中抓取数据。这些词有已知的来源可以直接下载吗?
谢谢
I want most frequent words in english. Basically, I am processing wikipedia text and am stuck with lot of words even after removing stop words. I tried googling for frequent words, but got the below link.
http://en.wiktionary.org/wiki/Wiktionary:Frequency_lists#English
I have to manually scrape the data from these link. Is there a known source for these words that can be directly downloaded?
Thank you
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
与所有统计数据一样,您的答案将取决于您所采样的内容。您对“英语”的定义是维基百科中使用的语言吗?正如您链接的页面所示,单词的频率根据不同的样本而有所不同。对语言处理工作进行文献综述可能会给您一个过时的列表。
并相信某人会创建一个具有该名称的网站 - wordFrequency。更具体地说这个。
As in all statistics your answer will depend on what you are sampling. Is your definition of "English" - language used in Wikipedia. As the page you have linked suggests the frequency of words differs based on different samples. Doing a Literature review on language processing work may give you a dated list.
And trust someone to make a website with the that name - wordfrequency. More specifically this.