海量明文数据用于解析实验
我正在用 ruby 开发一个解析器,它解析一些不一致的文本数据。谁能告诉我,在哪里可以获得大量的明文数据?
I am developing a parser in ruby which parses some nonuniform text data. Can anybody tell me, where I can get a good number of plaintext data for that?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(2)
您将在此处获得许多列表:
http://www.quora.com/Data/Where-can-I-get-large-datasets-open-to-the-public
我最喜欢的是:
http://ftp.sunet.se/mirror /archive/ftp.sunet.se/pub/tv+movies/imdb/
Here's you'll get a list of many:
http://www.quora.com/Data/Where-can-I-get-large-datasets-open-to-the-public
And my fav is:
http://ftp.sunet.se/mirror/archive/ftp.sunet.se/pub/tv+movies/imdb/
您可以抓取 Wikipedia (或者只是通过
lynx -dump
运行一堆内容) 。这也将为您提供大量的非英语文本来源。 古腾堡计划将是大量纯文本的另一个很好的来源。You could scrape Wikipedia (or just run a bunch of it through
lynx -dump
). That would also give you a vast source of non-English text as well. Project Gutenberg would be another good source of large amounts of plain text.