- 初窥Scrapy
- 安装指南
- Scrapy入门教程
- 例子
- 命令行工具(Command line tools)
- Items
- Spiders
- 选择器(Selectors)
- Item Loaders
- Scrapy终端(Scrapy shell)
- Item Pipeline
- Feed exports
- Link Extractors
- Logging
- 数据收集(Stats Collection)
- 发送email
- Telnet终端(Telnet Console)
- Web Service
- 常见问题(FAQ)
- 调试(Debugging)Spiders
- Spiders Contracts
- 实践经验(Common Practices)
- 通用爬虫(Broad Crawls)
- 借助Firefox来爬取
- 使用Firebug进行爬取
- 调试内存溢出
- 下载项目图片
- Ubuntu 软件包
- Scrapyd
- 自动限速(AutoThrottle)扩展
- Benchmarking
- Jobs: 暂停,恢复爬虫
- DjangoItem
- 架构概览
- 下载器中间件(Downloader Middleware)
- Spider中间件(Middleware)
- 扩展(Extensions)
- 核心API
- Requests and Responses
- Settings
- 信号(Signals)
- 异常(Exceptions)
- Item Exporters
- Release notes
- Contributing to Scrapy
- Versioning and API Stability
- 试验阶段特性
- 索引
- Python 模块索引
文章来源于网络收集而来,版权归原创者所有,如有侵权请及时联系!
Python 模块索引
s
s | ||
scrapy | ||
scrapy.contracts | ||
scrapy.contracts.default | ||
scrapy.contrib.closespider | Close spider extension | |
scrapy.contrib.corestats | Core stats collection | |
scrapy.contrib.debug | Extensions for debugging Scrapy | |
scrapy.contrib.downloadermiddleware | ||
scrapy.contrib.downloadermiddleware.ajaxcrawl | ||
scrapy.contrib.downloadermiddleware.chunked | Chunked Transfer Middleware | |
scrapy.contrib.downloadermiddleware.cookies | Cookies Downloader Middleware | |
scrapy.contrib.downloadermiddleware.defaultheaders | Default Headers Downloader Middleware | |
scrapy.contrib.downloadermiddleware.downloadtimeout | Download timeout middleware | |
scrapy.contrib.downloadermiddleware.httpauth | HTTP Auth downloader middleware | |
scrapy.contrib.downloadermiddleware.httpcache | HTTP Cache downloader middleware | |
scrapy.contrib.downloadermiddleware.httpcompression | Http Compression Middleware | |
scrapy.contrib.downloadermiddleware.httpproxy | Http Proxy Middleware | |
scrapy.contrib.downloadermiddleware.redirect | Redirection Middleware | |
scrapy.contrib.downloadermiddleware.retry | Retry Middleware | |
scrapy.contrib.downloadermiddleware.robotstxt | robots.txt middleware | |
scrapy.contrib.downloadermiddleware.stats | Downloader Stats Middleware | |
scrapy.contrib.downloadermiddleware.useragent | User Agent Middleware | |
scrapy.contrib.exporter | Item Exporters | |
scrapy.contrib.linkextractors | Link extractors classes | |
scrapy.contrib.linkextractors.lxmlhtml | lxml's HTMLParser-based link extractors | |
scrapy.contrib.loader | Item Loader class | |
scrapy.contrib.loader.processor | A collection of processors to use with Item Loaders | |
scrapy.contrib.logstats | 记录基本统计(stats) | |
scrapy.contrib.memdebug | Memory debugger extension | |
scrapy.contrib.memusage | Memory usage extension | |
scrapy.contrib.pipeline.images | Images Pipeline | |
scrapy.contrib.spidermiddleware | ||
scrapy.contrib.spidermiddleware.depth | Depth Spider Middleware | |
scrapy.contrib.spidermiddleware.httperror | HTTP Error Spider Middleware | |
scrapy.contrib.spidermiddleware.offsite | Offsite Spider Middleware | |
scrapy.contrib.spidermiddleware.referer | Referer Spider Middleware | |
scrapy.contrib.spidermiddleware.urllength | URL Length Spider Middleware | |
scrapy.contrib.spiders | Collection of generic spiders | |
scrapy.contrib.statsmailer | StatsMailer extension | |
scrapy.crawler | The Scrapy crawler | |
scrapy.exceptions | Scrapy exceptions | |
scrapy.http | Request and Response classes | |
scrapy.item | Item and Field classes | |
scrapy.log | Logging facility | |
scrapy.mail | Email sending facility | |
scrapy.selector | Selector class | |
scrapy.settings | Settings manager | |
scrapy.signalmanager | The signal manager | |
scrapy.signals | Signals definitions | |
scrapy.spider | Spiders base class, spider manager and spider middleware | |
scrapy.spidermanager | The spider manager | |
scrapy.statscol | Stats Collectors | |
scrapy.telnet | The Telnet Console | |
scrapy.utils.trackref | Track references of live objects |
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论