返回介绍

Python 模块索引

发布于 2020-02-24 17:13:31 字数 8672 浏览 1069 评论 0 收藏 0

s

 
s
scrapy
   
scrapy.contracts
   
scrapy.contracts.default
   
scrapy.contrib.closespider
Close spider extension
   
scrapy.contrib.corestats
Core stats collection
   
scrapy.contrib.debug
Extensions for debugging Scrapy
   
scrapy.contrib.downloadermiddleware
   
scrapy.contrib.downloadermiddleware.ajaxcrawl
   
scrapy.contrib.downloadermiddleware.chunked
Chunked Transfer Middleware
   
scrapy.contrib.downloadermiddleware.cookies
Cookies Downloader Middleware
   
scrapy.contrib.downloadermiddleware.defaultheaders
Default Headers Downloader Middleware
   
scrapy.contrib.downloadermiddleware.downloadtimeout
Download timeout middleware
   
scrapy.contrib.downloadermiddleware.httpauth
HTTP Auth downloader middleware
   
scrapy.contrib.downloadermiddleware.httpcache
HTTP Cache downloader middleware
   
scrapy.contrib.downloadermiddleware.httpcompression
Http Compression Middleware
   
scrapy.contrib.downloadermiddleware.httpproxy
Http Proxy Middleware
   
scrapy.contrib.downloadermiddleware.redirect
Redirection Middleware
   
scrapy.contrib.downloadermiddleware.retry
Retry Middleware
   
scrapy.contrib.downloadermiddleware.robotstxt
robots.txt middleware
   
scrapy.contrib.downloadermiddleware.stats
Downloader Stats Middleware
   
scrapy.contrib.downloadermiddleware.useragent
User Agent Middleware
   
scrapy.contrib.exporter
Item Exporters
   
scrapy.contrib.linkextractors
Link extractors classes
   
scrapy.contrib.linkextractors.lxmlhtml
lxml's HTMLParser-based link extractors
   
scrapy.contrib.loader
Item Loader class
   
scrapy.contrib.loader.processor
A collection of processors to use with Item Loaders
   
scrapy.contrib.logstats
记录基本统计(stats)
   
scrapy.contrib.memdebug
Memory debugger extension
   
scrapy.contrib.memusage
Memory usage extension
   
scrapy.contrib.pipeline.images
Images Pipeline
   
scrapy.contrib.spidermiddleware
   
scrapy.contrib.spidermiddleware.depth
Depth Spider Middleware
   
scrapy.contrib.spidermiddleware.httperror
HTTP Error Spider Middleware
   
scrapy.contrib.spidermiddleware.offsite
Offsite Spider Middleware
   
scrapy.contrib.spidermiddleware.referer
Referer Spider Middleware
   
scrapy.contrib.spidermiddleware.urllength
URL Length Spider Middleware
   
scrapy.contrib.spiders
Collection of generic spiders
   
scrapy.contrib.statsmailer
StatsMailer extension
   
scrapy.crawler
The Scrapy crawler
   
scrapy.exceptions
Scrapy exceptions
   
scrapy.http
Request and Response classes
   
scrapy.item
Item and Field classes
   
scrapy.log
Logging facility
   
scrapy.mail
Email sending facility
   
scrapy.selector
Selector class
   
scrapy.settings
Settings manager
   
scrapy.signalmanager
The signal manager
   
scrapy.signals
Signals definitions
   
scrapy.spider
Spiders base class, spider manager and spider middleware
   
scrapy.spidermanager
The spider manager
   
scrapy.statscol
Stats Collectors
   
scrapy.telnet
The Telnet Console
   
scrapy.utils.trackref
Track references of live objects

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
    我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
    原文