有下载图像问题

Question

我已经建立了一个简单的刮刀来从网站下载图像。不幸的是，我在下载这些图像时遇到了问题，因此没有下载任何内容。我已经在线搜索了类似的问题，并练习了这些问题，但对我不起作用。我过去曾做过这项工作，所以我不明白为什么它现在不起作用。

我的刮板：

import scrapy
from scrapy_exercises.items import ScrapyExercisesItem


class TestSpider(scrapy.Spider):
    name = 'test'
    start_urls = ['https://www.meadowhall.co.uk/eatdrinkshop?page=1']

    def start_requests(self):
        for url in self.start_urls:
            yield scrapy.Request(
                url=url,
                callback=self.parse
            )

    def parse(self, response):

        content_page = response.xpath("//div[@class='view-content']//div")
        for cnt in content_page:

            link = cnt.xpath('.//a/@href').get()
            image_url = cnt.xpath(".//img//@src").get()
            
            if link != None:
                items = ScrapyExercisesItem()
                items['images'] = [image_url.split('?')[0]]
                yield items

pipelines.py

from scrapy.pipelines.images import ImagesPipeline
class DownfilesPipeline(ImagesPipeline):
    def file_path(self, request, response=None, info=None):
        image_name: str = request.url.split("/")[-1]
        return image_name

settings.py

ITEM_PIPELINES = {
    'scrapy_exercises.pipelines.DownfilesPipeline': 55
    }
IMAGES_STORE = '.'

items.py：

class ScrapyExercisesItem(scrapy.Item):
    images = scrapy.Field()

Answer 1

我认为您需要做的就是添加一些设置，并在您的项目类中包含一个

字段

class ScrapyExercisesItem(scrapy.Item):
    images = scrapy.Field()
    results = scrapy.Field()

结果

IMAGES_URLS_FIELD = 'images'
IMAGES_RESULT_FIELD = 'results'

。