未显示解析petshop.ru的结果

Question

我正在尝试分析页面，但它行不通。

    import requests
from bs4 import BeautifulSoup as BS

r = requests.get ("https://www.petshop.ru/catalog/cats/veterinary_feed/dlya_koshek_pri_zapore_fibre_response_fr31_5789/")
html = BS (r.content, 'html.parser')

for el in html.select (".style_product_head__ufClP > .style_tablet__bK5he style_desktop__3Zkvu"):
title = el.select ('.style_list__3V0_P > .style_price_wrapper__1HT8P')
print ( title[0].text )

我按照模型的方式做，因为不熟悉python：

import requests
from bs4 import BeautifulSoup as BS

r = requests.get ("https://stopgame.ru/review/new/izumitelno/p1")
html = BS (r.content, 'html.parser')

for el in html.select (".items > .article-summary "):
title = el.select ('.caption > a')
print ( title[0].text )

我希望看到以下结果：о儿цRTim

理想情况下，知道如何显示这种结果也很有趣： petshop.ru：„обыч音乐3 125₽，因为我计划实施更多网站的解析，以跟踪此猫食品的价格:)

Answer 1

您想要的所有数据都在HTML源中，并且它以JSON对象作为＆lt; script＆gt; tag的json对象出现。您可以轻松定位它并解析它。

如下：

import json
import re

import requests

url = "https://www.petshop.ru/catalog/cats/veterinary_feed/dlya_koshek_pri_zapore_fibre_response_fr31_5789/"

headers = {
    "User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:99.0) Gecko/20100101 Firefox/99.0",
}

data = (
    json.loads(
        re.search(
            r'"onProductView",\s(.*)\);',
            requests.get(url, headers=headers).text
        ).group(1)
    )
)

print(f"{data['product']['name']} - {data['product']['price']} руб.")

输出：

Для кошек при запоре - 3125 руб.