在UL标签下的所有LI标签中找到链接的问题

Question

我正在尝试在UL标签HTML代码下的所有LI标签中获取链接

：

<div id="chapter-list" class="sbox" style="">
<ul>
<li>
<a href="https://example.com/manga/name/2">
<div class="chpbox">
<span class="chapternum">
Chapter 2 </span>
</div>
</a>
</li>
<li>
<a href="https://example.com/manga/name/1">
<div class="chpbox">
<span class="chapternum">
Chapter 1 </span>
</div>
</a>
</li>
</ul>
</div>

我写的代码：

from bs4 import BeautifulSoup
import requests

html_page = requests.get('https://example.com/manga/name/')

soup = BeautifulSoup(html_page.content, 'html.parser')
chapters = soup.find('div', {"id": "chapter-list"})

children = chapters.findChildren("ul" , recursive=False) # when printed, it gives the the whole ul content

for litag in children.find('li'):
    print(litag.find("a")["href"])

当我尝试打印LI标签链接时，它会出现以下错误：

Traceback (most recent call last):
  File "C:\0.py", line 12, in <module>
    for litag in children.find('li'):
  File "C:\Users\hs\AppData\Local\Programs\Python\Python310\lib\site-packages\bs4\element.py", line 2289, in __getattr__
    raise AttributeError(
AttributeError: ResultSet object has no attribute 'find'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?

Answer 1

您可以使用查找在章节列表中找到 ul 。然后 find_all 在 ul 中查找列表项。最后，再次使用 find_all 再次查找每个列表项目中的链接并打印URL。这两种方法的详细信息可以在 find_all方法BS4上的文档。您可以使用 get_text（）在每个链接上搜索 capternum 之后，以获取链接的文本，例如第1章。按课堂搜索可以在

（更新）代码：

from bs4 import BeautifulSoup

html_doc = """
<div id="chapter-list" class="sbox" style="">
    <ul>
        <li>
            <a href="https://example.com/manga/name/2">
                <div class="chpbox">
<span class="chapternum">
Chapter 2 </span>
                </div>
            </a>
        </li>
        <li>
            <a href="https://example.com/manga/name/1">
                <div class="chpbox">
<span class="chapternum">
Chapter 1 </span>
                </div>
            </a>
        </li>
    </ul>
</div>
"""

soup = BeautifulSoup(html_doc, 'html.parser')
chapters = soup.find('div', {"id": "chapter-list"})

list_items = chapters.find('ul').find_all('li')

for list_item in list_items:
    for link in list_item.find_all('a'):
        title = link.find('span', class_='chapternum').get_text().strip()
        href = link.get("href")
        print(f"{title}: {href}")

输出：

Chapter 2: https://example.com/manga/name/2
Chapter 1: https://example.com/manga/name/1

参考：

• find and find_all方法bs4
• bs4文档，用于搜索元素