在Beautifuresoup Python Web刮板中获得错误的链接

Question

我正在编写网络刮板，并正在努力从网页上获取HREF链接。 URL为 https://www.seedinvest.com/auto 我试图获得HREF链接他们的个人文章。这是一个示例：

<a class="card-url full-size-content" href="https://www.seedinvest.com/soil.connect/seed"></a>

这是我的代码：

import pandas as pd
import os
import requests
from bs4 import BeautifulSoup
import re



URL = "https://www.seedinvest.com/offerings"
page = requests.get(URL)
soup = BeautifulSoup(page.text, "html.parser")


### Searching for all embeded company website links and displaying them

links = []
for link in soup.findAll(class_="card-url full-size-content"):
    links.append(link.get('href'))
print(links)

当我运行代码时，我得到了：

[]

您能帮我找到正确的链接吗？

Answer 1

它在

import pandas as pd
import os
import requests
from bs4 import BeautifulSoup
import re


URL = "https://www.seedinvest.com/auto"
page = requests.get(URL)
soup = BeautifulSoup(page.text, "html.parser")


### Searching for all embeded company website links and displaying them

links = []
for link in soup.findAll(class_="card-url full-size-content"):
    links.append(link.get('href'))
print(links)

。

['https://www.seedinvest.com/nowrx/series.c', 'https://www.seedinvest.com/appmail/seed', 'https://www.seedinvest.com/soil.connect/seed', 'https://www.seedinvest.com/cytonics/series.c.2']

Answer 2

也许您在代码中使用了错误的URL：https://www.seedinvest.com/offerings而不是https://www.seedinvest.com/auto ？