python从网页中提取全部数据以获取上述日期
我正在尝试提取各种日期的数据（无硒） 我写了以下程序，没有获取数据 我也不知道如何在日期字段中输入各种日期以获取数据 我想要指导..
import json
import pandas as pd
import requests
import datetime
#from datetime import datetime
import os
import os.path
import schedule
import time
dt = str(datetime.date.today())
today = datetime.datetime.now()
date_time = today.strftime("%d-%m-%Y_%H.%M")
print("date and time:",date_time)
file_name = 'Data_' + date_time
save_path = r"C:\Users\Desktop\Python_OP\Data"
path = os.path.join(save_path, file_name+".csv")
endpoint = "https://bricsonline.nseindia.com/bondsnew/rest/public?r=sebiannexure1"
headers = {
"pageToken": "f06c7498-ac12-4def-95d2-f0fb903fff64",
"User-Agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36",
"X-Requested-With": "XMLHttpRequest",
}
payload = {
"columnNames": [
"Deal Type", "ISIN", "Listed / Unlisted Security", "Issuer Name", "Coupon",
"Issue Description", "Price", "Yield", "Yield Type",
"Outside Yield Range", "Put/Call Date", "Trade Value in Rs. Lacs", "Trade Date & Time", "Settlement Date",
"Reported trade/Trade executed on RFQ platform", "Remarks", "Settlement Status",
]
}
response = requests.post(endpoint, data=json.dumps(payload), headers=headers)
df = pd.DataFrame(response.json(), columns=payload["columnNames"])
print(df)
#df.to_csv(path, index=False)
#df.to_csv("your_table.csv", index=False)
I am trying to extract data for various dates ( without selenium )
I have written following program which is not fetching data
I also don't know how to enter various dates in date field to fetch data
I want guidance ..
import json
import pandas as pd
import requests
import datetime
#from datetime import datetime
import os
import os.path
import schedule
import time
dt = str(datetime.date.today())
today = datetime.datetime.now()
date_time = today.strftime("%d-%m-%Y_%H.%M")
print("date and time:",date_time)
file_name = 'Data_' + date_time
save_path = r"C:\Users\Desktop\Python_OP\Data"
path = os.path.join(save_path, file_name+".csv")
endpoint = "https://bricsonline.nseindia.com/bondsnew/rest/public?r=sebiannexure1"
headers = {
"pageToken": "f06c7498-ac12-4def-95d2-f0fb903fff64",
"User-Agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36",
"X-Requested-With": "XMLHttpRequest",
}
payload = {
"columnNames": [
"Deal Type", "ISIN", "Listed / Unlisted Security", "Issuer Name", "Coupon",
"Issue Description", "Price", "Yield", "Yield Type",
"Outside Yield Range", "Put/Call Date", "Trade Value in Rs. Lacs", "Trade Date & Time", "Settlement Date",
"Reported trade/Trade executed on RFQ platform", "Remarks", "Settlement Status",
]
}
response = requests.post(endpoint, data=json.dumps(payload), headers=headers)
df = pd.DataFrame(response.json(), columns=payload["columnNames"])
print(df)
#df.to_csv(path, index=False)
#df.to_csv("your_table.csv", index=False)
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（2）
您可以按照以下方式进行操作，更改JSON_DATA变量的日期，以
返回不同的数据
You can do it as below, change date in json_data variable for different data
returns
该页面上没有真正的内容。尝试“查看页面源”以查看我的意思。该页面只是一个用于布局的模板 /包装器，然后将 javascript生成的< / em>发布到Web服务中，以获取想要显示的数据，然后将其接收，格式和显示。
There is no real content on that page. Try 'View page source' to see what I mean. That page is just a template / wrapper for layout, which then makes a javascript-generated POST to a web service to get the data that it wants to display, which it then receives, formats and displays.