apefify如何停止在浏览器中打开新页面的Enqueuelink函数

Question

我正在尝试从页面获得链接，然后通过单击按钮导航到下一页。问题是我首先需要将第一页上的所有链接添加到队列中，但是当我尝试单击元素时，Enqueuelist函数似乎启动了一个新页面，从而导致“未找到错误”。 任何建议都会有所帮助！

exports.handleList = async ({ request, page }, requestQueue) => {
    await Apify.utils.enqueueLinks({
        page: page,
        requestQueue: requestQueue,
        selector: "#traziPoduzeca > tbody > tr > td > span > a",
        baseUrl: "https://www.fininfo.hr/Poduzece/[.*]",
        transformRequestFunction: (request) => {
            request.userData = {
                label: "DETAIL",
            };
            return request;
        },
    });

    log.info('about to scrap urls')

    
    await page.waitForTimeout(120);
    
    let btn_selector =
        "//div[@class='contentNav'][1]//div[@class='pagination'][1]//span[@class='current']/following-sibling::a";
    let buttonEle = await page.$x(btn_selector);

    log.info(`length of pagination is ${buttonEle.length}`);

    for (let index = 0; index < buttonEle.length; index++) {
        await page.waitForTimeout(120);

        await buttonEle[index].click();

        log.info("clicked");

        await page.waitForTimeout(200);

        await Apify.utils.enqueueLinks({
            page: page,
            requestQueue: requestQueue,
            selector: "#traziPoduzeca > tbody > tr > td > span > a",
            baseUrl: "https://www.fininfo.hr/Poduzece/[.*]",
            transformRequestFunction: (request) => {
                request.userData = {
                    label: "DETAIL",
                };
                return request;
            },
        });
    }
};

Answer 1

导致错误的不是Enqueuelinks函数。如果您想留在同一页面上，则需要等待导航，类似的事情：

const btn_selector =
        "//div[@class='contentNav'][1]//div[@class='pagination'][1]//span[@class='current']/following-sibling::a";

// log.info(`length of pagination is ${buttonEle.length}`);

for (;;) {
  // the button handle will change everytime the navigation happens
  // so you need to re-evaluate every time
  const [buttonEle] = await page.$x(btn_selector);
   
  if (!buttonEle) {
    log.info("no pagination element found");
    break;
  }
  
  await page.waitForTimeout(120);

  await Promise.all([
     page.waitForNavigation(), // this will not destroy the context of current page
     buttonEle.click(), 
  ]);

  log.info("clicked");

  await page.waitForTimeout(200);

  // enqueue links...
}