Glossary

Web Scraping & API Glossary

Comprehensive glossary of web scraping, crawling, and API terms. Learn the essential concepts and terminology used in web data extraction.

How can I expose BackendNodeId in the a11y snapshot?

Puppeteer

BackendNodeId is exposed in the a11y snapshot. Each node in the snapshot includes a backendNodeId that lets you map acce...

How can I open a page in a tab or a window using Puppeteer?

Puppeteer

This feature allows opening a page in a tab or a window. newPage() can now be called with window options to choose where...

How to configure CDP message ID generator in Puppeteer?

Puppeteer

The CDP message ID generator can be configured by passing a custom idGenerator to the Connection constructor. This enabl...

How to disable xdg-open popup in Puppeteer?

Puppeteer

To stop the xdg-open popup in Puppeteer, configure a Chrome policy URLAllowlist and use a Chrome binary that reads that ...

How to expose the url property for links in Puppeteer

Puppeteer

How to expose the url property for links If you need the full URL of a link in Puppeteer, use the url property that was ...

How to fix Fetch.enable wasn't found error for workers in Puppeteer

Puppeteer

Fetch.enable wasn't found is raised when trying to enable the Fetch domain for a worker. The fix is to ignore this error...

How to fix Puppeteer ExtensionTransport tasks and session management

Puppeteer

Puppeteer now dispatches each CDP message in its own JavaScript task by scheduling dispatch with setTimeout. This ensure...

How to open DevTools for a Page in Puppeteer?

Puppeteer

To open DevTools for a page in Puppeteer, use the new Page.openDevTools() method. It calls the DevTools interface for th...

How can I reload a Puppeteer page while ignoring the cache?

Puppeteer

Use the ignoreCache option with Page.reload to reload while ignoring the browser cache. ``js await page.reload({ ignoreC...

What fixes Puppeteer not waiting for all targets when connecting?

Puppeteer

Fixes Puppeteer not waiting for all targets when connecting by only awaiting child targets for tab targets. When connect...

What is the correct type for the pageerror event in Puppeteer?

Puppeteer

Summary The pageerror event may emit not only Error objects but also values of unknown type. Treat the payload as unknow...

What is the reason for removing the test server from release-please in Puppeteer

Puppeteer

The test server was removed from the release-please workflow to simplify the release process and remove an unnecessary e...