Day095 — puppeteer

Here records the things I learned in a puppeteer project.

Puppeteer is a Node library which provides a high-level API to control Chrome or Chromium over the DevTools Protocol.

GoogleChrome/puppeteer

API doc:

GoogleChrome/puppeteer

waitForNetworkIdle:

Control networkidle wait time · Issue #1353 · GoogleChrome/puppeteer

Can't await `networkidle` after `page.click` for JS sites · Issue #1278 · GoogleChrome/puppeteer

Run async function immediately:

5. Async functions

How to handle Async/Await UnhandledPromiseRejectionWarning:

Async/Await UnhandledPromiseRejectionWarning - Today I Learned

Debug Node.js in VS Code

Debug Node.js Apps using Visual Studio Code

Create directory if not exist:

Node.js create folder or use existing

Create file with fs Promises API:

File System | Node.js v12.3.1 Documentation

Using filesystem in node.js with async / await

check file / directory exist:

File System | Node.js v12.3.1 Documentation

use es6 syntax in node:

Getting started with Node.js modules: require, exports, imports and beyond

How To Enable ECMAScript 6 Imports in Node.JS

Read file line by line:

Reading a File Line by Line in Node.js

Node.js - Reading a File Line by Line

Parse HTML:

node-html-parser

Xpath Axes

XPath Axes

Difference between . and text() in XPath:

XPath: difference between dot and text()