Skip to main content
whitep4nth3r logo

17 Mar 2021

6 min read

3 ways to use Puppeteer and Node.js to screenshot web pages and generate Open Graph images for socials

Take screenshots of browser pages and generate dynamic images to share on your social media accounts.

⚠️ This post is over two years old and may contain some outdated technical information. Please proceed with caution!

It’s no secret that you drive more engagement when you share beautiful images with links on social media. But generating fresh images each time you publish a new blog post can be incredibly time-consuming. The good news is, we can harness the power of a tool called Puppeteer to take screenshots of browser pages and generate dynamic images to share on your social media accounts. Let’s take a look!

What is Open Graph?

The Open Graph (OG) protocol was created at Facebook in 2010 to enable web page links to become rich objects with similar functionality and appearance to other content posted on Facebook. If you’ve shared a link on social media and have seen the platform automatically show you a large image, title, description and URL for the link you want to share even before you’ve clicked Post — you’ve seen the OG protocol at work.

Open Graph meta tags are used in the <head> of an HTML page to expose information about web pages to social media platforms and other applications that unfurl URL metadata. OG meta tags are identified in the HTML by a property attribute prefixed with og.  

This is an example of an Open Graph meta tag. It provides a url to an image that is used to represent the web page.

<meta property="og:image" content="https://example.com/image.png" />

OG meta tags can also be used to customize the appearance of your web pages according to the platform it’s shared on. For example, Twitter rolled out their own custom implementation of this, built on the OG protocol, and the following code tells Twitter to show the large image web page previews.

<meta name="twitter:card" content="summary_large_image" />
<meta name="twitter:image" content="https://example.com/image.png" />

You can see this in this image generated from one of my tweets.

Read more about the Open Graph protocol here.

A basic — yet useful — implementation of an Open Graph image tag on your web pages should point to a static image. But in a world of sensory overload, how do you ensure your OG images provide useful context to your audience for the link you are sharing? How do you create automatically generated dynamic OG images for your web pages without having to open up Photoshop each time you want to promote a new post?

Enter Puppeteer!

Puppeteer is a Node library that provides a high-level API to control headless Chrome or Chromium. “Headless” browsers allow you to automate your interactions with a browser-like environment via a command-line interface. Most things that you can do manually in the browser can be done using Puppeteer.

Read the Puppeteer documentation.

A great way to elevate your Open-Graph-image game is to harness the power of Puppeteer by providing a link in your OG image tags that calls out to a serverless function that generates a screenshot of a browser page.

Other uses for the automation of generating screenshots of web pages might include build pipeline tools that check for web page regressions during new feature releases, or to provide richer experiences in the front end for your audience. Vercel had a great example of this. They show a preview of your application in your deployment dashboard.

A screenshot of the deployment dashboard in Vercel which shows a screenshot of the deployed website

If you want to dive straight into some example code, this repository demonstrates how you can get started with Puppeteer to generate screenshots of web page pages

I can take screenshots of webpages with code? This sounds pretty magical! How does it work?

This puppeteer-demo repository contains a Vercel serverless function that runs in the browser and accepts a URL parameter of page. This would be a URL of a web page you want to screenshot, including https://.

Give it a try by visiting this URL: https://puppeteer-screenshot-demo.vercel.app/api/screenshot?page=https://whitep4nth3r.com

Here’s what you’ll see in the browser.

A screenshot of Chrome browser with the Vercel function URL in the address bar, showing the generated screenshot from running the serverless function

Switch out the page parameter for a different URL to watch it in action!

Let’s take a look at what just happened when you called the URL in the browser.

  1. You called out to a serverless function hosted on Vercel

  2. The instance of the function installed Puppeteer and spun up a Chrome headless browser in memory

  3. The installation of Chrome launched, and visited the provided URL with a viewport size specified of 1920 x 1080

  4. Chrome took a screenshot of the page as a .png file in the viewport and the function saved the file in memory

  5. The instance of Chrome closed itself

  6. The function returned the file to the browser with a Content-Type of image/png

That’s pretty cool, right?

If this excites you as much as it excited me when I first discovered the capabilities of Puppeteer, read on to see three ways in which you can use Puppeteer to take screenshots of web pages: on the command line, as a serverless function in the background or in a front-end application.

1. Generating screenshots on the command line

First, clone the repo to your local machine.

Using git HTTPS:

git clone https://github.com/whitep4nth3r/puppeteer-demo.git

Or, using the GitHub CLI:

gh repo clone whitep4nth3r/puppeteer-demo

Install dependencies:

cd puppeteer-demo
npm install
#or
yarn install

Run the following command in your terminal at the root of the project directory. You can also pass in multiple URLs separated by a space.

cd puppeteer-demo
node demo.js https://whitep4nth3r.com
#or e.g.
node demo.js https://whitep4nth3r.com https://stefanjudis.com

You’ll notice that a new .png file (or files) will be created in the screenshots directory from the URL provided.

A screenshot of the file tree in VS Code showing the newly created png files

Let’s look at the code.

const puppeteer = require("puppeteer");

(async () => {
// Take the urls from the command line
var args = process.argv.slice(2);

try {
// launch a new headless browser
const browser = await puppeteer.launch();

// loop over the urls
for (let i = 0; i < args.length; i++) {

// check for https for safety!
if (args[i].includes("https://")) {
const page = await browser.newPage();

// set the viewport size
await page.setViewport({
width: 1920,
height: 1080,
deviceScaleFactor: 1,
});

// tell the page to visit the url
await page.goto(args[i]);

// take a screenshot and save it in the screenshots directory

await page.screenshot({
path: `./screenshots/${args[i].replace("https://", "")}.png`
});

// done!
console.log(`✅ Screenshot of ${args[i]} saved!`);
} else {
console.error(`❌ Could not save screenshot of ${args[i]}!`);
}
}

// close the browser
await browser.close();
} catch (error) {
console.log(error);
}
})();

2. Running a serverless function in the browser

Vercel serverless functions can have a maximum size of 50MB. The code on the server (api/screenshot.js) uses the puppeteer-core package (which comes without any headless browser installed) instead of the full puppeteer installation. To take the screenshot, we install a light version of Chrome via chrome-aws-lambda on the server. This keeps the function size down.

Additionally, we configure the puppeteer.launch() options differently for development and production. For safety on the server, we only accept one URL.

To run the serverless function locally, you’ll need to install the Vercel CLI

To install the Vercel CLI globally via npm, run:

npm i -g vercel

To start the development server, open your terminal and run:

cd puppeteer-demo
vercel dev

To ensure Puppeteer is given the correct options for the development environment, pass the query parameter isDev=true to the function. Here’s an example of how to run the serverless function in your local development environment.

http://localhost:3000/api/screenshot?page=https://whitep4nth3r.com&isDev=true

Here’s the serverless function adapted from the code which runs on the local command line.

const puppeteer = require("puppeteer-core");
const chrome = require("chrome-aws-lambda");

/** The code below determines the executable location for Chrome to
* start up and take the screenshot when running a local development environment.
*
* If the code is running on Windows, find chrome.exe in the default location.
* If the code is running on Linux, find the Chrome installation in the default location.
* If the code is running on MacOS, find the Chrome installation in the default location.
* You may need to update this code when running it locally depending on the location of
* your Chrome installation on your operating system.
*/


const exePath =
process.platform === "win32"
? "C:\\Program Files (x86)\\Google\\Chrome\\Application\\chrome.exe"
: process.platform === "linux"
? "/usr/bin/google-chrome"
: "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome";

async function getOptions(isDev) {
let options;
if (isDev) {
options = {
args: [],
executablePath: exePath,
headless: true,
};
} else {
options = {
args: chrome.args,
executablePath: await chrome.executablePath,
headless: chrome.headless,
};
}
return options;
}

module.exports = async (req, res) => {
const pageToScreenshot = req.query.page;

// pass in the isDev=true parameter if you are developing locally
// to ensure puppeteer picks up your machine installation of
// Chrome via the configurable options
const isDev = req.query.isDev === "true";

try {
// check for https for safety!
if (!pageToScreenshot.includes("https://")) {
res.statusCode = 404;
res.json({
body: "Sorry, we couldn't screenshot that page. Did you include https://?",
});
}

// get options for browser
const options = await getOptions(isDev);

// launch a new headless browser with dev / prod options
const browser = await puppeteer.launch(options);
const page = await browser.newPage();

// set the viewport size
await page.setViewport({
width: 1920,
height: 1080,
deviceScaleFactor: 1,
});

// tell the page to visit the url
await page.goto(pageToScreenshot);

// take a screenshot
const file = await page.screenshot({
type: "png",
});

// close the browser
await browser.close();

res.statusCode = 200;
res.setHeader("Content-Type", `image/png`);

// return the file!
res.end(file);
} catch (e) {
res.statusCode = 500;
res.json({
body: "Sorry, Something went wrong!",
});
}
};

3. Building a slightly fancier front end to run the serverless function

Finally, we can call out to the serverless function in a web page application that returns the screenshot to us in the browser. Call the function URL using fetch, construct a blob from the response and create an object URL from the blob to be able to display it in the HTML.

Here’s the functional front-end code built with vanilla JavaScript.

// Change this to "true" if you are developing locally
const isDev = "true";

// Query the elements we need from the DOM
const form = document.querySelector("form");
const urlInput = document.querySelector("[data-url-input]");
const imageHolder = document.querySelector("[data-image-holder]");
const imageHolderTitle = document.querySelector("[data-image-holder-title]");
const loader = document.querySelector("[data-loader]");

function buildImageElement(url) {
const imageEl = document.createElement("img");
imageEl.setAttribute("src", url);
imageEl.setAttribute("id", "generatedImage");
return imageEl;
}

function clearImageHolder() {
const imageEl = document.getElementById("generatedImage");
if (imageEl) {
imageHolderTitle.style.display = "none";
imageEl.remove();
}
}

function showLoader() {
loader.style.display = "block";
}

function hideLoader() {
loader.style.display = "none";
}

// Call out to the serverless function on form submit
form.addEventListener("submit", async (event) => {
event.preventDefault();
clearImageHolder();
showLoader();

await fetch(`/api/screenshot?page=${urlInput.value}&isDev=${isDev}`)
.then((response) => response.blob())
.then((blob) => {
const url = URL.createObjectURL(blob);

// build up the image element with the url
const newImageEl = buildImageElement(url);
imageHolderTitle.style.display = "block";

// add the new element to the DOM
imageHolder.appendChild(newImageEl);
hideLoader();
});
});
An animated GIF of the puppeteer demo front end in action

View the live demo application here.

How I generate my dynamic Open Graph images for whitep4nth3r.com

To create dynamic Open Graph images for my personal blog site built with Next.js and Contentful, I forked this repository from Vercel that uses Puppeteer in the same way as described above, and created my own custom service which I host on Vercel.

View the front-end application here.

The application renders an HTML page based on the title of a blog post or page, which then uses Puppeteer to screenshot the page, and cache it.

The URL parameters in the request hold the key to the magic being performed here. Here’s a look at the code that generates my dynamic Open Graph images in the head of my web pages, which you can find in full here.

// Get a random light/dark theme to switch things up
function getRandomTheme() {
const themes = ["light", "dark"];
return themes[Math.floor(Math.random() * themes.length)];
}

// Get a random panther SVG to switch things up even more
function getRandomPanther() {
const panthers = ["cool", "dolla", "fire", "heart", ...];
return panthers[Math.floor(Math.random() * panthers.length)];
}

// Get the base panther image uri - it's important to use encodeURIComponent() here to ensure all characters of the image url are encoded
function getBaseImageEncodedUri() {
return encodeURIComponent(
"https://examplebaseurl.com/dir/to/images",
);
}

// And the magic happens here
function generateImageUrl(title) {
return `https://url.to.the.service/${encodeURI(
title,
)}
.png?theme=${getRandomTheme()}&md=0fontSize=80px&images=${getBaseImageEncodedUri()}${getRandomPanther()}.svg`
;
}

// And this code calls the generateImageUrl function in the head of my blog pages
<meta property="og:image" content={generateImageUrl(title)} />

Harness the magic of Puppeteer in three ways: on the command line, as a serverless function in the background, or in a front-end application. Explore and fork this puppeteer-demo repository to see Puppeteer in action — and have fun creating dynamic Open Graph images for your websites or finding new ways to use Puppeteer!

If you found this helpful, check out the rest of my guides on the Contentful blog

And remember, build stuff, learn things and love what you do.

Originally posted on www.contentful.com

Want weird stuff in your inbox?

Join undefined subscribers in the Weird Wide Web Hole to find no answers to questions you didn't know you had.

Subscribe

Salma sitting cross legged on a sofa, holding a microphone, looking up into the right of the space.

Salma Alam-Naylor

I'm a live streamer, software engineer, and developer educator. I help developers build cool stuff with blog posts, tutorial videos, live coding and open source projects.

Related posts

7 Sep 2021

How to build a personalized image social sharing app with Cloudinary and Next.js

Encourage your event attendees to share their tickets for your next virtual event!

Tutorials 11 min read →