[SOLVED] Using Puppeteer in a Function? | Appwrite | Page 1

uncut kernel Dec 11, 2023, 9:59 PM

#

I'm trying to create PDF's from HTML in a Function, and right now I am getting this error

Error: Could not find Chrome (ver. 119.0.6045.105). This can occur if either
 1. you did not perform an installation before running the script (e.g. `npx puppeteer browsers install chrome`) or
 2. your cache path is incorrectly configured (which is: /root/.cache/puppeteer).
For (2), check out our guide on configuring puppeteer at https://pptr.dev/guides/configuration.
    at ChromeLauncher.resolveExecutablePath (file:///usr/local/server/src/function/node_modules/puppeteer-core/lib/esm/puppeteer/node/ProductLauncher.js:262:27)
    at ChromeLauncher.executablePath (file:///usr/local/server/src/function/node_modules/puppeteer-core/lib/esm/puppeteer/node/ChromeLauncher.js:213:25)
    at ChromeLauncher.computeLaunchArguments (file:///usr/local/server/src/function/node_modules/puppeteer-core/lib/esm/puppeteer/node/ChromeLauncher.js:107:37)
    at async ChromeLauncher.launch (file:///usr/local/server/src/function/node_modules/puppeteer-core/lib/esm/puppeteer/node/ProductLauncher.js:53:28)
    at async Module.default (file:///usr/local/server/src/function/src/main.js:15:19)
    at async execute (/usr/local/server/src/server.js:141:22)
    at async /usr/local/server/src/server.js:158:13

which makes sense, but I changed the command

npm install && npx puppeteer browsers install chrome and that ran, but it still doesn't know, so do I need to set the location or cache location? Anyone done this yet?

uncut kernel Dec 11, 2023, 10:29 PM

#

so I found out it's installing

#

it's just it's installing to executablePath: '/root/.cache/puppeteer/chrome/linux-119.0.6045.105/chrome-linux64/chrome',

inner stratus Dec 11, 2023, 10:29 PM

#

uncut kernel I'm trying to create PDF's from HTML in a Function, and right now I am getting t...

I got puppeteer to work with the following build commands:

apk update && apk fetch chromium nss freetype harfbuzz ca-certificates ttf-freefont && npm i

#

package.json:

{
  "name": "starter-template",
  "version": "1.0.0",
  "description": "",
  "main": "src/main.js",
  "type": "module",
  "scripts": {
    "format": "prettier --write ."
  },
  "dependencies": {
    "node-appwrite": "^9.0.0",
    "puppeteer": "^21.3.6"
  },
  "devDependencies": {
    "prettier": "^3.0.0"
  }
}

#

function variables:

PUPPETEER_EXECUTABLE_PATH=/usr/bin/chromium-browser

uncut kernel Dec 11, 2023, 10:32 PM

#

interesting

#

so I can't use default okay one sec

inner stratus Dec 11, 2023, 10:33 PM

#

main.js

import { execSync } from 'node:child_process';
import puppeteer from 'puppeteer';

let installed = false

export default async (context) => {
  try {

    if (installed) {
      context.log('already installed chromium');
    } else {
      execSync('apk add /usr/local/server/src/function/*.apk');
      context.log('installed chromium');
      installed = true;
    }


    const browser = await puppeteer.launch({
      headless: true,
      args: [
        "--no-sandbox",
        "--headless",
        "--disable-gpu",
        "--disable-dev-shm-usage",
      ],
    });
    return context.res.send("loaded puppeteer");
  } catch (e) {
    return context.res.send(e.message);
  }
};

uncut kernel Dec 11, 2023, 10:34 PM

#

wow thank you

inner stratus Dec 11, 2023, 10:37 PM

#

1st execution:

#

2nd:

uncut kernel Dec 11, 2023, 10:37 PM

#

interesting

#

and that stays in that docker?

#

so each deployment isn't a fresh install but more of a container overall and then updating it?

inner stratus Dec 11, 2023, 10:38 PM

#

uncut kernel and that stays in that docker?

so the idea is the build command downloads the OS level dependencies and so it gets added to the build output. When your function executes for the first time, the OS level dependencies get installed.

uncut kernel Dec 11, 2023, 10:38 PM

#

so I did

uncut kernel Dec 11, 2023, 10:39 PM

#

inner stratus so the idea is the build command downloads the OS level dependencies and so it g...

"name": "CreatePdfFromHtml",
            "runtime": "node-20.0",
            "execute": [
                "users"
            ],
            "events": [],
            "schedule": "",
            "timeout": 15,
            "enabled": true,
            "logging": true,
            "entrypoint": "src/main.js",
            "commands": "apk update && apk fetch chromium nss freetype harfbuzz ca-certificates ttf-freefont && npm install",
            "ignore": [
                "node_modules",
                ".npm"
            ],
            "path": "functions/CreatePdfFromHtml"
        }

#

so the build auto-fetches the latest version cause what if new features or idk but I wanted a way for that to work

#

then I did

export default async ({ req, res, log, error }) => {
  try {
    log(`Starting Puppeteer timestamp (seconds): ${Date.now() / 1000}`);
    
    // Add the executablePath to the launch options
    const browser = await Puppeteer.launch({
      headless: "new",
      executablePath: '/usr/bin/chromium-browser', // this is the path to the docker container's chromium-browser executable
      args: [
        '--no-sandbox', 
        '--disable-setuid-sandbox',
        '--disable-gpu',
        '--headless',
        '--disable-dev-shm-usage',
      ] // these args are often necessary in a Docker environment
    });

    const page = await browser.newPage();
    await page.setContent(req.body.html);
    const pdf = await page.pdf({ format: 'letter' });
    await browser.close();

    log(`Ending Puppeteer timestamp (seconds): ${Date.now() / 1000}`);

    res.setHeader('Content-Type', 'application/pdf');
    res.setHeader('Content-Disposition', 'attachment; filename=document.pdf');
    return res.send(pdf);
  } catch (e) {
    error('Error generating PDF', e);
    return res.send('Failed to generate PDF');
  }
};

and that fails after 2s

#

which

#

can I send a PDF like that?

#

lol

inner stratus Dec 11, 2023, 10:40 PM

#

inner stratus main.js ```javascript import { execSync } from 'node:child_process'; import pup...

see this

uncut kernel Dec 11, 2023, 10:40 PM

#

or do I need to base64 encode it

uncut kernel Dec 11, 2023, 10:40 PM

#

inner stratus see this

yeah but if it's installed it's just installed, it doesn't check for new no?

inner stratus Dec 11, 2023, 10:40 PM

#

uncut kernel can I send a PDF like that?

you can only send strings

uncut kernel Dec 11, 2023, 10:40 PM

#

rip so must send base64 if I don't auto-upload to storage?

inner stratus Dec 11, 2023, 10:40 PM

#

uncut kernel yeah but if it's installed it's just installed, it doesn't check for new no?

to download new dependencies, you'd have to deploy again

inner stratus Dec 11, 2023, 10:40 PM

#

uncut kernel rip so must send base64 if I don't auto-upload to storage?

i suggest uploading to Appwrite storage

uncut kernel Dec 11, 2023, 10:40 PM

#

yeah that's what I do oh I see what you mean

#

yeah that's what I was gonna do was just testing to see if it worked

uncut kernel Dec 11, 2023, 10:46 PM

#

inner stratus i suggest uploading to Appwrite storage

so

#

still getting an unknown error

#

need to add more logging to know where one sec

inner stratus Dec 11, 2023, 10:47 PM

#

uncut kernel still getting an unknown error

what's your code?

uncut kernel Dec 11, 2023, 10:47 PM

#

export default async ({ req, res, log, error }) => {
  try {
    log(`Starting Puppeteer timestamp (seconds): ${Date.now() / 1000}`);
    const client = new Client()
       .setEndpoint('https://appwrite.pva.ai/v1')
       .setProject(process.env["APPWRITE_FUNCTION_PROJECT_ID"])
       .setKey(process.env["APPWRITE_API_KEY"]);
    const storage = new Storage(client);

    const userId = req.body.userId;
    
    // Add the executablePath to the launch options
    const browser = await Puppeteer.launch({
      headless: "new",
      executablePath: '/usr/bin/chromium-browser', // this is the path to the docker container's chromium-browser executable
      args: [
        '--no-sandbox', 
        '--disable-setuid-sandbox',
        '--disable-gpu',
        '--headless',
        '--disable-dev-shm-usage',
      ] // these args are often necessary in a Docker environment
    });
    log(`Browser launched`);
    const page = await browser.newPage();
    log(`Page created`);
    await page.setContent(req.body.html);
    log(`Content set`);
    const pdf = await page.pdf({ format: 'letter' });
    log(`PDF generated`);
    await browser.close();

    log(`Ending Puppeteer timestamp (seconds): ${Date.now() / 1000}`);
    const file = await storage.createFile(
      "mystorageid",
      ID.unique(),
      InputFile.fromBuffer(pdf, `document_${new Date.now()}.pdf`),
    )

    log(`File ID: ${file.$id}`);
    log(`File Location: ${storage.getFileView("mystorageid", file.$id)}`)

    return res.send(file.$id);
  } catch (e) {
    error('Error generating PDF', e);
    return res.send('Failed to generate PDF');
  }
};

inner stratus Dec 11, 2023, 10:47 PM

#

uncut kernel ```js export default async ({ req, res, log, error }) => { try { log(`Star...

you're missing an important part from what i shared

uncut kernel Dec 11, 2023, 10:48 PM

#

the file.sync?

inner stratus Dec 11, 2023, 10:48 PM

#

uncut kernel the file.sync?

execSync

uncut kernel Dec 11, 2023, 10:48 PM

#

I don't understand, that runs the install command no?

#

Mine is in the build process so it's always there is the thought, why would that matter here?

inner stratus Dec 11, 2023, 10:50 PM

#

uncut kernel Mine is in the build process so it's always there is the thought, why would that...

no it's not.

#

and it needs to be done in the function

uncut kernel Dec 11, 2023, 10:50 PM

#

huh, oky

inner stratus Dec 11, 2023, 10:51 PM

#

the build container is not the same container where your function gets exeucted. Also, the container can be removed and the nrecreated. That's why you always need to make sure to install the dependencies at runtime

uncut kernel Dec 11, 2023, 10:51 PM

#

interesting, lemme try this rq

#

see my issue with the one executor is a perfect example here

#

a PDF generation thus far has taken 2s, if 1000 people want one, I can't have it as an Appwrite Function no?

#

oof 9s to successfully generate one

inner stratus Dec 11, 2023, 10:53 PM

#

uncut kernel a PDF generation thus far has taken 2s, if 1000 people want one, I can't have it...

if it always takes less than 30x, you can execute the function synchronously and they should all execute concurrently. However, it's probably best to execute the functions asynchronously

inner stratus Dec 11, 2023, 10:53 PM

#

uncut kernel oof 9s to successfully generate one

is that the 1st execution of the function?

uncut kernel Dec 11, 2023, 10:54 PM

#

yeah, oh true

#

the actual execution took 7 seconds I believe

#

including install

#

so lemme try again

#

oh yeah

uncut kernel Dec 11, 2023, 11:03 PM

#

inner stratus is that the 1st execution of the function?

so it's failing at creating the PDF in storage for some reason

#

fails here

log(`Ending Puppeteer timestamp (seconds): ${Date.now() / 1000}`);
    const fileToUpload = InputFile.fromBuffer(pdf, `document_${new Date.now()}_upload.pdf`);
    log(`File to upload created, trying to create file in Storage`);
    const file = await storage.createFile(
      "my_storage_id",
      ID.unique(),
      fileToUpload,
    )

#

could it be that it's getting the wrong mimetype? it has no error that it's actually logging

inner stratus Dec 11, 2023, 11:13 PM

#

uncut kernel could it be that it's getting the wrong mimetype? it has no error that it's actu...

not sure exactly...Maybe you can add a try catch.

inner stratus Dec 11, 2023, 11:35 PM

#

hmm how about:

import { Readable } from "stream";

// ...

    const stream = Readable.from(b);
    const size = Buffer.byteLength(b);
    const inputFile = InputFile.fromStream(stream, `document_${new Date.now()}_upload.pdf`, size);

uncut kernel Dec 14, 2023, 7:09 PM

#

inner stratus hmm how about: ```javascript import { Readable } from "stream"; // ... co...

So I got it to work doing exactly what you said yeah, forgot to update

#

[SOLVED] Using Puppeteer in a Function?

lusty lynx Apr 1, 2024, 2:32 PM

#

inner stratus hmm how about: ```javascript import { Readable } from "stream"; // ... co...

I'm using node-18 on a self-hosted instance, I am bein met with this error:
An internal curl error has occurred within the executor! Error Msg: Operation timed out\nError Code: 500

#[SOLVED] Using Puppeteer in a Function?