Node.js Runtime Environment

info

This article serves as a thorough introduction to Cloud Engine’s Node.js runtime environment. To quickly get started with Cloud Engine, see Getting Started With Cloud Engine.

A Node.js project has to have a package.json under its root directory for Cloud Engine to correctly identify it as a Node.js project. This file also helps Cloud Engine understand the project’s requirements for the environment:

package.json
{
  "name": "node-js-getting-started",
  "scripts": {
    "start": "node server.js",
    "dev": "nodemon server.js -- "
  },
  "dependencies": {
    "leancloud-storage": "^3.11.0",
    "leanengine": "^3.3.2"
  },
  "devDependencies": {
    "nodemon": "^1.18.7"
  },
  "engines": {
    "node": "16.x"
  }
}

If you are looking to start a new project, we recommend that you use our Node.js sample project as a boilerplate.

Startup Command

By default, Cloud Engine starts your project with npm start. You can change the entry point of your program or add additional options to node by editing scripts.start in package.json.

package.json
{
  "scripts": {
    "start": "node server.js"
  }
}

note

When debugging locally by running lean up with the CLI, the CLI will start your project with npm run dev.

Configure Node.js Version

You can specify the version of Node.js by setting engines.node in package.json:

package.json
{
  "engines": {
    "node": "16.x"
  }
}

You can set it to * to stick to the latest (current) version.

note

For newly created apps, if you don’t specify a Node.js version, the latest stable (LTS) version will be used. For apps created before 9/2/2021, Node.js `0.12` will be used by default to ensure compatibility.

Install Dependencies (`package.json`)

Cloud Engine will automatically install dependencies according to the package.json in your project:

package.json
{
  "dependencies": {
    "leancloud-storage": "^3.11.0",
    "leanengine": "^3.3.2"
  },
  "devDependencies": {
    "nodemon": "^1.18.7"
  }
}

While installing dependencies, Cloud Engine will trigger the life cycle scripts of npm, such as postinstall and prepare.

note

If your project contains package-lock.json, Cloud Engine will install dependencies with npm ci (requires Node.js 10 or higher). Otherwise, Cloud Engine will install dependencies with npm install --production, which means that dependencies listed under devDependencies will not be installed.

note

If your project contains yarn.lock, Cloud Engine will install dependencies with yarn (requires Node.js 4.8 or higher). To use npm instead of Yarn, add yarn.lock into .gitignore (if deploying with Git) or .leanignore (if deploying with the CLI). Since yarn.lock contains the URLs for downloading dependencies, please carefully choose the registry for your project, or you may experience increased build time.

Since Cloud Engine installs dependencies on the server side, the CLI won’t upload node_modules by default. If you’re deploying with Git, you should include node_modules in .gitignore so it won’t be tracked by Git.

Customize Build Process

Cloud Engine uses the default commands of each language to complete the build process. You can override these commands by editing leanengine.yaml.

Overriding Command for Execution With `run`

leanengine.yaml
run: $(npm bin)/serve -c static.json -l ${LEANCLOUD_APP_PORT}

You can use shell syntax here for purposes like accessing environment variables.

Overriding Command for Installing Dependencies With `install`

You can override the default command for installing dependencies (like npm install) or run additional commands before or after installing dependencies.

leanengine.yaml
install: npm

Most runtimes have their default commands for installing dependencies. You can refer to the default command with {use: 'default'}:

leanengine.yaml
install:
  - { use: "default" }
  - npm run install-additional

When installing dependencies, only the dependency lists (like package.json) will be loaded into the build directory. To load additional files, use require:

leanengine.yaml
install:
  - require:
      - frontend/package.json
      - frontend/package-lock.json
  - cd frontend && npm ci

Overriding Command for Building With `build`

leanengine.yaml
build: npm run build

When building your project, all the files in your project will be loaded into the build directory.

You can specify multiple pieces of commands with an array. You can use shell syntax here as well:

leanengine.yaml
build:
  - echo 'building'
  - NODE_ENV=production $(npm bin)/webpack

Certain runtimes have their default build commands. You can refer to these commands with {use: 'default'}.

Build Logs

By default, the logs generated during the build process won’t be printed to the console. If the build process fails, the logs from the last completed step will be printed to the console.

To print the complete build log for debugging, check Print build logs if you are deploying from the dashboard or add --options 'printBuildLogs=true' if you are deploying with the CLI.

System Dependencies

You can specify the system dependencies provided by the server-side environment by setting systemDependencies in leanengine.yaml:

leanengine.yaml
systemDependencies:
  - imagemagick

The following libraries are available for you to add:

ffmpeg A library for processing audio and videos.
imagemagick A library for processing images.
fonts-wqy 文泉驿点阵宋体 and 文泉驿微米黑. Often used with phantomjs or chrome-headless to display Chinese.
fonts-noto Source Han Sans (comes with a large size).
phantomjs A headless browser based on WebKit (discontinued).
chrome-headless Headless Chrome. It comes with a large size and will significantly increase the time needed for deployment. It also consumes a lot of CPU and RAM resources. If you need to use puppeteer, please provide {executablePath: '/usr/bin/google-chrome', args: ['--no-sandbox', '--disable-setuid-sandbox']} to puppeteer.launch. This library doesn’t support Java yet.
node-canvas The system dependency required for installing node-canvas (you still need to install node-canvas yourself).
python-talib A library for performing technical analysis of financial market data.

caution

Adding system dependencies will significantly increase the time needed for deployment. Please avoid adding dependencies that your project doesn’t need.

Health Check

Cloud Engine is primarily optimized for web applications. Your app is expected to provide HTTP services through the port specified by the environment variable named LEANCLOUD_APP_PORT. Keep in mind that the app should listen on 0.0.0.0 (all interfaces) instead of 127.0.0.1 which is the default host of many frameworks.

While your app is being deployed, Cloud Engine will check your app every second to see if it has been successfully started. If your app has not been started within the time limit (30 seconds by default), the deployment will be canceled. After your app has been deployed, Cloud Engine will run health checks for your app regularly and automatically restart it if the check fails.

The way the health check works is that Cloud Engine will send an HTTP request to the homepage (/) of your app. If it gets an HTTP 2xx response, your app will pass the health check.

Health check and the Cloud Engine SDK

Cloud Engine will also check /__engine/1/ping which is handled by the SDK. If the SDK is integrated correctly, Cloud Engine will not check the homepage (/) anymore.

If Dashboard > LeanEngine > Your group > Settings > Cloud functions mode is set to Enable, or if functionsMode in leanengine.yaml is set to strict, Cloud Engine will check if the SDK is integrated correctly. If not, it will consider your app to have failed to start.

Customizing startup timeout (startupTimeout)

The default timeout for your app to start is 30 seconds. You can change it to any value between 15 and 120 seconds with leanengine.yaml:

leanengine.yaml
startupTimeout: 60

Cloud Environment

Custom Domains

Projects deployed to Cloud Engine can only be accessed with domains configured. You can bind domains by going to Dashboard > LeanEngine > Your group > Settings > Domains.

If you bind a domain that starts with stg- (e.g., stg-api.example.com), it will be assigned to the staging environment automatically.

Load Balancer and CDN

All HTTP and HTTPS requests sent to Cloud Engine will go through a load balancer that deals with chores including HTTPS encryption, HTTPS redirection, and response compression. You won’t have to implement features for handling these tasks yourself for the programs hosted on Cloud Engine. Meanwhile, the load balancer brings the following restrictions that your program cannot bypass:

Paths starting with /.well-known/acme-challenge/ are used by Cloud Engine to automatically renew certificates. Requests sent to these paths won’t be forwarded to your program.
The size of a request header (URL and headers) should be within 64K and each line of the request header should be within 8K.
The size of a request (for uploading files) should be within 100M.
The timeout for connecting or waiting for a response is 60 seconds.

Getting the Client IP Address

Cloud Engine’s load balancer includes the following information depicting the original request in the HTTP header:

X-Real-IP: The original IP address.
X-Forwarded-Proto: The original protocol (http or https).
Forwarded: Information about the proxy, defined by RFC 7239. It contains the IP address and the protocol.

caution

If CDN is enabled, the information included in the HTTP headers above will be those of the CDN rather than the original request.

With CDN enabled, the following HTTP headers will also be present:

X-Forwarded-For: IP addresses separated by a comma. The first one would be the IP address of the original request.

caution

It’s possible that the information included in the HTTP headers above gets counterfeited. Cloud Engine won’t be able to guarantee its authenticity.

In Express:

app.get("/", function (req, res) {
  console.log(req.headers["x-real-ip"]);
  res.send(req.headers["x-real-ip"]);
});

info

For Cloud Engine applications deployed within Mainland China, CDN will be enabled by default. To ensure that your application always gets the accurate IP addresses of original requests, consider enabling dedicated IP. You can learn more about the differences between CDN and dedicated IP on Binding Your Domains § Cloud Engine Domains.

HTTPS Redirect

When you bind a custom Cloud Engine domain, you can enable Force HTTPS to have the load balancer redirect HTTP requests to HTTPS while keeping the paths.

caution

Force HTTPS won’t work properly if CDN is enabled. You’ll still need to implement redirect in your project’s code.

CDN Caching

If you resolve your custom domain to the CDN (including the shared domain provided by Cloud Engine), the CDN will cache the responses for the requests it has received. There are some default rules for caching followed by the CDN.

The CDN will cache the response if:

The response header contains Last-Modified (this indicates that the resource requested is static; for HTML files, they will be cached for at most 60 seconds).

The CDN will not cache the response if:

There is an error with the response (not 2xx).
The request is not idempotent (like a POST request).
The response header doesn’t contain Last-Modified (this often indicates that the resource requested is dynamic).

The age of the cache for a given file will depend on the file type and the value of the Last-Modified header. The less frequently the file gets modified, the longer the file gets cached. You can override the default behavior by configuring Cache-Control and the CDN will try its best to follow your configurations. For example:

You can use Cache-Control: no-cache to prevent the response from being cached.
You can use Cache-Control: max-age=3600 to specify the age of the cache (here we set it to be 1 hour).

info

To prevent your application from being affected by the caching mechanism, consider enabling dedicated IP. You can learn more about the differences between CDN and dedicated IP on Binding Your Domains § Cloud Engine Domains.

Environment Variables

The following environment variables are available for your application to use:

Variable name	Description
`LEANCLOUD_APP_ID`	The `App ID` of the current application.
`LEANCLOUD_APP_KEY`	The `App Key` of the current application.
`LEANCLOUD_APP_MASTER_KEY`	The `Master Key` of the current application.
`LEANCLOUD_APP_ENV`	The environment your application is running in. If you are running your application on your local computer, the value will be non-existent or `development` (if you are starting your application with the CLI). It will be `stage` for the staging environment and `production` for the production environment.
`LEANCLOUD_APP_PORT`	The port opened up for your application. Your application has to listen on this port in order for users to access your service.
`LEANCLOUD_API_SERVER`	The address used to access the Data Storage service. Please use this value if your application needs to access the Data Storage service or other cloud services with the REST API.
`LEANCLOUD_APP_GROUP`	The group the instance is located at.
`LEANCLOUD_REGION`	The region the application is running in. It will be `CN` for Mainland China and `US` for the United States.
`LEANCLOUD_VERSION_TAG`	The version number of the deployment.

The environment variables starting with LC_ (like LC_APP_ID) used by the older version of Cloud Engine have already been deprecated. Those environment variables will still be present for a while to ensure compatibility but will eventually get removed. If you are still using them in your application, please replace them with those starting with LEANCLOUD_.

Logs

note

See Cloud Engine Platform Features § Viewing Logs for more information on how to view logs and access logs on the dashboard.

Cloud Engine will collect the logs your application has printed to standard output (stdout) and standard error (stderr):

console.log("hello"); // stdout
console.error("some error"); // stderr

note

Each line of the logs can contain a maximum of 4096 characters. A maximum of 600 lines of logs can be collected every minute. The logs generated by your application that exceed these limits will be discarded.

Timezone

The server side uses Beijing Time (UTC+8).

File System

Your application can create temporary files under /home/leanengine and /tmp. The size limit for all the files created by your application is 1 GB.

caution

Each time you trigger a new deployment for your application, Cloud Engine will create a new container for it. Even though you don’t trigger deployments, Cloud Engine will still perform occasional maintenance operations. This means that your application should not treat the file system provided by Cloud Engine as permanent storage.

If the files created by your application bear relatively larger sizes, we recommend that your application always cleans them up once it finishes using them. Creating more files when there are already more than 1 GB files existing might lead to the Disk quota exceeded error. You can trigger a deployment to quickly clean up all the temporary files.

IP Addresses

Some third-party platforms (like Weixin Open Platform) may require that you provide an IP address whitelist. You can obtain the inbound and outbound IP addresses used by Cloud Engine on Dashboard > LeanEngine > Your group > Settings > Inbound IP and outbound IP.

info

For Cloud Engine applications deployed within Mainland China, CDN will be enabled by default. Depending on the provider we use, the inbound IP addresses might be changed frequently. To get a fixed inbound IP address for your application, consider enabling dedicated IP.

We will do our best to minimize the frequency of changing the inbound and outbound IP addresses, but there remains the possibility for them to get changed. If you encounter any problems with IP addresses, the first thing you can do is look at the IP addresses displayed on the dashboard and see if they have been changed.

To get a fixed inbound IP address for your application, consider enabling dedicated IP.

Troubleshooting

Why are the dependencies listed under `devDependencies` not installed?

When you deploy your project, Cloud Engine will install dependencies (including those listed under devDependencies) for your project with npm ci. However, if the Node.js version you specified is below 10, Cloud Engine will use npm install --production instead. This means that the dependencies listed under devDependencies will not be installed. To have these dependencies installed as well, you can specify installDevDependencies: true in leanengine.yaml.

What should I do if I see `npm ERR! peer dep missing`?

If you see an error like this when deploying your project:

npm ERR! peer dep missing: graphql@^0.10.0 || ^0.11.0, required by express-graphql@0.6.11

This means that some of the peer dependencies are not successfully installed. The reason is that if the version of Node.js you specified is below 10, Cloud Engine will only install the dependencies listed under dependencies. Please make sure the required dependencies of the dependencies listed under dependencies are also listed under dependencies, not devDependencies.

You can reproduce the problem on your local computer by deleting node_modules and installing dependencies with npm install --production.

You may also consider upgrading Node.js to 10 or higher to solve the problem.

Timeout Settings

If a request triggers a function that doesn’t give a response due to an error, the server’s RAM will still be occupied for this request. To prevent the RAM from being occupied in this case and to have the client receive an error without delay, there needs to be a timeout set up on the server so that when a request doesn’t receive a response in a while, the server will return an HTTP error code to the client.

The default timeout for the custom routes defined with Express is 15 seconds. You can edit this value in app.js:

// Set the default timeout
app.use(timeout("15s"));

Startup Command​

Configure Node.js Version​

Install Dependencies (package.json)​

Customize Build Process​

Overriding Command for Execution With run​

Overriding Command for Installing Dependencies With install​

Overriding Command for Building With build​

Build Logs​

System Dependencies​

Health Check​

Cloud Environment​

Custom Domains​

Load Balancer and CDN​

Getting the Client IP Address​

HTTPS Redirect​

CDN Caching​

Environment Variables​

Logs​

Timezone​

File System​

IP Addresses​

Troubleshooting​

Why are the dependencies listed under devDependencies not installed?​

What should I do if I see npm ERR! peer dep missing?​

Timeout Settings​

Startup Command

Configure Node.js Version

Install Dependencies (`package.json`)

Customize Build Process

Overriding Command for Execution With `run`

Overriding Command for Installing Dependencies With `install`

Overriding Command for Building With `build`

Build Logs

System Dependencies

Health Check

Cloud Environment

Custom Domains

Load Balancer and CDN

Getting the Client IP Address

HTTPS Redirect

CDN Caching

Environment Variables

Logs

Timezone

File System

IP Addresses

Troubleshooting

Why are the dependencies listed under `devDependencies` not installed?

What should I do if I see `npm ERR! peer dep missing`?

Timeout Settings