Commands

templates

Save launch settings once and reuse them from your terminal.

The templates commands create, list, show, change and delete templates.

featherless-cloud templates <subcommand> [options]

To deploy from a template, pass --template to instance create or exec. --template looks for your own template first, then one shared in your organization, then an official one. org/<name> and featherless/<name> choose explicitly.

List templates

featherless-cloud templates list

Lists official templates, yours, and those shared in your organization, with their tags.

Show a template

featherless-cloud templates show trainer
featherless-cloud templates show featherless/rocm-pytorch

Prints its settings. For an official template, it also lists the versions.

Create a template

featherless-cloud templates create trainer \
  --image ghcr.io/acme/trainer:1 --registry ghcr \
  --gpu-count 1 --disk 100 --volume data:/workspace \
  --env EPOCHS=3 --secret HF_TOKEN=... \
  --tag training
featherless-cloud templates create llm-dev --template featherless/rocm-vllm --gpu-count 1 --port 8000

The name uses lowercase letters, numbers and hyphens. It's what you deploy the template by.

OptionDescription
--description <text>What the template is for.
--visibility <private|organization>private (default), or organization to let every member deploy it, with its secrets.
--template <name>Start from an official template's image, command and environment. name:version for an older version.
--image <reference>Container image.
--registry <name|id>Registry credential for a private image.
--compute-type <gpu|cpu>GPU (default) or CPU compute.
--gpu-type <text>GPU model, matched on part of its name.
--gpu-count <n>GPUs: 1, 2, 4 or 8.
--cpu-cores <n>vCPUs, with --compute-type cpu.
--disk <gb>Container disk, 20–2,000.
--volume <name>:<path>Mount a network volume. Repeatable.
--command <string>Start command, split on spaces.
--env <K=V>Environment variable. Repeatable.
--secret <K=V>Secret variable, available as a file under $FEATHERLESS_SECRETS_PATH. Repeatable.
--port <port>Public port. Repeatable.
--tag <tag>Label. Repeatable.

Change a template

featherless-cloud templates update trainer --visibility organization
featherless-cloud templates update trainer --gpu-count 2 --tag training --tag multi-gpu

Takes the same options as create, plus --name to rename it. --secret and --tag replace the saved lists. Instances and Run Jobs already deployed keep their settings.

Delete a template

featherless-cloud templates delete trainer

Instances and Run Jobs deployed from it keep running.