The templates commands create, list, show, change and delete templates.
featherless-cloud templates <subcommand> [options]
To deploy from a template, pass --template to instance create or exec. --template looks for your own template first, then one shared in your organization, then an official one. org/<name> and featherless/<name> choose explicitly.
featherless-cloud templates list
Lists official templates, yours, and those shared in your organization, with their tags.
featherless-cloud templates show trainer
featherless-cloud templates show featherless/rocm-pytorch
Prints its settings. For an official template, it also lists the versions.
featherless-cloud templates create trainer \
--image ghcr.io/acme/trainer:1 --registry ghcr \
--gpu-count 1 --disk 100 --volume data:/workspace \
--env EPOCHS=3 --secret HF_TOKEN=... \
--tag training
featherless-cloud templates create llm-dev --template featherless/rocm-vllm --gpu-count 1 --port 8000
The name uses lowercase letters, numbers and hyphens. It's what you deploy the template by.
| Option | Description |
|---|---|
--description <text> | What the template is for. |
--visibility <private|organization> | private (default), or organization to let every member deploy it, with its secrets. |
--template <name> | Start from an official template's image, command and environment. name:version for an older version. |
--image <reference> | Container image. |
--registry <name|id> | Registry credential for a private image. |
--compute-type <gpu|cpu> | GPU (default) or CPU compute. |
--gpu-type <text> | GPU model, matched on part of its name. |
--gpu-count <n> | GPUs: 1, 2, 4 or 8. |
--cpu-cores <n> | vCPUs, with --compute-type cpu. |
--disk <gb> | Container disk, 20–2,000. |
--volume <name>:<path> | Mount a network volume. Repeatable. |
--command <string> | Start command, split on spaces. |
--env <K=V> | Environment variable. Repeatable. |
--secret <K=V> | Secret variable, available as a file under $FEATHERLESS_SECRETS_PATH. Repeatable. |
--port <port> | Public port. Repeatable. |
--tag <tag> | Label. Repeatable. |
featherless-cloud templates update trainer --visibility organization
featherless-cloud templates update trainer --gpu-count 2 --tag training --tag multi-gpu
Takes the same options as create, plus --name to rename it. --secret and --tag replace the saved lists. Instances and Run Jobs already deployed keep their settings.
featherless-cloud templates delete trainer
Instances and Run Jobs deployed from it keep running.