This example deploys a CPU instance with the CLI installed, then uses it to launch a GPU instance, open a shell on it, run a Run Job, and stop the GPU when you're done.
A jumpbox is an instance you work from rather than compute on. Use one to:
Open the jumpbox's Terminal tab. The CLI is ready to use:
featherless-cloud instance list
The terminal runs in tmux, so anything you start keeps running after you close the tab.
featherless-cloud instance create --name gpu-dev --template featherless/rocm-pytorch --gpu-count 1
featherless-cloud instance get gpu-dev
gpu-dev is an ordinary instance in your organization. It appears on the Instances page, and it's billed until you stop it, whether or not the jumpbox is running. To choose a GPU model, add --gpu-type <model>; featherless-cloud pricing list shows the models on offer.
featherless-cloud instance shell gpu-dev
You get the GPU instance's own terminal session, the one its Terminal tab shows, without an SSH key. Check the GPU:
python -c "import torch; print(torch.cuda.is_available(), torch.cuda.get_device_name(0))"
It prints True and the GPU's name.
To return to the jumpbox, press Ctrl-b twice, then d. The GPU instance's session runs inside the jumpbox's own tmux session: the first Ctrl-b goes to the jumpbox, and the second passes through to the GPU instance. Programs you started on the GPU instance keep running.
For work that ends on its own, a Run Job is billed only while the command runs and leaves nothing to stop afterwards:
featherless-cloud exec --gpu-count 1 -- python -c "import torch; print(torch.cuda.get_device_name(0))"
The CLI waits for the job, prints its output, and exits with the command's exit code, so a script on the jumpbox can submit jobs one after another and check each result.
featherless-cloud instance stop gpu-dev
Stopping ends compute billing and erases the GPU instance's container disk. Start it again later with featherless-cloud instance start gpu-dev, or remove it:
featherless-cloud instance delete gpu-dev --yes
Stop or delete the jumpbox on its page in the console. Its CLI key is revoked when it stops.