Run Jobs

Overview

Train, evaluate and process data on GPUs you pay for only while the work runs.

A Run Job runs one command in a container on temporary GPU or CPU compute. The command runs to completion, its output streams back to you, and the compute is released the moment it exits, so there's nothing to stop afterwards.

Run Jobs suit work with a clear end, such as:

  • fine-tuning a model, with checkpoints saved to a network volume;
  • evaluating a model against a benchmark;
  • batch inference, such as embedding or captioning a dataset;
  • preparing data, such as tokenizing or converting a dataset;
  • running GPU tests from a CI pipeline.

For interactive work, such as notebooks, debugging or a model server that stays up, use an instance.

Get started

Submit a Run Job

Run a command from the CLI.

Monitor and manage

Follow its status and logs, cancel or delete it.

Fine-tune with a Run Job

An end-to-end example with a network volume.

Deployment options

A Run Job runs your command in one of these:

  • The default environment: PyTorch, used when you don't choose an image.
  • A template: an official template, or one you or your organization saved.
  • A custom image: any Linux image from a public or private registry.

How Run Jobs are billed

Run Jobs bill per second for compute and container disk, from the moment the container starts until the command exits. Time spent waiting for compute and downloading the image isn't billed.

Before a Run Job starts, credit for its full time limit is set aside. When it ends, you're charged only for the time it ran, and the rest is released. A job whose time limit your credit can't cover waits until you add credit, so set the time limit close to what the job needs. See Billing.

When a Run Job is interrupted

Run Jobs can be interrupted to make room for other work. If you allow retries, an interrupted job starts again from the beginning; otherwise it stops there. Write checkpoints to a network volume so a retry can resume where it left off.

Limitations

  • CLI only: you submit Run Jobs with the CLI. The console lists them and shows their logs.
  • 24-hour limit: a Run Job can run for at most 24 hours.
  • No terminal or SSH: you can't open a shell in a running Run Job.

Next steps

Submit a Run Job

Run your first command.

Instance or Run Job?

Choose the right one for your work.