You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/fundamentals/art-backend.mdx
+5-76Lines changed: 5 additions & 76 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,15 +20,6 @@ While the backend's training and inference settings are highly configurable, the
20
20
arrow={true}
21
21
></Card>
22
22
</div>
23
-
<divclassName="card-wrapper">
24
-
<Card
25
-
title="SkyPilotBackend"
26
-
icon="cloud"
27
-
href="/fundamentals/art-backend#skypilotbackend"
28
-
horizontal={true}
29
-
arrow={true}
30
-
></Card>
31
-
</div>
32
23
<divclassName="card-wrapper">
33
24
<Card
34
25
title="LocalBackend"
@@ -40,17 +31,14 @@ While the backend's training and inference settings are highly configurable, the
40
31
</div>
41
32
</div>
42
33
43
-
## Managed, remote, or local training
34
+
## Managed or local training
44
35
45
-
ART provides three backend classes:
36
+
ART provides two backend classes:
46
37
47
38
*`ServerlessBackend` - train remotely on autoscaling GPUs
48
-
*`SkyPilotBackend` - train remotely on self-managed infra
49
39
*`LocalBackend` - run your agent and training code on the same machine
50
40
51
-
If your agent is already set up on a machine equipped with an advanced GPU and you want to run training on the same machine, use `LocalBackend`. If your agent is running on a machine without an advanced GPU (this includes most personal computers and production servers), use `SkyPilotBackend` or `ServerlessBackend` instead. `ServerlessBackend` optimizes speed and cost by autoscaling across managed clusters. `SkyPilotBackend` lets you use your own infra.
52
-
53
-
All three backend types implement the `art.Backend` class and the client interacts with all three in the exact same way. Under the hood, `SkyPilotBackend` configures a remote machine equipped with a GPU to run `LocalBackend`, and forwards requests from the client to the remote instance. `ServerlessBackend` runs within W&B Training clusters and autoscales GPUs to meet training and inference demand.
41
+
If your agent is already set up on a machine equipped with an advanced GPU and you want to run training on the same machine, use `LocalBackend`. If your agent is running on a machine without an advanced GPU (this includes most personal computers and production servers), use `ServerlessBackend` instead. `ServerlessBackend` optimizes speed and cost by autoscaling across managed clusters.
54
42
55
43
### ServerlessBackend
56
44
@@ -67,59 +55,6 @@ backend = ServerlessBackend(
67
55
68
56
As your training job progresses, `ServerlessBackend` automatically saves your LoRA checkpoints as W&B Artifacts and deploys them for production inference on W&B Inference.
69
57
70
-
### SkyPilotBackend
71
-
72
-
To use SkyPilotBackend, you'll need to install the optional dependency:
73
-
74
-
```bash
75
-
pip install openpipe-art[skypilot]
76
-
```
77
-
78
-
When a `SkyPilotBackend` instance is initialized, it does a few things:
79
-
80
-
- Provisions a remote machine with an advanced GPU (by default on RunPod)
81
-
- Installs `openpipe-art` and its dependencies
82
-
- Initializes a `LocalBackend` instance with vLLM and a training server (unsloth or torchtune)
83
-
- Registers the `LocalBackend` instance to forward requests to it over http
84
-
85
-
To initialize a `SkyPilotBackend` instance, follow the code sample below:
The `LocalBackend` class runs a vLLM server and either an Unsloth or torchtune instance on whatever machine your agent itself is executing. This is a good fit if you're already running your agent on a machine with a GPU.
@@ -148,12 +83,6 @@ BACKEND_TYPE = "serverless"
148
83
ifBACKEND_TYPE=="serverless":
149
84
from art.serverless.backend import ServerlessBackend
Copy file name to clipboardExpand all lines: docs/getting-started/installation-setup.mdx
-30Lines changed: 0 additions & 30 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -65,36 +65,6 @@ await model.register(backend)
65
65
... the rest of your code ...
66
66
```
67
67
68
-
### Running the server on remote dedicated GPUs
69
-
70
-
The ART client can also be run locally and connected to a remote server, which ART will automatically provision for you. To use SkyPilot, you'll need to install the optional dependency:
71
-
72
-
```bash
73
-
pip install openpipe-art[skypilot]
74
-
```
75
-
76
-
Then you can use SkyPilotBackend in your code:
77
-
78
-
```python
79
-
from art import TrainableModel, gather_trajectory_groups
The `langgraph` extra includes the LangGraph integration dependencies, while `backend` provides the training backend components. If running using the [SkyPilotBackend](/fundamentals/art-backend#skypilotbackend), substitute `skypilot` for `backend` in the extras array.
18
+
The `langgraph` extra includes the LangGraph integration dependencies, while `backend` provides the training backend components.
19
19
20
20
## Why Use ART with LangGraph?
21
21
@@ -264,7 +264,7 @@ from art.utils import iterate_dataset
264
264
265
265
# Initialize model and backend
266
266
model = art.Model(name="Qwen/Qwen2.5-7B-Instruct")
0 commit comments