Skip to content

Commit 4971d35

Browse files
committed
fix: update AsyncOpenAI client initialization
- Changed the client initialization in OpenAICompatibleTinkerServer to use a default API key for better configuration.logprob consistency to improve readability.
1 parent 3e4869b commit 4971d35

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/art/tinker/server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ async def start(self) -> tuple[str, int]:
4040
host = self.host or "0.0.0.0"
4141
port = self.port or get_free_port(host)
4242
self._task = asyncio.create_task(self._run(host, port))
43-
client = AsyncOpenAI(base_url=f"http://{host}:{port}/v1")
43+
client = AsyncOpenAI(api_key="default", base_url=f"http://{host}:{port}/v1")
4444
start = time.time()
4545
while True:
4646
timeout = float(os.environ.get("ART_SERVER_TIMEOUT", 300.0))

0 commit comments

Comments
 (0)