Open Source · backend

Use Dolphin 2.9.3 72B with FastAPI

Updated 2026-05-21 · By XALEN

1. Install

pip install xalen fastapi uvicorn

2. Code

from fastapi import FastAPI
from pydantic import BaseModel
from xalen import XALEN

app = FastAPI()
client = XALEN(api_key="xln_test_YOUR_KEY")

class ChatRequest(BaseModel):
    messages: list

@app.post("/chat")
async def chat(req: ChatRequest):
    response = client.chat.completions.create(
        model="dolphin-2-9-3-72b",
        messages=[m.dict() for m in req.messages]
    )
    return {"reply": response.choices[0].message.content}

Dolphin 2.9.3 72B with Other Frameworks

Other Models with FastAPI

Last updated: 2026-05-21