Open Source · backend

Use InternLM 2.5 20B with FastAPI

Updated 2026-05-21 · By XALEN

1. Install

pip install xalen fastapi uvicorn

2. Code

from fastapi import FastAPI
from pydantic import BaseModel
from xalen import XALEN

app = FastAPI()
client = XALEN(api_key="xln_test_YOUR_KEY")

class ChatRequest(BaseModel):
    messages: list

@app.post("/chat")
async def chat(req: ChatRequest):
    response = client.chat.completions.create(
        model="internlm-2-5-20b",
        messages=[m.dict() for m in req.messages]
    )
    return {"reply": response.choices[0].message.content}

InternLM 2.5 20B with Other Frameworks

Other Models with FastAPI

Last updated: 2026-05-21