Enterprise · framework

Use IBM Granite 3.1 8B with LlamaIndex

Updated 2026-05-21 · By XALEN

How to use IBM Granite 3.1 8B (Enterprise, 8B) with LlamaIndex. Install, authenticate, and make your first API call in minutes. Working code example included.

Model
IBM Granite 3.1 8B
8B · 128K context · $0.01 input
Framework
LlamaIndex
framework · pip install llama-index-llms-openai-like

1. Install

pip install llama-index-llms-openai-like

2. Code

from llama_index.llms.openai_like import OpenAILike

llm = OpenAILike(
    model="granite-3-1-8b",
    api_key="xln_test_YOUR_KEY",
    api_base="https://api.xalen.io/v1"
)

response = llm.complete("Explain IBM Granite 3.1 8B")
print(response.text)

IBM Granite 3.1 8B with Other Frameworks

Python JavaScript React Next.js Flask FastAPI Django Express.js

Other Models with LlamaIndex

Vedika Standard Vedika Fast Vedika Pro Ultra Vedika Vision Vedika Code Vedika Astro Agent

200+ models. One API. Works with any framework.

Get API Key

Last updated: 2026-05-21