Code · language
Use Code Llama 70B with Rust
Updated 2026-05-21 · By XALEN
How to use Code Llama 70B (Code, 70B) with Rust. Install, authenticate, and make your first API call in minutes. Working code example included.
Model
Code Llama 70B
70B · 100K context · $0.04 input
Framework
Rust
language · cargo add async-openai
1. Install
cargo add async-openai
2. Code
use async_openai::{Client, config::OpenAIConfig, types::*};
#[tokio::main]
async fn main() {
let config = OpenAIConfig::new()
.with_api_key("xln_test_YOUR_KEY")
.with_api_base("https://api.xalen.io/v1");
let client = Client::with_config(config);
let request = CreateChatCompletionRequestArgs::default()
.model("codellama-70b")
.messages(vec![ChatCompletionRequestUserMessageArgs::default()
.content("Hello from Rust!").build().unwrap().into()])
.build().unwrap();
let response = client.chat().create(request).await.unwrap();
println!("{}", response.choices[0].message.content.as_ref().unwrap());
}
Code Llama 70B with Other Frameworks
Other Models with Rust
200+ models. One API. Works with any framework.
Get API KeyLast updated: 2026-05-21