Text generation
import openai
client = openai.OpenAI(
base_url="https://api.llm7.io/v1",
api_key="unused", # Use a https://dash.llm7.io/ token for higher limits.
)
resp = client.chat.completions.create(
model="default", # or "fast", "pro", or a model ID from /v1/models
messages=[
{"role": "system", "content": "Answer concisely."},
{"role": "user", "content": "Give me three onboarding tips for new engineers."},
],
temperature=0.4,
)
print(resp.choices[0].message.content)
Use
model="fast" for lowest latency and model="pro" for higher-quality paid models. See Available models for selectors and Models API for live model details.