ezgh inference | EZGH Cloud

ezgh inference <command>

EZGH Inference serves models behind an OpenAI-compatible API: the stock OpenAI SDKs work with their base URL set to a project’s

https://inference-api.<domain>/v1/organizations/<org>/projects/<project>/openai/v1

and an EZGH API key as the API key. The CLI doesn’t call models; it reads the Model Catalog (every model EZGH serves, in any product, which needs no login) and a project’s limits.

Flags

This command also takes the global flags.

Subcommands

Command	Description
`ezgh inference limits`	Show a project’s inference limits
`ezgh inference models`	The Model Catalog: every model EZGH serves