Skip to content

OpenAI-compatible endpoint for the AI features #598

Description

@keysersoft

The AI passes (graph enrichment, skill generation) support OpenAI, OpenRouter and Anthropic. They do not support a local model behind an OpenAI-compatible endpoint, which is what people running Ollama, vLLM or LM Studio have — and those are exactly the people who self-host a gateway so data stays local, then discover the optional AI features send it to a vendor.

Scope

  • AI_BASE_URL + AI_MODEL alongside the existing provider config.
  • No assumption of function calling or JSON mode beyond what the prompts already need; degrade with a clear log line rather than failing.
  • A line in the docs saying which local models have actually been tested.

See Discussion #480.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is neededroadmapOn the published roadmap; exempt from the stale bot

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions