Usage with Third-Party UIs

The Mars and Mercury APIs can be used in the same way as an OpenAI reverse proxy, and are compatible with any UI that supports them. Here are some configuration examples for various UIs.

(If you're looking for Swagger documentation for the API itself, see https://inference.chub.ai.)

SillyTavern example configuration

Agnaistic example configuration

Risu example configuration

Base Tavern example configuration

Kobold Lite example configuration