mirrors/tabby
1
0
Fork 0
mirror of https://github.com/TabbyML/tabby synced 2024-11-22 00:08:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs(models-http-api): add jan.ai chat example (#3404)

Browse Source
This commit is contained in:
Wei Zhang 2024-11-12 08:11:40 +08:00 committed by GitHub
parent 39c5b8de0f
commit 03adfaa7ae
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 20 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

20
website/docs/references/models-http-api/jan.ai.md vendored Normal file
View File

@ -0,0 +1,20 @@
# Jan AI
[Jan](https://jan.ai/) is an open-source alternative to ChatGPT that runs entirely offline on your computer.
Jan can run a server that provides an OpenAI-equivalent chat API at https://localhost:1337,
allowing us to use the OpenAI kinds for chat.
To use the Jan Server, you need to enable it in the Jan App's `Local API Server` UI.
However, Jan does not yet provide API support for completion and embeddings.
Below is an example for chat:
```toml title="~/.tabby/config.toml"
# Chat model
[model.chat.http]
kind = "openai/chat"
model_name = "your_model"
api_endpoint = "http://localhost:1337/v1"
api_key = ""
```