Commit Graph

276 Commits

Author SHA1 Message Date
Meng Zhang
4a26fc1f4a Release 0.21.0-dev.0
aim-downloader@0.21.0-dev.0
hash-ids@0.21.0-dev.0
http-api-bindings@0.21.0-dev.0
llama-cpp-server@0.21.0-dev.0
ollama-api-bindings@0.21.0-dev.0
tabby@0.21.0-dev.0
tabby-common@0.21.0-dev.0
tabby-crawler@0.21.0-dev.0
tabby-db@0.21.0-dev.0
tabby-db-macros@0.21.0-dev.0
tabby-download@0.21.0-dev.0
tabby-git@0.21.0-dev.0
tabby-index@0.21.0-dev.0
tabby-index-cli@0.21.0-dev.0
tabby-inference@0.21.0-dev.0
tabby-schema@0.21.0-dev.0
tabby-webserver@0.21.0-dev.0

Generated by cargo-workspaces
2024-11-09 21:46:51 -08:00
antimonyGu
28a5328d9f
feat(ui): allow selecting model in answer engine (#3304)
* llm select FE sketch

* fetch model array & select model drop down

* finish model select function & to be polished

* fix selectedModel init value and style

* fix lint

* rename DropdownMenuItems

* refine feature toggle

* chore(answer): set chat model's name by selection

* refine model select dropdown position

* [autofix.ci] apply automated fixes

* properly fill model name

* rename selectedModelName to modelName

* uplift modelName state

* clean log

* format code

* fix lint

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* [autofix.ci] apply automated fixes (attempt 3/3)

* feat(ui): show tool bar in  search page

* fix: fix ui test

* refactor(chart-ui): persist modelName and show modelName selection in followup

* handle selectedModel not in models api

* fix: throw warning when request model is not in supported_models

* fix: fix modelInfo?.chat not supported case and check request.mode is supported in BE

* fix: using warn! to print warning

* fix: fix ui lint

* update: ajust style and check if model is valid

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Meng Zhang <meng@tabbyml.com>
Co-authored-by: liangfung <1098486429@qq.com>
2024-11-05 08:16:21 -08:00
Meng Zhang
e8cb4ce5fb Release 0.20.0-dev.0
aim-downloader@0.20.0-dev.0
hash-ids@0.20.0-dev.0
http-api-bindings@0.20.0-dev.0
llama-cpp-server@0.20.0-dev.0
ollama-api-bindings@0.20.0-dev.0
tabby@0.20.0-dev.0
tabby-common@0.20.0-dev.0
tabby-crawler@0.20.0-dev.0
tabby-db@0.20.0-dev.0
tabby-db-macros@0.20.0-dev.0
tabby-download@0.20.0-dev.0
tabby-git@0.20.0-dev.0
tabby-index@0.20.0-dev.0
tabby-index-cli@0.20.0-dev.0
tabby-inference@0.20.0-dev.0
tabby-schema@0.20.0-dev.0
tabby-webserver@0.20.0-dev.0

Generated by cargo-workspaces
2024-10-30 21:42:38 -07:00
Wei Zhang
a3a6bea000
feat(graphQL): add model check for chat, completion, embedding (#3311)
* feat(graphQL): add model health check for chat

* feat(graphql): add completion test connection

* feat(model): test embedding model connection

* chore: update graphql schema to return latency

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* chore: ignore use schema result lint

* choer(graphql): use response and error type

* chore: use CompletionStream for completion health check

* chore: specify chat check message to response quick

* chore: use TestModelConnectionError

* [autofix.ci] apply automated fixes

* chore: fix review from meng

* [autofix.ci] apply automated fixes

* update

* [autofix.ci] apply automated fixes

* update

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2024-10-29 22:05:14 +00:00
Wei Zhang
0e75cb2966
chore(completion): replace CRLF with LF for code completion LLM requests (#3303)
* feat: replease crlf to lf in completions

* [autofix.ci] apply automated fixes

* chore: crlf logic should under service

* [autofix.ci] apply automated fixes

* chore: replace CRLF for prompt instead of segments

* [autofix.ci] apply automated fixes

* chore: use functions and ut for replacing crlf

* chore: rename generated to generated_text

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-10-27 18:27:42 -07:00
Wei Zhang
779f785827
feat(download): allow fetching model files with multiple partitions (#3258)
* finish main logic

* add ut

* [autofix.ci] apply automated fixes

* feat: use indexed model name

* chore: apply review from meng

* chore: revert unnecessary downloader change

* chore: fix ut

* chore: donwload one file each time

* [autofix.ci] apply automated fixes

* chore: fix ut

* chore: fix review from meng

* chore: fix ci

* chore: revert multibar

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* chore: filter download address tests should be serial

* chore: use the workspace dep for serial_test

---------

Co-authored-by: leili <lilei@deeproute.ai>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-10-21 13:34:03 +08:00
Meng Zhang
494cd31366 Release 0.19.0-dev.0
aim-downloader@0.19.0-dev.0
hash-ids@0.19.0-dev.0
http-api-bindings@0.19.0-dev.0
llama-cpp-server@0.19.0-dev.0
ollama-api-bindings@0.19.0-dev.0
tabby@0.19.0-dev.0
tabby-common@0.19.0-dev.0
tabby-crawler@0.19.0-dev.0
tabby-db@0.19.0-dev.0
tabby-db-macros@0.19.0-dev.0
tabby-download@0.19.0-dev.0
tabby-git@0.19.0-dev.0
tabby-index@0.19.0-dev.0
tabby-index-cli@0.19.0-dev.0
tabby-inference@0.19.0-dev.0
tabby-schema@0.19.0-dev.0
tabby-webserver@0.19.0-dev.0

Generated by cargo-workspaces
2024-10-08 16:43:25 +08:00
Meng Zhang
385d7ae093
refactor(core): remove CodeRepositoryAccess, add AllowedCodeRepositor… (#3185)
* refactor(core): remove CodeRepositoryAccess, add AllowedCodeRepository as axum Extension

* update

* Update ee/tabby-webserver/src/service/user_group.rs

* refactor(webserver): remove more useless fields in Webserver

* cleanup
2024-09-23 12:27:16 +00:00
Meng Zhang
c9e61bc6e5 Release 0.18.0-dev.0
aim-downloader@0.18.0-dev.0
hash-ids@0.18.0-dev.0
http-api-bindings@0.18.0-dev.0
llama-cpp-server@0.18.0-dev.0
ollama-api-bindings@0.18.0-dev.0
tabby@0.18.0-dev.0
tabby-common@0.18.0-dev.0
tabby-crawler@0.18.0-dev.0
tabby-db@0.18.0-dev.0
tabby-db-macros@0.18.0-dev.0
tabby-download@0.18.0-dev.0
tabby-git@0.18.0-dev.0
tabby-index@0.18.0-dev.0
tabby-index-cli@0.18.0-dev.0
tabby-inference@0.18.0-dev.0
tabby-schema@0.18.0-dev.0
tabby-webserver@0.18.0-dev.0

Generated by cargo-workspaces
2024-09-05 19:45:32 -07:00
Meng Zhang
638ba37e83
refactor(hash-ids): fork hash-ids to return None instead of panic when ID is not valid (#3083)
* init commit

* update

* Update crates/hash-ids/Cargo.toml
2024-09-05 21:54:27 +00:00
Meng Zhang
2dbe2efbd2
fix(crawler): enhance crawling scope and exclusion patterns (#3065)
* chore(tabby-crawler): use breadth-first strategy for crawling

* fix(crawler): enhance crawling scope and exclusion patterns
2024-09-04 06:58:41 +00:00
Meng Zhang
c4b8f7f7ed
feat: add tabby-index-cli tool for debugging tabby's index (#2985)
* feat: add tabby-index-cli tool for debugging tabby's index

* update

* [autofix.ci] apply automated fixes

* update

* [autofix.ci] apply automated fixes

* improve formatting

* update

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-26 16:31:26 -07:00
Meng Zhang
474c1a200c
refactor(webserver): remove deprecated /v1beta/answer route (#2852)
* refactor(webserver): remove deprecated /v1beta/answer route

* remove unused

* clean up tabby-ui openapi.json

* update
2024-08-21 20:12:42 -07:00
Meng Zhang
fc9f6c1412 Release 0.17.0-dev.0
aim-downloader@0.17.0-dev.0
http-api-bindings@0.17.0-dev.0
llama-cpp-server@0.17.0-dev.0
ollama-api-bindings@0.17.0-dev.0
tabby@0.17.0-dev.0
tabby-common@0.17.0-dev.0
tabby-crawler@0.17.0-dev.0
tabby-db@0.17.0-dev.0
tabby-db-macros@0.17.0-dev.0
tabby-download@0.17.0-dev.0
tabby-git@0.17.0-dev.0
tabby-index@0.17.0-dev.0
tabby-inference@0.17.0-dev.0
tabby-schema@0.17.0-dev.0
tabby-webserver@0.17.0-dev.0

Generated by cargo-workspaces
2024-08-19 21:08:49 -07:00
Meng Zhang
0c38d77c99
fix(answer): properly handle user input attachment (#2865)
* fix(answer): properly handle user input attachment

* update

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-13 16:54:01 -07:00
Meng Zhang
82c513eb83
fix(db): disable sqlx-sqlite implementation for encoding DateTime<Utc> (#2861)
* fix(db): disable sqlx-sqlite implementation for encoding DateTime<Utc>

* update

* update

* update

* update

* update
2024-08-13 09:02:51 +00:00
Meng Zhang
946037ffde
feat(db): add thread / thread_messages table (#2826)
* add warning on structs that will be serialized to db column

* add thread / thread_messages table

* implement create_thread / append_messages

* implement create_run

* update validation errors to include struct error

* set relevant_questions in thread

* update

* update

* update

* upodate

* update

* update

* add user message yielding

* refactor to enum

* update

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-10 21:07:16 -07:00
Meng Zhang
5c9b62faa3
feat(webserver): support persisted thread in answer engine (#2793)
* init commit

* [autofix.ci] apply automated fixes

* draft create_thread_run_api

* cleanup

* update

* update

* update

* update

* update

* update

* connect streaming

* update

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* add back answer api for ease of migration

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-09 15:29:19 -07:00
Meng Zhang
00aaae4133
chore: upgrade validator to 0.18.1 (#2816) 2024-08-09 01:08:07 +00:00
Vladislav Bykov
f9842a2735
feat: add Elixir Language support (#2804)
* feat: add Elixir support

* Update website/docs/programming-languages.md

Co-authored-by: Meng Zhang <meng@tabbyml.com>

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2024-08-08 00:31:35 -07:00
Meng Zhang
742b39ce11 Release 0.16.0-dev.0
aim-downloader@0.16.0-dev.0
http-api-bindings@0.16.0-dev.0
llama-cpp-server@0.16.0-dev.0
ollama-api-bindings@0.16.0-dev.0
tabby@0.16.0-dev.0
tabby-common@0.16.0-dev.0
tabby-crawler@0.16.0-dev.0
tabby-db@0.16.0-dev.0
tabby-db-macros@0.16.0-dev.0
tabby-download@0.16.0-dev.0
tabby-git@0.16.0-dev.0
tabby-index@0.16.0-dev.0
tabby-inference@0.16.0-dev.0
tabby-schema@0.16.0-dev.0
tabby-webserver@0.16.0-dev.0

Generated by cargo-workspaces
2024-08-07 20:12:48 -07:00
Meng Zhang
e43869beaf
chore(webserver): support graphql subscriptions (streaming) (#2794)
* chore(webserver): support graphql subscriptions

* update

* update

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-06 00:59:44 +00:00
Meng Zhang
cc30964549
feat: return DocSearchHit / CodeSearchHit in /answer api (#2742)
* feat: return DocSearchHit / CodeSearchHit in /answer api

* [autofix.ci] apply automated fixes

* add answer types to openapi

* [autofix.ci] apply automated fixes

* feat(ui): integrate hits for answer (#2764)

* feat(ui): integrate hits for answer

* feat(ui): integrate hits for answer

* update

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: aliang <1098486429@qq.com>
2024-08-02 02:34:44 +00:00
Meng Zhang
b7fea156f3
refactor(webserver): move answer routes to webserver (#2704)
* refactor(webserver): move answer routes to webserver

* fix
2024-07-23 11:43:20 +08:00
Meng Zhang
04bcd3f775 Release 0.15.0-dev.0
aim-downloader@0.15.0-dev.0
http-api-bindings@0.15.0-dev.0
llama-cpp-server@0.15.0-dev.0
ollama-api-bindings@0.15.0-dev.0
tabby@0.15.0-dev.0
tabby-common@0.15.0-dev.0
tabby-crawler@0.15.0-dev.0
tabby-db@0.15.0-dev.0
tabby-db-macros@0.15.0-dev.0
tabby-download@0.15.0-dev.0
tabby-git@0.15.0-dev.0
tabby-index@0.15.0-dev.0
tabby-inference@0.15.0-dev.0
tabby-schema@0.15.0-dev.0
tabby-webserver@0.15.0-dev.0

Generated by cargo-workspaces
2024-07-23 11:35:47 +08:00
Eric
4e1e5394cf
feat: add spinner for prod release (#2623)
* feat: add spinner for prod release

* [autofix.ci] apply automated fixes

* resolve comment

* revert change

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-07-13 16:24:03 +08:00
Meng Zhang
116e1e1826
refactor: rename tabby-scheduler to tabby-index (#2606) 2024-07-10 00:27:19 +00:00
Meng Zhang
5956d15b89
refactor(scheduler): extract tabby-crawler crate (#2603)
* refactor(scheduler): extract tabby-crawler crate

* fix tests

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-07-10 08:50:26 +09:00
Meng Zhang
ef8542c6b1
feat: add mistral/chat support to talk to mistral api platform through chat api (#2568)
* feat: support ExtendedOpenAIConfig

* update

* support mistral/chat use case
2024-07-09 05:11:23 +00:00
Meng Zhang
ac49f8e3ba
chore: dedupe issues / PRs indexing by updated_at (#2576)
* chore: dedupe issues / PRs indexing by updated_at

* add dedup logic with updated_at comparision

* refactor: extract doc.public

* refactor: combine SourceDocument and WebDocument

* add unit test to verify updated_at dedup logic work

* use query to compare date to avoid read date
2024-07-05 08:30:06 +00:00
Meng Zhang
64cc7f493f
refactor(webserver): switch to openai chat interface (#2564)
* refactor(webserver): switch to openai chat interface

* fix query get content

* update utoipa path

* fix test

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-07-03 15:44:34 +09:00
Meng Zhang
d66f960afa
feat(config): add option enable_fast_attention for local model config (#2555) 2024-07-01 03:29:21 +00:00
Guilherme G. Schardong
24af7a1bb0
feat: support for Lua (#2530)
* feat: add lua language configuration

* feat: add lua repository context support

* updating programming-languages.md

* Update website/docs/programming-languages.md

* [autofix.ci] apply automated fixes

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-28 00:31:35 +08:00
Meng Zhang
50a810f6eb
chore(download): enable sha256 checksum, remove partition urls support (#2514) 2024-06-26 12:23:43 +00:00
Meng Zhang
b7d2cf6044
feat(webserver): use logkit to simplify logging to db for background jobs. (#2497)
* switch to log crate for dblogger

* fix

* make fix

* update
2024-06-25 14:01:37 +08:00
Meng Zhang
efdadc6a5f
refactor(core): remove scheduler command as web ui is enabled by default (#2489)
* refactor(core): remove scheduler command as web ui is mature

* update
2024-06-24 10:03:27 +00:00
Eric
a772c41a91
refactor: panic on invalid config.toml loading (#2460)
* refactor: panic on invalid config.toml loading

* allow tabby start when config is missing

* add warning message

* resolve comment

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-24 18:02:16 +08:00
Meng Zhang
381e88392c
refactor(scheduler): remove kv cache, using tantivy directly for incremental indexing + garbage collection (#2485)
* refactor(scheduler): remove get_source_file cache as it's no longer the bottleneck for computation

* chore: rename methods

* switch to tantivy for garbage collection

* remove legacy KV cache

* rename to source_file_key

* update

* update

* format

* update

* update

* update

* update

* update
2024-06-24 08:52:37 +00:00
boxbeam
b8bb15a9fc
feat(tabby): allow specifying custom certificates or allowing insecure certs for gitlab (#2392)
* feat(tabby): allow specifying custom certificates or allowing insecure certs for gitlab

* [autofix.ci] apply automated fixes

* Update gitlab

* Remove unneeded client_pem feature

* Revert import

* Simplify import format

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-22 10:57:41 +08:00
Meng Zhang
f2f27cd681
chore: switch to htmd for html -> markdown in web crawler (#2442) 2024-06-19 11:25:35 +00:00
boxbeam
3ef1bc47ea
feat(webserver): list config repositories from the repository_list endpoint (#2379)
* feat(webserver): list config repositories from the repository_list endpoint

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* Fix

* Resolve repositories from config

* Use sanitized repository name

* Remove reference to anyhow

* Resolve comments

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-18 21:34:25 +08:00
boxbeam
04de9057c0
feat(webserver): implement indexing of issues for github/gitlab integrated repositories (#2365)
* Incomplete draft for indexing issues

* [autofix.ci] apply automated fixes

* Initial implementation of cron job

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* List all issues and commit to index

* Add support for indexing gitlab issues

* [autofix.ci] apply automated fixes

* Apply suggestions

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* Refactor scheduler jobs

* Remove explicit reference to anyhow

* Apply suggestions

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-18 21:14:05 +08:00
Eric
94d35f0c42
feat: adapt --chat-template parameter of llama-server (#2362)
* feat: pass --chat-tempate, create ChatCompletionServer

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* improve impl

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-09 11:20:19 +08:00
Meng Zhang
ad781abcc6 Release 0.13.0-dev.0
aim-downloader@0.13.0-dev.0
http-api-bindings@0.13.0-dev.0
llama-cpp-server@0.13.0-dev.0
ollama-api-bindings@0.13.0-dev.0
tabby@0.13.0-dev.0
tabby-common@0.13.0-dev.0
tabby-db@0.13.0-dev.0
tabby-db-macros@0.13.0-dev.0
tabby-download@0.13.0-dev.0
tabby-git@0.13.0-dev.0
tabby-inference@0.13.0-dev.0
tabby-scheduler@0.13.0-dev.0
tabby-schema@0.13.0-dev.0
tabby-webserver@0.13.0-dev.0

Generated by cargo-workspaces
2024-06-06 11:58:13 +08:00
boxbeam
5cf27c7315
chore(scheduler): update text-splitter to 0.13.3 (#2333) 2024-06-04 07:32:54 +08:00
Meng Zhang
1a981a9c23
refactor: remove apalis (#2324)
* add tabby-job

* actual remove

* update

* update

* update

* fix

* update
2024-06-03 11:11:42 +08:00
Meng Zhang
a4ba051955
feat(scheduler): implement experimental code splitter (#2321)
* feat(scheduler): implement experimental code splitter

* Add failing test

* Update failing test

* Reimplement depth

* Add snapshot tests

* Add another snapshot test

* Add comment to explain pinned tree-sitter-kotlin version

* Update tree-sitter versions to be able to use text-splitter experimental features without custom patches

* Index versioning

* Remove unneeded comment

* Make wrapper type for batching

* Update crates/tabby-scheduler/src/code/cache.rs

* workaround lifetime

* update

* [autofix.ci] apply automated fixes

---------

Co-authored-by: boxbeam <instantiable@gmail.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-06-03 10:12:18 +08:00
Meng Zhang
074dec1e34
refactor(webserver): switch MemoryStorage for apalis background jobs (#2322)
* change to 0.5.3

* switch to memory storage
2024-06-01 19:23:07 +08:00
Meng Zhang
830343dcfd
feat(scheduler): add support for code indexing with embedding (#2304)
* chore: add embedding vector in code index

* feat(scheduler): add support for code indexing with embedding

* fix token

* use rank score to sort responses

* [autofix.ci] apply automated fixes

* update

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-05-31 05:04:04 +00:00
Meng Zhang
9464431176
chore: fix tantivy dependency due to upstream rev missing (#2269)
* chore: fix tantivy dependency due to upstream rev missing

* fix
2024-05-29 14:23:45 +00:00