tabby/README.md
Meng Zhang df149fad61
Reduce repo size (#5)
* Remove binary files from git

* Add Makefile

* update
2023-03-23 13:10:59 +08:00

1.3 KiB

🐾 Tabby

License Code style: black Docker build status

Warning

This repository is undering heavy construction, everything changes fast.

An opensource / on-prem alternative to GitHub Copilot

Contents

  • admin: Admin panel for monitoring / settings purpose.
  • server: API server for completion requests. It also logs users' selections (as feedback to model's quality).
  • deployment: Container related deployment configs.
  • converter: Converts a transformers causal LM model into TensorRT / FasterTransformer serving formats.
  • preprocess: Preprocess files into datasets
  • tabformer: NOT RELEASED Trainer(PEFT w/RLHF) for tabby models.

Development

Assuming Linux workstation with:

  1. docker
  2. docker w/ gpu driver
  3. python 3.10

Use make dev to start local dev server.