Tabby

Tabby is an open-source, self-hosted AI coding assistant developed by TabbyML. The assistant draws context from comments and code to suggest lines and whole functions to the user, helping them write code faster. Tabby is free and compatible with major coding LLMs (large language models), including CodeLlama, StarCoder, and CodeGen. Tabby also includes optimizations in IDE (integrated development environment) extensions and model serving. Achieving accurate streaming and cancellation with an adaptive caching strategy to increase the speed code completions are delivered and parsing relevant code into tags to provide effective prompts. Tabby aims to make it easier for everyone to contribute to a project, including both AI experts and the EngOps team.

Tabby is positioned as an open-source and on-premises alternative to GitHub Copilot, without the need for a DBMS (database management system) or cloud service. It offers an OpenAPI interface to integrate with existing infrastructure while supporting consumer-grade GPUs. Tabby aims to increase the use of AI-powered code assistants, in particular among developers who have legal, ethical, and governance concerns using other products.

TabbyML launched in April 2023. On April 6, 2023, the company held a Show HN (Hacker News) launch for Tabby. On August 31, 2023, the first stable version (v0.0.1) of Tabby was released. After six months of development, the company opened a waiting list to register for Tabby.