⚡ Faster Chat

A blazingly fast, privacy-first chat interface for AI that works with any LLM provider—cloud or completely offline.

Connect to OpenAI, Anthropic, Groq, Mistral, or run completely offline with Ollama or LMStudio or even llama.cpp. Your conversations stay local in on your machine. No vendor lock-in, no tracking, full control.

+++++++++++

CONSIDER THIS BETA I am actively working on polishing the UI and getting this into a stable position. So please consider this as WORK IN PROGRESS PRESENTLY.

+++++++++++

✨ Features

Core

• 💬 Real-time streaming chat with Vercel AI SDK
• ⚡ Blazingly fast - 3KB Preact runtime, zero SSR overhead, instant responses
• 🗄️ Server-side SQLite storage - Conversations persist across devices and browser tabs
• 🤖 Multi-provider support: OpenAI, Anthropic, Ollama, Groq, Mistral, custom APIs
• 📥 Import conversations from ChatGPT exports (more formats coming soon)
• 📎 File attachments with preview and download
• 📝 Markdown rendering with syntax highlighting (Shiki) and LaTeX support
• 🎨 Themable UI - Dark/light themes, custom fonts, customizable syntax highlighting
• 🎤 Voice input/output - Speech-to-text and text-to-speech capabilities
• ⌨️ Keyboard shortcuts for power users (Ctrl+B sidebar, Ctrl+Shift+O new chat, etc.)
• 📱 Responsive design for desktop, tablet, and mobile

Administration

• 🔐 Multi-user authentication with role-based access (admin/member/readonly)
• 🔌 Provider Hub: Auto-discover models with models.dev integration
• ⬇️ Pull Ollama models directly from Admin Panel with progress streaming (no CLI needed)
• 🛡️ Admin panel for user management (CRUD, password reset, role changes)
• 🔑 Encrypted API key storage with server-side encryption
• 🎭 White labeling - Customize app name and logo icon for your organization

Deployment

• 🌐 Works completely offline with local models (Ollama, LM Studio, etc.)
• 🐳 One-command Docker deployment with optional HTTPS via Caddy
• 🎨 Modern stack: Preact + Hono + TanStack + Tailwind 4.1

🚀 Quick Start

One-Click Docker Deploy (Recommended)

git clone https://github.com/1337hero/faster-next-chat.git
cd faster-next-chat
docker compose up -d

That's it. Open http://localhost:8787, register your first user (becomes admin), and configure your AI providers.

With HTTPS (for production):

docker compose -f docker-compose.yml -f docker-compose.caddy.yml up -d

Local Development

Prerequisites: Bun (recommended) or Node.js 20+

git clone https://github.com/1337hero/faster-next-chat.git
cd faster-next-chat
bun install
bun run dev

On first run, the server automatically generates encryption keys and initializes the database.

• Frontend: http://localhost:3000
• API Server: http://localhost:3001

Important: Backup server/.env - contains the encryption key for stored API keys.

First-Time Setup

1. Register an account at http://localhost:3000/login
   • The first account is automatically promoted to admin
2. Configure AI providers in the Admin Panel (/admin → Providers tab):
   • Add OpenAI, Anthropic, or other cloud providers with API keys
   • Configure local providers (Ollama, LM Studio) with custom endpoints
   • API keys are encrypted and stored securely server-side
3. Enable models in the Admin Panel (Providers tab → Refresh Models)
   • Select which models appear in the chat interface
   • Set default model for new chats

Configure providers and API keys in the Admin Panel

Enable and manage models from all your providers

New Focus Mode

New Apperance Options, to change colors and fonts

You can now white label and customize the app title and icon

Using Offline with Ollama

# Install Ollama (macOS/Linux)
curl -fsSL https://ollama.ai/install.sh | sh

# In Faster Chat: Admin Panel → Connections → Search "Ollama" → Add
# Then: Admin Panel → Models → Click "Pull Model" on Ollama row → Enter model name

You can pull models directly from the Admin Panel—no CLI needed! Just click Pull Model next to your Ollama provider, enter a model name (e.g., llama3.2, mistral, codellama), and watch the download progress in real-time.

The Provider Hub auto-discovers 50+ providers including Ollama, LM Studio, OpenAI, Anthropic, Groq, Mistral, OpenRouter, and more. Just search and add.

💻 Development

Commands

Root (recommended)

bun run dev         # Start frontend + backend concurrently
bun run build       # Build all packages for production
bun run start       # Run production builds
bun run clean       # Remove all build artifacts
bun run format      # Format code with Prettier

Frontend

cd frontend
bun run dev         # Vite dev server on :3000
bun run build       # Production build to dist/
bun run preview     # Preview production build

Backend

cd server
bun run dev         # Hono dev server on :3001
bun run build       # Build for production
bun run start       # Run production server on :3001

🐳 Docker Details

The Docker setup uses a hybrid build (Bun for deps, Node.js 22 runtime) with SQLite storage in a persistent volume.

HTTPS with Caddy: For production with automatic Let's Encrypt certificates:

docker compose -f docker-compose.yml -f docker-compose.caddy.yml up -d
# Edit Caddyfile with your domain, point DNS, restart

See docs/caddy-https-setup.md and docs/docker-setup.md for details.

Configuration

Environment Variables (server/.env):

# Required: Encryption key for API keys
API_KEY_ENCRYPTION_KEY=...  # Generate with crypto.randomBytes(32)

# Optional: Configure via Admin Panel instead
APP_PORT=8787              # Internal port (default: 8787)
NODE_ENV=production        # Environment mode
DATABASE_URL=sqlite:///app/server/data/chat.db

# For local Ollama access from Docker
OLLAMA_BASE_URL=http://host.docker.internal:11434

Common Commands:

docker compose up -d                # Start
docker compose logs -f              # View logs
docker compose down                 # Stop
docker compose up -d --build        # Rebuild

# Reset database
docker compose down
docker volume rm faster-chat_chat-data
docker compose up -d

🗺️ Roadmap

Completed ✅

• Preact + Hono migration from Next.js
• Streaming chat with Vercel AI SDK
• Server-side SQLite persistence (chats sync across devices/tabs)
• Multi-provider support (OpenAI, Anthropic, Ollama, custom APIs)
• Admin panel for providers, models, and users
• Role-based access control
• File attachments with preview/download
• Markdown, code highlighting (Shiki syntax highlighting), LaTeX rendering
• One-click Docker deployment with optional HTTPS
• Keyboard shortcuts (Ctrl+B sidebar, Ctrl+Shift+O new chat, Ctrl+K search)
• Theming system (multiple color themes, light/dark mode)
• Font customization and font themes
• Voice input/output (speech-to-text, text-to-speech)
• Settings UI improvements (tabbed interface for user preferences)
• White labeling (custom app name, custom logo icon selection)
• ChatGPT conversation import (drag-drop JSON export files)
• Ollama model pull UI (download models directly from Admin Panel)

In Progress 🚧

• Tool calling implementation (infrastructure ready)
• Image generation integration (DALL-E, Stable Diffusion, local models)
• Web search capabilities (optional internet access for AI)

Planned 📋

Settings & UX

• Conversation branching (explore alternative responses)
• Export conversations (JSON, Markdown, CSV)
• Import from more sources (Claude, other AI assistants)
• Auto title generation for chats
• Message regeneration
• Advanced message features (inline editing, rating)

Advanced Capabilities

• Local RAG with vector search (private document search)
• Multi-modal requests (vision, audio)
• Conversation sharing and collaboration

Infrastructure

• PostgreSQL backend option (for larger deployments)
• Plugin system for custom extensions
• Mobile app (Capacitor)

🎨 Design Philosophy

Faster Chat is built on these principles:

• Self-Hosted: Your data stays on your server. No cloud dependencies.
• Provider-Agnostic: Never locked into a single AI vendor.
• Minimal Runtime: 3KB Preact, no SSR overhead, instant responses.
• Offline-Capable: Run completely offline with local models.
• Fast Iteration: Bun for speed, no TypeScript ceremony, clear patterns.
• Simple Code: Small focused components, derive state in render, delete aggressively.

Why No TypeScript?

We chose speed over ceremony. TypeScript's compile step and constant type churn across fast-moving AI SDKs slowed development more than it helped.

Our guardrails:

• Runtime validation at system boundaries
• Shared constants and clear contracts
• Tests for critical paths
• JSDoc for complex functions

Trade-off: Less friction, faster iteration, easier contribution.

See WIKI for detailed coding principles and architecture documentation.

🙏 Credits & Acknowledgments

Faster Chat is built on the shoulders of excellent open source projects:

Core Infrastructure

• Vercel AI SDK - Streaming chat completions and multi-provider support
• models.dev - Community-maintained AI model database for auto-discovery
• Preact - Lightweight 3KB React alternative
• Hono - Ultrafast web framework for the backend
• TanStack Router & TanStack Query - Modern routing and server state management
• bun:sqlite - Fast SQLite driver for server-side persistence

UI & Styling

• Tailwind CSS - Utility-first CSS framework
• lucide-preact - Beautiful icon library
• Catppuccin - Soothing pastel theme

External API Calls

For transparency, this application makes the following external API calls:

• models.dev/api.json - Fetches provider and model metadata on server startup (cached for 1 hour)
• Your configured AI providers (OpenAI, Anthropic, etc.) - Only when you send chat messages
• No tracking, analytics, or telemetry services - Your privacy is paramount

All data (conversations, settings, API keys) is stored in your self-hosted SQLite database. Nothing leaves your server except API calls to your configured AI providers.

🤝 Contributing

Contributions welcome! We're looking for:

• Bug fixes and error handling
• New provider integrations
• Documentation improvements
• UI/UX enhancements <-- I'm a frontend dev w/ an eye for design but not a DESIGNER - if you ARE! HELP!
• Tests and quality improvements

Before submitting:

1. Read Documention for coding philosophy and patterns
2. Ensure changes align with our lightweight, offline-first approach
3. Test locally with bun run dev
4. Keep PRs focused on a single feature or fix

📄 License

MIT License - see LICENSE for details.

---

⭐ Star History

If Faster Chat helps you take control of your AI conversations, consider giving us a star!

---

Built with ❤️ by 1337Hero for developers who value privacy, speed, and control.
_{No tracking. No analytics. Just fast, local-first AI conversations.}