|
|
||
|---|---|---|
| .. | ||
| public | ||
| src | ||
| package-lock.json | ||
| package.json | ||
| postcss.config.js | ||
| README.md | ||
| tailwind.config.js | ||
🗝️ RouteGPT (Beta)
RouteGPT is a dynamic model selector Chrome extension for ChatGPT. It intercepts your prompts, detects the user's intent, and automatically routes requests to the most appropriate model — based on preferences you define. Powered by the lightweight Arch-Router, it makes multi-model usage seamless.
Think of it this way: changing models manually is like shifting gears on your bike every few pedals. RouteGPT automates that for you — so you can focus on the ride, not the mechanics.
📁 Project Name
Folder: chatgpt-preference-model-selector
🚀 Features
- 🧠 Preference-based routing (e.g., "code generation" → GPT-4, "travel help" → Gemini)
- 🤖 Local inference using Ollama
- 📙 Chrome extension interface for setting route preferences
- ⚡ Runs with Arch-Router-1.5B.gguf
📦 Installation
1. Clone and install dependencies
git clone https://github.com/katanemo/archgw/
cd demos/use_cases/chatgpt-preference-model-selector
2. Build the extension
npm install
npm run build
This will create a build/ directory that contains the unpacked Chrome extension.
🧠 Set Up Arch-Router in Ollama
Ensure Ollama is installed and running.
Then pull the Arch-Router model:
ollama pull hf.co/katanemo/Arch-Router-1.5B.gguf:Q4_K_M
🌐 Allow Chrome to Access Ollama
Start Ollama with appropriate network settings:
OLLAMA_ORIGINS=* ollama serve
This:
- Sets CORS to allow requests from Chrome
📩 Load the Extension into Chrome
- Open
chrome://extensions - Enable Developer mode (top-right toggle)
- Click "Load unpacked"
- Select the
buildfolder insidechatgpt-preference-model-selector
Once loaded, RouteGPT will begin intercepting and routing your ChatGPT messages based on the preferences you define.
⚙️ Configure Routing Preferences
- In ChatGPT, click the model dropdown.
- A RouteGPT modal will appear.
- Define your routing logic using natural language (e.g.,
brainstorm startup ideas → gpt-4,summarize news articles → claude). - Save your preferences. Routing begins immediately.
💸 Profit
RouteGPT helps you:
- Use expensive models only when needed
- Automatically shift to cheaper, faster, or more capable models based on task type
- Streamline multi-model workflows without extra clicks
🧪 Troubleshooting
- Make sure Ollama is reachable at
http://localhost:11434 - If routing doesn’t seem to trigger, check DevTools console logs for
[ModelSelector] - Reload the extension and refresh the ChatGPT tab after updating preferences
🧱 Built With
- 🧠 Arch-Router (1.5B)
- 📙 Chrome Extensions API
- 🛠️ Ollama
- ⚛️ React + TypeScript
📜 License
Apache 2.0 © Katanemo Labs, Inc.