plano/demos/use_cases/chatgpt-preference-model-selector
2025-07-14 21:20:23 -07:00
..
public chatgpt.com updated its backend api path. fixing (#530) 2025-07-14 21:20:23 -07:00
src chatgpt.com updated its backend api path. fixing (#530) 2025-07-14 21:20:23 -07:00
package-lock.json Salmanap/chrome extension routing (#511) 2025-07-08 16:16:32 -07:00
package.json Salmanap/chrome extension routing (#511) 2025-07-08 16:16:32 -07:00
postcss.config.js Salmanap/chrome extension routing (#511) 2025-07-08 16:16:32 -07:00
README.md Salmanap/chrome extension routing (#511) 2025-07-08 16:16:32 -07:00
tailwind.config.js Salmanap/chrome extension routing (#511) 2025-07-08 16:16:32 -07:00

🗝️ RouteGPT (Beta)

RouteGPT is a dynamic model selector Chrome extension for ChatGPT. It intercepts your prompts, detects the user's intent, and automatically routes requests to the most appropriate model — based on preferences you define. Powered by the lightweight Arch-Router, it makes multi-model usage seamless.

Think of it this way: changing models manually is like shifting gears on your bike every few pedals. RouteGPT automates that for you — so you can focus on the ride, not the mechanics.


📁 Project Name

Folder: chatgpt-preference-model-selector


🚀 Features

  • 🧠 Preference-based routing (e.g., "code generation" → GPT-4, "travel help" → Gemini)
  • 🤖 Local inference using Ollama
  • 📙 Chrome extension interface for setting route preferences
  • Runs with Arch-Router-1.5B.gguf

📦 Installation

1. Clone and install dependencies

git clone https://github.com/katanemo/archgw/
cd demos/use_cases/chatgpt-preference-model-selector

2. Build the extension

npm install
npm run build

This will create a build/ directory that contains the unpacked Chrome extension.


🧠 Set Up Arch-Router in Ollama

Ensure Ollama is installed and running.

Then pull the Arch-Router model:

ollama pull hf.co/katanemo/Arch-Router-1.5B.gguf:Q4_K_M

🌐 Allow Chrome to Access Ollama

Start Ollama with appropriate network settings:

OLLAMA_ORIGINS=* ollama serve

This:

  • Sets CORS to allow requests from Chrome

📩 Load the Extension into Chrome

  1. Open chrome://extensions
  2. Enable Developer mode (top-right toggle)
  3. Click "Load unpacked"
  4. Select the build folder inside chatgpt-preference-model-selector

Once loaded, RouteGPT will begin intercepting and routing your ChatGPT messages based on the preferences you define.


⚙️ Configure Routing Preferences

  1. In ChatGPT, click the model dropdown.
  2. A RouteGPT modal will appear.
  3. Define your routing logic using natural language (e.g., brainstorm startup ideas → gpt-4, summarize news articles → claude).
  4. Save your preferences. Routing begins immediately.

💸 Profit

RouteGPT helps you:

  • Use expensive models only when needed
  • Automatically shift to cheaper, faster, or more capable models based on task type
  • Streamline multi-model workflows without extra clicks

🧪 Troubleshooting

  • Make sure Ollama is reachable at http://localhost:11434
  • If routing doesnt seem to trigger, check DevTools console logs for [ModelSelector]
  • Reload the extension and refresh the ChatGPT tab after updating preferences

🧱 Built With

  • 🧠 Arch-Router (1.5B)
  • 📙 Chrome Extensions API
  • 🛠️ Ollama
  • ⚛️ React + TypeScript

📜 License

Apache 2.0 © Katanemo Labs, Inc.