Local AI Research Gateway: Ubuntu, Docker, & SearXNG

What is a Local AI Research Gateway? Building a local research stack gives you total privacy by keeping your data and LLM execution entirely on your hardware. By combining Ollama with Open WebUI and SearXNG, you can create a localized version of modern chat interfaces capable of real-time web search. Key Components: Ollama: The backend engine handling model execution locally. Open WebUI: The interface for chat and agent orchestration. SearXNG: A self-hosted metasearch engine that feeds real-time web data directly to the LLM. How to get started: Host Ollama: Run Ollama natively on your Ubuntu host to maximize GPU access for your local models (like gemma2:2b). Deploy via Docker: Use a docker-compose.yml to spin up Open WebUI and SearXNG containers. Bridge the Connection: In Open WebUI, navigate to Admin Panel > Settings > Web Search and set the Query URL to http://host.docker.internal:8080/search?q=<query>. Configure Search: Set the “Search Result Count” to 3 to ensure memory usage stays within the limits of constrained hardware. ...