Modernizing a Local Town Website with AI-Powered RAG Chatbot

T10 Consulting recently transformed the outdated website of a local town by implementing an AI-powered Retrieval-Augmented Generation (RAG) chatbot, delivering an enhanced user experience. The legacy website, hindered by an old and cumbersome design, struggled to provide residents with quick access to information. Our solution modernized access to town resources while maintaining a cost-effective and scalable architecture.

Project Overview

We designed a robust RAG-based chatbot system to provide accurate and conversational responses to user queries about town services, events, and policies. The solution leverages cutting-edge AI tools and workflows to ensure seamless integration and performance.

Technology Stack

• n8n: Orchestrated workflows to automate data ingestion, processing, and chatbot interactions.
• Firecrawl: Scraped and indexed content from the outdated town website, enabling efficient data retrieval.
• Grok (xAI): Powered the conversational AI, delivering human-like responses to user queries.
• OpenAI: Generated high-quality embeddings for semantic search and context understanding.
• Supabase: Served as the vector store for efficient storage and retrieval of embeddings.
• Cohere: Enhanced response accuracy through reranking of retrieved documents.

Impact

The RAG chatbot revitalized the town's online presence, enabling residents to access information instantly through natural language queries. Despite the website’s outdated structure, our solution bridged the gap, providing a modern, user-friendly interface without requiring a full website overhaul.

For the knowledge graph, we used LightRAG as it was easy to implement. There are some better solutions out there but this seemed to work fine. This graph was created by simply sending it markdown documents from the website. We couldn't load them all in as this can get rather expensive because you need to use an embedding LLM like OpenAI.

This project showcases T10 Consulting’s expertise in AI engineering, combining n8n workflows, RAG implementations, and advanced AI models to deliver impactful solutions for our clients.