The Brief

A mid-sized electronics e-shop. 200+ orders per day. Customer support couldn’t keep up with the same repetitive questions — order status, returns, warranty claims, product availability.

Goal: An AI assistant that handles routine queries automatically and escalates more complex cases to a human operator.

Day 1: Discovery and Architecture

Morning: Call with the client. We reviewed the most common queries (pulled from their ticketing system). 80% of inquiries fell into 5 categories.

Afternoon: Solution architecture:

  • GPT-4o as the foundation for response generation
  • RAG over FAQ, terms of service, and the product catalog
  • Integration with the order management system via API (order status)
  • Escalation to a live operator on low confidence scores

Day 2: Implementation

Morning: RAG pipeline setup — document indexing, embeddings, vector store.

Afternoon: Integration with the order management system. The chatbot can now ask for an order number and return its current status. Prompt engineering for consistent tone of voice.

Day 3: Testing and Deployment

Morning: Testing against real queries from the previous month. Tuning prompts for edge cases.

Afternoon: Deployment on the client’s website. Widget in the bottom-right corner. Live monitoring of initial conversations in real time.

Results (After 2 Weeks)

  • 78% of queries resolved automatically without human intervention
  • Response time dropped from an average of 4 hours to 15 seconds
  • Customer satisfaction (CSAT) increased by 12 points
  • Support team can now focus on complex cases

What I Learned

  1. RAG quality > model quality. Better documents = better answers. Investing in data preparation pays off more than model upgrades.
  2. Escalation is key. The AI must know when to say “I don’t know” and hand it off to a human. No hallucinations allowed.
  3. Iterate, don’t perfectionate. Ship fast, collect feedback, improve. A perfect v1.0 doesn’t exist.

Want a similar solution? Book a consultation.

Share this article

Found this article helpful? Share it with colleagues who might benefit.