I remember a few years back, running support for a growing SaaS. We were drowning. Every Monday, a fresh wave of “my integration isn’t working” tickets would hit, often for the same three or four common issues. Our human agents were spending hours on repetitive diagnostics, burning out fast. We tried the usual: better FAQs, canned responses, even a basic rule-based chatbot. None of it truly scaled. The tickets kept piling up, and our first response time stretched unacceptably long. That’s when I started looking hard at AI for ticket automation. Not the hype, but the actual, deployable tech.
Building vs. Buying for Support Automation
The first big decision was always: build or buy? For a while, I was convinced we needed a custom agent. The idea was to create something truly bespoke, something that understood our specific product nuances. I spent weeks prototyping with frameworks like LangGraph and AutoGen. The promise was alluring: an agent that could read a ticket, query our internal knowledge base, check user permissions via an API, and even suggest a fix or escalate to the right team with all the context.
Building with these frameworks gives you incredible control. You define the states, the transitions, the tools the agent can call. For example, a simple LangGraph agent might have states like CLASSIFY_TICKET, FETCH_USER_DATA, DIAGNOSE_ISSUE, and RESPOND_OR_ESCALATE. Each state would call a specific tool: a classification model, an internal user API, a diagnostic script, or a messaging API. It’s powerful, but it’s also a full-stack engineering project. You’re not just writing prompts; you’re managing state, handling retries, and building strong tool integrations.
On the other hand, platforms like Intercom have been quietly adding serious AI capabilities to their existing support automation toolsets. They’re not selling you a raw framework; they’re selling a productized agent experience. Their AI can often classify tickets, suggest answers from your knowledge base, and even draft replies based on conversation history. It’s less flexible, sure, but it’s also a lot less work to get off the ground. For many teams, especially those without dedicated AI engineering resources, this is the only sensible path.
What Breaks When Agents Go Live
Here’s where the rubber meets the road. I’ve seen agents fail in spectacular, silent, and expensive ways. My biggest gripe with early agent deployments wasn’t outright crashes; it was the subtle, insidious failures. An agent might misclassify a critical bug report as a feature request, sending it into a low-priority queue for days. Or it might get stuck in a loop, repeatedly trying to access an API endpoint that returned a 403, burning through tokens without ever resolving the issue.
Debugging these issues is a nightmare without the right tools. You can’t just look at a stack trace. You need to see the agent’s thought process, its internal monologue, the sequence of tool calls, and the exact inputs and outputs at each step. This is where observability platforms like LangSmith and Langfuse become non-negotiable. Without them, you’re flying blind. I’ve spent too many late nights sifting through raw logs, trying to reconstruct an agent’s decision path. It’s a terrible way to spend your time.
One specific failure I remember vividly involved an agent designed to handle refund requests. It was supposed to check purchase history, verify eligibility, and then initiate a refund via our payment gateway. Sounds simple, right? Except it occasionally misinterpreted “partial refund” as a full refund, or worse, tried to refund an order that was already refunded. The financial implications were immediate and painful. We had to implement a human-in-the-loop approval for all refund actions, which, yes, is annoying, but absolutely necessary for compliance and preventing financial loss. This isn’t just about customer satisfaction; it’s about not losing money.
The Wins: When AI Actually Delivers
Despite the headaches, when an AI agent works, it really works. My concrete love is the sheer volume of repetitive tickets it can handle, freeing up human agents for complex, high-value interactions. For that SaaS company, we eventually deployed a hybrid system. We used Intercom’s built-in AI for initial classification and response suggestions for common queries. For anything requiring deeper diagnostics or specific API calls, we built a custom agent using LangGraph, integrated into our existing support workflow.
This custom agent, after several iterations and a lot of debugging with LangSmith, became incredibly effective at pre-qualifying technical issues. It could ask clarifying questions, pull relevant logs from our internal systems (via secure API calls), and present a concise summary to the human agent. This cut down the average handling time for those “integration isn’t working” tickets by over 40%. Our human agents were happier, and our customers got faster, more accurate resolutions. That’s a tangible win.
Another win: accurate routing. Before, tickets would often bounce between teams. Now, an AI support agent review system, even a simple one, can analyze the ticket content and route it to the correct department (billing, technical, sales) with high accuracy. This reduces internal friction and gets the customer to the right expert faster. It’s a small thing, but it adds up to a much smoother operation.