Your AI platform isn't mature — here's what is

About this episode

I keep hearing 'we're building an AI platform' from enterprises. Most are stitching together demos. Thomson Reuters has been doing AI for 30 years. I sat down with Laura Skylaki (VP AI Engineering, Thomson Reuters) at AWS Summit London — and the gap between what they're doing vs. what most companies call 'AI maturity' is striking. In this episode, Laura breaks down how Thomson Reuters built an enterprise AI platform that serves 30,000 employees across three user personas — from business users to AI creators to developers — with 16 internal services, a $200M/year AI commitment, and a healthy skepticism about when agentic is actually the right answer. Key takeaways: • Evaluation before building — 'It's increasingly harder to retrofit an evaluation framework to an agent capability you already deployed.' They build evaluation benchmarks first to force understanding of the business problem, then build the agent. LLM-as-a-judge with human-in-the-loop calibration — and the judges themselves need continuous regression checks. • Know when NOT to use agents — 'Where we can go and write deterministic code with a logical rule-based approach, I don't think it makes sense to rely on the agent.' Not everything needs to be agentic. When tools exceed a dozen or overlap semantically, specialize into multiple agents instead of overloading one. • Engineers haven't written code manually in 3-4 months — Not experimenting; their AI coding tooling is that far ahead. The shift is toward system design, architecture, and clear structuring for AI assistance. • AWS under the hood with AgentCore and Strands — The platform runs on AWS with API Gateway, Lambda, Step Functions, and Amazon Bedrock AgentCore for agent deployments (runtime, memory, MCP marketplace, code interpreter, browser tools, policy and identity governance). They use Strands Agents SDK to build agents. AgentCore removes the infrastructure burden of long-running agent sessions. • Rethink workflows, don't retrofit — Teams reimagining legacy workflows from scratch for AI rather than bolting generative AI onto systems not built for it. 'If I was building this now for the first time, how would I build it?' The companies that succeed with AI are not fitting it into existing processes — they're redesigning the process through AI.

Links

Here are the links to the tools, technologies, or articles we mentioned in this episode.