Peregian Digital HubUplift

Designing and deploying agents

Designing and deploying agents

What AI agents are, how they differ from chat assistants, what makes them reliable, and where they create bottlenecks in real organisations.

AI agents are software systems that execute tasks within workflows, not assistants that answer questions. The technology is immature but potentially enterprise-reshaping, comparable to cloud computing circa 2007. For organisations deploying them, the constraint has shifted from what models can do to what organisations can build: data infrastructure, access controls, and the expertise to wire agents into existing systems.

Read-write systems, not assistants

Aaron Levie, CEO of Box, describes the shift plainly: agents are "read-write" operations rather than "read-only" assistance. A chat assistant helps a human retrieve or create information; an agent accepts a task, performs work inside the organisation's systems, checks its own results, and reports back. The difference is decisive. Levie places agents at the maturity point cloud computing occupied in 2007: "very early" with potential to reshape enterprise work over a decade.

For a small manufacturing business or a law firm, the implication is concrete: agents could provide access to specialist capacity—legal research, sales support, operations analysis—that only larger competitors could previously afford. Levie argues this will erase the talent advantage size confers, enabling smaller enterprises to access specialist skills that were once the province of large competitors. At the same time, agents could absorb mechanical work—data entry, information extraction, routine documentation—freeing staff to focus on customer interactions and judgment-intensive tasks.

Infrastructure as the constraint

When Levie speaks to CIOs about agents in 2026, the conversation is not about model capability. Instead, he identifies a structural gap: coding agents work well because technical users can fix mid-run failures, outputs are verifiable, and access controls are clean. Knowledge work—the workflows across most SME functions—fails for opposite reasons. Context for those workflows is scattered across 20 systems, access permissions are tangled, and there is no single source of truth. Levie calls this the "Bob and Sally problem": Bob has too much access, Sally has too little, and the agent either bounces off an entitlement wall or answers using data it should not have seen.

Data is the deeper bottleneck. The problem long predates agents: contracts stored in five different places, roadmaps across 30 locations, inconsistent definitions of core metrics. When only a data science team needed those answers, humans compensated through tribal knowledge. When an agent needs to answer the same questions reliably, weak definitions become company-wide problems.

The corollary for agents specifically: there is no shortcut from model capability to stable business processes. Levie notes that both Anthropic and OpenAI have launched enterprise agent initiatives, recognising that the hard work is upgrading IT systems, provisioning agents with accurate context, redesigning workflows around human-agent handoffs, driving adoption, and managing change. This is not one-time setup. Each model upgrade creates fresh work: you either capture the gains of the new model or step backward into scaffolding the prior model required.

Self-improving loops through observation

When agents execute work repeatedly, their logs become a learning signal. The Peregian Digital Hub video on building CLIs for agents documents this pattern: when an agent performs an action, the action can be assessed, learnings can be fed back into the loop, and the system can iteratively improve. This requires structured output from tools—which is why CLIs outperform GUI-based tools for agent automation. A command-line interface returns JSON or tabular data that agents parse directly, saving tokens and reducing hallucination; every execution is logged and can be retrospectively analysed.

The retrospection process is where improvement lives. When a batch of completed tasks is reviewed, patterns surface—a missing database field, a repeated query failure, a systemic misunderstanding—and the agent itself can name the new CLI method the system should build. Tom Blomfield, a General Partner at Y Combinator, describes YC's implementation: a monitoring agent watches queries, diagnoses failures, proposes fixes to tools and context, commits code, and deploys overnight. The next morning, the same query succeeds. This is not productivity gain; it is self-improvement.

Blomfield frames this as a fundamental shift in company structure. When an organisation makes its knowledge legible to AI, hierarchical coordination becomes redundant; loops that self-improve transcend the traditional coordination problem. The constraint shifts: token budget becomes more precious than headcount, and data and comprehension become the permanent assets while software becomes ephemeral and regenerable.

Loop architecture in practice

Three web developers building production systems with AI agents—Román Olivera, Kevin Eulenberg, and Rob Linker—have documented concrete patterns for self-improving loops that move beyond this framing into method. Context is the asset, and the loop is the delivery mechanism: static LLM memory maintained by the platform (e.g. chat history) is insufficient for ongoing work. Context needs to be persisted in the application itself—stored in files, databases, or systems the agent wires to, not in the chat platform's session management.

The three builders use different architectures but share a core insight: consolidation. Consolidation processes running at fixed intervals summarise conversation logs and agent traces into a single data file, filtering repetition and keeping only actionable learnings. This moves context into the work system rather than being trapped in chat history. Olivera's Flat Fish System, for instance, watches file changes to detect when the agent or human has updated the knowledge store, then consolidates those changes automatically into a compressed context file the next agent run reads at startup. This decouples the loop from any one platform's session management; the same agents could swap platforms or be reimplemented without losing the learnings.

Within a single project run, the builders emphasise nested loops. Within each stage, mini-loops (plan, execute, review, fix) preserve finer-grained learnings before context compression; larger single-pass loops lose detail. Eulenberg, transforming a prototype into a CMS-driven product, ran repeated cycles with progressively refined skills—each run learning from the previous one's failures before compression, so early mistakes inform later stages without bloating the final context window.

A systemic principle binds the approaches: repeated failures are process failures, not model failures. When the same bug recurs, the loop did not capture the learning; the system missed a rule or validation step. Linker's daily testing loop for a construction SaaS runs autonomous agent-driven fixes on issues discovered in production, without merging to production itself. The discipline: every preventable re-occurrence signals that the loop should embed a new check or skill.

The practical consequence: when the agent tells you it is fixed, convert that into a rule or validation check and embed it in the skill file, rather than accepting the agent's report as authoritative. This is where the loop becomes self-improving rather than just self-reporting.

The deployment gap

The gap between agent capability and deployed workflow is where the real work lives. Levie identifies the internal FDE (forward-deployed engineer) as the highest-demand hire in tech: a technical person embedded in a business function who maps workflows, wires agents to tools and data, manages permissions, and carries the knowledge forward through model upgrades. This is not a one-time engagement; each model upgrade creates fresh work.

The practical consequence: people tracking AI development closely are roughly two years ahead of their organisations' adoption cycles, creating a window for practitioners. For engineers, IT staff, and operations people, there is an opportunity to help organisations implement AI agents into working enterprise workflows, and that opportunity will persist. The need is structural, not temporary.

What an agent in production requires

Background agents—the largest source of token consumption and business value—require infrastructure most organisations lack. Levie argues the biggest agent use of tokens will come from always-on agents or workflow-triggered agents, not chat-based interaction. His example: Claude Managed Agents running overnight to review contracts uploaded to Box, extracting critical information and writing tasks into Linear. This same pattern applies to client onboarding, invoice processing, M&A due diligence, data extraction pipelines, and millions of similar workflows.

To operate at scale, background agents need long-running execution, safe code execution, tool access, compute sandboxes, and cross-system connectivity. For an SME, this means the agent must safely call APIs into the systems where the business already lives—accounting, CRM, document stores, project tracking. This is where MCP (Model Context Protocol) servers earn their place: they let agents discover and call APIs into existing systems without writing point-to-point integrations. Levie demonstrates this pattern: Claude uses Box and Linear MCP servers to turn product roadmap documents into trackable work issues, connecting a knowledge store to an execution system without manual transcription.

The lesson is simpler than the infrastructure: a deployed agent bridges a gap in the organisation. It does not need to be perfect. It needs to connect knowledge that exists in one place to tools where work gets tracked and executed in another.

What works, what does not

Coding agents: why they work

Coding agents have cleared the hurdles that stall agents in the rest of the business. Levie identifies the structural reasons: coding has highly technical users who fix mid-run failures, verifiable outputs (code runs or it does not), a single source of context (the codebase), clean access controls, and purely digital work. None of those apply to most SME workflows. A law firm does not have a codebase; it has case files scattered across three systems. A manufacturing business does not have "users" in the technical sense; it has people tracking inventory in sheets, email, and a decade-old system.

Knowledge work: the structural gap

Knowledge work has context strewn across 20 systems, many not digital, scattered access permissions, and no single truth. The barrier is not capability but infrastructure. This is not news; it is a restatement of the data problem every organisation has faced. What changes with agents is that the problem becomes acute: when a human handled it, silence and workarounds were acceptable. When an agent touches it, bad data becomes visible failure.

The implication: agent deployment in knowledge work requires data work first. Not perfect data, but data the agent can reliably use. Context the agent can find. Permissions the agent can understand. This is not model capability; it is operations.

Knowledge agent platforms for non-engineers

When an organisation scales knowledge agents beyond a pilot, the architecture Levie describes—surface-agnostic APIs, domain-owned builders, shared execution with access controls—becomes concrete. Stripe's Kai platform, launched in 2026 and run by Emily Sands, the product lead, demonstrates what this looks like in practice across a large technical organisation. Stripe's AI platform team built Kai by building on top of Deep Agents, an open-source framework, completing the initial version within one week. The rapid build time indicated that investing in Python infrastructure and using foundational agent frameworks cut the real work down to domain-specific problems rather than reinventing agent infrastructure from scratch.

Kai's design separates three layers. The first is surface-agnostic APIs: the agent as a service, not an app. The second is domain-specific agent builders—a tool Sands calls AgentStudio—where business experts configure agents without centralising expertise. The third is shared execution environments with security and access controls embedded. This distributes responsibility: engineering provides the platform, domain teams build the agents, and the platform enforces governance (access rules, approval gates, audit trails) without domain teams needing to code it. The technical challenge Kai solves is skill selection and scale. Instead of a single agent architecture pointing to all available tools—which does not work for knowledge work because there is no prior folder structure like a codebase has—Sands describes Kai as using RAG and LLM routing to select the right skill from over 1,000 tools and data sources. A hybrid approach handles routing in domains where a single canonical structure does not exist.

To make this scale reliably, Stripe runs a distributed system where teams own domain modules, with the platform using two-pass selection to load skills and tools. This distributes maintenance burden to domain experts rather than centralising it. The platform also implements infrastructure for persistent context, sandboxed code execution, and automatic summarisation. These technical decisions enabled Kai to scale reliably in production without custom engineering for each new workflow.

Multi-turn state management is essential for knowledge work. According to Sands, Kai holds state across sessions reaching 932 turns, allowing iterative reasoning that builds on prior context without degrading or hitting context limits. This is where knowledge work differs from single-prompt code generation: domain experts need to loop, refine, and reason with the agent over time.

Access governance is the closing constraint. Sands argues that knowledge agents must enforce implicit access rules not present in coding—for example, preventing data from unrelated customer contexts appearing in the same session—and a monolithic agent cannot encode these per-domain; the platform distributes governance to domain teams. This is Levie's "Bob and Sally problem" in architecture: Kai solves it by making the platform enforce access rules rather than trusting the agent to reason about them.

Within two weeks of launch, 83% of Stripe became weekly active users of Kai—a result driven by building Kai for non-engineers with an interface matching how they actually work, rather than requiring them to master developer tooling. Adoption rates across non-engineering functions reached 95% in marketing and 87% in go-to-market roles, outpacing adoption in engineering despite the platform being built by engineers. The business outcomes suggest the architecture works. Account executives using Kai generated 26% more revenue opportunities and closed 39% more deals; new hires used it 2.7x more than baseline cohorts; and across the company, Kai shifted 25,000 hours per year from admin work to revenue work. These figures come from Stripe, a large technical company, and indicate the scale of time-shifting when agent access is frictionless; SME outcomes may differ, but the pattern shows where focus matters: reducing adoption friction and building for domain experts, not centralising all intelligence in one place.

Token costs and operational budgets

Token costs are reshaping enterprise budgets. Levie observes that a single agent run can cost $1,000, far above the $20-per-user-per-month ceiling that worked for chatbots. Labs have pricing power as capacity runs tight and frontier token prices keep rising. The cost dynamics are breaking the subscription model.

The consequence is structural: AI spending must escape the capped 3 to 7 per cent IT budget and flow into line-of-business allocations. That is marketing, sales, and operations. This creates friction between finance, IT, and business owners over compute spend. For a small business, this is simpler: there is no IT budget to escape; the agent either delivers value faster than it costs, or it does not. But the scrutiny will be sharper, and the cost transparency is immediate.

Blomfield turns this into strategy: burn tokens, not headcount. If staff time is the constraint you face, trading it for token spent is often the right move. If token spend is the constraint, then you are optimising for the wrong thing.

Building agents that scale

Tool design and CLI efficiency

The tools an agent calls matter enormously to its cost and reliability. The CLI pattern is proving more efficient than GUI-based or MCP-only approaches for agent automation. CLIs enable agents to self-improve because every execution is logged and the agent can inspect what it tried, what succeeded, and what failed. They parse structured output directly—JSON, tabular data—saving tokens and reducing hallucination.

The practical implication: build tools with structured output. Modern CLI frameworks (Click for Python, Bun for Node) require only a few lines of code. The CLI's --help text becomes its API spec; agents call it first, read it, and learn what is available without separate documentation. The 90 seconds case study demonstrates this in production: background agents monitoring production logs autonomously diagnose and fix recurring issues, discovering things like shared email-provider reputation blocks and rotating credentials without human intervention.

The loop structure

Blomfield describes the systematic approach YC takes. A self-improving loop has five layers: sensors (data in), policy (what the AI can do without asking), tools (deterministic APIs), quality gate (checks and human review for high-risk actions), and learning (feedback and iteration). When minimal human intervention is required, the system compounds.

The discipline this requires is legibility. Record everything the organisation does—office hours, Slack, decisions, telemetry—then diarise, aggregate, and synthesise it into context the models can use. Blomfield captures the maxim: "If it is recorded, it happened to the AI. If it did not get recorded, it did not happen." This is not poetic; it is operational constraint. The agent can only learn from and reason about what is in its context.

Headless software and the persistent GUI

Levie's forecast on software architecture: every enterprise software vendor will operate a hybrid model within three years: a seat business model for the human UI and a consumption model for the agent caller. By volume, headless queries will dwarf human-interface interactions. But the GUI remains useful for complex document work, data rooms, and cases where a person wants to be hands-on. The agent does not replace the interface; it multiplies the capacity of the person using it.

The SME's feasible first step

The sources do not prescribe where to start, but the pattern is clear. Find a workflow where knowledge already exists in one place, work happens in another, and the gap is manual transcription or routing. Wire an agent to bridge that gap. Use MCP servers for the connections if the tools already exist. Start with a small batch and retrospectively improve. This is not a deployment infrastructure problem; it is a wiring problem.

Sources

Aaron Levie on enterprise AI in 2026: token shock, agent diffusion, and the rise of the internal FDE — Aaron Levie, CEO of Box

Rebuilding companies around self-improving AI loops — Tom Blomfield, General Partner at Y Combinator

Knowledge agents for non-engineers: Stripe's Kai platform — Emily Sands, Product lead at Stripe

How Stripe built Kai: a company-wide AI agent on Deep Agents — LangChain

Building agent self-improvement loops with command-line interfaces — Peregian Digital Hub

Three practitioner approaches to self-improving agent systems — Román Olivera, Kevin Eulenberg, Rob Linker, Peregian Digital Hub

AI agents as specialist capacity for smaller companies — Aaron Levie

AI agents could narrow the specialist-talent gap for SMEs — Aaron Levie

The agent implementation gap for engineers, IT, and operations people — Aaron Levie

Claude turning Box roadmap documents into Linear issues via MCP — Aaron Levie

Agent deployment needs systems, context, workflow, and change work — Aaron Levie

Background agents as the next workflow pattern — Aaron Levie

AI agents as software that can act inside workflows — Aaron Levie

Workflow implementation is the AI-agent labour opportunity — Aaron Levie

MCP as a bridge between documents and work systems — Aaron Levie

There is no shortcut from model capability to stable process — Aaron Levie

Agent use cases hiding in document-heavy workflows — Aaron Levie