Systems | Development | Analytics | API | Testing

LLM and AI Agent Observability: What to Monitor, Evaluate, and Test

LLM observability is the practice of collecting and analyzing data about how a language model application or AI agent behaves, including prompts, responses, tool calls, cost, speed, and errors, so teams can find problems, measure quality, and improve results. AI agents can now plan tasks, call tools, and work across business systems. That makes them powerful, and it also means a single request can involve many steps that no one sees directly.

How to Install Claude Code on Mac (Official Installer, Step by Step) #shorts #coding #claudecode

How to install Claude Code on Mac in under one minute using the official native installer. Claude Code is Anthropic’s AI coding assistant for Terminal. This tutorial follows the official setup process step by step: find the installer, open Terminal, complete the installation, verify the version and sign in.

AI-Powered Performance Testing: Why Modern Systems Need Intelligent Engineering

Digital platforms move faster than ever today. In complicated systems, engineering teams upload code modifications numerous times a day. These apps are powered by distributed microservices, third-party APIs, and cloud resources. But many teams still validate speed with legacy workflows. Traditional load tests run solely static scripts against pre-planned scenarios. After the developers complete constructing the feature, they model historical traffic.

How ThoughtSpot's Marketing Team Built an Agent to Segment Their Entire Database

Marketing teams spend more time waiting on ops tickets to segment their database than they do actually running campaigns. By the time the segmentation comes back, the brief has changed, the moment has moved on, and someone is already asking for a revision. In this clip from the Thought Tank: Marketing in the Age of Agents, ThoughtSpot SVP Marketing EMEA Katie Marcham introduces the agent her team built to change that. They call it Slicy McSliceface, and it does exactly what the name suggests.

Connect AI Studio to On-Prem SQL Server (No Open Ports)

Connect Google AI Studio to an on-prem SQL Server database without opening a single firewall port or handing over a database password. In this video I put DreamFactory in front of a SQL Server database on my local network, generate a REST API from it, lock that API down with a read-only role and a scoped API key, then I have AI Studio build a live delivery operations dashboard on top of it. AI Studio calls the API from its own Node server, so the key never reaches the browser.

Controlling the Uncontrollable: Bring FinOps discipline to AI spend

AI costs are unpredictable and behave nothing like traditional cloud spend. FinOps teams face new challenges: opaque model pricing, and hidden costs in places like prompt design and context length. In this session, our Head of AI, Prajakta, will show you how to bring FinOps discipline to AI costs: how to see them, attribute them, and optimize them. She’ll give you practical levers that can cut AI costs by 20 – 80%.

New in Katalon True Platform: AI that knows your app (and flags when sources disagree)

New in Katalon True Platform this month: Katalon AI Knowledge Base + Conflict Check: Knowledge base for project docs and glossary Linked Jira issues as extra context Conflict check across sources, with no edits made What feature should we ship next? Drop it in the comments.

AI Agent Manager

This lab was presented at WSO2Con Africa 2026. Presenters: Asanka Abeyweera, Associate Director - Head of Product Management & Architecture, Agent Platform BU, WSO2 Viggnah Selvaraj, Lead Sales Engineer, WSO2 Getting an AI agent to work is only the start. Once it runs, you need to show exactly what it said and why, keep compliance rules in force across agents built by teams that have never met, tell whether quality is improving or slipping, and make sure each agent reaches only the systems it needs.

AI Agent Manager part 2

This lab was presented at WSO2Con Africa 2026. Presenters: Menaka Jayawardena, Technical Lead & Head of Engineering, Agent Platform BU, WSO2 Viggnah Selvaraj, Lead Sales Engineer, WSO2 This is the second half of the hands-on AI Agent Manager lab. It picks up where part one left off and keeps the focus on operating AI agents that already work, rather than writing new ones.