The slides The tool is lesson 7 of LLMOps for AI Agents, in thirteen slides: What is a trace?: one complaint about a slow, wrong answer, looked into with ordinary monitoring and then with a trace. Observing an agent: one request, many calls: a web service's one path beside the on-call assistant's many calls. A trace of …
Read MoreThe slides The tool is lesson 3 of LLMOps for AI Agents, in twelve slides: What is a prompt?: one sentence of a prompt changed in the running service, and the same change made like a code change. The context window of one call: the five parts our code assembles, and where each comes from. Prompt engineering and context …
Read MoreThe slides The tool is lesson 4 of LLMOps for AI Agents, in thirteen slides. The on-call assistant answers questions from the team's runbooks, and these slides follow the runbooks from the git repository to the model's context: What is RAG?: one question answered by the model alone, and by the model with the runbook's …
Read MoreThe slides The tool is lesson 9 of LLMOps for AI Agents, in thirteen slides: How do we secure an AI agent?: one instruction hidden in a log line, read by an agent with no limits and by a limited one. The LLM as an attack surface: one context window, where instructions and data are the same tokens. Direct and indirect …
Read More