In this lab you send one request to a language model and read what comes back. First you set up a small model on your own computer, and your copy of the lab repository: the other labs use both. Then you send one request and read the answer, the tokens the model counted, and what the call would cost. Last you send the …
Read MoreIn this lab you change the assistant's prompt the way code is changed. First you run the on-call assistant, a system prompt and a 20-line Python script. Then you run its eval: four saved questions, each with a check its answer must pass. Last you delete one sentence of the prompt in a pull request, and watch the check …
Read MoreIn this lab you give the model the team's runbooks before it answers. First you read a runbook, and find a fact in it that no model could know. Then you ask the model alone, and it answers with general advice. Last you ask with retrieval: the script finds the nearest runbook sections and sends them with the question. …
Read MoreIn this lab you run an agent, and then attack it through the data it reads. First you read the agent's tools: two that read the cluster, and one that opens a ticket after you approve it. Then you run the agent, and approve the ticket it asks for. Last you plant an instruction in a pod's log, run the agent again, and …
Read More