Performance Engineering for Autonomous Systems on Google Cloud (PEAS) – Contenuti

Contenuti dettagliati del Corso

Module 1 - The Diagnostic Mindset

Topics:

  • 1. The Failure Quartet (Theory)
  • 2. The Latency Tax (The Constraint)
  • 3. Trace Analysis (The Tool)

Objectives:

  • Isolate Root Failures: Map runtime errors directly to the specific pillar of the Failure Quartet (Brain, Past, Hands, or Perimeter) causing the breakdown.
  • Diagnose Lost Reasoning: Perform forensic trace analysis to pinpoint the exact moment an agent deviates from its logical execution path.
  • Fix Latency Bottlenecks: Identify and eliminate the "Brute Force" fallacy where over-provisioning compute tokens destroys system response times.

Activities:

  • 1 use case, 2 demos

Module 2 - Tuning the Engine

Topics:

  • 1. Tuning the Past (Retrieval Optimization)
  • 2. Tuning the Hands (Tool-Call Refinement)
  • 3. Tuning the Brain (Instruction Distillation)

Objectives:

  • Cure Memory Drowning: Apply context pruning and token summarization to keep the agent focused strictly on relevant, high-value data.
  • Eliminate Execution Errors: Structure tool schemas and API documentation so the agent executes external code without logical leaps.
  • Lean Out Prompts: Use instruction distillation to shrink bloated, expensive system instructions into tight, deterministic runtime logic.

Activities:

  • 2 use cases, 2 demos

Module 3 - Optimizing the Guardrails

Topics:

  • 1. RAI as a Performance Metric (Compliance)
  • 2. Tuning the Perimeter (Gateway Security)
  • 3. The Forensic HITL Stamp (Human Loop)

Objectives:

  • Replace Vibe Checks: Deploy quantitative safety scorecards to measure compliance using hard, repeatable metrics instead of guesswork.
  • Optimize Security Latency: Tune platform safety layers to achieve maximum data protection without causing user-facing lag.
  • Master Human-in-the-Loop: Deploy a confidence-scored intervention workflow to loop in a human only when the agent's logic score drops.

Activities:

  • 1 use case, 2 Demos

Module 4 - Scaling Excellence

Topics:

  • 1. The Pilot’s Logbook (Golden Datasets)
  • 2. Continuous Optimization (CI/CO)
  • 3. The Performance Tuning Roadmap

Objectives:

  • Build a Performance Baseline: Construct a master logbook of "Golden Datasets" to serve as your absolute ground truth for testing.
  • Automate Defenses: Establish an automated feedback loop that flags and patches logical drift the moment an agent begins to degrade in production.
  • Prove Financial ROI: Translate technical telemetry into board-ready metrics that prove real corporate capacity gains against cloud infrastructure costs.

Activities:

  • 1 use case, 2 Demos

Module 5 - Summary and Quiz