• Previous course videos focused on experimental (offline) evaluations during development; this one covers what changes once the app is live 0:02
  • In production you get real users and real data, which brings two obligations 0:02:
    • a huge opportunity to learn and improve from actual usage 0:19
    • the need to keep an eye on things so nothing goes wrong 0:19
  • The video's scope: what you can track, what LLM observability is, and why testing still matters after launch 0:02