Zum Hauptinhalt springen Zur Suche springen Zur Hauptnavigation springen
Beschreibung

Stop using guesswork to find out how your AI applications are performing. Evals for AI Engineers gives you a practical framework for systematically testing, measuring, and improving AI applications, especially those built with LLMs. Written by Shreya Shankar and Hamel Husain, AI engineers with extensive experience across 35+ AI products and cutting-edge research, this book focuses on the techniques teams actually need to build reliable AI systems in production.

Ideal for software engineers, technical product managers, and technical leads, this hands-on guide shows you how to build an evaluation process that improves alongside your product.

  • Find and prioritize failures through systematic error analysis and representative test sets
  • Build trustworthy evaluations using code based checks, LLM judges, human feedback, and synthetic data
  • Improve production systems over time by monitoring regressions and optimizing quality, latency, and cost

Stop using guesswork to find out how your AI applications are performing. Evals for AI Engineers gives you a practical framework for systematically testing, measuring, and improving AI applications, especially those built with LLMs. Written by Shreya Shankar and Hamel Husain, AI engineers with extensive experience across 35+ AI products and cutting-edge research, this book focuses on the techniques teams actually need to build reliable AI systems in production.

Ideal for software engineers, technical product managers, and technical leads, this hands-on guide shows you how to build an evaluation process that improves alongside your product.

  • Find and prioritize failures through systematic error analysis and representative test sets
  • Build trustworthy evaluations using code based checks, LLM judges, human feedback, and synthetic data
  • Improve production systems over time by monitoring regressions and optimizing quality, latency, and cost
Über den Autor
Shreya Shankar is an incoming assistant professor in the computer science department at Carnegie Mellon. Her research focuses on effectively integrating LLMs into database systems and business intelligence tools. Some of the open source systems she built include DocETL, a system for LLM-powered document processing, and Quail, an execution engine for AI functions in SQL. Her work has received paper awards at multiple conferences (SIGMOD, CHI, UIST) and runs in production environments.
Details
Erscheinungsjahr: 2026
Genre: Importe, Informatik
Rubrik: Naturwissenschaften & Technik
Medium: Taschenbuch
ISBN-13: 9798341660724
Sprache: Englisch
Einband: Kartoniert / Broschiert
Autor: Shankar, Shreya
Husain, Hamel
Hersteller: O'Reilly Media
Verantwortliche Person für die EU: Libri GmbH, Europaallee 1, D-36244 Bad Hersfeld, gpsr@libri.de
Maße: 231 x 174 x 15 mm
Von/Mit: Shreya Shankar (u. a.)
Erscheinungsdatum: 31.10.2026
Gewicht: 0,42 kg
Artikel-ID: 136502806