AI & Software EngineeringKnowledge Atlas
Catalogues / NDSE2 chapter guides and sources

C:C07

Chapter 7: Independent Verification and the Oracle Problem

A guide to the published second edition, with literal citations separated from wider editorial reading suggestions.

Open this group in the atlasChapter catalogue entry

Chapter guide

Builds independent verification around authorized behavior. Regression cases, properties, counterexamples and mutants expose circular testing; correlated checker errors and benchmark limits motivate an evidence dossier that supports review without granting the maker acceptance authority.

Verifica indipendente e problema dell'oracle

Sintesi in italiano

Costruisce la verifica indipendente a partire dal comportamento autorizzato. Regressioni, proprietà, controesempi e mutanti rivelano i test circolari; errori correlati dei checker e limiti dei benchmark motivano un dossier di evidenze senza attribuire al maker l'autorità di accettazione.

Learning goals

  • derive an independent oracle from authorized behavior
  • use counterexamples and mutants to reveal circular testing
  • assemble a dossier that allows another person to decide whether a candidate is ready for review
Obiettivi in italiano

Obiettivi di apprendimento

  • ricavare un oracle indipendente dal comportamento autorizzato
  • usare controesempi e mutant per smascherare i test circolari
  • preparare un dossier di evidenze che consenta a un'altra persona di decidere se una modifica candidata sia pronta per la review
Chapter outline
  • 7.1 The oracle problem in AI-generated software
  • 7.2 A hierarchy of evidence
  • 7.3 Preventing bug-shaped test generation
  • 7.4 Regression tests for existing and changed behavior
  • 7.5 Properties and adversarial counterexamples
  • 7.6 Benchmark success versus merge readiness
  • 7.7 Independent checkers and correlated error
  • 7.8 Bounded repair versus independent acceptance
  • 7.9 The acceptance evidence dossier
  • 7.10 Worked engineering example: make wrong behavior fail independently
  • 7.11 Practice exercise: build an oracle the maker does not control
Struttura del capitolo
  • 7.1 Il problema dell'oracle nel software generato dall'AI
  • 7.2 Una gerarchia delle evidenze
  • 7.3 Evitare test modellati sui bug
  • 7.4 Regression test per comportamenti esistenti e modificati
  • 7.5 Proprietà e controesempi avversariali
  • 7.6 Successo nei benchmark e prontezza al merge
  • 7.7 Checker indipendenti ed errori correlati
  • 7.8 Correzione delimitata e accettazione indipendente
  • 7.9 Il dossier delle evidenze per l'accettazione
  • 7.10 Esempio svolto: far fallire autonomamente il comportamento errato
  • 7.11 Esercizio: costruire un oracle che il maker non controlla

Cited in the published chapter

19 linked atlas references from literal citations in the English and Italian editions. General bibliography membership and identifier-index entries are counted separately.

SE@PoliMi bibliography 18

The Pragmatic Engineer 1

Trace literal citations to chapter sections

Locations come from the supplied English and Italian source files. Chapter text and figure captions are identified separately; identifier-index references and general bibliography membership are not treated as chapter citations.

Complete citation locators and source hashes

Editorial reading mappings

Broader topical suggestions can overlap the cited sources. A mapping does not add a citation to the published edition or establish that a practice is effective.

SE@PoliMi bibliography 69

Addy Osmani 3

The Pragmatic Engineer 8

Martin Fowler’s website 10

Earlier Non-Deterministic books 23

Software Engineering Practices 7