Question

What technique uses a powerful AI system to assist humans in evaluating the outputs of a more complex model when the task exceeds human cognitive capacity?

Accepted Answer

The technique is called scalable oversight. It is used when an artificial intelligence model performs a task so complex or data-intensive that a human cannot directly evaluate whether the output is correct or safe. In this process, the human uses a separate, powerful AI system to act as an assistant. This assistant model breaks down, summarizes, or verifies the output of the complex system into a format the human can easily understand and judge. By using this hierarchical approach, the human can supervise models that are smarter than themselves because they are evaluating the reasoning process or the summarized findings rather than auditing every line of raw data. For example, if a model writes a massive computer program that is too long for a person to check, the human uses an oversight model to scan the code for errors or security flaws and report those findings to the human for final approval.

Home → All Courses → Engineering and Technology Courses → AI Safety and Responsible AI Engineering → Flashcard

What technique uses a powerful AI system to assist humans in evaluating the outputs of a more complex model when the task exceeds human cognitive capacity?

The technique is called scalable oversight. It is used when an artificial intelligence model performs a task so complex or data-intensive that a human cannot directly evaluate whether the output is correct or safe. In this process, the human uses a separate, powerful AI s....