Two concepts of an "episode" (Section 2.2.1 of "Scheming AIs")

This is section 2.2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

Chapters

• 0:30 2.2 Beyond-episode goals
• 0:41 2.2.1 Two concepts of an “episode”
• 0:49 2.2.1.1 The incentivized episode
• 5:44 2.2.1.2 The intuitive episode