rlhf

A podcast episode in which GPT-4 red teamer Nathan Labenz describes using the model before release, finding it human-level but not human-like, and discussing its weaknesses and worrying capabilities. It closes with speculation about GPT-5.

Computerphile interviews AI safety researcher Rob Miles about ChatGPT: how it was trained with human feedback, why it tends to produce confident nonsense, and where it may or may not be dangerous.