Definition. Labeler demonstration collection [ouyang2022training, Sections 3.2 and 3.4] [ftip-002E]
Definition. Labeler demonstration collection [ouyang2022training, Sections 3.2 and 3.4] [ftip-002E]
In the InstructGPT data-collection procedure, a labeler receives a prompt and writes a desired response. The resulting prompt--response pair enters the demonstration data used by the supervised fine-tuning stage. Prompts come from the declared API and labeler-written sources, and the paper records filtering and labeler-selection procedures.
This construction specifies a human demonstration channel. It is distinct from the later comparison channel, in which a labeler ranks model-generated responses rather than writing the target response.