This trace has been submitted and is locked. Contact the researcher if you need to change it.
— End of trace —
Task A · Human annotation
One operation.
One segment.
Read the reasoning. Find where each new operation begins.
Insert your own CUT markers, using the rules in the guidelines.
Task A · Human annotation
One operation.
One segment.
Read the reasoning. Find where each new operation begins.
Insert your own CUT markers, using the rules below.
No AI assistance — required
Do not use ChatGPT, Gemini, Copilot, or any other AI tool to read, explain, review, segment, or label these traces. Make every boundary decision yourself.
01
What counts as one segment?
One segment = one explicit local operation
Keep the operation together with its necessary lead-in, operands, and stated result. It can depend on earlier context, span several sentences, or occupy only part of a sentence.
Insert CUT when a distinct new introduction, inference, calculation, check, correction, or method choice begins. Follow the operation being expressed, even if its content is incorrect.
Apply the same rule in every case
- Several sentences, one operation
- Keep together. Sentence boundaries do not determine segments.
- One sentence, distinct operations
- Split at the new operation. A check followed by a separate calculation needs a boundary.
- Calculation + its stated result
- Keep together. The result completes that calculation.
- Two calculations on the same topic
- Split if they are distinct operations. A shared topic or action type does not merge them.
- A lead-in or an explicit replacement
- Keep the lead-in with its content and the replacement with its value. Avoid unfinished fragments.
- Punctuation, a newline, or a long passage
- Do not split for formatting or length alone. Look for a distinct operation inside the passage.
- Uncertain boundary
- Flag the character position and describe both interpretations. Do not invent an unstated operation.
Start a new operation
Insert CUT before a distinct introduction, inference, calculation, check, correction, or method choice.
Keep the operation together
Keep a lead-in with its content, a calculation with its stated result, and a replacement with its replacement value.
Punctuation, a newline, or length alone is not a reason to split. A shared topic or action category is not a reason to merge distinct operations.
02
Insert boundaries from scratch
Each trace starts without suggested boundaries. Read the entire trace and insert <CUT> wherever a new local operation begins. The first segment begins automatically; no marker is needed at the start or end.
- 1
Click once to insert
Click directly before the new operation. A colored CUT appears immediately.
- 2
Adjust your own markers
Click a colored CUT to remove it. Undo restores your last change.
- 3
Review & submit
Check the whole trace and flag uncertainty.
Source text is locked. You may insert, remove, or undo your own markers. Do not correct, omit, reorder, or rewrite the reasoning. Do not invent operations that are not explicitly expressed.
03
A small worked example
Input · Unsegmented source
Compute u = 2 + 3. The result is u = 5. Check: u − 3 = 2, then compute v: v = 2u = 10.
Task A · Independent segmentation
Compute u = 2 + 3. The result is u = 5. CUT Check: u − 3 = 2, CUT then compute v: v = 2u = 10.
The calculation stays with its result. The check and the next calculation begin separate operations. This website collects Task A boundaries only; action labels are not requested.
04
Before you submit
- Read the full trace, including long passages.
- Check that each segment expresses one operation with its necessary context.
- Use an uncertainty note to identify ambiguous locations and explain the alternatives.
Practice · Not scored
Try two short passages first.
Insert CUT markers, then check them against a reference. Practice answers are not part of the study; they only help you calibrate.
Your traces
Four shared traces.
Every annotator segments the same traces, independently. Work in any order and at your own pace; drafts are saved automatically. Once you submit a trace it is locked.
All traces submitted
Thank you.
Every boundary counts.
Your segmentation of all four traces has been received. You can close this page.