📚 How to Annotate

Follow these step-by-step instructions to successfully complete the annotation task

Understanding the Interface

The annotation interface has two main sections: a Reference Section (read-only) and your Annotation Workspace (editable).

🔍 Reference Section (Top)

Shows the original question and answer with pre-highlighted facts. Each highlight has accept (✓) and reject (✗) buttons.

✏️ Your Workspace (Bottom)

Your editable workspace where accepted highlights will appear. You can also manually add new highlights by selecting text.

Reviewing Highlights

Look at each highlighted fact in the reference section. Each highlight shows important information with color-coded fact IDs.

🎨 Example Highlights

                            The bakery produces 120 cupcakes per hour✓✗ during peak hours. 
                            During regular hours, they produce 80 cupcakes per hour✓✗. 
                            Today, they operated for 3 peak hours✓✗.
                        

Making Decisions

For each highlight, decide whether it contains important factual information needed to solve the problem.

✅

Accept Facts That Are:

• Numbers, quantities, or measurements
• Time periods or dates
• Key conditions or constraints
• Essential problem data

❌

Reject Facts That Are:

• Filler words or descriptions
• Obvious or redundant information
• Intermediate calculations
• Non-essential context

💡 Decision Examples

✅ Accept: "120 cupcakes per hour" (specific quantity needed for calculation)

❌ Reject: "the bakery" (just descriptive context, not a fact)

Using Accept/Reject Buttons

Click the ✓ (accept) or ✗ (reject) buttons next to each highlight. You can change your mind and click again to undo your decision.

🎯 Button Actions

✓ Accept: Highlight automatically appears in your workspace

✗ Reject: Highlight becomes faded and crossed out

Click Again: Undo your decision and return to neutral state

Switch Decision: Click the opposite button to change accept→reject or reject→accept

Managing Your Workspace

Your annotation workspace shows the text with your accepted highlights. You can also manually select text to add new highlights or click existing highlights to remove them.

🔧 Workspace Features

Auto-Added: Accepted highlights automatically appear

Manual Selection: Select any text to add new fact tags

Click to Remove: Click highlighted text to remove it

Fact IDs: Each highlight shows its fact ID (fact1, fact2, etc.)

Saving and Progressing

When you're satisfied with your annotations, save your work and move to the next question.

💾 Save Process

Review: Check your highlighted facts in the workspace

Notes: Add optional comments about your decisions

Save: Click "Save & Next Question" to proceed

Complete: After all questions, you'll see a completion page

🎯 Ready to Start?

You now understand the annotation process! Remember: focus on identifying truly important facts that are needed to solve the math problems. When in doubt, ask yourself "Is this information essential for solving the problem?"