Builder
Test a visible rule with new examples.
Project Example
Coming laterAI Guessing Game
Test a small guessing system with new examples and find out where its confident answers stop matching the evidence.
Coming laterTools, accounts, and any data use will be reviewed before the program opens.
Planned build
What the project will contain.
- A transparent guessing rule or future model
- A test set
- Recorded correct and incorrect results
- An error explanation
- A human verification step
Ideas in the project
What students will need to understand.
- Patterns versus understanding
- Training and testing distinction
- Classification
- Confidence limits
- Bias
- Evaluation
Test questions
What the project must answer.
- Was the test data seen during setup?
- Are classes balanced?
- Does confidence match correctness?
- Can a person explain the error categories?
Likely problems
What could weaken the result.
- Testing with the same examples used to create the rule.
- Calling pattern matching understanding.
- Reporting only successful guesses.
- Collecting unnecessary personal data.
Possible challenge levels
How the project could become harder.
Inventor
Compare two approaches and sort their errors.
Boss Level
Design a test that exposes confident mistakes.