[CoffeePoweredComputers]

Summary

Fixes #135. Probe inputs for probeable_code / probeable_spec were only checked by parameter name, so probing x="abc" against f(x: int) reached the oracle and either showed a misleading "successful" result ("abcabc") or leaked the raw Python TypeError text to the student.

Backend

• validate_probe_input now checks int / float / bool / str values after the existing name checks. bool is never accepted for int or float; int is accepted for float; Any, containers and unknown hints are unchecked.
• Hidden-signature mode (show_function_signature=False): the error is generic ("That value is not valid for parameter 'x'") so the hidden type is not revealed, and both oracle exception branches return a generic message instead of raw Python text. Visible mode says "Parameter 'x' must be an int".
• ProbeOracleView calls a new ProbeService.validate_input(problem, probe_input) so the mode decision lives in the service. Response bodies are unchanged.
• Refute shares the validator and always shows its signature, so refute inputs are now type-checked too (covered by a new integration test).
• Rejected probes still do not consume quota.

Frontend

• parseInputValue parses by declared type first (not JSON-first) and returns a per-field error; ProbePanel shows it inline, marks the input aria-invalid, and the Probe button is disabled while any field has an error.
• Untyped fields (hidden mode, containers) keep JSON-first parsing and now accept Python-style True / False / None.
• Ints outside the safe-integer range and non-Python float literals (hex, binary) are rejected client-side.
• Hidden-mode placeholder hints that text should be quoted. New i18n keys in en and es.

Tests

• tests/unit/test_probe_input_validation.py (75 tests, no DB): every primitive, the bool-for-int trap, aliases, defaults, skipped types, hidden-mode messages, oracle sanitisation.
• Integration: probe round-trip 200, visible/hidden/bool mismatches 400, _record_probe not called on mismatch, refute mismatch 400.
• Vitest matrix for parseInputValue (57 tests) plus composable tests through withSetup.
• Playwright: new seeded double(n: int) problem in e2e-code and a strict inline-error test.

Known limitations

• In hidden mode the client has no type, so 5.0 for an int parameter is sent as 5 and passes; 5 for a str parameter is rejected generically until quoted.
• Container / Optional types are unchecked; the naive signature parser (parse_function_signature splits on commas naively; breaks probing for container/tuple/default signatures (3 duplicate parsers) #160) is the blocker.

Related issues filed during this work

• Student problem-set payload exposes reference_solution and full function_signature for every problem (incl. probeable oracle) #159 student problem-set payload exposes reference_solution (the oracle) — security, needs-senior-review
• parse_function_signature splits on commas naively; breaks probing for container/tuple/default signatures (3 duplicate parsers) #160 parse_function_signature splits on commas naively
• probeable_spec submissions run under the EiPL handler (hardcoded get_handler("eipl")) and skip the AI-consent gate #161 probeable_spec runs under a hardcoded EiPL handler and skips the AI-consent gate

Test plan

• pytest -m "unit or integration" — 2291 passed
• pytest -m architecture — 51 passed
• ruff check . clean; ruff format --check clean on changed files
• npx vitest run src/components/activities src/features/editor — 90 passed
• npm run lint:check — 0 errors
• npx playwright test --project=student — 64 passed, 1 pre-existing self-skip

🤖 Generated with Claude Code

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 83.01887% with 27 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
...components/activities/inputs/shared/ProbePanel.vue	0.00%	15 Missing ⚠️
.../problems_app/management/commands/seed_e2e_data.py	0.00%	6 Missing ⚠️
...omponents/activities/inputs/ProbeableCodeInput.vue	0.00%	2 Missing ⚠️
...omponents/activities/inputs/ProbeableSpecInput.vue	0.00%	2 Missing ⚠️
...mponents/activities/inputs/shared/useProbeState.ts	98.94%	1 Missing ⚠️
purplex/problems_app/services/probe_service.py	97.36%	1 Missing ⚠️

📢 Thoughts on this report? Let us know!

[CoffeePoweredComputers]

Ultrareview triage

Finding	Action
param: T = None now rejects null (normal)	Fixed. A None default is treated as implicit Optional and left unchecked on both sides, same as Optional[T]. Tests added.
Big ints rejected with a misleading message (nit)	Fixed. Distinct intRange message. Still refused: JSON cannot carry ints above 2^53 without corrupting them, and the server would then validate the wrong value.
Dead valuePlaceholder i18n key (nit)	Fixed. Removed from en and es.
Hidden mode still acts as a type oracle (nit)	Not changed, by design. The goal of reveal_types=False is to not name the type; a value kind being rejected is what a typed function does, and rejected probes have always been free of quota (validation and oracle failures never called _record_probe before this PR either). Moving the rejection to the 200 path would reveal exactly the same bit. Skipping the check in hidden mode would reinstate the #135 bug for those problems. If we want hidden-mode type discovery to cost something, that is a quota-policy change and deserves its own issue.
Graded refute path still unchecked; RefuteInput keeps its own parser (pre-existing)	Out of scope, tracked in #163.

🤖 Generated with Claude Code