Scope
Implement the five Domain 4 rubrics under the RoB 2 pointwise package.
Domain 4: bias in measurement of the outcome.
Target package
Create:
yescieval/rubric/pointwise/rob2/d4_measurement/
├── __init__.py
├── sq_4_1_measurement_method.py
├── sq_4_2_measurement_difference.py
├── sq_4_3_assessor_awareness.py
├── sq_4_4_assessment_could_be_influenced.py
└── sq_4_5_assessment_likely_influenced.py
Required rubric classes
| ID |
Class |
4.1 |
MeasurementMethod |
4.2 |
MeasurementDifference |
4.3 |
AssessorAwareness |
4.4 |
AssessmentCouldBeInfluenced |
4.5 |
AssessmentLikelyInfluenced |
Each class must inherit RoB2PointwiseRubric and define:
rubric_id
rob2_domain_id = "D4"
name
question
guidance
allowed_responses
Criterion requirements
Tests
Create test/test_rob2_d4_rubrics.py and verify for every class:
Definition of done
All five Domain 4 signaling questions are independently importable and executable through the shared RoB 2 rubric interface.
Scope
Implement the five Domain 4 rubrics under the RoB 2 pointwise package.
Domain 4: bias in measurement of the outcome.
Target package
Create:
Required rubric classes
4.1MeasurementMethod4.2MeasurementDifference4.3AssessorAwareness4.4AssessmentCouldBeInfluenced4.5AssessmentLikelyInfluencedEach class must inherit
RoB2PointwiseRubricand define:Criterion requirements
NAis workflow-generated for skipped questions and is not a free model answer for an executed rubric.d4_measurement/__init__.py.Tests
Create
test/test_rob2_d4_rubrics.pyand verify for every class:Definition of done
All five Domain 4 signaling questions are independently importable and executable through the shared RoB 2 rubric interface.