Scope
Implement the four Domain 3 rubrics under the RoB 2 pointwise package.
Domain 3: bias due to missing outcome data.
Target package
Create:
yescieval/rubric/pointwise/rob2/d3_missing_data/
├── __init__.py
├── sq_3_1_outcome_data_availability.py
├── sq_3_2_evidence_no_missing_data_bias.py
├── sq_3_3_missingness_could_depend.py
└── sq_3_4_missingness_likely_depended.py
Required rubric classes
| ID |
Class |
3.1 |
OutcomeDataAvailability |
3.2 |
EvidenceNoMissingDataBias |
3.3 |
MissingnessCouldDepend |
3.4 |
MissingnessLikelyDepended |
Each class must inherit RoB2PointwiseRubric and define:
rubric_id
rob2_domain_id = "D3"
name
question
guidance
allowed_responses
Criterion requirements
Tests
Create test/test_rob2_d3_rubrics.py and verify for every class:
Definition of done
All four Domain 3 signaling questions are independently importable and executable through the shared RoB 2 rubric interface.
Scope
Implement the four Domain 3 rubrics under the RoB 2 pointwise package.
Domain 3: bias due to missing outcome data.
Target package
Create:
Required rubric classes
3.1OutcomeDataAvailability3.2EvidenceNoMissingDataBias3.3MissingnessCouldDepend3.4MissingnessLikelyDependedEach class must inherit
RoB2PointwiseRubricand define:Criterion requirements
NAis workflow-generated for skipped questions and is not a free model answer for an executed rubric.d3_missing_data/__init__.py.Tests
Create
test/test_rob2_d3_rubrics.pyand verify for every class:Definition of done
All four Domain 3 signaling questions are independently importable and executable through the shared RoB 2 rubric interface.