The harvest_collection DAG fails at the mapping.validate_collection task with a KeyError: 'values_changed'. The task assumes every DeepDiff comparison result contains a values_changed key, but DeepDiff only includes that key when it actually finds changed field values — it's absent when a page's diff has no value changes (e.g. only additions/removals, or no differences at all).
UCM: Sutter and Yuba Counties, UC Cooperative Extension Records [#27831]
DAG Run: https://7a8067cb-3b99-477e-a883-7e311175a9b4.c3.us-west-2.airflow.amazonaws.com/dags/harvest_collection/grid?base_date=2026-08-17T22%3A17%3A31%2B00%3A00&dag_run_id=manual__2026-08-17T22%3A17%3A31%2B00%3A00&task_id=content_harvesting.content_harvest&tab=mapped_tasks&map_index=48
The
harvest_collectionDAG fails at themapping.validate_collectiontask with aKeyError: 'values_changed'.The task assumes every DeepDiff comparison result contains avalues_changedkey, but DeepDiff only includes that key when it actually finds changed field values — it's absent when a page's diff has no value changes (e.g. only additions/removals, or no differences at all).UCM: Sutter and Yuba Counties, UC Cooperative Extension Records [#27831]
DAG Run: https://7a8067cb-3b99-477e-a883-7e311175a9b4.c3.us-west-2.airflow.amazonaws.com/dags/harvest_collection/grid?base_date=2026-08-17T22%3A17%3A31%2B00%3A00&dag_run_id=manual__2026-08-17T22%3A17%3A31%2B00%3A00&task_id=content_harvesting.content_harvest&tab=mapped_tasks&map_index=48