Skip to content

1284 miovision validation pipeline#1354

Draft
gabrielwol wants to merge 11 commits into
masterfrom
1284-miovision-validation-pipeline
Draft

1284 miovision validation pipeline#1354
gabrielwol wants to merge 11 commits into
masterfrom
1284-miovision-validation-pipeline

Conversation

@gabrielwol

Copy link
Copy Markdown
Collaborator

What this pull request accomplishes:

Issue(s) this solves:

What, in particular, needs to reviewed:

What needs to be done by a sysadmin after this PR is merged

E.g.: these tables need to be migrated/created in the production schema.

@gabrielwol gabrielwol self-assigned this Feb 23, 2026
@gabrielwol gabrielwol added the Miovision Permanent intersection-based video multimodal volume collection. Also use "Permanent Sensors" label label Feb 23, 2026
@gabrielwol gabrielwol linked an issue Feb 23, 2026 that may be closed by this pull request
@gabrielwol

Copy link
Copy Markdown
Collaborator Author

Something to add to the readme:

When Spectrum updates a study used in Miovision validation, we can manually mark those studies as non-yet processed:

UPDATE miovision_validation.spectrum_studies
SET processed = False
WHERE count_id IN (114895, 114896, 112885);

DELETE FROM miovision_validation.mio_spec_processed_counts 
WHERE count_id IN (114895, 114896, 112885);

And then the next time DAG runs, it will reprocess those studies.

--get the time bins from tmc study
JOIN traffic.tmc_study_data AS dat USING (count_id)
--cross join to get every movement
CROSS JOIN miovision_validation.spec_class_move_map AS mmp,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gabrielwol
We are making some changes to this table's content. just some renaming. would this matter anyway?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the heads up. Since this is still in early development, you can go ahead and make changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Miovision Permanent intersection-based video multimodal volume collection. Also use "Permanent Sensors" label open data

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Miovision Validation Pipeline

2 participants