1284 miovision validation pipeline#1354
Draft
gabrielwol wants to merge 11 commits into
Draft
Conversation
Collaborator
Author
|
Something to add to the readme: When Spectrum updates a study used in Miovision validation, we can manually mark those studies as non-yet processed: UPDATE miovision_validation.spectrum_studies
SET processed = False
WHERE count_id IN (114895, 114896, 112885);
DELETE FROM miovision_validation.mio_spec_processed_counts
WHERE count_id IN (114895, 114896, 112885);And then the next time DAG runs, it will reprocess those studies. |
ZahraGhayen
reviewed
Apr 30, 2026
| --get the time bins from tmc study | ||
| JOIN traffic.tmc_study_data AS dat USING (count_id) | ||
| --cross join to get every movement | ||
| CROSS JOIN miovision_validation.spec_class_move_map AS mmp, |
There was a problem hiding this comment.
@gabrielwol
We are making some changes to this table's content. just some renaming. would this matter anyway?
Collaborator
Author
There was a problem hiding this comment.
Thanks for the heads up. Since this is still in early development, you can go ahead and make changes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this pull request accomplishes:
Issue(s) this solves:
What, in particular, needs to reviewed:
What needs to be done by a sysadmin after this PR is merged
E.g.: these tables need to be migrated/created in the production schema.