set harvest record "success" status on successful dataset change

User Story

In order to provide better meaning to what a "successful" harvest record is, datagov wants to set that status after the dataset change.

Acceptance Criteria

[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]

GIVEN we write harvest records as successful before applying the change to the dataset table
WHEN the dataset change/write happens
THEN the harvest record status is "success" \

Background

Security Considerations (required)

[Any security concerns that might be implicated in the change. "None" is OK, just be explicit here!]

Sketch

[Notes or a checklist reflecting our understanding of the selected approach]

Make this more useful status. Add E num for synched with dataset or something.

@jaredb96

@jaredb96 here's the things we need to do with this ticket

add a new status enum value "dataset_pending" which requires a db migration
replace this status with "dataset_pending"
then set status = "success" only if the upsert or delete in the dataset table were successful so...

dataset = self.harvest_source.db_interface.upsert_dataset(
    update_payload
)
if dataset:
    self.status = "success"

#############################################

deleted = self.harvest_source.db_interface.delete_dataset_by_slug(
    self.dataset_slug
)
if deleted:
    self.status = "success"
    self._delete_dataset_from_opensearch(dataset)

and then you can just have the record update itself right before the return statement at the end of the function

self.update_self_in_db()

return True

Navigation Menu

Repository navigation

set harvest record "success" status on successful dataset change #5935

User Story

Acceptance Criteria

Background

Security Considerations (required)

Sketch

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

set harvest record "success" status on successful dataset change #5935

Description

User Story

Acceptance Criteria

Background

Security Considerations (required)

Sketch

Activity

SueValente commented on Jun 24, 2026

rshewitt commented on Jun 30, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions