Skip to content

Harvest Documentation #5657

Description

@jbrown-xentity

User Story

In order to better support federal data providers, data.gov admins want clear documentation on expectations, requirements, and details on what harvest.data.gov requires to get data onto data.gov catalog.

Acceptance Criteria

[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]

  • GIVEN a data provider doesn't know where to start
    WHEN they go to data.gov
    THEN a webpage exists detailing the data.gov harvest process
    AND details on transformation, requirements, standards, etc are readily available.

Background

This webpage already exists, but is not ready for the new harvester and new catalog process. https://resources.data.gov/resources/data-gov-open-data-howto/

Security Considerations (required)

None

Sketch

When updating/creating content, the following should also be considered:

  • Should this webpage be clearly linked on data.gov or catalog.data.gov or harvest.data.gov?
  • Should this content be re-formatted?
  • Should DCAT-US3.0 be included?
  • What part of the transformation crosswalk should be included? Should https://resources.data.gov/resources/podm-field-mapping/ be overwritten, or removed with a completely new version?
  • Are there future tickets that should be created to make the process as currently constructed easier?

Activity

  1. moved this from 📥 Queue to Next Up in data.gov team boardon Apr 23, 2026
  2. moved this from Next Up to 📥 Queue in data.gov team boardon Apr 23, 2026
  3. self-assigned this
    on Apr 23, 2026
  4. moved this from 📥 Queue to Next Up in data.gov team boardon Apr 23, 2026
  5. moved this from Next Up to 🏗 In Progress [8] in data.gov team boardon Apr 29, 2026
  6. SueValente commented on Apr 29, 2026

    @SueValente
    Contributor

    Created a how to get your data on data.gov revised page for resources. Yuda reviewing
    GSA/resources.data.gov#1001

  7. SueValente commented on Apr 29, 2026

    @SueValente
    Contributor

    Creating Frequently encountered errors document for.. something.. we'll see how it is best presented when its drafted.

  8. moved this from 🏗 In Progress [8] to 👀 Needs Review in data.gov team boardon May 5, 2026
  9. moved this from 👀 Needs Review to ✔ Done in data.gov team boardon May 10, 2026
  10. moved this from ✔ Done to 🗄 Closed in data.gov team boardon May 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions