Skip to content

catalog abnormal view count #5723

Description

@FuhuXia

Based on historical data, we have 20-50k daily dataset visits and it take 2-3 hours to finish indexing the new visit count to solr. But recently we see abnormal view counts

  1. 59k daily dataset visits
  2. takes more than 6 hours to index
  3. most popular datasets made no sense (Authorizations From 10/01/2006 Thru 09/30/2025?).

How to reproduce

  1. catalog.data.gov
  2. 📌 Tracking Update Auditing Log catalog.data.gov#847

Sketch

We need to inspect the visit count and exclude malicious/robotic hits from the stats

Activity

  1. moved this to Queue for Next Sprint in data.gov team boardon Feb 25, 2026
  2. moved this from Queue for Next Sprint to 📥 Queue in data.gov team boardon Feb 25, 2026
  3. moved this from 📥 Queue to Next Up in data.gov team boardon Apr 9, 2026
  4. moved this from Next Up to 📟 Sprint Backlog in data.gov team boardon Apr 23, 2026
  5. moved this from 📟 Sprint Backlog to No status in data.gov team boardon Apr 30, 2026
  6. added
    O&MOperations and maintenance tasks for the Data.gov platform
    on Jun 24, 2026
  7. modified the milestones: 2026 07, 2026 08 on Jun 24, 2026
  8. moved this from O&M Specific Backlog to 📟 Sprint Backlog (Top Priority) in data.gov team boardon Aug 12, 2026
  9. jbrown-xentity commented on Aug 19, 2026

    @jbrown-xentity
    Contributor

    Our dataset popularity process has completely changed, no longer using old catalog and solr methods. The dataset mentioned is no longer relevant or even in catalog.

    Going to say this is "Cannot reproduce", and close.

  10. moved this from 📟 Sprint Backlog (Top Priority) to ✔ Done in data.gov team boardon Aug 19, 2026
  11. moved this from ✔ Done to 🗄 Closed in data.gov team boardon Aug 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

O&MOperations and maintenance tasks for the Data.gov platformbugSoftware defect or bug

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions