Repository navigation
Data Audit #225
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: Data Audit | |
| # ────────────────────────────────────────────────────────────── | |
| # 데이터 파이프라인 정기 및 완료 이벤트 감사. 모든 실패 Issue 자동 알림(단발은 auto-rerun 병행). | |
| # | |
| # 감사 대상 = scheduled(cron) 데이터/자동화 파이프라인 전체 (목록 SSOT = monitorPipeline.py | |
| # MONITORED_WORKFLOWS): Original SSOT Sync · Data Sync · DART New Stocks · Data Prebuild · | |
| # EDGAR · Gov(가격/지수) · Macro · News Archive · Valuation Snapshot · Search Index(delta/main) · | |
| # Quant Audit · Update KindList. 새 scheduled 워크플로우 추가 시 그 목록에도 등록. | |
| # | |
| # 수동 (workflow_dispatch): | |
| # - 즉시 감사 실행 (실패 Issue 갱신 포함) | |
| # | |
| # full 모드 수집은 dataSync.yml workflow_dispatch (mode=full) 로 이전. | |
| # ────────────────────────────────────────────────────────────── | |
| on: | |
| schedule: | |
| - cron: '0 20 * * *' # UTC 20:00 = KST 05:00, 일일 감사 | |
| workflow_run: | |
| workflows: | |
| - Original SSOT Sync | |
| - AllFilings Backfill | |
| - Data Sync | |
| - DART New Stocks Sync | |
| - Data Prebuild (DART) | |
| - EDGAR Data Sync (Bulk) | |
| - Gov Price Sync (Bulk) | |
| - Gov Index Sync (Bulk) | |
| - Macro Data Sync (Bulk) | |
| - News Archive Sync | |
| - GDELT Sync | |
| - Naver News Sync | |
| - Valuation Snapshot | |
| - Search Index Build | |
| - Quant Audit | |
| - Update KindList | |
| - Intent Model Pipeline | |
| - Notify Watch | |
| types: [completed] | |
| workflow_dispatch: | |
| permissions: | |
| contents: read | |
| issues: write | |
| actions: write # transient 단발 실패 자동 재실행(gh run rerun) 용 | |
| concurrency: | |
| group: data-audit | |
| cancel-in-progress: true | |
| jobs: | |
| audit: | |
| runs-on: ubuntu-latest | |
| timeout-minutes: 10 | |
| steps: | |
| - uses: actions/checkout@v6 | |
| - name: Install uv | |
| uses: astral-sh/setup-uv@v7 | |
| - name: Set up Python | |
| run: uv python install 3.12 | |
| - name: Install dependencies | |
| run: uv sync | |
| - name: Pipeline health check | |
| run: uv run python .github/scripts/ops/monitorPipeline.py | |
| env: | |
| GH_TOKEN: ${{ secrets.GITHUB_TOKEN }} |