main merge - #233
Open
matthewpeterkort wants to merge 21 commits into
Open
Conversation
Co-authored-by: Matthew Peterkort <33436238+matthewpeterkort@users.noreply.github.com>
* update docs for latest * document new,non-lfs paths * extract issues * refactor lfs out of docs * update docs --------- Co-authored-by: matthewpeterkort <matthewpeterkort@gmail.com> Co-authored-by: Matthew Peterkort <33436238+matthewpeterkort@users.noreply.github.com>
* update git-drs cli to be LFS like * remove sentinel, address issues * add design doc * add new command for migrating records, fix go.mod * Fix ls-files inventory for hydrated tracked LFS files * fix cli * fix tests * integrate git drs init into remote add * address a bajillion outstanding issues * fix tests * fix test * bump deps * fix progress bar output styling * add business logic for handling git-drs rm command * fix tests * bump deps * clean up * fix tests * fix go mod * fix tests
Removed unnecessary introductory text from developer documentation. Co-authored-by: Matthew Peterkort <33436238+matthewpeterkort@users.noreply.github.com>
* clean up progress upload * add progress for git drs pull downloads, update docs * fix tests * fix coverage test * fix bot issues * bump library deps
* fix wiring to support selecting the bucket in instances where more than one bucket is supported * fix add url command record templating * fix copy records * update deps * test create new branch use case * fix lint
…nd scan to prevent script hang
* get rid of artifact code * just push * update deps from data-client to calypr-cli, fix issue where first time users errored out of remote add command from nonexistant gen3 config in home directory * take a pass cleaning up dead code from legacy architecture * regorg packages to be more human readable and cleaner * add returns to swallowed errors * cleanup internal packages. organize cmd package code * update docs, fix CI job * fix ci * fix tests * fix tests * fix test * fix test * beef up pull command * update deps
* patch ping bug * add local copy records command. remove file_name field from structs * update releaser * fixes an issue where git-drs pull would leave working tree in dirty state by refreshing indices after a pull * fix tests * fix tests * fix test * fix tests * fix syfon version * fix the last failing ci test
* Add macOS code signing to GoReleaser configuration - Configure code signing for darwin binaries using Apple Developer ID - Use environment variables for Apple certificate credentials - Follows same pattern as drs_downloader for consistency * Add Apple certificate secrets to release workflow * Add macOS Code Signing Operation Guide Added a comprehensive operation guide for macOS code signing, including setup, release creation, troubleshooting, and best practices. * Fix macOS code signing configuration: use binary_signs instead of signs * Add comprehensive binary verification steps to macOS code signing guide Added detailed verification commands including: - Basic signature validation - Certificate and signer information display - Hardened runtime verification - Architecture-specific signature checks - Expected output examples - Additional troubleshooting for signature verification failures * Enhance release workflow with binary verification Add verification step for signed macOS binaries in release workflow. * Add support for multiple architectures in goreleaser * Refactor release workflow for GoReleaser Refactor GitHub Actions workflow for GoReleaser to include build and sign jobs, and update steps for artifact handling. * fix release signing workflow Run GoReleaser release on macOS after importing the Apple certificate so darwin binaries are signed during the release build before packaging. Also fix the GoReleaser archives config indentation so archive settings are top-level instead of being parsed as a second binary_signs entry. --------- Co-authored-by: Matthew Peterkort <33436238+matthewpeterkort@users.noreply.github.com> Co-authored-by: matthewpeterkort <matthewpeterkort@gmail.com>
Added 'files' configuration to archives section with 'none: "*"' to exclude all files by default. This prevents README.md and other files from being included in the tar.gz archives. The binary is still included as the primary artifact being released.
* fix: remove invalid files field from archives config * fix: exclude all files from archives except binary * fix: include only the built binary in archives * yet another attempt * no match pattern
Make git-drs push discover committed pointer blobs from the pushed ref tree instead of relying on changed-path diffs. This prevents Git refs from being pushed when matching DRS objects were missed, and lets a later push repair already-published pointer commits with missing Syfon records. Also add coverage for space-bearing paths, malformed pointer filtering, and oid deduplication before upload planning
* adds apple notary * fix staple hook * Address PR comments
* adds target to generate 100s of files * removes lfs dependencies * address codex review comment --------- Co-authored-by: Matthew Peterkort <33436238+matthewpeterkort@users.noreply.github.com> Co-authored-by: matthewpeterkort <matthewpeterkort@gmail.com>
…emote … (#248) * add support for copying recrods from local git cach to calypr remote instances * update upload ux to be tolerable * update tests * fix add url test * fix test * fix bug
…ort (#247) * TDD: add tests for terra * Support DRS URI pointers in LFS cache paths * Adds Terra remote model, type * Updated git drs ping for Terra * adds terra ping * Adds DRS uri <--> OID clarification * clarifies pointer file usage * adds sequence diagram * add-ref contacts the configured source authority * Document multi-remote add-ref resolution * documents Terra creds * adds loadGitConfigOverrides * adds service-info to ping * adds anvil poc * Implement AnVIL/Terra reference workflow * Fix unknown flag error in git drs command * fix drs uri validation * fix clean-filter bug * Keep hydrated DRS URI references clean. * adds presentation * adds anvil manifest * Add example AnVIL manifest workflow slide * adds docs/index.html * docs: propose a unified remote CLI and multi-DRS architecture * ignore working dirs * clarified --auth and --credential * Restrict override reads to repo-local config * Remove Terra auth and mode keys with the remote * Match the DRS access header schema * fix: Destination validation can escape through symlinks * Fix Terra automatic smudge downloads * Clarify read-only Terra push behavior * docs DRS compact identifiers and auth discovery * Make pulled files read-only for read-only remotes * Document rollback for accidental read-only DRS edits * Refresh AnVIL POC gaps and roadmap * Publish end-user docs and presentation with GitHub Pages * Define DRS preset catalog ownership and safe overrides * Implement unified remote CLI and built-in DRS presets * Update user docs for unified remote presets * listed preset includes auth type * Complete generic remote runtime boundary * Clarify read-only Terra push error * Support inline and non-first DRS access methods * Resolve unified Gen3 credential sources at runtime * Resolve scoped Gen3 buckets at runtime * Preserve source routing in add-ref pointers * Validate AnVIL checksums before caching downloads * Hydrate DRS OIDs through the URI downloader * Skip DRS URI references during push sync * Reject unresolved providers during remote add * Validate generic Gen3 authentication modes * Track add-ref destinations from repository root * Fix read-only gitattributes marker * Persist local DRS metadata for manifest references * Update documentation for unified remote add. * Fix AnVIL HTTPS access selection * 1 of 2 update presentation * 2 of 2 update presentation * correct formatting * more presentation fixes * yet more presentation fixes * mkdocs options * mkdocs options take 2 --------- Co-authored-by: Matthew Peterkort <33436238+matthewpeterkort@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.