Implement tar optimization and dynamic exclusions (Issues #3, #4, #5, #6, #8)#11

Open

tomkinsc wants to merge 14 commits intomainfrom

claude/issue-8-20250815-2255

Commits on Aug 15, 2025

Implement tar improvements for smaller tarballs and obviate --ignore-zeros

claude[bot]
and
tomkinsc
committed
add Claude-related infrastructure files
tomkinsc
committed
do not trim EOF blocks from final incremental tarball
tomkinsc
committed

Commits on Aug 16, 2025

more claude config
tomkinsc
committed
obtain metadata related to the upload and the uploader, and persist via in-band tar labels, plus a verbose json file alongside the README.txt in the destination bucket
tomkinsc
committed
use last component of run basename for short-form representation, rather than just truncating it
tomkinsc
committed
migrate Google Cloud CLI calls from `gsutil` -> `gcloud storage`
tomkinsc
committed
eliminate unnecessary repetition of path construction for tarball destination (store in `FINAL_TARBALL_PATH `)
tomkinsc
committed
create tsv file for appending a row to a Terra table for the uploaded run
tomkinsc
committed
parameterize name included in tsv for Terra table row upsert
tomkinsc
committed
add hard and optional dependency checking; revise cron detection to be more involved and hopefully cross-platform (GNU/Linux vs macOS/BSD)
tomkinsc
committed
parameterize static exclusion list used to omit large debug/diagnostic data from run folder tarballs
tomkinsc
committed
use dynamic exclusions to avoid tarball bloat by discouraging tar from including multiple snapshots of large in-progress files
tomkinsc
committed
sort and de-duplicate dynamic exclusions
tomkinsc
committed