TLDR Tech / DevOps
Remote Cache CDC: Reusing Bytes
BuildBuddy is using content-defined chunking in its remote cache so large build outputs can reuse unchanged byte chunks instead of re-uploading or re-downloading entire files after small code changes. Early results show major savings for Bazel builds—about 40% less uploaded data in a benchmark and hundreds of TiB of duplicate chunk uploads skipped in production—with support available via Bazel's experimental remote cache chunking flag.
Read the full story