TLDR Tech / Data
How Data 360 Segmentation Processes a Quadrillion Records Across Arbitrary Customer Data Models
Salesforce's Data 360 segmentation processes 1 quadrillion records per month across arbitrary customer schemas, relationship graphs, and storage systems, while running about 3 million Spark jobs monthly. Metadata became the bottleneck, with some environments hitting 3,000 to 6,000 tables, 500+ MB metadata payloads, and billions of candidate query plans.
Read the full story