~hackernews | Bookmarks (2)

A few weeks ago, Figma published an article introducing their own sharding solution for PostgreSQL. The Figma engineering team was aware of, and evaluated, several existing options that could have made their database layer horizontally scalable. But still, they decided to build their own sharding solution from scrat...

The basic principle of the shuffle algorithm is to bucket the input data, where each bucket’s data can be processed independently and output results. This reduces the size of the hash table when aggregating data.Taking the group operator as an example, there are two implementation methods: sort group and hash group....