Dev

[agolokoz]

No description provided.

[CC-Yeh]

cache layer -> cache

cache layer is our internal implementation, I think cache is fine.

I think we could remove this line: As you may have guessed, we implemented KV cache on sparse buffers with a sparse heap pool.

section name:
Metal sparse buffers -> Metal sparse buffers and placement heaps

Maybe this is clearer?

Not sure if placement and sparse are intuitive to the audience, maybe a very short explanation is good.