Memory technologies make fundamental tradeoffs between storage capacity and read speeds, and these drive programmers to put different data on different memory technologies.

But what actually are those tradeoffs? Here is a graph of read speeds (in MB/s of sequential reads) vs capacity (in GB) per dollar.

Why did I not include SRAM? because

When making this graph, there are a lot of tricky modelling assumptions that I've simply had to bulldoze.