Discussion

notyourbiz: Super helpful.

PaulHoule: I remember dealing with this BS back in 2017. It was clear to me that containers were, more than anything else, a system for turning 15MB of I/O into 15GB of I/O.So wow and new shiny though so if you told people that they would just plug their ears with their fingers.

pocksuppet: This doesn't follow from anything in the article.

PaulHoule: I was working with prototypical foundation models and having the exact same problem. My diagnosis wasn't quite the same, I think more radical gains could be had with a "stamp out unnecessary copies everywhere" policy but it looks like he did get through a bottleneck.