That is true for Linux and maybe Mac, but on windows I think they have a bit more overhead.
But again I agree that in most cases it is not significant.
Is the overhead because of containers or is it because you’re running something that is meant to run on Linux and is using a conversion layer like MinGW ?
Windows > Windows Subsystem for Linux (WSL) Ubuntu > docker container
I think WSL 2 actually runs Linux in a virtual environment. I’ve tried getting my own LLM instance running on my windows machine but it’s been such a pain.
That is true for Linux and maybe Mac, but on windows I think they have a bit more overhead. But again I agree that in most cases it is not significant.
Is the overhead because of containers or is it because you’re running something that is meant to run on Linux and is using a conversion layer like MinGW ?
Windows > Windows Subsystem for Linux (WSL) Ubuntu > docker container
I think WSL 2 actually runs Linux in a virtual environment. I’ve tried getting my own LLM instance running on my windows machine but it’s been such a pain.