Greenthread
UnknownThe GreenThread inference engine allows you to multiplex many LLM's and SLM's on the same GPU, swapping them subsecond.
The GreenThread inference engine allows you to multiplex many LLM's and SLM's on the same GPU, swapping them subsecond.