Actual Computer is building a system for inference that can coordinate real hardware as it exists, allowing for hosting GGUF models on local devices as well as across them, while striving to produce realtime tokens/second on everything from frontier-capable hardware to low-resource devices
Actual Computer is building a system for inference that can coordinate real hardware as it exists, allowing for hosting GGUF models on local devices as well as across them, while striving to produce realtime tokens/second on everything from frontier-capable hardware to low-resource devices.