Run Your Own AI Cluster at Home with Exo
Overview
Exo allows users to create personal AI clusters by connecting multiple everyday devices like phones, computers, and tablets. The tool auto-discovers devices and enables them to run large AI models efficiently by distributing tasks across the cluster. Key features include RDMA over Thunderbolt support for reduced latency and topology-aware auto parallelization for optimized model execution.
All Sources
Articles
Story Timeline
Run Your Own AI Cluster at Home with Exo
Exo allows users to create personal AI clusters by connecting multiple everyday devices like phones, computers, and tablets. The tool auto-discovers devices and enables them to run large AI models efficiently by distributing tasks across the cluster. Key features include RDMA over Thunderbolt support for reduced latency and topology-aware auto parallelization for optimized model execution.