

Exo
Overview :
Exo is an experimental software project designed to harness existing household devices such as iPhones, iPads, Androids, Macs, and Linux to unite them as a powerful GPU to run AI models. It supports a variety of popular models such as LLaMA and features dynamic model partitioning that optimally divides models based on the current network topology and device resources. Additionally, Exo provides APIs compatible with ChatGPT, allowing the use of Exo to run models in applications with just a simple line of code change.
Target Users :
Targeted at developers and AI enthusiasts who wish to build and run AI models using existing household devices without the need for expensive NVIDIA GPUs. Exo provides an experimental platform that enables users to explore and implement distributed computing for AI models in a multi-device environment.
Use Cases
Build an AI cluster using iPhones and iPads for image recognition tasks.
Run natural language processing models on multiple Linux devices at home.
Execute complex data analysis tasks by combining Mac and Android devices.
Features
Supports popular models like LLaMA.
Dynamic model partitioning, optimally distributing models based on network topology and device resources.
Automatic device discovery, no manual configuration required.
Provides APIs compatible with ChatGPT, simplifying the model running process.
Supports various inference engines, such as MLX, tinygrad, and llama.cpp.
Supports various network modules including GRPC, Radio, Bluetooth.
How to Use
1. Install Exo from source: Go into the Exo directory and use pip to install the dependencies.
2. Run Exo on multiple devices according to the documentation example.
3. Integrate Exo into your application using the provided API to run models.
4. Use the ChatGPT-style Web interface by accessing the device's 8000 port.
5. If necessary, modify the code to access the inference engine.
6. Monitor and participate in the community, report issues, and contribute code.
Featured AI Tools

Gemini
Gemini is the latest generation of AI system developed by Google DeepMind. It excels in multimodal reasoning, enabling seamless interaction between text, images, videos, audio, and code. Gemini surpasses previous models in language understanding, reasoning, mathematics, programming, and other fields, becoming one of the most powerful AI systems to date. It comes in three different scales to meet various needs from edge computing to cloud computing. Gemini can be widely applied in creative design, writing assistance, question answering, code generation, and more.
AI Model
11.4M
Chinese Picks

Liblibai
LiblibAI is a leading Chinese AI creative platform offering powerful AI creative tools to help creators bring their imagination to life. The platform provides a vast library of free AI creative models, allowing users to search and utilize these models for image, text, and audio creations. Users can also train their own AI models on the platform. Focused on the diverse needs of creators, LiblibAI is committed to creating inclusive conditions and serving the creative industry, ensuring that everyone can enjoy the joy of creation.
AI Model
6.9M