Decentralized Confidential Machine Learning
Use a model on someone else's hardware without the host or the model's developer seeing your data, and check which model actually answered.
- 1Private inference. Hidden from the host and the model's developer.
- 2Verifiable models. Weights provably built from the published code and data.
- 3Monetizable models. Anyone can serve one. No one uses it without paying.
- 4Community-owned models. Trained together, seen by no one, earnings shared.
Running inside the TEE cost 1.6–12.1% of token throughput across three models on NVIDIA H200.
Decentralized Confidential Machine Learning (opens the 17-page PDF)
Illia Polosukhin, Alex Skidanov and Pierre Le Guen
NEAR AI
Abstract
Currently, using advanced AI models requires giving up privacy of users' data and limits how models can be used. Meanwhile, open source models do not yet have a sustainable business model. We present a decentralized system that enables the creation and deployment of large language models and AI agents that are both open-source and monetizable; private and verifiable while open for all to use; and preserve users' ownership of their data and assets while enabling customized experiences that improve their well-being.