Skip to yearly menu bar Skip to main content


Poster

DICE: Data Influence Cascade in Decentralized Learning

Tongtian Zhu · Wenhao Li · Can Wang · Fengxiang He

Hall 3 + Hall 2B #337
[ ] [ Project Page ]
Wed 23 Apr 7 p.m. PDT — 9:30 p.m. PDT

Abstract:

Decentralized learning offers a promising approach to crowdsource data consumptions and computational workloads across geographically distributed compute interconnected through peer-to-peer networks, accommodating the exponentially increasing demands. However, proper incentives are still in absence, considerably discouraging participation.Our vision is that a fair incentive mechanism relies on fair attribution of contributions to participating nodes, which faces non-trivial challenges arising from the localized connections making influence "cascade" in a decentralized network. To overcome this, we design the first method to estimate Data Influence CascadE (DICE) in a decentralized environment. Theoretically, the framework derives tractable approximations of influence cascade over arbitrary neighbor hops, suggesting the influence cascade is determined by an interplay of data, communication topology, and the geometry of loss landscape.DICE also lays the foundations for applications including selecting suitable collaborators and identifying malicious behaviors.The code is available at https://github.com/Raiden-Zhu/ICLR-2025-DICE.

Live content is unavailable. Log in and register to view live content