Skip to content

Meta-Collab/MetaCollab

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

57 Commits
 
 
 
 
 
 
 
 

Repository files navigation

MetaCollab

Introduction:

Tracking users' daily activities on their smartphones and other devices, often shared with companies, raises serious concerns about data privacy. Such practices compromise users' privacy and put their data at risk of misuse and unauthorized access, including being sold to third-party apps. For instance, ubiquitous features like keyboard word prediction and fitness activity tracking, designed to enhance user experience, inadvertently become conduits for extensive data collection, leaving users vulnerable to exploitation.

How do we solve the Problem?

Rather than directly sharing data across devices to train a model for generating recommendations, we address this challenge by distributing a pre-trained model and a numpy array containing the resulting weights of model training across a network of users' diverse devices via blockchain technology. When a device's collected data is required to contribute to training the distributed model, we train its model locally on its own dataset and aggregate its resultant weights with the weights already stored on blockchain using the pre-trained model stored in IPFS, using federated learning techniques. Subsequently, we update the numpy array on the blockchain, whereas the pre-trained model remains the same. This methodology enhances privacy and security while promoting improvement in the collaborative model.

Demo

WhatsApp Image 2024-04-21 at 9 43 43 AM

WhatsApp Image 2024-04-21 at 9 43 46 AM

WhatsApp Image 2024-04-21 at 9 52 39 AM

WhatsApp Image 2024-04-21 at 10 21 55 AM

WhatsApp Image 2024-04-21 at 10 25 10 AM

Technology Stack:

  1. Hardhat
  2. Solidity
  3. IPFS
  4. Ethereum
  5. Django
  6. Node.js
  7. Federated Learning
  8. LSTM
  9. Metamask
  10. JavaScript

Contributors:

Team Name: AIOverlords

Challenges We Faced

  1. Integrating blockchain and machine learning technologies proved time-consuming, necessitating the use of Django to interface with ML and Node.js to interface with Hardhat. Bridging these disparate web technologies posed complexities that we addressed through Axios.
  2. Optimizing gas fees in smart contracts presented a formidable hurdle. We underwent multiple iterations of optimization to minimize gas usage.
  3. Implementing federated learning techniques also posed considerable challenges, demanding thorough attention to detail and innovative problem-solving.

Made at: