Seer × Ethereum AI Ecosystem Collaboration

[seetadev]

Discussion Notes • July 11, 2026 and July 22, 2026

Participants

• Schofield
• Clément Lesaege
• Johanna Moran: @johannamoran
• Manu Gupta: @seetadev
• Alex @ Kleros

Objective

Explore collaboration opportunities around Seer, AI model builders, and the broader Ethereum open-source ecosystem.

The discussion focuses on creating an ecosystem where AI models, datasets, retrieval systems, benchmarks, contributors, and maintainers are rewarded through transparent open-source infrastructure.

White Paper Reference: AI Training, Copyright

---

Agenda

1. Introduction
2. Current Seer ecosystem
3. Community growth strategies
4. AI competitions and developer engagement
5. Seer RAG Agent Arena
6. Open-source contribution attribution
7. Dependency Graphs & Ecosystem Intelligence
8. Potential collaborations
9. Next Steps

Vision

Imagine an ecosystem where:

• AI models compete publicly
• RAG pipelines are benchmarked continuously
• Open-source contributors receive attribution automatically
• Ethereum provides transparent coordination
• Communities collectively improve AI systems
• Builders earn recognition through measurable impact

Rather than only hosting inference endpoints, Seer could become the coordination layer for open AI model development.

Discussion Topics

1. Growing the Seer Community

Current communities often rely heavily on

• X Spaces
• Discord
• Telegram
• Blog posts

We believe there are opportunities to engage developers through interactive challenges.

Possible initiatives include

Weekly Prediction Challenges

Examples

• AI model builder, training and inferencing initiatives
• MEV prediction
• ETH price forecasting
• Governance proposal outcome prediction
• Security vulnerability prediction
• Gas fee prediction

Leaderboard-based competitions.

AI Agent Tournaments

Agents compete on tasks such as

• Smart contract auditing
• Research
• Bug fixing
• Documentation generation
• DAO proposal summarization
• Solidity explanation
• Ethereum education

Evaluation metrics

• Accuracy
• Cost
• Latency
• Explainability
• Reproducibility

Benchmark Bounties

Community members submit

• datasets
• prompts
• evaluation pipelines
• benchmark improvements

Rewards could come from

• Sponsors
• Gitcoin
• Ethereum

Public Leaderboards

Inspired by

• Kaggle
• LMSYS Chatbot Arena
• Open LLM Leaderboards

Possible leaderboards

• Best Ethereum RAG
• Best Solidity Assistant
• Best Research Agent
• Best Governance Assistant
• Best Wallet Assistant
• Best DeFi Copilot

2. AI Competition Ecosystem

Potential partners

Developer Platforms

• Devpost
• HackerEarth
• Analytics Vidhya
• MachineHack
• Topcoder
• MLH (Major League Hacking)

Possible hackathon tracks

• AI + Ethereum
• AI Security
• Autonomous Agents
• RAG
• Model Evaluation
• Smart Contract Agents

---

Open Source Communities

• Gitcoin
• DoraHacks
• ETHGlobal
• Protocol Labs
• Optimism
• Arbitrum
• Base
• Filecoin

---

Academic Outreach

Potential collaborations

• Universities
• AI labs
• Ethereum research groups
• Open-source clubs
• Student organizations

---

3. Seer RAG Agent Arena

One idea is creating an evaluation platform similar to

• Chatbot Arena
• SWE Bench
• GAIA
• OpenAI Evals

But specialized for

• Ethereum
• Web3
• Smart contracts
• Blockchain research

Proposed Architecture

Question
     │
     ▼
Retriever

     │

Retrieved Documents

     │

LLM

     │

Generated Answer

     │

Evaluation Pipeline

     │

Scores

Evaluation dimensions

• Faithfulness
• Hallucination
• Retrieval quality
• Citation accuracy
• Latency
• Cost
• Robustness
• Security
• Determinism

---

Community Submission Model

Anyone can submit

• Retriever
• Embedding model
• Reranker
• Generator
• Prompt
• Evaluation metric
• Dataset

Leaderboards update automatically.

Potential Benchmark Categories

Ethereum

• EIPs
• Yellow Paper
• Solidity
• Smart Contracts
• Security

Filecoin

• Retrieval
• Storage
• FVM
• Deal making

libp2p

• Networking
• DHT
• Gossipsub
• Hole Punching
• QUIC

IPFS

• IPLD
• CIDs
• UnixFS
• DAG APIs

Optimism

• OP Stack
• RetroPGF
• Governance

4. AI Agent Arena

Beyond RAG

Agents perform complete tasks

Examples

• Review a PR
• Write documentation
• Generate tests
• Explain code
• Find bugs
• Audit Solidity
• Produce dependency graphs
• Answer governance questions

Evaluation

• Quality
• Accuracy
• Time
• Cost
• Human preference

5. Contribution Attribution

One challenge in AI ecosystems

Who deserves credit?

Possible contributors include

• Dataset creators
• Prompt authors
• Retriever developers
• Evaluation authors
• Benchmark maintainers
• Model builders
• Infrastructure maintainers
• Documentation writers
• Community reviewers

Contribution graphs can help recognize ecosystem impact.

6. Proof of Contribution

Inspired by

• RetroPGF
• ProPGF
• Gitcoin
• Open Source Observer

Possible signals

• Git commits
• Issues
• Reviews
• Benchmarks
• Datasets
• Documentation
• Community moderation
• AI evaluation submissions

7. Ecosystem Intelligence

Instead of only repository metrics

Measure

• dependency graphs
• package adoption
• downstream impact
• ecosystem influence
• maintenance health

Possible dashboards

Repository Impact

• Dependents
• Contributors
• Commits
• Releases

Package Impact

• Downloads
• Integrations
• SDK usage

Ecosystem Graph

Project A
   │
   ▼
Project B
   │
   ▼
Project C

Measure indirect ecosystem impact.

8. Dependency Graph Research

Areas we've been exploring

• libp2p dependency graph
• Ethereum package graph
• Protocol Labs ecosystem graph
• Python ecosystem
• npm ecosystem
• Rust crates

Potential use cases

• funding allocation
• maintenance prioritization
• ecosystem risk
• contributor discovery

---

9. AI for Open Source Funding

Possible applications

• RetroPGF evaluation
• Grant recommendations
• Maintainer discovery
• Ecosystem health
• Missing dependencies
• Funding impact prediction

10. Ethereum Ecosystem Opportunities

Potential collaborations

• Ethereum Foundation
• Protocol Labs
• Optimism
• Gitcoin
• Open Source Observer
• DevTool builders
• AI infrastructure providers

11. Possible Joint Projects

Project 1

Seer AI Leaderboard

Evaluate

• models
• prompts
• RAG
• agents

Project 2

Ethereum RAG Benchmark

Community-maintained benchmark suite.

Project 3

Contributor Attribution Dashboard

Visualize

• maintainers
• contributors
• reviewers
• downstream users

Project 4

Open Source Dependency Explorer

Interactive graph showing

• packages
• repositories
• contributors
• funding
• ecosystem impact

Project 5

AI Evaluation Marketplace

Community submits

• benchmarks
• datasets
• evaluators

Earn

• reputation
• funding
• badges

Existing Work Relevant to Discussion

ProPGF

Research around

• contribution attribution
• funding metrics
• ecosystem analytics

PLDG Dashboard

Exploration of

• dependency graphs
• ecosystem adoption
• package relationships

libp2p Ecosystem Research for Ethereum Consensus clients

Topics

• dependency analysis
• protocol adoption
• implementation comparisons
• interoperability

Ethereum's Mopro SDK Experiments

Using

• zero-knowledge proofs
• dependency verification
• attestations
• contributor validation

Additional Ideas

AI Security Benchmarks

Evaluate

• prompt injection
• jailbreak resistance
• retrieval poisoning
• adversarial documents
• hallucination attacks

Smart Contract Benchmarks

Tasks

• audit
• optimization
• explanation
• formal verification

Research Assistant Arena

Compare

• Deep Research
• Seer
• Open models
• Domain-specific agents

Dataset Marketplace

Community contributes

• Ethereum datasets
• Security datasets
• Governance datasets
• Smart contract corpora

Potential Ethereum, AI and Web3 Ecosystem Partners

Ethereum

• Ethereum Foundation
• Devcon
• ETHGlobal
• Protocol Guild
• Gitcoin
• Open Source Observer

AI

• Hugging Face
• Together AI
• OpenRouter
• LMSYS
• LangChain
• LlamaIndex

Protocol Labs

• libp2p
• IPFS
• Filecoin
• IPLD
• Lassie
• Saturn
• Storacha

Research

• Stanford
• Berkeley
• MIT
• ETH Zurich
• CMU
• Oxford

Useful References

Open Source Funding

• RetroPGF
• ProPGF
• Gitcoin Grants
• Open Source Observer
• Allo Protocol

AI Evaluation

• Chatbot Arena
• SWE-bench
• GAIA Benchmark
• OpenAI Evals
• HELM
• BIG-bench
• MMLU
• HumanEval
• GPQA

RAG Evaluation

• RAGAS
• TruLens
• DeepEval
• LangSmith
• Phoenix (Arize)
• LlamaIndex Evaluation
• NVIDIA NeMo Evaluator

Agent Benchmarks

• τ-bench
• WebArena
• BrowserArena
• OSWorld
• AgentBench
• GAIA
• SWE-bench Verified

Open Source Intelligence

• Open Source Observer
• Libraries.io
• deps.dev
• Ecosyste.ms
• GitHub Archive
• Software Heritage

Knowledge Graphs

• Neo4j
• NetworkX
• Graphistry
• Memgraph
• Apache AGE

Ethereum Data

• Dune
• Flipside
• The Graph
• Etherscan APIs
• Blockscout
• EigenPhi

AI Frameworks

• LangGraph
• LangChain
• LlamaIndex
• DSPy
• Haystack
• AutoGen
• CrewAI

Long-Term Vision

Create an Open AI Coordination Layer for Ethereum, where:

• AI models are openly benchmarked.
• RAG systems are evaluated continuously.
• Autonomous agents compete in transparent arenas.
• Contributors receive measurable recognition.
• Dependency graphs reveal ecosystem-wide impact.
• Funding programs leverage objective contribution metrics.
• Builders across Ethereum, IPFS, Filecoin, libp2p, Optimism, and the broader open-source community collaborate through shared infrastructure.

Such a platform could become the foundation for a decentralized, transparent, and merit-based AI ecosystem that accelerates innovation while ensuring contributors and maintainers receive meaningful recognition for their work.