Skip to content

Feat/update incentive mechanism#430

Merged
ibraheem-abe merged 23 commits into
stagingfrom
feat/update-incentive-mechanism
Jul 16, 2026
Merged

Feat/update incentive mechanism#430
ibraheem-abe merged 23 commits into
stagingfrom
feat/update-incentive-mechanism

Conversation

@ibraheem-abe

@ibraheem-abe ibraheem-abe commented Jul 15, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Changelog

  • Changes mechanism from king of the hill to uniform decaying scheme
  • Scores are based on relative improvements instead of raw scores
  • Approve candidates that meaningfully improve performance or reduce cost without lowering quality.
  • Reward larger improvements more, especially after longer periods without competition progress.
  • Gradually reduce improvement bonuses over time.
  • Exclude banned, rejected, incomplete, benchmark, and unregistered miners from rewards.
  • Activate the mechanism from a fresh evaluation set without changing previous competitions.

@ibraheem-abe
migration: Adds new fields (perf delta, cost delta etc)
4b43f7f
@ibraheem-abe
env vars: adds new + updates asi dependency
e40f011
@ibraheem-abe
New incentive: core business logic
dc0a72d
@ibraheem-abe
queries: align leader and reward eligibility
0a396ae 
Use only finished, approved, review-eligible, non-benchmark, and non-banned agents when selecting leaders and reward candidates
@ibraheem-abe
queries (approval): validate and snapshot incentive promotions
df3edaf 
Recheck candidates against a ban-stable leader and persist their improvement bonus atomically at approval time.
@ibraheem-abe
validator: prefilter candidates by relative improvement
51037a0 
Run the approval judge only when an active-set candidate meets the configured performance or cost threshold.
@ibraheem-abe
incentives: allocate rewards to registered top-k hotkeys
e993319 
Batch and cache candidate membership for 60 seconds, then normalize rewards across the highest-ranked registered hotkeys.
@ibraheem-abe
update bittensor: add batched hotkey membership lookup
6e0785a
@ibraheem-abe
weights + socring: expose top-k weights and emission shares
380f366
@ibraheem-abe
vali: submit resilient top-k weight allocations
6120c12
@ibraheem-abe
update: remaining tests
aac1e9c
jmnmv12
jmnmv12 reviewed Jul 15, 2026
View reviewed changes
Comment thread api/endpoints/evaluation_sets.py
jmnmv12
jmnmv12 reviewed Jul 15, 2026
View reviewed changes
Comment thread validator/set_weights.py Outdated
jmnmv12
jmnmv12 approved these changes Jul 15, 2026
View reviewed changes

@jmnmv12 jmnmv12 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

@camfairchild
camfairchild requested a review from jmnmv12 July 16, 2026 04:55
jmnmv12
jmnmv12 reviewed Jul 16, 2026
View reviewed changes

@jmnmv12 jmnmv12 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just left one small comment the rest looks great 🚀

Comment thread api/config.py Outdated
@ibraheem-abe
ibraheem-abe merged commit 846236f into staging Jul 16, 2026
2 checks passed
@ibraheem-abe
ibraheem-abe deleted the feat/update-incentive-mechanism branch July 16, 2026 16:30
@ibraheem-abe ibraheem-abe mentioned this pull request Jul 17, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jmnmv12 jmnmv12 jmnmv12 approved these changes
@camfairchild camfairchild camfairchild approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ibraheem-abe @camfairchild @jmnmv12