Skip to content

Conversation

@dylanuys
Copy link
Contributor

@dylanuys dylanuys commented Jun 4, 2025

  • New synthetic image dataset added to challenges https://huggingface.co/datasets/bitmind/bm-aura-imagegen
  • Healthchecks in proxy to avoid sending organics to unhealathy miners
  • Logging full semisynthetic masks to W&B
  • Consolidated and simplified error handling logic for miner responses (now in epistula.query_miners)
    • Safer logic for accessing historical miner predictions (filtering for potential improper responses that were stored prior to this release)
    • This also deprecates compute_penalty_multiplier in scoring, since improper responses are no longer processed by the reward function
  • Longer interval for media updates (60 -> 300 blocks), this is currently happening more frequently than necessary
  • autoupdate/restart for proxy and generator

dylanuys and others added 30 commits May 14, 2025 12:19
* V3

* removing v2 ci pipeline

* removing outdated .gitmodules

* keeping the noise that sample size of 50 and slight decay of .5 in EMA provides to avoid having any one model completely dominate the subnet.

* release 2.2.6 datasets, models, and lora support (#188)

* deprecate stable-diffusion-inpainting

* .env templates

* V3/RGB (#191)

* bgr images --> rgb images

* proper BGR -> RGB conversion

* eradicate all usage of bgr in image challenge flow

* extract frames as rgb

* skip extraneous rgb conversion

* fix deeperforesnics consistency

* v2 frame sampling parity + eidon mp4 fix

* missing import

* handling improper reporting of fps in wembs

* correct content-type on miner side

* max_fpx setting

* improved video metadata extraction

* cleaning up ffprobe options

* fixing first frame rotation edge case

* i2i fix

---------

Co-authored-by: Dylan Uys <dylan@bitmind.ai>

* V3 frame extraction (#192)

* bgr images --> rgb images

* proper BGR -> RGB conversion

* eradicate all usage of bgr in image challenge flow

* extract frames as rgb

* skip extraneous rgb conversion

* fix deeperforesnics consistency

* v2 frame sampling parity + eidon mp4 fix

* missing import

* handling improper reporting of fps in wembs

* correct content-type on miner side

* max_fpx setting

* improved video metadata extraction

* cleaning up ffprobe options

* fixing first frame rotation edge case

* i2i fix

* frame extraction

---------

Co-authored-by: Dylan Uys <dylan@bitmind.ai>

* setup.sh

* removing wandb log call from generator

* V3/2.2.9 (#189)

* mugshot dataset

* black

* i2v support and fixed prompt motion enhancement

* gen pipeline updates for i2v

* fixing prompt indexing

* properly handling new prompt dictionary key (task type)

* V3/2.2.11 (#190)

* mugshot dataset

* black

* i2v support and fixed prompt motion enhancement

* gen pipeline updates for i2v

* prompt sanitation + i2v model

* more retries for prompt sanitation

* fixing truthy tuple assertion

* Update min_compute.yml

* fixing setup script name in docs

* correct script name

* updated requirements.txt with bittensor-cli

* removing wandb.off

* import cleanup

* miner substrate thread restart + vali autoupdate test

* temporary v3 branch set to test autoudpate

* autoupdate update

* lower frequency of audoupdate check

* autoudpate test

* check autoupdate at setp 0

* typo

* autoupdate test

* dont set weights immediately at startup in case of many restarts

* Pyproject toml (#193)

* pyproject setup

* executable setup.sh

* autoupdate test

* resetting version after autoupdate tests

* Add Hugging Face model access instructions to validator docs; improve logging and fix LLM device mapping for multi-GPU

- Added section to Validating.md with instructions for gaining access to required Hugging Face models (FLUX.1-dev, DeepFloyd IF).
- Added logging of generation arguments in generation_pipeline.py.
- Fix LLM loading for multi-GPU in prompt_generator.py: use device_map and remove .to(self.device) for quantized models.
  Quantized LLMs must use device_map for correct device placement; calling .to(self.device) causes device mismatch errors. Parse GPU ID from device string for device_map assignment.

* fixing image_samples check for i2i

* hf_xet requirement

* wandb autorestart

* Fix: raise error if image is None for i2i/i2v tasks and ensure image is converted from array

* fixing wandb autorestart

* error log

* Update setup.sh to install Node.js 20.x LTS from NodeSource for pm2 compatibility; add doc note for existing validators' Hugging Face access

* external port for proxy cuz tensordock rugged us (#196)

* incentive doc

* Typo

* proxy updates

* v2 parity encoding (#197)

* final autoupdate test

* reset version

---------

Co-authored-by: Benjamin S Liang <caliangben@gmail.com>
Co-authored-by: Dylan Uys <dylan@bitmind.ai>
* fixing wandb cache clean paths (#202)

* max frames configuration

* fn header update

* slight increase to timeout
* adding extra metadata to testnet requests for miners

* adding label and mediatype to testnet metadata
* log augmentation params

* braindead typo
* fix hotkey check in sync_metagraph

* bump version
* healthcheck wip

* remove old miner health task vars, change miner healtchechk endpoint name

* health count logging

* fixing query based on health logic

* updating healthcheck interval to 10

* removing unecessary lock

* use DEFAULT_TIMEOUT

* adding blacklisting for bad responses

* fixing detect_image fallback

* a couple comments

* update functionality for generator and proxy
* adding basic health dict to miner tracker

* move all request processing logic to epistula module

* reflect request processing updates in eval engine

* healthy/unhealthy miner uid functions

* proxy using simpler miner health from tracker state

* new fn signature for score_challenge
* scraper wip

* fixing queries with max date set in tbs, also adding placeholder for reverse image search which i cant get to work rn due to captchas

* taking first sentence of prompt as initial version of search queries

* - Adding specific media scraping interval config
- Adding retry logic and error handling to scraping callback

* Fixing enum value for output path in scraper

* add selenium to requirements

* Fixing str treated as enum

* cleaning up

* increasing media update intervals

* [testnet] Safer Miner Prediction History (#214)

* centralizing logic for safely getting valid predictions and associated labels

* cleaning up
* adding bm-aura-imagegen dataset

* log mask as npy artifact

* format
@benliang99 benliang99 self-assigned this Jun 4, 2025
Copy link
Contributor

@benliang99 benliang99 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dylanuys dylanuys merged commit 1a10825 into main Jun 4, 2025
@dylanuys dylanuys deleted the release/3.0.10 branch December 3, 2025 11:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants