Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Calculate Miner Response Time for Utility Score #122

Closed
Tracked by #33
grantdfoster opened this issue Jun 27, 2024 · 2 comments
Closed
Tracked by #33

Calculate Miner Response Time for Utility Score #122

grantdfoster opened this issue Jun 27, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@grantdfoster
Copy link
Contributor

grantdfoster commented Jun 27, 2024

We are able to access the response times of the miners by changing deserialze to False in the forward function in the masa/validator/forwarder.py to access the raw synapse object... then:

synapses = await self.validator.dendrite(
    axons=[self.validator.metagraph.axons[uid] for uid in miner_uids],
    synapse=request,
    deserialize=False,
    timeout=timeout
)

responses = [synapse.response for synapse in synapses]
process_times = [synapse.dendrite.process_time for synapse in synapses]
bt.logging.info(f"PROCESS TIMES: {process_times}")
@grantdfoster grantdfoster added the feature New feature or task label Jun 27, 2024
@grantdfoster grantdfoster added task and removed feature New feature or task labels Jun 27, 2024
@grantdfoster
Copy link
Contributor Author

Branch already started showing the above code in action. https://github.com/masa-finance/masa-bittensor/tree/feat/miner-response-times

@grantdfoster grantdfoster changed the title Use miner response time to reward below threshold Calculate Miner Response Time for Utility Score Jul 2, 2024
@mudler mudler added the triage label Jul 15, 2024
@grantdfoster grantdfoster self-assigned this Jul 15, 2024
@grantdfoster grantdfoster linked a pull request Jul 16, 2024 that will close this issue
1 task
@mudler mudler added enhancement New feature or request and removed task labels Jul 17, 2024
@grantdfoster
Copy link
Contributor Author

Closing this as the feature has merged - we are tracking latency now along w/ our data validation scores. As we continue to refine and improve our scoring, latency can now become a secondary factor!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants