Hotfix/3.6.2/validator logit parameters #1057
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
isabella618033
approved these changes
Jan 17, 2023
* fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai>
eduardogr
reviewed
Jan 18, 2023
Comment on lines
+428
to
+452
| def prune_len (self) -> int: | ||
| r""" Returns PruneLen | ||
| Returns: | ||
| prune_len (int): | ||
| the number of pruned tokens from each requests | ||
| """ | ||
| @retry(delay=2, tries=3, backoff=2, max_delay=4) | ||
| def make_substrate_call_with_retry(): | ||
| with self.substrate as substrate: | ||
| return substrate.query( module='SubtensorModule', storage_function = 'ValidatorPruneLen' ).value | ||
| return make_substrate_call_with_retry() | ||
|
|
||
| @property | ||
| def logits_divergence (self) -> int: | ||
| r""" Returns logits_divergence | ||
| Returns: | ||
| logits_divergence (int): | ||
| the divergence value for logit distances, a measure for anomaly detection | ||
| """ | ||
| @retry(delay=2, tries=3, backoff=2, max_delay=4) | ||
| def make_substrate_call_with_retry(): | ||
| with self.substrate as substrate: | ||
| U64MAX = 18446744073709551615 | ||
| return substrate.query( module='SubtensorModule', storage_function = 'ValidatorLogitsDivergence' ).value/U64MAX | ||
| return make_substrate_call_with_retry() |
There was a problem hiding this comment.
I miss unit tests to cover this functions.
From my point of view, If we are hotfixing, we should define what we are covering creating the missing tests that was not existing and lead us to have the scenario we are fixing.
What do you think about this?
There was a problem hiding this comment.
Yes, I agree. In this case, the master branch was failing tests, so I pulled a few updates that fixed the tests. Those in of itself should have been a hotfix. I will update the description
opentaco
approved these changes
Jan 19, 2023
Eugene-hu
added a commit
that referenced
this pull request
Jan 24, 2023
* release/3.5.0 (#1006) * [feature] external axon flags (#887) * add external axon changes * add defaults for new axon flags * fix args to axon * default to internal ip and port if not specified * add new args and todefaults * add axon unit tests * add description for subtensor integration test * move test to unit test * create new test file add/update copyright notices * don't default to internal ip * add tests for setting the full_address * add tests for subtensor.serve w/external axon info * allow external port config to be None * switch to mock instead of patch * fix test mocks * change mock config create * fix/add default config * change asserts add mesage * fix check call args * fix mock config set * only call once * fix help wording * should be True * [fix] fixes unstake with max-stake flag (#905) * add equality to None to the balance class * add tests for the None case * local train bug fix (#906) * [feature] [CUDA solver] Add multi-GPU and ask for CUDA during btcli run (#893) * added cuda solver * boost versions to fix pip error * allow choosing device id * fix solution check to use keccak * adds params for cuda and dev_id to register * list devices by name during selection * add block number logging * fix calculation of hashrate * fix update interval default * add --TPB arg to register * add update_interval flag * switch back to old looping/work structure * change typing * device count is a function * stop early if wallet registered * add update interval and num proc flag * add better number output * optimize multiproc cpu reg keeping proc until solution * fix test * change import to cubit * fix import and default * up default should have default in CLI call * add comments about params * fix config var access * add cubit as extra * handle stale pow differently check registration after failure * restrict number of processes for integration test * fix stale check * use wallet.is_registered instead * attempt to fix test issue * fix my test * oops typo * typo again ugh * remove print out * fix partly reg test * fix if solution None * fix test? * fix patch * add args for cuda to subtensor * add cuda args to reregister call * add to wallet register the cuda args * fix refs and tests * add for val test also * fix tests with rereg * fix patch for tests * add mock_register to subtensor passed instead * move register under the check for isregistered * use patch obj instead * fit patch object * fix prompt * remove unneeded if * modify POW submit to use rolling submit again * add backoff to block get from network * add test for backoff get block * suppress the dev id flag if not set * remove dest so it uses first arg * fix pow submit loop * move registration status with * fix max attempts check * remove status in subtensor.register * add submit status * change to neuron get instead * fix count * try to patch live display * fix patch * . * separate test cases * add POWNotStale and tests * add more test cases for block get with retry * fix return to None * fix arg order * fix indent * add test to verify solution is submitted * fix mock call * patch hex bytes instead * typo :/ * fix print out for unstake * fix indexing into mock call * call indexing * access dict not with dot * fix other indent * add CUDAException for cubit * up cubit version * [Feature] ask cuda during btcli run (#890) * add ask for cuda reg config in btcli run * suppress unset arg * [Feature] [cuda solver] multi gpu (#891) * change diff display out * remove logging * check cubit support in the check config * allow 1 or more devices in flag * cuda flag should be suppress * modify how cpu count is found * make a solver base class * add a solverbase for CUDA * use mutli process kernel launching, one per GPU * move check under dot get accessor * Feature/cuda solver multi gpu (#892) * change diff display out * remove logging * check cubit support in the check config * allow 1 or more devices in flag * cuda flag should be suppress * modify how cpu count is found * make a solver base class * add a solverbase for CUDA * use mutli process kernel launching, one per GPU * move check under dot get accessor * add All gpus specification * continue trying reg after Stale * catch for OSX * dont use qsize * add test for continue after being stale * patch get_nowait instead of qsize * [Docs] Update old docs link to new link. Change discord invite to custom link (#915) * Update old docs link to new one This change deletes the old gitbooks documentation link and replaces it with the new one. * fix discord links Co-authored-by: Mac Thrasher <95183714+quac88@users.noreply.github.com> * Fix for test_neuron.py (#917) prevents downloading from huggingface * [feature] add --seed option to regen_hotkey (#916) * add seed option to regen hotkey * make seed optional and fix docstring * add tests for both coldkey and hotkey regen w/seed * oops, make seed optional * fix old test, add config.seed * circle ci version update and fix (#920) * Add test_phrases_split unit test Asserts that randomly instantiated compact_topk encodings can be correctly decoded to recover the original topk_tensor. * Update unravel_topk_token_phrases with faster implementation Replaces .tensor_split() with block indexing to avoid extra copy operations. * Rename test_phrases_split to test_random_topk_token_phrases * Unit tests cleanup (#922) * circle ci version update and fix * Test clean up * uncomment test and remove specific test * remove loguru and fix flaky tests * fix syncing * removing tokenizer equivalence + some bug fixes * moving old dataset test * Deactivate test_random_topk_token_phrases unit test * Create topk_tensor on origin device * Normalization Update (#909) * local train bug fix * normalization update * fix tests * remove test * updated normalization * Naming changes, bug fixes * subtensor update for max clip * max weight to a million * Fixes for ordering and comments * additional tests * string fix * numerical stability and testing updates * minor update for division by zero * Naming and spacing fixes * epsilon update * small fix * Adding development workflow documentation and script for bumping the version (#918) BIT-582 Adding development workflow documentation and script for bumping the version * Revert "Normalization Update (#909)" This reverts commit 3990a28. * Parachain registration (#912) * removed ws assumption * removing check * never registered * Fixed sched_getaffinity for mac osx * Started adding parachain support * [hot-fix] fix indent again. add test (#907) fix indent again. add test * Fixed registration check and first time registration * Removed old entrypoint list structure * Fixed unit tests Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: Ala Shaabana <ala@bittensor.com> Co-authored-by: Cameron Fairchild <cameron.fairchild@mail.utoronto.ca> * Bit 583 memory optimization v4 (#929) * set allowed receptor to be 0 in validator to not store any receptor * max_active receptro to 0 * fix * feature/BIT-579/Adding Prometheus (#928) * BIT-582 Adding development workflow documentation and script for bumping the version * BIT-579 Adding prometheus_client==0.14.1 to requirements * BIT-579 Removing wandb defaults from sample_configs * Revert "BIT-579 Removing wandb defaults from sample_configs" This reverts commit 2940cc7. * BIT-579 Starting prometheus code. Adding metric_exporter concept/element and its MetricsExporterFactory * BIT-579 Adding prometheus_client==0.14.1 to requirements * BIT-579 Removing wandb defaults from sample_configs * Revert "BIT-579 Removing wandb defaults from sample_configs" This reverts commit 2940cc7. * BIT-579 Starting prometheus code. Adding metric_exporter concept/element and its MetricsExporterFactory * Revert "BIT-579 Starting prometheus code. Adding metric_exporter concept/element and its MetricsExporterFactory" This reverts commit 8742d7f. * BIT-579 Adding _prometheus to bittensor * BIT-579 Adding prometheus code to bittensor/_neuron/text/core_* * BIT-579 Adding prometheus code to bittensor/_config/config_impl.py. Sends the config to the inprocess prometheus server if it exists. * BIT-579 Adding prometheus code to bittensor/_axon/* * BIT-579 Adding prometheus code to bittensor/_dendrite/* * BIT-579 Fixing syntax error * BIT-579 Fixing missing import: time * BIT-579 fixing typo * BIT-579 fixing test: unit_tests/bittensor_tests/test_neuron.py Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Dendrite Text Generate (#941) * adds generate to dendrite * vune fixes * extend readme Co-authored-by: unconst <jake@bittensor.com> * Subtensor and Normalization updates (#936) * local train bug fix * normalization update * fix tests * remove test * updated normalization * Naming changes, bug fixes * subtensor update for max clip * max weight to a million * Fixes for ordering and comments * additional tests * string fix * numerical stability and testing updates * minor update for division by zero * Naming and spacing fixes * epsilon update * small fix * additional subtensor parameters * remove print * help string fixes * Prometheus bug fix (#942) * local train bug fix * normalization update * fix tests * remove test * updated normalization * Naming changes, bug fixes * subtensor update for max clip * max weight to a million * Fixes for ordering and comments * additional tests * string fix * numerical stability and testing updates * minor update for division by zero * Naming and spacing fixes * epsilon update * small fix * additional subtensor parameters * remove print * help string fixes * small bug fix * [Fix] only reregister if flag is set (#937) * add test for expected reregister behaviour * add fix * pass passed args into earlier parse * fix test by using args * exit before actual register * use strtobool Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * [BIT 584] [feature] btcli register output stats not in place (#923) * add flags for output_in_place during registration * stop tracking best * refactor registration logging output * fix reregister from type bool * change in_place and use_cuda to strtobool * add param and defaults * fix reference before assignment * add new logger to cuda rege * pass param to btcli register call * oops * fix init * try slight timeout * try fix * oop * ? * fix use_cuda flag * add test for new use_cuda flag setup * use create pow to patch * all no prompt dev id * fix console.error * use lower for str comparison * call self register instead * add test for wallet register call * tests are for wallet reregister * fix typo * no self on top-level test * fix tests? * use reregister * typo in test * fix assert * fix assert * should be False * fix time output to use timedelta * add log verbose as option to reg output * should be action * fix typo * add missing function arg * fix spacing * fix flags * fix flags * fix test * should pass in args to config pre-parse * use None instead of NA Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * [Fix] multi cuda fix (#940) * adjust none end calculation * attempt to fix stop issue * modify stop * update nonce_start by correct amount * fix nonce init to only random and update * fix update amount * add start values * add test * try different hashrate calc * try EWMA for hash_rate * oops bad import * change name to worker * extract helper and modify comment * fix time now * catch Full * use a finished queue instead of times * move constants to function params * fix name of n * fix verbose log * allow --output_in_place * fix n * change to --no_ouput_in_place * fix test * Fix/pin wandb (#945) pin below 0.13.4 * [Fix] change bellagene entrypoint string (#938) dont add special case for network endpoint Co-authored-by: Ala Shaabana <shaabana@gmail.com> * Update dockerfile to current on dockerhub (#934) * update dockerfile to current on dockerhub * add netcat * move nvm install up to take advantage of caching * use pip * add nvm install checksum Co-authored-by: Ala Shaabana <shaabana@gmail.com> * Minor fixes (#955) minor fixes Co-authored-by: unconst <jake@bittensor.com> * Remove locals from cli and bittensor common (#947) remove locals from cli and bittensor common Co-authored-by: unconst <jake@bittensor.com> Co-authored-by: Ala Shaabana <shaabana@gmail.com> * [feature] Improve dataloader performance (#950) * use threadpool and futures for dataloader * add cli arg for max directories Co-authored-by: Joey Legere <joey@opentensor.ai> Co-authored-by: Ala Shaabana <shaabana@gmail.com> * No set weights (#959) * add no set weights * add no_set_weights * fix logging * comments fix; Co-authored-by: unconst <jake@bittensor.com> * Bit 590 backward fix (#957) * init * no local forward and remote forward overlap * clean up * saving remote * fix local size mismatch * clean up * fix * hidden state and causalLM deterministicness * rm backward * default to have dendrite backward * [Fix] add perpet hash rate and adjust alpha (#960) * perpet hash rate and adjust alpha * move reg code to registrationpy * try different calc * fix div by 0 * fix for cpu too * fix race * modify reg metrics output * fix test mock * oops * [Fix] stake conversion issue (#958) * modify balance arithm to cast to float first * fix tests to model this behavior * fix prompt spacing * should be value error * add test for eq balance other * add comment to explain change * fix tests * . * fix class * balance fix * try fix to staking * fix comments * add test for fix * fix test * fix impl * add tests with bad types * catch Typerror too and notimplerror * catch typeerror * . * catch valueerror also * initial commit * fix manager server no return * Dasyncio (#967) * initial commit * fix manager server no return Co-authored-by: unconst <jake@bittensor.com> * Update __init__.py * Moving to release * Release 3.4.2 (#969) * initial commit * fix manager server no return * Moving to release Co-authored-by: unconst <jake@bittensor.com> * fix failing test_forward_priority_2nd_request_timeout * Decrease validator moving average window Decrease validator moving average window from 20 (alpha=0.05) to 10 (alpha=0.1) steps. This parameter could probably eventually be set to alpha=0.2. The current 20-step window means that a server model change will take 20 steps * ~250 blocks/epoch * 12 sec = approx. 17 hours to reach full score in the validator neuron stats, because of the moving average slowly weighing in new model performance. 17 hours is probably too long, and it is also likely affecting registration immunity. * Release 3.4.2 (#972) * remove test_receptor test * fix tests Co-authored-by: unconst <jake@bittensor.com> * No version checking (#974) * no version checking * fix integration tests * remove print Co-authored-by: Thebes <jake@bittensor.com> * Promo suffix (#977) * initial commit * promo change to axon and dendrite Co-authored-by: Thebes <jake@bittensor.com> * Validator exit (#980) * remove test_receptor test * fix tests * fix valdidator exit Co-authored-by: unconst <jake@bittensor.com> * Support arbitrary gRPC request metadata order (#976) * Format AuthInterceptor using black * Parse request metadata as key value pairs * Use request method to black list calls * Fix request type provided on backward * Add type hints * Refactor signature parsing * [Fix] Dockerfile: clone the repo to install instead (#984) * clone the repo to install instead * no cd Co-authored-by: Ala Shaabana <shaabana@gmail.com> * Update bittensor version to 3.4.3 (cherry picked from commit 43110cf) * Catch precision errors in synapse forward responses Response serialization/deserialization introduces precision errors that may cause probability sums to exceed permissible boundaries. Now checks to see if precision errors are within established absolute tolerance (atol = 1e-6 currently). (cherry picked from commit d96b625) * Comment update for tensor size (cherry picked from commit 6dd06f9) * Fix/allow synapse all (#988) * allow set synapse All using flag * add test * use dot get * Mark registration threads as daemons (#998) Make solver processes daemons * Add response table to validator debugging * Add return_ops to parameters * Decode context and answer * Add validation length parameter * Itemize probabilities * Add debug prints * Change table formatting * Add extra tasks to response table * Debug add print * Remove batch_size parameter * Switch modulo order * Modify table format * Modify table format * Modify table format * Modify table format * Try table print to catch rich errors * Modify table title and caption * Add shapley_values_nxt column * Refactor response table functions * Correct responsive count * Format table caption * [BIT-599] Validator weight setting improvements (#1000) * Remove responsive prioritization from validator weight calculation Weight setting limitation based on responsive prioritization is no longer needed, so has been removed. Part of the original intent of the limitation was a chain storage concern of setting too many weights, but since the network has gained very high > 90% response rate the concern is moot. The downside of applying the limitation is that validators with longer step size artificially set fewer weights simply because they could not query the network in a single epoch. This introduced a counterproductive weight setting variability across validators. Responsiveness is scored in any case via a Shapley EMA zero-push penalty, so setting weights on non-responsive nodes still relay an accurate scoring. * Move metagraph_sync just before weight setting The metagraph is one epoch (~250 blocks) outdated by the time weight setting is done. This means that newly registered keys will have weights set based on the stats of the key just previously registered on the same UID. Weights will now be set more accurately when the metagraph is updated just before weight setting, which will reset stats of a UID that has changed ownership. * Update neuron stats table caption * Add metagraph register to validator Tracks new hotkey registrations on UIDs, and records statistics of previous hotkey. * Update validator epoch conditions Epoch overrun beyond blocks_per_epoch no longer needed, since weight setting no longer restricted to epoch responsives. Normal epoch duration is blocks_per_epoch if all UIDs have been queried try to query each UID at least once - assumes nucleus samples without replacement but keep minimum epoch duration at blocks_per_epoch * 12 sec block_period in case of subtensor outage causing invalid block readings to prevent fast repeated weight setting. Also logs while conditions per step * Cast phrase_cross_entropy tokens to int * Assert self.metagraph.n == len(self.neuron_hotkeys) * Round before casting to int in phrase_cross_entropy * Log epoch while condition details * Update validator weights console message * Consume validator nucleus UID queue fully Since epochs are now concluded at blocks_per_epoch many validators will have unqueried UIDs still in queue. It is better that these are retained and consumed in the next epoch, since this will ensure all UIDs are queried over a cycle that may involve successive epochs. The inefficiency introduced is that if the queue has to be refilled in the same epoch, then a UID may be queried twice, although this is preferred over the risk of not querying a UID at all if the remaining queue is not fully consumed even if another epoch is required. * No cache: metagraph.sync(cached=False) Turns off metagraph cache, now requires ~10 minutes (on local) to update metagraph before weight setting, but typically provides more recent values that can catch UID ownership changes. * Add validator --neuron.metagraph_cached When flag --neuron.metagraph_cached is set the validator uses metagraph.sync(cached=True). * Record block before validator neuron register entry * Force validators without local subtensor to use cached metagraph * Incorporate __blocktime__ and remove asserts * Refactor neuron_register to neuron_changes and add flag * Use cached metagraph.sync() * Remove unused print_neuron_stats flag * Strip lead 0. from table float displays * Increase synergy table display precision * Increase synergy table display precision * Format validator query response table * Improve release scripts and adding some labels to dockerfile #1004 (#1005) * Pinning requirements versions in requirements/prod.txt * Improve release scripts. Generating RELEASING.md document for release releasing guidelines. Adding more labels to dockerfile Removing dockerfile label bittensor.packages * Removing dockerfile label bittensor.dependencies.versions.cudnn * Removing file that came from a wrong rebase * Renaming RELEASING.md to RELEASE_GUIDELINES.md * Modifying release scripts so versioning is independent of the relese process. Modifying RELEASE_GUIDELINES adding more information * Modifying RELEASE_GUIDELINES adding more information * Fixing the versioning script. Modifying RELEASE_GUIDELINES.md * Version: 3.5.0. Applying ./scripts/release/versioning.sh --update minor -A Co-authored-by: Cameron Fairchild <cameron.fairchild@mail.utoronto.ca> Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: Mac Thrasher <95183714+quac88@users.noreply.github.com> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: opentaco <93473497+opentaco@users.noreply.github.com> Co-authored-by: Ala Shaabana <shaabana@gmail.com> Co-authored-by: Ala Shaabana <ala@bittensor.com> Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> Co-authored-by: unconst <jake@bittensor.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: joeylegere <joeylegere@gmail.com> Co-authored-by: Joey Legere <joey@opentensor.ai> Co-authored-by: Adrian-Stefan Mares <36161392+adriansmares@users.noreply.github.com> * [hotfix] pin scalecodec lower (#1013) * Modifying Dockerfile to build bittensor from repository version and not from github (#1016) * Modifying Dockerfile to build bittensor from repository version and not git clone the github repo. Updating version to 3.5.1 * CircleCI check to check that version was updated * CircleCI check to check that version was updated * CircleCI check to check that version was updated * CircleCI check to check that version was updated * CircleCI check to check that version was updated * Updating version to 3.6.0 running './scripts/release/versioning.sh --update minor -A' * [BIT-602] Update scaling power from subtensor (#1027) Update power from subtensor always Since self.config.nucleus.scaling_law_power is updated from default -1 at nucleus init, the condition here at epoch start needs to be removed and has to update from subtensor always. * Fix extras for wheel package * Update version to 3.6.1 * Update README.md * Hotfix/3.6.2/validator logit parameters (#1057) * additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> * fixing no_version_checking error * updating version to 3.6.3 Co-authored-by: Cameron Fairchild <cameron.fairchild@mail.utoronto.ca> Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: Mac Thrasher <95183714+quac88@users.noreply.github.com> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: opentaco <93473497+opentaco@users.noreply.github.com> Co-authored-by: Ala Shaabana <shaabana@gmail.com> Co-authored-by: Ala Shaabana <ala@bittensor.com> Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> Co-authored-by: unconst <jake@bittensor.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: joeylegere <joeylegere@gmail.com> Co-authored-by: Joey Legere <joey@opentensor.ai> Co-authored-by: Adrian-Stefan Mares <36161392+adriansmares@users.noreply.github.com>
eduardogr
pushed a commit
that referenced
this pull request
Jan 24, 2023
* additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com>
eduardogr
pushed a commit
that referenced
this pull request
Jan 24, 2023
* additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com>
camfairchild
added a commit
that referenced
this pull request
Feb 2, 2023
* Update README.md * Hotfix/3.6.2/validator logit parameters (#1057) * additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> * fixing no_version_checking error * updating version to 3.6.3 --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: Eugene <etesting007@gmail.com>
eduardogr
pushed a commit
that referenced
this pull request
Feb 2, 2023
* additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com>
unconst
added a commit
that referenced
this pull request
Mar 20, 2023
* wallet config update for cuda * fix test_axon.py * [BIT-619] ValidatorPermit integration (#1048) Add ValidatorPermit NeuronInfo * fix main.py incompatible with netuid * fix test_endpoint * general improvements to subtensor naming * fix test_dendrite.py * fix test_receptor * fix test_wallet * fix test_server_compression * fix test_forward_backward * fix test_wandb * fix test_network_utils * fix endpoint to new * connection requriement * fix stake is None * switch back to old stake format * use total stake for stake logs * . * add comment about field, use dict * . * use proper stake * add todo and fix tests * use total_stake instead * . * fix tests with netuid * use netuid or neuron.netuid * try using config.netuid as well * set config in test * use unittest and explicit config set * try using config.netuid as well * set config in test * use unittest and explicit config set * fix no password flag * use get_neuron_for_pubkey_and_subnet * add netuid param * fix mock diff * AttributeError: comman -> command * don't save stake to metagraph save * try fix by mocking with a constant * fix unstake test * use colkeypub * dont use remote on sub mock * fix unstake tests * fix cli stake tests * remove no cache and tests * use total stake for neuron from dict * add netuid to test config * change default format to ws:// * add copyright notices * add unit test for from neurons * remove forward test * add netuid optional to sync * updated call in benchmark * make mock helper * add mock call override for neurons * use mock call instead * update copyright notices * fix ss58 byte length * fix test for wandb * fix test decl * add ws to nobu for tests * Fix/neuron netuid arg (#1056) * use netuid instead of neuron netuid * add check for dataset in del * use netuid only * also check for dendrite * return bool * add test helper get mock neuron by uid * fix some subtensor tests * fix axon test, mock wallet * remove connect tests * use netuid * fix no axon info on inspect * add error for endpoint from null neuron * support SubnetInfo RPC (#1049) . * Support delegateInfo RPC (#1059) * move helpers into utils * implement delegate info rpc * move u8 to hk to utils * fix ss58 to bytes * convert bytes to list int * Fix/only explorer if known network (#1037) * add explorer urls to init and check before print * extract to util function instead * add util functions * add tests * use more flexible format * fix tests add ddt * add finney explorer url * fix func call * oops * add more mocks * add netuid and network mock * patch everything * mock payment info * patch query * fix mock and check patch attr * add netuid to default test config * fix test * notify user that hotkey is not registered (#1030) * notify user that hotkey is not registered * Revert "notify user that hotkey is not registered" This reverts commit 9e103aa. * notify if not registered * bool fix for btcli * add call for validator permit (#1061) * Remove Py 3.7 (#1067) * remove install python3.7 in dockerfile * up req to 3.8 * remove from circleci * fix tag in setup * add py3 only tag * Catch subnet doesn't exist (#1070) * catch diff None * catch subnet does not exist in create_pow * check subnet exists during reg * check for subnet exists * check netuid before run neuron * Move hotkeys flag (#1071) * nominate doesn't need these flags * fix unstake * remove from wallet args * fix stake * fix overview * fix tests * [fix] rename ss58_hotkey to hotkey_ss58 (#1074) * rename ss58_hotkey to hotkey_ss58 * fix call * change message output * [fix] instantiate subtensor before check for netuids (#1072) make subtensor before check to netuid * fix f string error * move rao symbol to init * mock is_hotkey_registered_any * fix mock without mock subtensor * modify args for mocking * fix test for new args * fix f string error * [BIT-626] Add neuron_info fields for ValidatorTrust and WeightConsensus (#1073) * Add neuron_info fields for ValidatorTrust and WeightConsensus * Change some neuron stats from u64 to u16 * Correct type hints in wallet Return wallet field None when neuron is None. * Remove wallet.ip NeuronInfo doesn't seem to have an ip field anymore. * fix type reg * fix type hints * fix get mock neuron * fix mock_subtensor neurons * fix neuron from json * [fix] [ci] modify cache key (#1075) * modify cache key * install the dev extra too * use + separator * Add init for extrinsics submod (#1077) add init file * Fix is_registered call (#1080) . * [Fix] comment out addition of new neuron fields (#1081) comment out addition of new neuron fields * [hotfix][3.6.3] Merging back hotfix into finney (#1065) * Update README.md * Hotfix/3.6.2/validator logit parameters (#1057) * additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> * fixing no_version_checking error * updating version to 3.6.3 --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: Eugene <etesting007@gmail.com> * Adding CHANGELOG and updating .circleci/config.yml Start adding release workflow to circleci Adding release job without applying release Adding 3.6.3 release notes to CHANGELOG.md Improving release script to be able to execute a dry run with no secrets Enabling circleci to build docker image Reorganizing circleci workflows Downgrade version now that tests with circleci are done Improve release documentation and scripts * Server update for finney (#1053) * fixes for get_external_ip * fix ordering of external APIs * refactoring the server code * remove debug prints and fixed tests * fixes for the test_neuron * updated logging for servers * remove axon wandb * remove wandb * additional logging * merge from finney * additional logging for the server * fixes for validator * remove pdb * config.netuid * improved logging message * bug fixes for core_validator * ip string fix --------- Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> * fix bittensor dir path (#1088) * update substrate interface version (#1087) * Fix/get ss58 format (#1090) * use ss58 get format * fix keyfile seed_hex * Restore from json (#1092) * allow restore from json backup * fix check config * use overload for function sig * Add undelegate command (#1076) * change to balance check * add delegateunstake command * fix type of arg * move delegate pull * update torch version to 1.13.1 and docker to py3.10 (#1089) * update torch version to 13.1 * down to 1.13.0 * back to 1.13.1 * fix bittensor dir path (#1088) * update substrate interface version (#1087) * down to 1.13.0 * back to 1.13.1 * Fix pad_token not set * bring working with finney and mock branch * move zombienet things * remove client tests * add unique keypairs per test * use mock chain to setup tests for stake * use coldkeypub * use total_stake for overview * [BIT-630] Add netuid to validator console status (#1102) Add netuid to validator console status * undelegate * Dataset API cleanup (#1106) pluralize dataset_names for dataset api, add checks and allow strings * Release 3.7 subtensor integration (#1105) * adds back old subtensor, metagraph, and wallet * naka wallet add netuid param * naka subtensor add netuid param * validator adapt to netuid param * btcli list fix * btcli naka query fix * btcli finney query fix * help & update fix * weights fix * cli finney weight fix * btcli wallets fix * cli fix list_subnet * fixed btcli new hotkey * revert unecessary finney check * btcli stake and unstake fix * btcli naka stake/unstake fix * btcli naka metagraph fix * btcli naka query fix * btcli naka weights fix * removed uncessary finney check * version key for subtensor set_weights * remove duplicated deepcopy * validator version 1 -> version_as_int * get_n -> get_neuron_num * reverted validator version_key to 1 * removed deepcopy * removed uncessary copy import Co-authored-by: Eduardo García <garciaruiz.edu+github@gmail.com> --------- Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: Eduardo García <garciaruiz.edu+github@gmail.com> * Release 3.7 replace paratensor (#1109) * adds back old subtensor, metagraph, and wallet * naka wallet add netuid param * naka subtensor add netuid param * validator adapt to netuid param * btcli list fix * btcli naka query fix * btcli finney query fix * help & update fix * weights fix * cli finney weight fix * btcli wallets fix * cli fix list_subnet * fixed btcli new hotkey * revert unecessary finney check * btcli stake and unstake fix * btcli naka stake/unstake fix * btcli naka metagraph fix * btcli naka query fix * btcli naka weights fix * removed uncessary finney check * version key for subtensor set_weights * remove paratensor with subtensor * remove copy --------- Co-authored-by: isabella618033 <isabella618033@gmail.com> * remove zombienet use new subv3 * fix flags * module name to Subtensor * change module name * oops SubtensorModule * clear mock db before start of mock chain * fix rm dir * fix generate mock keypair * make same coldkey * verify all str * fix coldkey keypair as same * fix use keyword * fix own hotkey check * fix delegate check * progress fixing tests * adding --netuid to subtensor parser * overview fix * default use finney for network (#1110) * Fix unit (#1111) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * Fix stake is none (#1112) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix stake output for inspect (#1113) * Security update 3.7.0 (#1103) * security update * recieve message length * neuron hotkey blacklist * add checks during epoch * seq2seq updates * fixes for comments * naka metagraph fix * remove fee call (#1115) * Overview and Transfer tests (#1114) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * Fix metagraph output (#1116) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * fix metagraph output and add test * Neuron metagraph fix (#1118) * fix * fix metagraph stake -> S * (un)stake CLI tests (#1117) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * fix metagraph output and add test * move test that can be mocked * fix stake and unstake tests * don't try endpoint if null neuron * update finney endpoint (#1119) update endpoint * Add hyp params (#1121) * add info * Fix how metagraph chooses network arg * add to and from parameter dict * add hook to save info to torch file * validator trust (#1120) * fixes for overview + server * self subtensor * Add prometheus extrinsic (#1124) * init prometheus extrinsic * core_server adapt * prometheus adapt * subtensor adapt * extrinsic fix * prometheus extrinsic cleanup * clean up * clean up * adding test * remove upnpc and added comment * serving to its own functio * added test * removed prompt param * Add prometheus extrinsic (#1125) * init prometheus extrinsic * core_server adapt * prometheus adapt * subtensor adapt * extrinsic fix * prometheus extrinsic cleanup * clean up * clean up * adding test * remove upnpc and added comment * serving to its own functio * added test * removed prompt param * removed prompt doc string * removed all prometheus * lol * . * validator fix * btcli burned_register (#1123) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * fix metagraph output and add test * move test that can be mocked * fix stake and unstake tests * don't try endpoint if null neuron * use default netuid of 1 * use subtensor get bal * update testing bin * default finney for reg check * add burned register command * add test for burned reg * sign with coldkey instead * [BIT-634] Remove `weight_consensus` and fully include `validator_trust` (#1127) Remove weight_consensus and fully include validator_trust * Add prometheus already served check (#1130) * moved prometheus to serve with axon * adding prometheus already served check * printing prometheus already served * fix * fix * . * server fix * redundant output * 3.7 server fix (#1126) * console fixes * fixes for .stake * neuron stake change * moving comment * prometheus port check * Use new rpc format (#1131) * get custom rpc info from vec u8 * include check in parser * use cleaner none/[] check * use new weight and bond format * Revert "Use new rpc format" (#1132) Revert "Use new rpc format (#1131)" This reverts commit ab68455. * Use new rpc format (#1133) * get custom rpc info from vec u8 * include check in parser * use cleaner none/[] check * use new weight and bond format * Use scalecodec for custom RPCs (#1134) * . * use new weights/bonds encoding * typo * ss58 encode accountid * use compact ints for custom rpcs * oops * use compact for pruning score too * move type reg * pruning score for null neuron * Fix prometheus serve (#1136) * Send netuid * fix typo * nit changes to loggin and config warning * Add netuid to path (#1137) * added netuid to path * prettier logger info * Fix validator weights table metagraph_n (#1138) * Overview emission per block and undelegate (#1140) * emission per block * delegation fix * add burn to registry (#1141) * Fix scalecodec issue subnetinfo (#1143) . * More delegate info (#1142) * add more delegate info * to to from * don't list take * Add more delegate info for rpcs * Change ValidatorLogitsDivergence to u16 (#1139) * Change ValidatorLogitsDivergence to u16 * Fix wrong hyperparam * Fix hyperparam type * Fix scaling law powers (#1145) * add delegates index * add delegates info.json * add my delegates * update with taostats info (#1154) * update with taostats info * add Vune validator * Update delegates.json --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Recycle_register (#1152) recycle Co-authored-by: “quac88” <“mac2@thrasher.com”> * Revert "Recycle_register (#1152)" (#1159) This reverts commit 309d430. * Make list prettier (#1147) * Prometheus dont error when off (#1153) * use upper case for level * dont serve if OFF and dont error * Default to finney (#1155) * wallet default to finney * default to finney in server and validator * version key fixes (#1148) * Undelegate fix (#1165) * fixes * list as percent in list * list subnets fix * normalize connect req --------- Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * recycle register 2 (#1164) * recycle * change burn functions and classes to recycle --------- Co-authored-by: “quac88” <“mac2@thrasher.com”> * Update delegates.json (#1156) This commit purpose is to add a TaoPolishNode to the validators list * Version 3.7 update (#1167) * Update README.md * version update + bug fix for server --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * adds total_daily_return to delegateInfo (#1151) * add delegated rpc (#1150) * Neuron info lite RPC (#1149) * add to chaindata * add lite methods to subtensor --------- Co-authored-by: Eugene <etesting007@gmail.com> * Update delegates.json * Add taostats.io to delegates (#1171) Verified True Validator information: {"5Hddm3iBFD2GLT5ik7LZnT3XJUnRnN8PoeCFgGQgawUVKNm8": {"name": "\u03c4aos\u03c4a\u03c4s", "url": "taostats.io", "description": "Supporting the bittensor eco-system through data provision, statistics and analytics."}} Validator signature: 1e4107f3f5b5282ab1b168e4fe0a5e1580884dc45fe6d4487a88f7bdca078c23535ddb292c913a6b56fcf59971f5aa4b61653acae7a363f25864562f9306b181 * chore: update the TaoStation delegate (#1163) * Update delegates.json * Update WaveTensor delegates.json (#1166) Verified True Validator information: {"5DCc5oHA6c1Lpt9R6T1xU8jJGTMvvwBqD1yGX67sL8dHUcga": {"name": "WaveTensor", "url": "https://twitter.com/wavetensor", "description": "A new Wave is coming, join the AI revolution on top of Bittensor by staking with us."}} Validator signature: 5e072b4752ccbdd4ca3298f336284dfdab347dd133850f4d2f9873e7ea59bd2a8f201732842ec79d2bab3abaf133a06b6bd992940389e42d57802c9b8f855889 Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Update delegates.json * Overview dont count stake twice (#1175) * dont count stake twice * don't count keys twice * remove some tqdm * add netuid flag for overview * use new rpc and catch file error (#1176) * add validator info * add foundry digital validator (#1172) * add foundry digital validator add foundry digital validator * Update delegates.json --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Update delegates.json (#1170) Validator signature: b41db5092b7e6fde8eeab5133527a334f7b82498eaa8a1c6e59d474af64a0663ca334013a323dfa2c5213e97c8468ff3c868d3d64cb73fdab6a68e649e3d1187 Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * No advertising about rakebacks (#1177) * Adding TaoStaking info to delegates (#1169) Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * add runpod as validator (#1173) Verified True Validator information: {"5DPEpUTZn94sgYXH3sdXxsVvb46m3iEvg8aZwX7SMDowivzB": {"name": "RunPod", "url": "https://runpod.io", "description": "GPU Cloud built for AI. We plan to introduce perks for those who stake."}} Validator signature: 806c88c327a6488d3fa05628b2e1c06d8688ebda4c50e0627704cb02c6a7a044aed6625bd132e88a333436829fc5dc2c2d5cda73f1aee90351916ba16ff7518b Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * use neurons lite for overview (#1179) * Remove weights underflow fix (#1178) * Update __init__.py * Update __init__.py * fix delegates * remove check network --------- Co-authored-by: isabella618033 <isabella618033@gmail.com> Co-authored-by: Joey Legere <joey@opentensor.ai> Co-authored-by: opentaco <93473497+opentaco@users.noreply.github.com> Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: unconst <jake@bittensor.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: Eduardo García <garciaruiz.edu+github@gmail.com> Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: Eduardo <garciaruiz.edu@gmail.com> Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> Co-authored-by: joeylegere <joeylegere@gmail.com> Co-authored-by: Mac Thrasher <95183714+quac88@users.noreply.github.com> Co-authored-by: “quac88” <“mac2@thrasher.com”> Co-authored-by: piotrekraw <piotrekraw@o2.pl> Co-authored-by: mog <mog@mogmachine.com> Co-authored-by: Philippe Schommers <philippe@schommers.be> Co-authored-by: nikogold78 <128321290+nikogold78@users.noreply.github.com> Co-authored-by: teast21 <109384972+teast21@users.noreply.github.com> Co-authored-by: Alex <96243054+wildcommunist@users.noreply.github.com> Co-authored-by: Jermaine <jermaine150@gmail.com> Co-authored-by: Pardeep Singh <ps0296@gmail.com>
Eugene-hu
added a commit
that referenced
this pull request
Mar 23, 2023
* AttributeError: comman -> command * don't save stake to metagraph save * try fix by mocking with a constant * fix unstake test * use colkeypub * dont use remote on sub mock * fix unstake tests * fix cli stake tests * remove no cache and tests * use total stake for neuron from dict * add netuid to test config * change default format to ws:// * add copyright notices * add unit test for from neurons * remove forward test * add netuid optional to sync * updated call in benchmark * make mock helper * add mock call override for neurons * use mock call instead * update copyright notices * fix ss58 byte length * fix test for wandb * fix test decl * add ws to nobu for tests * Fix/neuron netuid arg (#1056) * use netuid instead of neuron netuid * add check for dataset in del * use netuid only * also check for dendrite * return bool * add test helper get mock neuron by uid * fix some subtensor tests * fix axon test, mock wallet * remove connect tests * use netuid * fix no axon info on inspect * add error for endpoint from null neuron * support SubnetInfo RPC (#1049) . * Support delegateInfo RPC (#1059) * move helpers into utils * implement delegate info rpc * move u8 to hk to utils * fix ss58 to bytes * convert bytes to list int * Fix/only explorer if known network (#1037) * add explorer urls to init and check before print * extract to util function instead * add util functions * add tests * use more flexible format * fix tests add ddt * add finney explorer url * fix func call * oops * add more mocks * add netuid and network mock * patch everything * mock payment info * patch query * fix mock and check patch attr * add netuid to default test config * fix test * notify user that hotkey is not registered (#1030) * notify user that hotkey is not registered * Revert "notify user that hotkey is not registered" This reverts commit 9e103aa. * notify if not registered * bool fix for btcli * add call for validator permit (#1061) * Remove Py 3.7 (#1067) * remove install python3.7 in dockerfile * up req to 3.8 * remove from circleci * fix tag in setup * add py3 only tag * Catch subnet doesn't exist (#1070) * catch diff None * catch subnet does not exist in create_pow * check subnet exists during reg * check for subnet exists * check netuid before run neuron * Move hotkeys flag (#1071) * nominate doesn't need these flags * fix unstake * remove from wallet args * fix stake * fix overview * fix tests * [fix] rename ss58_hotkey to hotkey_ss58 (#1074) * rename ss58_hotkey to hotkey_ss58 * fix call * change message output * [fix] instantiate subtensor before check for netuids (#1072) make subtensor before check to netuid * fix f string error * move rao symbol to init * mock is_hotkey_registered_any * fix mock without mock subtensor * modify args for mocking * fix test for new args * fix f string error * [BIT-626] Add neuron_info fields for ValidatorTrust and WeightConsensus (#1073) * Add neuron_info fields for ValidatorTrust and WeightConsensus * Change some neuron stats from u64 to u16 * Correct type hints in wallet Return wallet field None when neuron is None. * Remove wallet.ip NeuronInfo doesn't seem to have an ip field anymore. * fix type reg * fix type hints * fix get mock neuron * fix mock_subtensor neurons * fix neuron from json * [fix] [ci] modify cache key (#1075) * modify cache key * install the dev extra too * use + separator * Add init for extrinsics submod (#1077) add init file * Fix is_registered call (#1080) . * [Fix] comment out addition of new neuron fields (#1081) comment out addition of new neuron fields * [hotfix][3.6.3] Merging back hotfix into finney (#1065) * Update README.md * Hotfix/3.6.2/validator logit parameters (#1057) * additional parameters * fixed naming to logit divergence * versioning and fixes * typo fixes * bug fixes * Tests cli fixes (#1058) * fix btcli list with wallet.path (#1036) fix path join * remove mock subtensor and replace with mock calls * additional fixes * mock wallet Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Log prune_len and logits_divergence * Always get latest prune_len Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> * fixing no_version_checking error * updating version to 3.6.3 --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: Eugene <etesting007@gmail.com> * Adding CHANGELOG and updating .circleci/config.yml Start adding release workflow to circleci Adding release job without applying release Adding 3.6.3 release notes to CHANGELOG.md Improving release script to be able to execute a dry run with no secrets Enabling circleci to build docker image Reorganizing circleci workflows Downgrade version now that tests with circleci are done Improve release documentation and scripts * Server update for finney (#1053) * fixes for get_external_ip * fix ordering of external APIs * refactoring the server code * remove debug prints and fixed tests * fixes for the test_neuron * updated logging for servers * remove axon wandb * remove wandb * additional logging * merge from finney * additional logging for the server * fixes for validator * remove pdb * config.netuid * improved logging message * bug fixes for core_validator * ip string fix --------- Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> * fix bittensor dir path (#1088) * update substrate interface version (#1087) * Fix/get ss58 format (#1090) * use ss58 get format * fix keyfile seed_hex * Restore from json (#1092) * allow restore from json backup * fix check config * use overload for function sig * Add undelegate command (#1076) * change to balance check * add delegateunstake command * fix type of arg * move delegate pull * update torch version to 1.13.1 and docker to py3.10 (#1089) * update torch version to 13.1 * down to 1.13.0 * back to 1.13.1 * fix bittensor dir path (#1088) * update substrate interface version (#1087) * down to 1.13.0 * back to 1.13.1 * Fix pad_token not set * bring working with finney and mock branch * move zombienet things * remove client tests * add unique keypairs per test * use mock chain to setup tests for stake * use coldkeypub * use total_stake for overview * [BIT-630] Add netuid to validator console status (#1102) Add netuid to validator console status * undelegate * Dataset API cleanup (#1106) pluralize dataset_names for dataset api, add checks and allow strings * Release 3.7 subtensor integration (#1105) * adds back old subtensor, metagraph, and wallet * naka wallet add netuid param * naka subtensor add netuid param * validator adapt to netuid param * btcli list fix * btcli naka query fix * btcli finney query fix * help & update fix * weights fix * cli finney weight fix * btcli wallets fix * cli fix list_subnet * fixed btcli new hotkey * revert unecessary finney check * btcli stake and unstake fix * btcli naka stake/unstake fix * btcli naka metagraph fix * btcli naka query fix * btcli naka weights fix * removed uncessary finney check * version key for subtensor set_weights * remove duplicated deepcopy * validator version 1 -> version_as_int * get_n -> get_neuron_num * reverted validator version_key to 1 * removed deepcopy * removed uncessary copy import Co-authored-by: Eduardo García <garciaruiz.edu+github@gmail.com> --------- Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: Eduardo García <garciaruiz.edu+github@gmail.com> * Release 3.7 replace paratensor (#1109) * adds back old subtensor, metagraph, and wallet * naka wallet add netuid param * naka subtensor add netuid param * validator adapt to netuid param * btcli list fix * btcli naka query fix * btcli finney query fix * help & update fix * weights fix * cli finney weight fix * btcli wallets fix * cli fix list_subnet * fixed btcli new hotkey * revert unecessary finney check * btcli stake and unstake fix * btcli naka stake/unstake fix * btcli naka metagraph fix * btcli naka query fix * btcli naka weights fix * removed uncessary finney check * version key for subtensor set_weights * remove paratensor with subtensor * remove copy --------- Co-authored-by: isabella618033 <isabella618033@gmail.com> * remove zombienet use new subv3 * fix flags * module name to Subtensor * change module name * oops SubtensorModule * clear mock db before start of mock chain * fix rm dir * fix generate mock keypair * make same coldkey * verify all str * fix coldkey keypair as same * fix use keyword * fix own hotkey check * fix delegate check * progress fixing tests * adding --netuid to subtensor parser * overview fix * default use finney for network (#1110) * Fix unit (#1111) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * Fix stake is none (#1112) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix stake output for inspect (#1113) * Security update 3.7.0 (#1103) * security update * recieve message length * neuron hotkey blacklist * add checks during epoch * seq2seq updates * fixes for comments * naka metagraph fix * remove fee call (#1115) * Overview and Transfer tests (#1114) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * Fix metagraph output (#1116) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * fix metagraph output and add test * Neuron metagraph fix (#1118) * fix * fix metagraph stake -> S * (un)stake CLI tests (#1117) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * fix metagraph output and add test * move test that can be mocked * fix stake and unstake tests * don't try endpoint if null neuron * update finney endpoint (#1119) update endpoint * Add hyp params (#1121) * add info * Fix how metagraph chooses network arg * add to and from parameter dict * add hook to save info to torch file * validator trust (#1120) * fixes for overview + server * self subtensor * Add prometheus extrinsic (#1124) * init prometheus extrinsic * core_server adapt * prometheus adapt * subtensor adapt * extrinsic fix * prometheus extrinsic cleanup * clean up * clean up * adding test * remove upnpc and added comment * serving to its own functio * added test * removed prompt param * Add prometheus extrinsic (#1125) * init prometheus extrinsic * core_server adapt * prometheus adapt * subtensor adapt * extrinsic fix * prometheus extrinsic cleanup * clean up * clean up * adding test * remove upnpc and added comment * serving to its own functio * added test * removed prompt param * removed prompt doc string * removed all prometheus * lol * . * validator fix * btcli burned_register (#1123) * fix symbol unicode * add alias for --delegate_ss58 * fix patch * add linux bin * . * nominate test works * delegate stake works * delegate unstake works * remove todo * fix mock of get all hotkeys * use finney for network name and _mock for config * fix add arg * add rich text console helpers * overview test for subnets * add case for overview * add overview test for unregistered subnet 1 and 2 * add transfer test * add test for failed transfer * transfer test with check for error output * fix metagraph output and add test * move test that can be mocked * fix stake and unstake tests * don't try endpoint if null neuron * use default netuid of 1 * use subtensor get bal * update testing bin * default finney for reg check * add burned register command * add test for burned reg * sign with coldkey instead * [BIT-634] Remove `weight_consensus` and fully include `validator_trust` (#1127) Remove weight_consensus and fully include validator_trust * Add prometheus already served check (#1130) * moved prometheus to serve with axon * adding prometheus already served check * printing prometheus already served * fix * fix * . * server fix * redundant output * 3.7 server fix (#1126) * console fixes * fixes for .stake * neuron stake change * moving comment * prometheus port check * Use new rpc format (#1131) * get custom rpc info from vec u8 * include check in parser * use cleaner none/[] check * use new weight and bond format * Revert "Use new rpc format" (#1132) Revert "Use new rpc format (#1131)" This reverts commit ab68455. * Use new rpc format (#1133) * get custom rpc info from vec u8 * include check in parser * use cleaner none/[] check * use new weight and bond format * Use scalecodec for custom RPCs (#1134) * . * use new weights/bonds encoding * typo * ss58 encode accountid * use compact ints for custom rpcs * oops * use compact for pruning score too * move type reg * pruning score for null neuron * Fix prometheus serve (#1136) * Send netuid * fix typo * nit changes to loggin and config warning * Add netuid to path (#1137) * added netuid to path * prettier logger info * Fix validator weights table metagraph_n (#1138) * Overview emission per block and undelegate (#1140) * emission per block * delegation fix * add burn to registry (#1141) * Fix scalecodec issue subnetinfo (#1143) . * More delegate info (#1142) * add more delegate info * to to from * don't list take * Add more delegate info for rpcs * Change ValidatorLogitsDivergence to u16 (#1139) * Change ValidatorLogitsDivergence to u16 * Fix wrong hyperparam * Fix hyperparam type * Fix scaling law powers (#1145) * add delegates index * add delegates info.json * add my delegates * update with taostats info (#1154) * update with taostats info * add Vune validator * Update delegates.json --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Recycle_register (#1152) recycle Co-authored-by: “quac88” <“mac2@thrasher.com”> * Revert "Recycle_register (#1152)" (#1159) This reverts commit 309d430. * Make list prettier (#1147) * Prometheus dont error when off (#1153) * use upper case for level * dont serve if OFF and dont error * Default to finney (#1155) * wallet default to finney * default to finney in server and validator * version key fixes (#1148) * Undelegate fix (#1165) * fixes * list as percent in list * list subnets fix * normalize connect req --------- Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * recycle register 2 (#1164) * recycle * change burn functions and classes to recycle --------- Co-authored-by: “quac88” <“mac2@thrasher.com”> * Update delegates.json (#1156) This commit purpose is to add a TaoPolishNode to the validators list * Version 3.7 update (#1167) * Update README.md * version update + bug fix for server --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * adds total_daily_return to delegateInfo (#1151) * add delegated rpc (#1150) * Neuron info lite RPC (#1149) * add to chaindata * add lite methods to subtensor --------- Co-authored-by: Eugene <etesting007@gmail.com> * Update delegates.json * Add taostats.io to delegates (#1171) Verified True Validator information: {"5Hddm3iBFD2GLT5ik7LZnT3XJUnRnN8PoeCFgGQgawUVKNm8": {"name": "\u03c4aos\u03c4a\u03c4s", "url": "taostats.io", "description": "Supporting the bittensor eco-system through data provision, statistics and analytics."}} Validator signature: 1e4107f3f5b5282ab1b168e4fe0a5e1580884dc45fe6d4487a88f7bdca078c23535ddb292c913a6b56fcf59971f5aa4b61653acae7a363f25864562f9306b181 * chore: update the TaoStation delegate (#1163) * Update delegates.json * Update WaveTensor delegates.json (#1166) Verified True Validator information: {"5DCc5oHA6c1Lpt9R6T1xU8jJGTMvvwBqD1yGX67sL8dHUcga": {"name": "WaveTensor", "url": "https://twitter.com/wavetensor", "description": "A new Wave is coming, join the AI revolution on top of Bittensor by staking with us."}} Validator signature: 5e072b4752ccbdd4ca3298f336284dfdab347dd133850f4d2f9873e7ea59bd2a8f201732842ec79d2bab3abaf133a06b6bd992940389e42d57802c9b8f855889 Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Update delegates.json * Overview dont count stake twice (#1175) * dont count stake twice * don't count keys twice * remove some tqdm * add netuid flag for overview * use new rpc and catch file error (#1176) * add validator info * add foundry digital validator (#1172) * add foundry digital validator add foundry digital validator * Update delegates.json --------- Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * Update delegates.json (#1170) Validator signature: b41db5092b7e6fde8eeab5133527a334f7b82498eaa8a1c6e59d474af64a0663ca334013a323dfa2c5213e97c8468ff3c868d3d64cb73fdab6a68e649e3d1187 Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * No advertising about rakebacks (#1177) * Adding TaoStaking info to delegates (#1169) Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * add runpod as validator (#1173) Verified True Validator information: {"5DPEpUTZn94sgYXH3sdXxsVvb46m3iEvg8aZwX7SMDowivzB": {"name": "RunPod", "url": "https://runpod.io", "description": "GPU Cloud built for AI. We plan to introduce perks for those who stake."}} Validator signature: 806c88c327a6488d3fa05628b2e1c06d8688ebda4c50e0627704cb02c6a7a044aed6625bd132e88a333436829fc5dc2c2d5cda73f1aee90351916ba16ff7518b Co-authored-by: Unconst <32490803+unconst@users.noreply.github.com> * use neurons lite for overview (#1179) * Remove weights underflow fix (#1178) * Update __init__.py * Update __init__.py * fix delegates * remove check network * hotkey naming on wallet regen * -all to my_delegates * add per 1000 tao * fix per 24 hour * fix inspect * fix minor in inspect * Update delegates.json (#1181) Verified True Validator information: {"5GBxDYkDp8eJZHGT89wcZJKcMc4ytSqnqqVSpeuGeqtGfqxK": {"name": "Tao Stake", "url": "www.taostake.io", "description": "We have been mining since the start of bittensor and want to maintain a long term solid validator to help people get some value from thier investment and keep TAO within the ecosystem."}} Validator signature: 0272522b503ebb29f0b506f10765b4d5c7a23b85c78cc7bfae76b9816b80ab43282ea4642f09eb09be70812341e5d9946abc8a9d2c73bab0113e9bf939430c87 * Hotfixes 3.7.0 (#1187) * fix metagraph network name issue * fix local entrypoint port * pin scalecode to 1.2.0 * pin jsonschema format-nongpl * fix delegates_json * get right dir * remove extra get delegated * use lite sync for metagraph by default * fix blockhash for rpcs * use lite in sync() * add percentage change to list_delegates * remove axon + fix emission (#1188) * remove axon + fix emission * small fix spacing * allow inspect to get keys from the chain and also allow unstake to accept a hotkey directly * Overview - only tempo once (#1191) only tempo once * Request to add Lucrosus Capital to delegates.json (#1192) Verified True Validator information: {"5FcXnzNo3mrqReTEY4ftkg5iXRBi61iyvM4W1bywZLRqfxAY": {"name": "Lucrosus Capital", "url": "https://lucrosuspool.io/", "description": "Decentralized VC focused on the most thriving blockchain ideas. Join our pool to receive early entrance into promising projects!"}} Validator signature: 1a37ab3bd51a6590dea9772d6a5550632ddcd8d76da6595b66e6425692feac6699dc5f788e587a734cedc3f54efc96c2c9e5453f9052867c1b9a1b5a443b848c * Server validator hotfix (#1189) * remove metagraph.load * remove destroy receptor log * remove create receptor log * validator dendrite backward default to false * fix * push vogue tensor to delegates * fix ts to τs * fix inspect command (#1194) * fix finney explorer (#1200) * 3.7 version checking (#1195) * fix metagraph network name issue * fix local entrypoint port * pin scalecode to 1.2.0 * pin jsonschema format-nongpl * fix delegates_json * get right dir * remove extra get delegated * use lite sync for metagraph by default * fix blockhash for rpcs * use lite in sync() * version checking * int comparison + default checks --------- Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * No zero nominators (#1206) * fix typehints * don't count zero nominators * Adding Validator Info (#1183) 9241f63eb43f7aa57b1fc6d99789331542476f57f683f032192f3dfd7be6c015d47c9f1fe69bc4513ed70e0410097395186df60e3f6b67376e6e73a5f4f9a286 Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1211) Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1210) * Update delegates.json Verified True Validator information: {"5E6oB7h5wtWPbqtPxtSoZeo11fpvDjPuY13SobAMxqEUjqkQ": {"name": "StakeTensor.com-3", "url": "www.staketensor.com", "description": "We run multiple, parallel validators to support Bittensor decentralization & achieve maximum returns"}} Validator signature: a2567b6de748f02f6a14e0063f5b5720b34c96deb2115b33893d016de1f60633ba58bf9bdd49b2141e12a4a8784b4b11c007679d7526eb1e91147e5284258d8a * Update delegates.json --------- Co-authored-by: Cameron Fairchild <cameron@fairchild.dev> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1202) Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1209) * Update delegates.json * Fix formatting * Don't use fake quote * Remove , --------- Co-authored-by: Cameron Fairchild <cameron@fairchild.dev> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1208) * Update delegates.json * Needs comma --------- Co-authored-by: Cameron Fairchild <cameron@fairchild.dev> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1204) * Update delegates.json * Fix desc to from PR --------- Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Fix (un)stake multiple (#1214) fix stake mult * Check transfer fee (#1215) * add existential check * add check existential and fee to transfer * add fee mention * add type reg and remove delegate profile url * use type reg for finney nets * add spacing * set weights era parameter (#1219) * Update delegates.json (#1218) Verified True Validator information: {"5FvhvCWLbu2VgotT5obC9E6S9nskerJUrVsWqkWXCbuD8veW": {"name": "The Lost Cove", "url": "https://lostcove.tech/", "description": "Australia and New Zealand community. We're in it for the gains."}} Validator signature: 626ae6b91aac1591e5d4f8d4fdf2c55f927419fc766dd5184b149f4d7cbc9749ebc94e4e8d04d286b4000c7665afa5682aa28cd94071c5e384e0eb4f44def188 Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Update delegates.json (#1217) * Update delegates.json * Match msg for sig --------- Co-authored-by: Cameron Fairchild <cameron@fairchild.dev> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> * Overview emission in rao (#1213) show emission in rao with _ * Add TAO almanach (#1222) * 3.7 merge master (#1223) Add Owl Ventures Validator (#1199) * Add Owl Ventures Validator 2 Verified True Validator information: {"5CsvRJXuR955WojnGMdok1hbhffZyB4N5ocrv82f3p5A2zVp": {"name": "Owl Ventures 2", "url": "https://owlventures.co.uk", "description": "Owl Ventures Tao Validator 2"}} Validator signature: c807eea902fb786cba8ef768a3ec025d735e3a547d034f82779bdbdcda73cd0fb27b784db9a88d08bb6d4cde3e95fc1257486d86c37b38f309ebb53b7c145b89 * Name change We decided to use single validator to aggregate stakes. Changing the name accordingly. Co-authored-by: igor-papyrus <alferov@gmail.com> --------- Co-authored-by: isabella618033 <isabella618033@gmail.com> Co-authored-by: Cameron Fairchild <cameron@opentensor.ai> Co-authored-by: Eugene <etesting007@gmail.com> Co-authored-by: opentaco <93473497+opentaco@users.noreply.github.com> Co-authored-by: Eduardo García <garciaruiz.edu+github@gmail.com> Co-authored-by: Eugene-hu <85906264+Eugene-hu@users.noreply.github.com> Co-authored-by: opentaco <opentaco@protonmail.com> Co-authored-by: Eduardo <garciaruiz.edu@gmail.com> Co-authored-by: isabella618033 <49876827+isabella618033@users.noreply.github.com> Co-authored-by: joeylegere <joeylegere@gmail.com> Co-authored-by: unconst <jake@bittensor.com> Co-authored-by: Mac Thrasher <95183714+quac88@users.noreply.github.com> Co-authored-by: “quac88” <“mac2@thrasher.com”> Co-authored-by: piotrekraw <piotrekraw@o2.pl> Co-authored-by: mog <mog@mogmachine.com> Co-authored-by: Philippe Schommers <philippe@schommers.be> Co-authored-by: nikogold78 <128321290+nikogold78@users.noreply.github.com> Co-authored-by: teast21 <109384972+teast21@users.noreply.github.com> Co-authored-by: Alex <96243054+wildcommunist@users.noreply.github.com> Co-authored-by: Jermaine <jermaine150@gmail.com> Co-authored-by: Pardeep Singh <ps0296@gmail.com> Co-authored-by: nickbeentjes <nick@pacificshredder.com> Co-authored-by: LucrosusCapital <96264897+LucrosusCapital@users.noreply.github.com> Co-authored-by: 0xSkol <128446359+0xSkol@users.noreply.github.com> Co-authored-by: StakeTensor <128402936+StakeTensor@users.noreply.github.com> Co-authored-by: Cameron Fairchild <cameron@fairchild.dev> Co-authored-by: gmarlettTS <gmarlett@technologysolutions.net> Co-authored-by: lewbare <120072191+lewbare@users.noreply.github.com> Co-authored-by: lawrenceboyd-1995 <128547579+lawrenceboyd-1995@users.noreply.github.com> Co-authored-by: arguad <rickyguadagnin@gmail.com> Co-authored-by: TAOVali <128548800+TAOVali@users.noreply.github.com> Co-authored-by: igor-papyrus <alferov@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hotfix Bittensor v3.6.2
Motivation
In v3.6.1, we introduce anomaly detector, which measures the divergence of server responses to the overall network response. However we saw that anomaly detection was negatively impacting the server scores that deviate too much from the consensus. As such, we are adding two parameters that control the power of the anomaly detection.
Major Changes
Minor Changes