Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release 1.0.1 #100

Merged
merged 36 commits into from
Dec 21, 2023
Merged

Release 1.0.1 #100

merged 36 commits into from
Dec 21, 2023

Conversation

RusticLuftig
Copy link
Collaborator

Release Notes:

  1. Performance improvement for handling large MinerIndexes on the Validator
  2. Support for special characters in labels
  3. Validators now validate 2 samples instead of 1 per evaluation
  4. Auto restart the validator if it's not making forward progress
  5. Miner's will now update existing content if scraped again

Sid-Data-Universe and others added 30 commits December 18, 2023 09:50
@Sid-Data-Universe
Miner storage optimizations.
5f28fd4
@Sid-Data-Universe
Merge pull request #86 from RusticLuftig/minerStorageOptimizations
ad012e9 
Miner storage optimizations.
@Sid-Data-Universe
Update user agent to be unique per user.
0c61a5d
@Sid-Data-Universe
Merge pull request #87 from RusticLuftig/userAgentUpdate
3990608 
Update user agent to be unique per user.
@Sid-Data-Universe
Optimize validator storage for large miner indexes.
2bce451
@Sid-Data-Universe
Batch the vali storage inserts in cases over 1m.
e273373
@Sid-Data-Universe
Update validator to check two entities.
e6698c7
@Sid-Data-Universe
Reserve data source enum values for yet to be implemented sources.
7f2ebe9
@Sid-Data-Universe
Allow for batch update of newly discovered labels if necessary.
c61b582
@RusticLuftig
Merge pull request #91 from RusticLuftig/newSourcesEnum
5200769 
Reserve data source enum values for yet to be implemented sources.
@RusticLuftig
Merge pull request #89 from RusticLuftig/valiLabelOptimize
a3923e7 
Update validator storage to better support large miner indexes.
@Sid-Data-Universe
Update logic to pick two distinct entities and weight by size.
6d04495
@RusticLuftig
Merge pull request #90 from RusticLuftig/updateValiCheckCount
161565d 
Update validator to check two entities.
Compress the MinerIndex
a58d403
Address PR feedback
a875003
@RusticLuftig
Merge pull request #88 from RusticLuftig/index-compression
41745e5 
Compress the MinerIndex
@Sid-Data-Universe
Update validator mysql storage to support accent sensititvity.
9850f6e
@Sid-Data-Universe
Merge pull request #92 from RusticLuftig/vali_db_accent_sensitivity_fix
46af738 
Update validator mysql storage to support accent sensititvity.
@Sid-Data-Universe
Limit miner index to 200k until more performant index is returnable.
480cd5f
@Sid-Data-Universe
Update to handle special characters that are not in the expanded enco…
ffb0922 
…ding.
@Sid-Data-Universe
Merge pull request #93 from RusticLuftig/minerBucketLimit
0e79df3 
Limit miner index to 200k until more performant index is returnable.
@RusticLuftig
Merge pull request #94 from RusticLuftig/vali_db_accent_sensitivity_fix
0269905 
Update to handle special characters that are not in the expanded encoding.
@Sid-Data-Universe
Fix creation of ValidationResult objects in Validator.
65b1a02
@Sid-Data-Universe
Handle case of 0 validated bytes size.
8814ff0
@Sid-Data-Universe
Merge pull request #95 from RusticLuftig/vali_results_fix
53276c0 
Fix creation of ValidationResult objects in Validator.
@Sid-Data-Universe
Update vali to handle entities with no specified datetime as utc.
1b0a7b2
@Sid-Data-Universe
Switch to use wait rather than gather to ensure validator doesn't han…
138926f 
…g on eval miner.
@Sid-Data-Universe
Merge pull request #98 from RusticLuftig/valiGatherTimeout
d3ab61b 
Switch to use wait rather than gather to ensure validator doesn't hang.
@Sid-Data-Universe
Merge pull request #97 from RusticLuftig/timezonesFix
fdfcbae 
Update vali to handle entities with no specified datetime as utc.
@Sid-Data-Universe
Revert "Merge pull request #88 from RusticLuftig/index-compression"
29cd875 
This reverts commit 41745e5, reversing
changes made to 161565d.
@RusticLuftig RusticLuftig merged commit b9ecf86 into main Dec 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@RusticLuftig @Sid-Data-Universe