Skip to content
This repository has been archived by the owner on Aug 2, 2022. It is now read-only.

Microservice - Sync Chainbase to SQL and Mongo #172

Closed
bytemaster opened this issue Aug 15, 2017 · 1 comment
Closed

Microservice - Sync Chainbase to SQL and Mongo #172

bytemaster opened this issue Aug 15, 2017 · 1 comment
Assignees
@heifner
Milestone
EOS Dawn 2.0

Comments

@bytemaster
Copy link
Contributor

This microservice needs to synchronize the blockchain state found in chainbase multiindex containers to traditional databases that can be replicated and used to service queries.

This will require generating the "reverse" of the UNDO database and generate a "DIFF" that can be used to update the SQL database.
@bytemaster bytemaster added this to the EOS Beta milestone Aug 15, 2017
@brianjohnson5972 brianjohnson5972 mentioned this issue Oct 5, 2017
Closed
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Skeleton of db_plugin created #172
637ae0d
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Added boost lockfree queue and consum thread #172
63fb9f0
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Setup to write to mongodb #172
9b1f438
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Transactions now pushed to mongodb #172
81d22e8
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Messages now pushed to mongodb #172
7ffc55a
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Add fake block call to create initial accounts #172
58d57aa
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Add start of Account update #172
c3deee8
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Account newaccount, transfer done #172
9325725
heifner added a commit that referenced this issue Oct 6, 2017
@heifner
Add eos ABI and Account msg handling #172
5060798
heifner added a commit that referenced this issue Oct 9, 2017
@heifner
Add indexes #172
09153e8
heifner added a commit that referenced this issue Oct 9, 2017
@heifner
Add missing setcode #172
a5d5f49
heifner added a commit that referenced this issue Oct 9, 2017
@heifner
-Add ABI for user types via setcode #172
8751862 
-Add MongodB URI command line option
-Add exception handling of process_irreversible_block
-Add verification of last block on startup
heifner added a commit that referenced this issue Oct 10, 2017
@heifner
Add ability to build without mongodb #172
afed5cd
heifner added a commit that referenced this issue Oct 12, 2017
@heifner
Switched to blocking queue to avoid busy wait #172
2446ebd
heifner added a commit that referenced this issue Oct 12, 2017
@heifner
- Database specified via mongodb-uri cli is now honored #172
2a14413 
- Now collections are dropped instead of database since
  databaes drop requires additional privileges that the
  user may not have.
heifner added a commit that referenced this issue Oct 12, 2017
@heifner
-Disabled now by default unless --mongodb-uri specified #172
7bd27fd 
-Add startup verification of no data
heifner added a commit that referenced this issue Oct 12, 2017
@heifner
-Add test script for db_plugin #172
0a8f2d8
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
-Add ABI for user types via setcode #172
3962475 
-Add MongodB URI command line option
-Add exception handling of process_irreversible_block
-Add verification of last block on startup
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add ability to build without mongodb #172
72cecfc
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Switched to blocking queue to avoid busy wait #172
d559fe6
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
- Database specified via mongodb-uri cli is now honored #172
e84ba4d 
- Now collections are dropped instead of database since
  databaes drop requires additional privileges that the
  user may not have.
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
-Disabled now by default unless --mongodb-uri specified #172
8549856 
-Add startup verification of no data
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
-Add test script for db_plugin #172
a3a6fa7
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Account ABI now stored as document instead of string #172
5a7553b
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Fix for resync startup #172
46387eb
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
-Add updateAt to Account, createAt to all documents #172
767410e
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add copyright header #172
1951b25
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Changed 'fake' block_num to 0 from 1 #172
3f32aba
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Changed to use microsecond timestamp instead of sec #172
68bd75c
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add transaction array to block #172
3b6e07c
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add comments on existing approach #172
a0a530c
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
First attempt at travis mongodb build #172
9967b02
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add sudo to before_install make install #172
2a44828
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add CC=clang to mongo-c-driver #172
31f3b6f
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add cat of log for travis debug #172
3d45ec3
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Move mongo-cxx-driver to script so logs can be viewed #172
8468a9c
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Add clang options to cmake #172
fa22e0a
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Use cmake 3.9 for mongo-cxx-driver build #172
8dfa33a
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
export CC and CXX #172
983804b
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Cleanup of travis build #172
0d9a340
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Move eos_run_mongodb_test.sh to build dir #172
3ef0567
heifner added a commit that referenced this issue Nov 2, 2017
@heifner
Fixed peer review comments #172
ce30439
@heifner
Copy link
Contributor

heifner commented Nov 6, 2017

For STAT work this is now STAT-64 - Create MongoDB mirror of blockchain for Web UI.
Not synced directly with JIRA due to large comment discussion.

@heifner heifner closed this as completed Nov 6, 2017
ljrprocc pushed a commit to bithacks-tech/myeosio that referenced this issue Jul 4, 2018
Merge pull request EOSIO#172 from enumivo/staging
4f2c00d 
Staging
NorseGaud pushed a commit that referenced this issue Jul 30, 2019
# This is a combination of 186 commits.
6c09577 
# This is the 1st commit message:

various improvements

# This is the commit message #2:

new hash

# This is the commit message #3:

fix for script path

# This is the commit message #4:

fixes

# This is the commit message #5:

fixes

# This is the commit message #6:

fixes

# This is the commit message #7:

fixes

# This is the commit message #8:

fixes

# This is the commit message #9:

fixes

# This is the commit message #10:

fixes

# This is the commit message #11:

fixes

# This is the commit message #12:

fixes

# This is the commit message #13:

fixes

# This is the commit message #14:

fixes

# This is the commit message #15:

fixes

# This is the commit message #16:

fixes

# This is the commit message #17:

fixes

# This is the commit message #18:

fixes

# This is the commit message #19:

fixes

# This is the commit message #20:

fixes

# This is the commit message #21:

fixes

# This is the commit message #22:

fixes

# This is the commit message #23:

fixes

# This is the commit message #24:

fixes

# This is the commit message #25:

fixes

# This is the commit message #26:

testing

# This is the commit message #27:

testing

# This is the commit message #28:

testing

# This is the commit message #29:

testing

# This is the commit message #30:

testing

# This is the commit message #31:

testing

# This is the commit message #32:

testing

# This is the commit message #33:

testing

# This is the commit message #34:

testing

# This is the commit message #35:

testing

# This is the commit message #36:

testing

# This is the commit message #37:

testing

# This is the commit message #38:

testing

# This is the commit message #39:

testing

# This is the commit message #40:

testing

# This is the commit message #41:

testing

# This is the commit message #42:

testing

# This is the commit message #43:

testing

# This is the commit message #44:

fixes

# This is the commit message #45:

fixes

# This is the commit message #46:

fixes

# This is the commit message #47:

fixes

# This is the commit message #48:

fixes

# This is the commit message #49:

fixes

# This is the commit message #50:

fixes

# This is the commit message #51:

fixes

# This is the commit message #52:

fixes

# This is the commit message #53:

fixes

# This is the commit message #54:

fixes

# This is the commit message #55:

fixes

# This is the commit message #56:

fixes

# This is the commit message #57:

fixes

# This is the commit message #58:

fixes

# This is the commit message #59:

fixes

# This is the commit message #60:

fixes

# This is the commit message #61:

fixes

# This is the commit message #62:

fixes

# This is the commit message #63:

fixes

# This is the commit message #64:

fixes

# This is the commit message #65:

fixes

# This is the commit message #66:

fixes

# This is the commit message #67:

fixes

# This is the commit message #68:

fixes

# This is the commit message #69:

fixes

# This is the commit message #70:

fixes

# This is the commit message #71:

fixes

# This is the commit message #72:

fixes

# This is the commit message #73:

fixes

# This is the commit message #74:

fixes

# This is the commit message #75:

fixes

# This is the commit message #76:

fixes

# This is the commit message #77:

fixes

# This is the commit message #78:

fixes

# This is the commit message #79:

more testing

# This is the commit message #80:

testing

# This is the commit message #81:

fixes

# This is the commit message #82:

fixes

# This is the commit message #83:

fixes

# This is the commit message #84:

fixes

# This is the commit message #85:

fixes

# This is the commit message #86:

fixes

# This is the commit message #87:

fixes

# This is the commit message #88:

fixes

# This is the commit message #89:

fixes

# This is the commit message #90:

fixes

# This is the commit message #91:

fixes

# This is the commit message #92:

fixes

# This is the commit message #93:

propagate-environment for buildkite-agent

# This is the commit message #94:

propagate-environment for buildkite-agent

# This is the commit message #95:

propagate-environment for buildkite-agent

# This is the commit message #96:

propagate-environment for buildkite-agent

# This is the commit message #97:

fixes

# This is the commit message #98:

fixes

# This is the commit message #99:

fixes

# This is the commit message #100:

fixes

# This is the commit message #101:

fixes

# This is the commit message #102:

fixes

# This is the commit message #103:

fixes

# This is the commit message #104:

fixes

# This is the commit message #105:

fixes

# This is the commit message #106:

fixes

# This is the commit message #107:

fixes

# This is the commit message #108:

fixes

# This is the commit message #109:

fixes

# This is the commit message #110:

fixes

# This is the commit message #111:

fixes

# This is the commit message #112:

fixes

# This is the commit message #113:

fixes

# This is the commit message #114:

fixes

# This is the commit message #115:

fixes

# This is the commit message #116:

fixes

# This is the commit message #117:

fixes

# This is the commit message #118:

fixes

# This is the commit message #119:

fixes

# This is the commit message #120:

fixes

# This is the commit message #121:

fixes

# This is the commit message #122:

fixes

# This is the commit message #123:

fixes

# This is the commit message #124:

fixes

# This is the commit message #125:

fixes

# This is the commit message #126:

fixes

# This is the commit message #127:

fixes

# This is the commit message #128:

fixes

# This is the commit message #129:

fixes

# This is the commit message #130:

fixes

# This is the commit message #131:

fixes

# This is the commit message #132:

fixes

# This is the commit message #133:

fixes

# This is the commit message #134:

fixes

# This is the commit message #135:

fixes

# This is the commit message #136:

fixes

# This is the commit message #137:

fixes

# This is the commit message #138:

fixes

# This is the commit message #139:

fixes

# This is the commit message #140:

fixes

# This is the commit message #141:

fixes

# This is the commit message #142:

fixes

# This is the commit message #143:

fixes

# This is the commit message #144:

fixes

# This is the commit message #145:

fixes

# This is the commit message #146:

fixes

# This is the commit message #147:

fixes

# This is the commit message #148:

fixes

# This is the commit message #149:

fixes

# This is the commit message #150:

fixes

# This is the commit message #151:

fixes

# This is the commit message #152:

fixes

# This is the commit message #153:

testing

# This is the commit message #154:

fixes

# This is the commit message #155:

fixes

# This is the commit message #156:

fixes

# This is the commit message #157:

fixes

# This is the commit message #158:

fixes

# This is the commit message #159:

fixes

# This is the commit message #160:

fixes

# This is the commit message #161:

fixes

# This is the commit message #162:

fixes

# This is the commit message #163:

fixes

# This is the commit message #164:

fixes

# This is the commit message #165:

fixes

# This is the commit message #166:

fixes

# This is the commit message #167:

fixes

# This is the commit message #168:

fixes

# This is the commit message #169:

fixes

# This is the commit message #170:

fixes

# This is the commit message #171:

fixes

# This is the commit message #172:

fixes

# This is the commit message #173:

fixes

# This is the commit message #174:

fixes

# This is the commit message #175:

fixes

# This is the commit message #176:

fixes

# This is the commit message #177:

fixes

# This is the commit message #178:

fixes

# This is the commit message #179:

fixes

# This is the commit message #180:

fixes

# This is the commit message #181:

fixes

# This is the commit message #182:

fixes

# This is the commit message #183:

fixes

# This is the commit message #184:

fixes

# This is the commit message #185:

fixes

# This is the commit message #186:

fixes
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@heifner heifner

Labels
None yet
Projects
None yet
Milestone
EOS Dawn 2.0
Development

No branches or pull requests
2 participants
@bytemaster @heifner