Skip to content

Synchronize blockchain data to message queue

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE
MIT
COPYING
Notifications You must be signed in to change notification settings

enhellowhy/bds-ltc

 
 

Repository files navigation

bds-ltc

logo

Introduction

bds-ltc is one of the independent modules in open source project of block chain data service (BDS) - provides full node service.

bds-ltc Based on the v0.16.3 version of litecoin-project/litecoin,bds-litecoin redeveloped to support sending new block data directly to message middleware service of kafka to facilitate upstream services to subscribe and consume.

Architecture

Architecture

Environmental Deployment

Install LTC

Environment Initialization

build-unix

Install steps

  1. Compile
  ./autogen.sh
  ./configure
  make
  make install # optional
  1. Run full node and support sending messages to Kafka
   /usr/local/bin/litecoind  -kafka -kafkaproxyhost=<kafka proxy host> -kafkaproxyport=<kafka proxy port,default 8082> -kafkatopic=ltc -datadir=<data directory> -rpcuser=<user> -rpcpassword=<password>

Install confluent and kafka

Install kafka

See kafka

Modify config/server.properties
  • message.max.bytes=1048576000

Install confluent

see confluent

Unzip the confluent package and run Confluent REST Proxy

Modify /etc/kafka-rest/kafka-rest.properties
  • max.request.size = 1048576000
  • buffer.memory = 1048576000
  • send.buffer.bytes = 1048576000

Install BDS

See BDS

Database

Database we now support SQL Server, PostgreSQL, you can choose one as a data storage method.

SQL Server

Buy JCS For SQL Server

PostgreSQL

Buy JCS For PostgreSQL

Install Grafana

See Grafana Official

New funtion

  1. The new function of sending messages to Kafka is added(every time a new block is synchronized by full node, the data of the block is sent to kafka and the data structure is customized).
  2. Sendblock and sendbatchblock are newly added as RPC interfaces to trigger full node to send data for a specific block.

Source Code Change History

bds-ltc

Contributing

Contributing guide

License

Apache License 2.0

Project Demonstration

Blockchain Data Service

About

Synchronize blockchain data to message queue

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE
MIT
COPYING

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages

  • C++ 68.8%
  • Python 16.5%
  • C 8.5%
  • M4 2.4%
  • Makefile 1.4%
  • Shell 0.8%
  • Other 1.6%