Skip to content

zhangwei5095/OracleToElasticSearch

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Using of Oracle QRN

Given library provides Oracle query notification functionality to an existing system. It can be use as a standalone application with leader election functionality through Zookeeper and able to send notification with RowID to any messaging queue such as Apollo or Kafka. Consumer of the queue can consume the message and query to the data base to get the changed row and feed Elastic search or execute any operation.

Version

1.0-snapshot

Prerequisites

  • Oracle JDBC 11g driver needs to compile the project.
  • apache zookeeper
  • apache Apollo
  • elastic search

Core functionalities

  • [qrcn] - collect notification from Oracle and send the notifications to any existing queue [apollo].
  • [es] - consumer, collects the message from the queue and index in Elastic search
  • [es-dto] - common dto

Data Flow

alt tag

Run

  • Start Zookeeper
  • run com.blu.curator.ExecuteClients
  • run com.blu.es.camel.router.Standalone

TODO

  • add fat jar to run QRCN
  • add fat jar to run es standalone
  • update data in ES by query operation
  • add google guava for cache

About

Pulling data from Oracle database to Elastic Search

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 100.0%