Skip to content
This repository was archived by the owner on May 12, 2021. It is now read-only.

TAJO-1221: HA TajoClient should not connect TajoMaster at the first.#286

Closed
blrunner wants to merge 21 commits intoapache:masterfrom
blrunner:TAJO-1221
Closed

TAJO-1221: HA TajoClient should not connect TajoMaster at the first.#286
blrunner wants to merge 21 commits intoapache:masterfrom
blrunner:TAJO-1221

Conversation

@blrunner
Copy link
Copy Markdown
Contributor

@blrunner blrunner commented Dec 5, 2014

I added a method to update TableStats at CatalogStore. For reference, all unit cases for physical operators verify output row numbers and it finished successfully with my patch. So, I didn't implement unit test cases. In addition, HCatalogStore::updateTableStats is dummy method. Because hive don't provide no api to update table row numbers.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you explain its purpose?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Main components (ex: CatalogServer, TajoResourceTracker) create an InetSocketAddress with NetUtils::createSocketAddr and TajoConf. But if the address set to "0.0.0.0" at TajoConf, NetUtils::createSocketAddr bind socket address to "localhost" unconditionally. It does matter on Yarn with TajoMaster Ha. If socket address bind to "localohost" in Netty, TajoWorker never can't connect the component. So, I set local ip address with NetUtils::createLocalSocketAddr. If you have any good idea, suggest to me easefully.

@blrunner
Copy link
Copy Markdown
Contributor Author

blrunner commented Dec 8, 2014

Thanks @hyunsik.

I've just added a constant class for HA. And I leaved some comments for NetUtils::createLocalSocketAddr.

@hyunsik
Copy link
Copy Markdown
Member

hyunsik commented Dec 9, 2014

You seem to merge your patch with wrong revisions. Could you check the submitted patch?

@blrunner
Copy link
Copy Markdown
Contributor Author

blrunner commented Dec 9, 2014

Thanks @hyunsik

I merged the master branch to TAJO-1221 again.
Could you check it again?

@blrunner
Copy link
Copy Markdown
Contributor Author

Hi @hyunsik.

I removed NetUtils::createLocalSocketAddr. And we need to guide for users to use rpc server address '0.0.0.0' instead of 'localhost' on yarn cluster.

…into TAJO-1221

Conflicts:
	tajo-core/src/main/java/org/apache/tajo/master/querymaster/QueryMaster.java
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The port is hard coded. any have reason ?

@blrunner
Copy link
Copy Markdown
Contributor Author

Thanks @jinossy ,
I removed unnecessary codes. Could you check it again?

@jinossy
Copy link
Copy Markdown
Member

jinossy commented Dec 17, 2014

+1
Looks good to me.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants