Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pinpoint web ui can not select an application on win7 #172

Closed
tangyong opened this issue Feb 11, 2015 · 26 comments
Closed

pinpoint web ui can not select an application on win7 #172

tangyong opened this issue Feb 11, 2015 · 26 comments
Labels
help wanted proposal

Comments

@tangyong
Copy link

After I started all cmd script successfully, pinpoint web ui can not select an application. And the following exception happened,

严重: Servlet.service() for servlet [pinpoint-web] in context with path [] threw exception [Request processing failed; nested exception is org.springframew
ork.data.hadoop.hbase.HbaseSystemException: org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for ApplicationIndex,,99999999
999999 after 10 tries.; nested exception is java.lang.RuntimeException: org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region fo
r ApplicationIndex,,99999999999999 after 10 tries.] with root cause
org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for ApplicationIndex,,99999999999999 after 10 tries.
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:980)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:987)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:889)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:846)
at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:270)
at org.apache.hadoop.hbase.client.HTable.(HTable.java:210)
at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)
at org.apache.hadoop.hbase.client.HTablePool.createHTable(HTablePool.java:265)
at org.apache.hadoop.hbase.client.HTablePool.findOrCreateTable(HTablePool.java:195)
at org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:174)
at org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:213)
at com.navercorp.pinpoint.common.hbase.PooledHTableFactory.createHTableInterface(PooledHTableFactory.java:47)
at org.springframework.data.hadoop.hbase.HbaseUtils.getHTable(HbaseUtils.java:73)
at org.springframework.data.hadoop.hbase.HbaseTemplate.getTable(HbaseTemplate.java:75)
at org.springframework.data.hadoop.hbase.HbaseTemplate.execute(HbaseTemplate.java:54)
at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.find(HbaseTemplate2.java:124)
at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.find(HbaseTemplate2.java:153)
at com.navercorp.pinpoint.web.dao.hbase.HbaseApplicationIndexDao.selectAllApplicationNames(HbaseApplicationIndexDao.java:58)
at com.navercorp.pinpoint.web.service.CommonServiceImpl.selectAllApplicationNames(CommonServiceImpl.java:38)
at com.navercorp.pinpoint.web.controller.MainController.getApplicationGroup(MainController.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:219)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:745)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:686)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:925)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:856)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:936)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:827)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:812)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.navercorp.pinpoint.web.servlet.NoCacheFilter.doFilter(NoCacheFilter.java:50)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1041)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:603)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
@tangyong
Copy link
Author

This issue is very fatal on win7. Please evaluate it.

@tangyong
Copy link
Author

This issue also happened on 1.0.4-rc on my win7. I will describe the scene as following:

1 hbase status:

hbase version: hbase-0.98.10-hadoop1 (because I plan to use it with native windows cmd)

...
2015-02-12 17:04:55,408 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.NIOServerCnxn: Closed socket connection for client /127.0.0.1:59727 which had s
essionid 0x14b7d06fd770006
2015-02-12 17:05:36,000 INFO [SessionTracker] server.ZooKeeperServer: Expiring
session 0x14b7d06fd770006, timeout of 40000ms exceeded
2015-02-12 17:05:36,000 INFO [ProcessThread(sid:0 cport:-1):] server.PrepReques
tProcessor: Processed session termination for sessionid: 0x14b7d06fd770006
2015-02-12 17:07:18,581 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.NIOServerCnxnFactory: Accepted socket connection from /127.0.0.1:59852
2015-02-12 17:07:18,583 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.ZooKeeperServer: Client attempting to establish new session at /127.0.0.1:59852

2015-02-12 17:07:18,624 INFO [SyncThread:0] server.ZooKeeperServer: Established
session 0x14b7d06fd770015 with negotiated timeout 40000 for client /127.0.0.1:5
9852
2015-02-12 17:08:09,729 DEBUG [LruStats #0] hfile.LruBlockCache: Total=407.29 KB
, free=386.3 MB, max=386.7 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cac
hingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evict
edPerRun=0.0
2015-02-12 17:08:18,806 DEBUG [CNHQ-14090991N.sn.suning.ad,59646,1423731786596-B
alancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 act
ive regionserver(s)
2015-02-12 17:08:28,231 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.NIOServerCnxnFactory: Accepted socket connection from /127.0.0.1:59868
2015-02-12 17:08:28,231 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.ZooKeeperServer: Client attempting to establish new session at /127.0.0.1:59868

2015-02-12 17:08:28,259 INFO [SyncThread:0] server.ZooKeeperServer: Established
session 0x14b7d06fd770016 with negotiated timeout 40000 for client /127.0.0.1:5
9868
2015-02-12 17:08:28,312 INFO [ProcessThread(sid:0 cport:-1):] server.PrepReques
tProcessor: Processed session termination for sessionid: 0x14b7d06fd770016
2015-02-12 17:08:28,337 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.NIOServerCnxn: Closed socket connection for client /127.0.0.1:59868 which had s
essionid 0x14b7d06fd770016
2015-02-12 17:13:09,738 DEBUG [LruStats #0] hfile.LruBlockCache: Total=407.29 KB
, free=386.3 MB, max=386.7 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cac
hingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evict
edPerRun=0.0
2015-02-12 17:13:18,772 DEBUG [CNHQ-14090991N.sn.suning.ad,59646,1423731786596-B
alancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 act
ive regionserver(s)
2015-02-12 17:18:09,746 DEBUG [LruStats #0] hfile.LruBlockCache: Total=407.29 KB
, free=386.3 MB, max=386.7 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cac
hingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=89, evicted=0, evict
edPerRun=0.0
2015-02-12 17:18:18,772 DEBUG [CNHQ-14090991N.sn.suning.ad,59646,1423731786596-B
alancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 act
ive regionserver(s)
2015-02-12 17:19:46,064 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.NIOServerCnxnFactory: Accepted socket connection from /127.0.0.1:60073
2015-02-12 17:19:46,070 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.ZooKeeperServer: Client attempting to establish new session at /127.0.0.1:60073

2015-02-12 17:19:46,119 INFO [SyncThread:0] server.ZooKeeperServer: Established
session 0x14b7d06fd770017 with negotiated timeout 40000 for client /127.0.0.1:6
0073
2015-02-12 17:20:44,170 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.NIOServerCnxnFactory: Accepted socket connection from /127.0.0.1:60114
2015-02-12 17:20:44,175 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server
.ZooKeeperServer: Client attempting to establish new session at /127.0.0.1:60114

2015-02-12 17:20:44,230 INFO [SyncThread:0] server.ZooKeeperServer: Established
session 0x14b7d06fd770018 with negotiated timeout 40000 for client /127.0.0.1:6
0114
2015-02-12 17:23:09,755 DEBUG [LruStats #0] hfile.LruBlockCache: Total=407.29 KB
, free=386.3 MB, max=386.7 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cac
hingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=119, evicted=0, evic
tedPerRun=0.0
2015-02-12 17:23:18,773 DEBUG [CNHQ-14090991N.sn.suning.ad,59646,1423731786596-B
alancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 act
ive regionserver(s)
2015-02-12 17:28:09,763 DEBUG [LruStats #0] hfile.LruBlockCache: Total=407.29 KB
, free=386.3 MB, max=386.7 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cac
hingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=149, evicted=0, evic
tedPerRun=0.0
2015-02-12 17:28:18,773 DEBUG [CNHQ-14090991N.sn.suning.ad,59646,1423731786596-B
alancerChore] balancer.BaseLoadBalancer: Not running balancer because only 1 act
ive regionserver(s)

2 Agent status:

normal.

3 Collector status:

Always in the following , not any change.

二月 12, 2015 5:17:39 下午 org.apache.coyote.AbstractProtocol init
信息: Initializing ProtocolHandler ["http-bio-28082"]
二月 12, 2015 5:17:39 下午 org.apache.catalina.core.StandardService startInterna
l
信息: Starting service Tomcat
二月 12, 2015 5:17:39 下午 org.apache.catalina.core.StandardEngine startInternal

信息: Starting Servlet Engine: Apache Tomcat/7.0.47
二月 12, 2015 5:17:45 下午 org.apache.catalina.core.ApplicationContext log
信息: No Spring WebApplicationInitializer types detected on classpath
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/F:/next-suning-monitor/pinpoint/pinpoint-1.0.
4-rc/quickstart/collector/target/deploy/WEB-INF/lib/slf4j-log4j12-1.7.5.jar!/org
/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/F:/next-suning-monitor/pinpoint/pinpoint-1.0.
4-rc/quickstart/bin/../collector/target/apache-tomcat-maven-plugin/pinpoint-coll
ector/WEB-INF/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.cla
ss]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
二月 12, 2015 5:17:46 下午 org.apache.catalina.core.ApplicationContext log
信息: Initializing Spring root WebApplicationContext
二月 12, 2015 5:17:48 下午 org.apache.coyote.AbstractProtocol start
信息: Starting ProtocolHandler ["http-bio-28082"]

4 Web UI

The following exception happened,

二月 12, 2015 5:35:33 下午 org.apache.catalina.core.StandardWrapperValve invoke
严重: Servlet.service() for servlet [pinpoint-web] in context with path [] threw
exception [Request processing failed; nested exception is org.springframework.d
ata.hadoop.hbase.HbaseSystemException: org.apache.hadoop.hbase.client.NoServerFo
rRegionException: Unable to find region for ApplicationIndex,,99999999999999 aft
er 10 tries.; nested exception is java.lang.RuntimeException: org.apache.hadoop.
hbase.client.NoServerForRegionException: Unable to find region for ApplicationIn
dex,,99999999999999 after 10 tries.] with root cause
org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region
for ApplicationIndex,,99999999999999 after 10 tries.
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen
tation.locateRegionInMeta(HConnectionManager.java:980)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen
tation.locateRegion(HConnectionManager.java:885)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen
tation.locateRegionInMeta(HConnectionManager.java:987)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen
tation.locateRegion(HConnectionManager.java:889)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplemen
tation.locateRegion(HConnectionManager.java:846)
at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:270)
at org.apache.hadoop.hbase.client.HTable.(HTable.java:210)
at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HT
ableFactory.java:36)
at org.apache.hadoop.hbase.client.HTablePool.createHTable(HTablePool.jav
a:265)
at org.apache.hadoop.hbase.client.HTablePool.findOrCreateTable(HTablePoo
l.java:195)
at org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:17
4)
at org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:21
3)
at com.navercorp.pinpoint.common.hbase.PooledHTableFactory.createHTableI
nterface(PooledHTableFactory.java:47)
at org.springframework.data.hadoop.hbase.HbaseUtils.getHTable(HbaseUtils
.java:73)
at org.springframework.data.hadoop.hbase.HbaseTemplate.getTable(HbaseTem
plate.java:75)
at org.springframework.data.hadoop.hbase.HbaseTemplate.execute(HbaseTemp
late.java:54)
at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.find(HbaseTemplate
2.java:124)
at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.find(HbaseTemplate
2.java:153)
at com.navercorp.pinpoint.web.dao.hbase.HbaseApplicationIndexDao.selectA
llApplicationNames(HbaseApplicationIndexDao.java:58)
at com.navercorp.pinpoint.web.service.CommonServiceImpl.selectAllApplica
tionNames(CommonServiceImpl.java:38)
at com.navercorp.pinpoint.web.controller.MainController.getApplicationGr
oup(MainController.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.web.method.support.InvocableHandlerMethod.invoke(
InvocableHandlerMethod.java:219)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeF
orRequest(InvocableHandlerMethod.java:132)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocabl
eHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingH
andlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:745)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingH
andlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:686)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapt
er.handle(AbstractHandlerMethodAdapter.java:80)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(Dispatch
erServlet.java:925)
at org.springframework.web.servlet.DispatcherServlet.doService(Dispatche
rServlet.java:856)
at org.springframework.web.servlet.FrameworkServlet.processRequest(Frame
workServlet.java:936)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServl
et.java:827)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkSer
vlet.java:812)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
icationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
ilterChain.java:210)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51
)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
icationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
ilterChain.java:210)
at com.navercorp.pinpoint.web.servletfilter.NoCacheFilter.doFilter(NoCac
heFilter.java:50)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
icationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
ilterChain.java:210)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterIntern
al(CharacterEncodingFilter.java:88)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerR
equestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appl
icationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationF
ilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperV
alve.java:222)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextV
alve.java:123)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authentica
torBase.java:502)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.j
ava:171)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.j
ava:100)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:
953)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineVal
ve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.jav
a:408)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp
11Processor.java:1041)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(
AbstractProtocol.java:603)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoin
t.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:615)
at java.lang.Thread.run(Thread.java:745)

@tangyong
Copy link
Author

While I entered into hbase shell, it seemes not any row,

hbase(main):006:0> scan 'AgentInfo'
ROW COLUMN+CELL

0 row(s) in 0.0670 seconds

hbase(main):007:0> scan 'AgentInfo'
ROW COLUMN+CELL

0 row(s) in 0.0110 seconds

hbase(main):008:0> scan 'AgentInfo'
ROW COLUMN+CELL

0 row(s) in 0.0090 seconds

hbase(main):009:0> scan 'AgentInfo'
ROW COLUMN+CELL

0 row(s) in 0.0090 seconds

hbase(main):010:0> scan 'ApiMetaData'
ROW COLUMN+CELL

0 row(s) in 0.0340 seconds

hbase(main):011:0> scan 'ApiMetaData'
ROW COLUMN+CELL

0 row(s) in 0.0320 seconds

hbase(main):012:0> scan 'AgentStat'
ROW COLUMN+CELL

0 row(s) in 0.0570 seconds

hbase(main):013:0> scan 'Traces'
ROW COLUMN+CELL

0 row(s) in 0.1600 seconds

hbase(main):014:0> scan 'ApplicationStatistics'
ROW COLUMN+CELL

0 row(s) in 0.0120 seconds

hbase(main):015:0>

So, I felt that maybe the reason is just here!

@barneykim
Copy link
Contributor

I had to reproduce the problem.
I don't know your environment. So you can be different.

There are two Ethernet adapter in my OS.
One is a physical Ethernet adapter, the other is adapter for the virtual machine.
For example:

C:> ipconfig /all
Windows IP Configuration
   Host Name             : BK-P2
   Primary Dns suffix  : foo.com
...

Ethernet adapter Local Area Connection:
   Description            : Realtek PCIe GBE Family Controller
   IPv4 Address         : 192.168.123.306

Ethernet adapter VirtualBox Host-Only Network:
   Description            : VirtualBox Host-Only Ethernet Adapter
   IPv4 Address         : 192.168.56.1

When I run HBase on Windows, logs are the following:

INFO util.VersionInfo: HBase 0.94.26
INFO server.ZooKeeperServer: Server environment:host.name=BK-P2.FOO.COM
...
INFO regionserver.HRegionServer: Connected to master at BK-P2.FOO.COM/192.168.56.1:56332
INFO regionserver.HRegionServer: Telling master at BK-P2.FOO.COM,56332,1423732578852 that we are up with port=56360, startcode=1423732588081

I defined region server to localhost in hbase/conf/regionservers.
But the region server use the IP address for the virtual machine (192.168.56.1)
After run the Pinpoint Collector and TestApp, I was able to see the following log in quickstart.collector.log:

[INFO ](o.a.z.ClientCnxn                   :1207) Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x14b7d1318ed0003, negotiated timeout = 40000
[DEBUG](c.n.p.r.s.PinpointServerSocket     :202) messageReceived:RequestPacket{requestId=2, payloadLength=84} channel:[id: 0xb2ae16b0, /127.0.0.1:56526 => /127.0.0.1:29994]
[INFO ](c.n.p.c.h.ApiMetaDataHandler       :51) Received ApiMetaData=TApiMetaData(agentId:test-agent, agentStartTime:1423733151414, apiId:-1, apiInfo:sun.net.www.protocol.http.HttpURLConnection.connect(), line:846)
[DEBUG](c.n.p.c.d.h.HbaseApiMetaDataDao    :53) insert:TApiMetaData(agentId:test-agent, agentStartTime:1423733151414, apiId:-1, apiInfo:sun.net.www.protocol.http.HttpURLConnection.connect(), line:846)
[INFO ](o.a.h.i.HBaseRPC                   :261) Server at BK-P2.FOO.COM/192.168.123.306:56360 could not be reached after 1 tries, giving up.

You can see that HBaseRPC are attempting to connect is to 192.168.123.306:56360
Run command to confirm:

C:\> netstat -an | findstr 56360
  TCP    192.168.56.1:56360     0.0.0.0:0              LISTENING

This problem is caused because it is different from the actual IP address bound.
This is a problem related to hostname with HBase.
I don't know the perfect solution.

But I solve it to disable another Ethernet adapter.

  • Stop the HBase and Pinpoint Collector and TestApp.
  • Control Panel > Network and Internet Connections > Network Connections
  • Select VirtualBox Host-Only Network
  • Disable a network connection
  • Start the HBase and Pinpoint Collector and TestApp again.

I hope this helps you.

@Xylus
Copy link
Contributor

Xylus commented Feb 12, 2015

It could also be due to difference in hbase versions. We'll try to reproduce the error with 0.98.10.

Meanwhile, you can use 0.94.x with Windows as explained here. It's in Korean, but the gist of it is:

  1. Download HBase 0.94.x
  2. Extract the file into quickstart\hbase and rename the directory to "hbase" - ie quickstart\hbase\hbase
  3. Run quickstart\bin\prepare-hbase-win.cmd - This copies the HBase scripts for Windows that are available in 0.98.x.
  4. Start HBase - run quickstart\bin\start-hbase.cmd
  5. Create tables - run quickstart\bin\init-hbase.cmd

@tangyong
Copy link
Author

@Xylus note a point: 0.94.x does not directly offer a native hbase cmd. I want to know which version you said.

@tangyong
Copy link
Author

@Xylus meanwhile, from 0.96.x, hbase team starts to offer some native hbase cmds.

@tangyong
Copy link
Author

@Xylus oh, maybe I am wrong, quickstart\support\hbase-win\bin seems to offer some wrapped hbase cmds. let me see and switch 0.94.x

@tangyong
Copy link
Author

I have confirmed that using hbase-0.94.x and 1.0.4-rc works fine!

I can select TESTAPP from web ui!

@tangyong
Copy link
Author

I have a question: how I can see my callstack? Now, I only see Response Summary , load, and servers.
Whether needing to click some operations?

@Xylus
Copy link
Contributor

Xylus commented Feb 13, 2015

You can view the callstack by dragging on the scatter chart on the top right hand corner.

@tangyong
Copy link
Author

@Xylus Sorry, I does not understand you said, and could you please tell me how to see the callstack of TESTAPP in details.

From chinese, I can not access twitter, so, some operations from testapp can not work fine.

Thanks!

@Xylus
Copy link
Contributor

Xylus commented Feb 13, 2015

Sure, in order to view the callstack, you've got to generate some requests from your testapp.

You can do this by opening up a browser and heading over to [http://localhost:28081](http://localhost:28081]. This is the testapp browser where you can emulate requests received by your profiler application.
Since Twitter doesn't work, you can generate a HTTP GET remote call to google map API by clicking on /httpclient4/getGeoCode.

You should now be able to view the server map from the Web UI, and to view the callstack click and drag your mouse over the dots in the scatter chart (top right hand corner).
scatter-chart

You can also open up the help menu by clicking on the "?" icon at the top right hand corder of the screen.

@tangyong
Copy link
Author

Thanks @Xylus , I can understand your means. It is very pity that from china, http://maps.googleapis.com/maps/api/geocode/json can not also be accessed.

HTTP Status 500 - Connect to maps.googleapis.com:80 [maps.googleapis.com/173.194.72.95] failed: Connection timed out: connect

type Exception report

message Connect to maps.googleapis.com:80 [maps.googleapis.com/173.194.72.95] failed: Connection timed out: connect

description The server encountered an internal error that prevented it from fulfilling this request.

exception
org.apache.http.conn.HttpHostConnectException: Connect to maps.googleapis.com:80 [maps.googleapis.com/173.194.72.95] failed: Connection timed out: connect
org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:142)
org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:319)
org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363)
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:219)
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:86)
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
com.navercorp.pinpoint.testapp.service.remote.HttpRemoteService.execute(HttpRemoteService.java:92)
com.navercorp.pinpoint.testapp.service.remote.HttpRemoteService.get(HttpRemoteService.java:43)
com.navercorp.pinpoint.testapp.controller.HttpClient4Controller.getGeoCode(HttpClient4Controller.java:42)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:606)
org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:781)
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:721)
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:83)
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:943)
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:877)
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:961)
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:852)
javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:837)
javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

root cause
java.net.ConnectException: Connection timed out: connect
java.net.DualStackPlainSocketImpl.connect0(Native Method)
java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:79)
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
java.net.Socket.connect(Socket.java:579)
org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:72)
org.apache.http.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:125)
org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:319)
org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363)
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:219)
org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:86)
org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
com.navercorp.pinpoint.testapp.service.remote.HttpRemoteService.execute(HttpRemoteService.java:92)
com.navercorp.pinpoint.testapp.service.remote.HttpRemoteService.get(HttpRemoteService.java:43)
com.navercorp.pinpoint.testapp.controller.HttpClient4Controller.getGeoCode(HttpClient4Controller.java:42)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:606)
org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:781)
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:721)
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:83)
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:943)
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:877)
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:961)
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:852)
javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:837)
javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)
org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

note The full stack trace of the root cause is available in the Apache Tomcat/7.0.47 logs.

Apache Tomcat/7.0.47

@tangyong
Copy link
Author

There is other simple way to see callstack for users from china?

@tangyong
Copy link
Author

I am looking for other json url and modify testapp.

@Xylus
Copy link
Contributor

Xylus commented Feb 13, 2015

You should be able to see the request dots on the scatter chart even if the http call failed. It should show up as a red dot. You can also try other links at the testapp console such as /getCurrentTimestamp to generate a simple call stack.

However, if you are not seeing any dots on the scatter chart at all, it means the trace data are not being stored in HBase. If this is the case, please restart everything and try again. (start up order should be HBase -> Collector -> TestApp -> Web).

If you are looking to modify testapp by adding other json urls, it'd be great if you could send us a pull request!

@tangyong
Copy link
Author

@Xylus yeah, I have seen the callstack, cool! However, I think that Response Time Scatter Chart should be improved. My idea is that the response time display should be enlarged so that users can directly click it rather than dragging. :)

@Xylus
Copy link
Contributor

Xylus commented Feb 13, 2015

Thanks for the suggestion.

We do get quite a few questions regarding how to use the Scatter Chart. Clicking on the dots may feel more intuitive, but it would be almost impossible to click on individual dots if the request count is large.

Dragging seemed like the best option for us, but things may improve in the future.

@tangyong
Copy link
Author

@Xylus back to the issue, current confirmation result is that on win7 ,

  1. hbase-0.94.x + 1.0.4-rc
    successful

  2. hbase-0.98.x + 1.0.4-rc
    failure (direct reason: hbase starting failed)

  3. hbase-0.98.x + master
    failure (direct reason: not clear)

  4. hbase-0.94.x + master
    todo

@tangyong
Copy link
Author

if hbase-0.94.x + master failed, I believe that there must be some regressions.

@coder-chenzhi
Copy link

I guess the maintainer should give some tutorial for how to use the webUI. I also struggled to find where is callstack information before I saw above conversation.

@tangyong
Copy link
Author

@Xylus meanwhile, we can directly click the edge in server map, then, show the transaction or call stack happened on the two nodes or more nodes.

I think this is a better solution and you can consider using graphic database to store the server map then, combine with hbase.

@Xylus
Copy link
Contributor

Xylus commented Feb 13, 2015

Thank you for your suggestion.

We've actually considered the click edge -> call stack idea before, but some applications had over 100,000 requests per 5 minutes (with less than 5% sampling) and we needed a better way to filter out the requests. Dragging on the scatter chart seemed like the best solution for us.

Work on the Web UI will pick up speed over the next few months and we'll look into your suggestion.
Thank you.

@tangyong
Copy link
Author

@Xylus I can understand you said. forgotting to say: you can also consider the following:

1 Making the user set a gate value of response time
2 Care the response time above the gate value.
3 on displaying, using table way maybe more suitable rather than scatter chart .
4 user can click each row to see calltrace.

@sunflowerlb
Copy link

I installed OpenVPN, have the same problem! Turn off OpenVPN, everything is all right.

@emeroad emeroad closed this as completed Oct 24, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
help wanted proposal
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@tangyong @nstopkimsk @barneykim @sunflowerlb @coder-chenzhi @minwoo-jung @emeroad @Xylus