查看Tomcat中日志

[ZHANGGUOQING91]

在tomcat中设置查看日志的路径，但是控制台没有采集到，ma麻烦查看一下
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(328) ### LogTailComponet stop process.###
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(255) ###LogTailComponet starting process.###
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 15728648 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 263021 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-manager-/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782611 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:361] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782610 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:361] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:361] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:361] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.startAllT(68) AbstractParallelJob tasks size is zero ##
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(328) ### LogTailComponet stop process.###
[2017-10-24 19:34:37:362] 63 D com.creditease.uav.messaging.impl.RMQMessageProducer.submit(119) Submit Message SUCCESS: msg {"iDString":"JQ_IVC-922664408679931904-1508844877305","messageType":"JQ_IVC","params":{"JQ_IVC":"[{"action":"JQ_IVC","appgroup":"UNKNOWN","eof":false,"file":"/app/data/uav/ivc/datax-console_8081_ivc.0.log","host":"vm-10-112-178-171","ip":"10.112.178.171","lines":[{"content":"10.112.178.171_8081_1508844876857_26_467;1;N;E;1508844876857;4;10.112.178.171:8081;datax-console;apache.http.Client,mtd=POST;com.taobao.diamond.client.impl.DefaultDiamondSubscriber;checkUpdateDataIds;/diamond-server/config.co;1%3F200","lnum":24312,"timestamp":1508844877305}],"target":"http://10.112.178.171:8081/datax-console---datax-console","time":1508844877305}]"},"systemId":"922664408679931904","timeStamp":1508844877305},topic={"JQ_IVC":["JQ_IVC"]}
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.TaildirLogComponent.process(255) ###LogTailComponet starting process.###
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 15728648 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 263021 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-manager-/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782611 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:362] 94 D com.creditease.agent.feature.logagent.ReliableTaildirEventReader.updateTailFiles(428) tailfile mapping: 782610 --> /app/apache-datax-7.0.70---/app/apache-datax-7.0.70-datax-console-/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/logs/com.gome.architect.datax-console/app.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/app/apache-datax-7.0.70/logs/catalina.2017-10-24.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###true
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-dynamic.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.addAllTask(60) ### TailFilesMutiJobs tf path:###/root/logs/tddl/tddl-stat.log
[2017-10-24 19:34:37:362] 127 D this.addAllTask(61) ### TailFilesMutiJobs tf needTail: ###false
[2017-10-24 19:34:37:362] 127 D this.startAllT(62) AbstractParallelJob tasks.size(): 1
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.TailFile.readEvents(267) ### Before Total LineNo:2
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.RuleFilterFactory$FilterAndRuleChain.doProcess(347) get log event - [Oct 24, 2017 7:34:36 PM com.creditease.tomcat.plus.util.TomcatLog doLog]
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.RuleFilterFactory$FilterAndRuleChain.doProcess(347) get log event - [INFO: 2017-10-24 19:34:36 [CE] INFO [MonitorServer] com.creditease.monitor.UAVMonitor.record [26(pool-3-thread-1)] UAV.MOF 2017-10-24 19:33:36.847~2017-10-24 19:34:36.858(60): max=1,min=0,avg=0,total=18,req=256,msg=InvokeChain]
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.RuleFilterFactory$FilterAndRuleChain.doProcess(367) datalog >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> []
[2017-10-24 19:34:37:362] 127 D com.creditease.agent.feature.logagent.TailFileTaskJob.work(75) serverlogs is emptry!!!
[2017-10-24 19:34:37:362] 127 E com.creditease.agent.feature.logagent.TailFileTaskJob.work(84) finally invoked...

[uavstack]

Hi，

根据对开源版的测试，JAppLogs的功能是可以正常运行的。无论对JSE还是JEE，只需要在JVM启动参数上加入-DJAppLogs=<日志模式>;<日志模式>;...， 可实现日志画像功能，通过启动日志归集也可以实现对日志的归集。

目前JAppLogs的日志模式支持三种：
1） 绝对路径
2）文件名模糊匹配, 使用作为模糊匹配：例如/app/logs/catalina..log
3）文件夹下文件全部画像：例如/app/logs/*, 则意味着/app/logs目录下面所有文件都被画像

JAppLogs支持多个日志模式的配置，用";"分隔即可。例如：
-DJAppLogs=/app/logs/catalina..log;/app/logs/catalina.out, 则意味着catalina..log的文件和catalina.out的文件都会被画像。

问题诊断：如果发现启动日志归集后，日志没有被抓取，应该是日志文件的时间戳没有更新，MA的Log抓取是根据目标文件的更新时间戳是否变化来判断是否有新的日志数据需要抓取的。

测试发现有时候catalina.out文件可能存在没有更新时间戳的情况，这个是系统层面的文件flush问题。

优化可能：目前考虑会增加其他因子共同判断文件是否有更新，这个会作为未来优化的一个点。

最后，感谢给我们提issue！