Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

INFO MemoryObserver:41 used RAM: 2543 MB #1489

Closed
cs071372 opened this issue May 6, 2021 · 1 comment
Closed

INFO MemoryObserver:41 used RAM: 2543 MB #1489

cs071372 opened this issue May 6, 2021 · 1 comment

Comments

@cs071372
Copy link

cs071372 commented May 6, 2021

Hi, I m facing a problem while doing a big number of simulations on Matsim. The simulation is called 10 times and each time it makes 40 simulation runs, thus, 40*10 simulation runs. However, At some point, after 6-7hours of running I receive the log below at my outputlog and from that point nothing else happends. It seems like it never terminates.
I cannot see what this MemoryObserver is? Might be a java problem? Or some memory problem at some point?
Thanks in advance

2021-05-06T15:43:28,317 ERROR AbstractMultithreadedModule$ExceptionHandler:210 Thread PlanRouter.21 died with exception. Will stop after all threads finished.

java.lang.NullPointerException: null
                at org.matsim.core.router.AStarEuclidean.addToPendingNodes(AStarEuclidean.java:176) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.relaxNodeLogic(Dijkstra.java:423) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.AbstractFastRouterDelegate.relaxNode(AbstractFastRouterDelegate.java:99) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.FastAStarLandmarks.relaxNode(FastAStarLandmarks.java:128) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.searchLogic(Dijkstra.java:318) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.calcLeastCostPath(Dijkstra.java:237) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.AStarLandmarks.calcLeastCostPath(AStarLandmarks.java:125) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.FastAStarLandmarks.calcLeastCostPath(FastAStarLandmarks.java:79) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.NetworkRoutingModule.calcRoute(NetworkRoutingModule.java:95) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.contrib.ev.routing.MyEvNetworkRoutingModule.calcRoute(MyEvNetworkRoutingModule.java:125) ~[classes/:?]
                at org.matsim.core.router.TripRouter.calcRoute(TripRouter.java:174) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.PlanRouter.run(PlanRouter.java:94) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.replanning.modules.AbstractMultithreadedModule$PlanAlgoThread.run(AbstractMultithreadedModule.java:234) ~[matsim-12.0-SNAPSHOT.jar:?]
                at java.lang.Thread.run(Thread.java:834) [?:?]
2021-05-06T15:43:28,332 ERROR AbstractMultithreadedModule$ExceptionHandler:210 Thread PlanRouter.20 died with exception. Will stop after all threads finished.
java.lang.NullPointerException: null
                at org.matsim.core.router.AStarEuclidean.addToPendingNodes(AStarEuclidean.java:176) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.relaxNodeLogic(Dijkstra.java:423) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.AbstractFastRouterDelegate.relaxNode(AbstractFastRouterDelegate.java:99) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.FastAStarLandmarks.relaxNode(FastAStarLandmarks.java:128) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.searchLogic(Dijkstra.java:318) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.calcLeastCostPath(Dijkstra.java:237) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.AStarLandmarks.calcLeastCostPath(AStarLandmarks.java:125) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.FastAStarLandmarks.calcLeastCostPath(FastAStarLandmarks.java:79) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.NetworkRoutingModule.calcRoute(NetworkRoutingModule.java:95) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.contrib.ev.routing.MyEvNetworkRoutingModule.calcRoute(MyEvNetworkRoutingModule.java:125) ~[classes/:?]
                at org.matsim.core.router.TripRouter.calcRoute(TripRouter.java:174) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.PlanRouter.run(PlanRouter.java:94) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.replanning.modules.AbstractMultithreadedModule$PlanAlgoThread.run(AbstractMultithreadedModule.java:234) ~[matsim-12.0-SNAPSHOT.jar:?]
                at java.lang.Thread.run(Thread.java:834) [?:?]

2021-05-06T15:43:28,317 ERROR AbstractMultithreadedModule$ExceptionHandler:210 Thread PlanRouter.16 died with exception. Will stop after all threads finished.

java.lang.NullPointerException: null
                at org.matsim.core.router.AStarEuclidean.addToPendingNodes(AStarEuclidean.java:176) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.relaxNodeLogic(Dijkstra.java:423) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.AbstractFastRouterDelegate.relaxNode(AbstractFastRouterDelegate.java:99) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.FastAStarLandmarks.relaxNode(FastAStarLandmarks.java:128) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.searchLogic(Dijkstra.java:318) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.Dijkstra.calcLeastCostPath(Dijkstra.java:237) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.AStarLandmarks.calcLeastCostPath(AStarLandmarks.java:125) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.FastAStarLandmarks.calcLeastCostPath(FastAStarLandmarks.java:79) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.NetworkRoutingModule.calcRoute(NetworkRoutingModule.java:95) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.contrib.ev.routing.MyEvNetworkRoutingModule.calcRoute(MyEvNetworkRoutingModule.java:125) ~[classes/:?]
                at org.matsim.core.router.TripRouter.calcRoute(TripRouter.java:174) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.router.PlanRouter.run(PlanRouter.java:94) ~[matsim-12.0-SNAPSHOT.jar:?]
                at org.matsim.core.replanning.modules.AbstractMultithreadedModule$PlanAlgoThread.run(AbstractMultithreadedModule.java:234) ~[matsim-12.0-SNAPSHOT.jar:?]
                at java.lang.Thread.run(Thread.java:834) [?:?]`
@mrieser
Copy link
Contributor

mrieser commented May 31, 2021

The MemoryObserver is independent, it just regularly reports the current memory usage.

In your case, you have an exception during the shortest path search ("routing"). This is very uncommon, as this part is very often used and pretty well tested.

I see that you use a rather old version (matsim-12.0-SNAPSHOT.jar). MATSim 12.0 was released in 2020, MATSim 13.0 in 2021, so your version is at least 1.5 years old. There was an issue last year where a problem in routing came up randomly in some configurations (e.g. only when running on Java 11, not when running on Java 8). So I suggest to try to use a newer version of MATSim and see if the problem still occurs.

@mrieser mrieser closed this as completed Jul 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants