New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
export resultset very slow #1059
Comments
Are you sure the problem is in DBeaver? |
Thanks for yuour answer.
I'm sure the problem is in dbeaver.
Today, I've done the tests many times with 3 versions of Dbeaver and the problem occurs only for 3.7.8 and 3.8.1.
The query is just a select with where clause on a column that's the table index.
best regards
T.Coudert
|
Ok. Maybe it is about configuration.
|
We use the same *DB2* driver for all the versions.
With 372 versions, I've got the following times
Data Transfer completed : 556 ms but with CPU user time of 2m58
With 381 versions, I've got the following times
Data transfer completed : 5m37 and CPU user time is 8m29
Note that the execute statement takes only 276 ms for the whole lines
It seems that the same problem occurs on Windows 7
best regards
T.Coudert
Le 13/12/2016 à 18:49, Serge Rider a écrit :
…
Ok. Maybe it is about configuration.
* Do you use the same PostgreSQL driver version in 3.7.2 and 3.7.8+?
* Are there any non-standard column types?
* Check CPU load during CSV export. How much CPU time DBeaver consumes?
* Check what's going on in Session Manager (there should be just one
SELECT query running)
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#1059 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AXaU0EKG4B9jo_FWUttSf341sTwNoy5Iks5rHtqcgaJpZM4LL5Ga>.
|
Dunno why I thought it is PostgreSQL. Anyhow I can't reproduce that with DB2 too (or with any other database). 10k rows are exported in 0.5sec. I can't figure out what may affect bad performance. CSV export is just a single SQL select + consequent fetch of all rows. How long whole data fetch takes in your case (click on Fetch all rows in data editor toolbar)? |
I see the same issue. I have a db2 query that takes 7.5 sec for 1237 rows. When I try to 'export resultset', it's taking on the order of 8 mins and consuming 12-13% CPU on my W520. This is unusual. Before Friday, exporting the resultset would take just a tad longer than the original pull since it's writing to disk. (I'm running 3.7.7 after having run 3.8.1 to see if the latest version would resolve the issue. - Still seeing the issue.) |
I'd wish to fix that but I need more details (as I can't reproduce this on 3 different machines + different databases).
|
I've done some tests
the query was like this
select * from shcema.table where col1 in ('xxxxx','yyyy',...;)
col1 is part of an index on 2 columns and there is 3700 values in the
"in list".
fetching all row in data viewer takes 101 ms with the orignal query
The original query seems to do nothing during some time before the
result file begins to grow, and dbeaver screen is frozen during
execution and remians frozen during about one minute after validation of
"data transfer completed"
When I submit the same query without the where clause, it takes 1m10 for
about 3700000 rows and 500 Mo and dbeaver screen does not
freeze.Immediately, the result file begins to grow.
It seems that some executions are in background and other not
best regards
T.Coudert
Le 14/12/2016 à 23:34, Serge Rider a écrit :
…
I'd wish to fix that but I need more details (as I can't reproduce
this on 3 different machines + different databases).
* What about fetching all rows in data viewer? Does it works slow too?
* Does this problem happens with all tables or only with some?
* Is there anything in error log or debug log
(https://github.com/serge-rider/dbeaver/wiki/Log-files)?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#1059 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AXaU0F_XXRxMzZQIWOj41E767fYgQm3Dks5rIG76gaJpZM4LL5Ga>.
|
Well, this is something. Although I still can't reproduce (even a query with a thousand elements in IN exports fast). Please do this: run export and once UI will freeze make a thread dump (https://github.com/serge-rider/dbeaver/wiki/Making-a-thread-dump). Then post it here. Or just post an example of a query which freezes UI. Maybe it has something very special inside. |
here is the thread dump
best regards
T.Coudert
Le 15/12/2016 à 19:11, Serge Rider a écrit :
Well, this is something. Although I still can't reproduce (even a
query with a thousand elements in IN exports fast).
Please do this: run export and once UI will freeze make a thread dump
(https://github.com/serge-rider/dbeaver/wiki/Making-a-thread-dump).
Then post it here.
Or just post an example of a query which freezes UI. Maybe it has
something very special inside.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#1059 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AXaU0JHw_tNi7RHbSNJ3oV_XTUg94CSDks5rIYLTgaJpZM4LL5Ga>.
2016-12-16 15:35:36
Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.79-b02 mixed mode):
"Attach Listener" daemon prio=10 tid=0x00007f57a4001000 nid=0x870 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Worker-5" prio=10 tid=0x00007f5748004000 nid=0x67c in Object.wait() [0x00007f57ac273000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:52)
"[ThreadPool Manager] - Idle Thread" daemon prio=10 tid=0x00007f576c004000 nid=0x6e63 in Object.wait() [0x00007f57ac374000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006c2e180a0> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
at java.lang.Object.wait(Object.java:503)
at org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor.run(Executor.java:106)
- locked <0x00000006c2e180a0> (a org.eclipse.equinox.internal.util.impl.tpt.threadpool.Executor)
"Worker-4" prio=10 tid=0x00007f5748001000 nid=0x6191 in Object.wait() [0x00007f57ac62e000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:52)
"Worker-3" prio=10 tid=0x00007f575c004000 nid=0x6169 in Object.wait() [0x00007f57d812c000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:52)
"EventAdmin Async Event Dispatcher Thread" daemon prio=10 tid=0x00007f5814dc8800 nid=0x6132 in Object.wait() [0x00007f57d84ac000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006b1a43d48> (a org.eclipse.swt.widgets.RunnableLock)
at java.lang.Object.wait(Object.java:503)
at org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:199)
- locked <0x00000006b1a43d48> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:145)
at org.eclipse.swt.widgets.Display.syncExec(Display.java:4633)
at org.eclipse.e4.ui.internal.workbench.swt.E4Application$1.syncExec(E4Application.java:211)
at org.eclipse.e4.ui.internal.di.UIEventObjectSupplier$UIEventHandler.handleEvent(UIEventObjectSupplier.java:53)
at org.eclipse.equinox.internal.event.EventHandlerWrapper.handleEvent(EventHandlerWrapper.java:197)
at org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:197)
at org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:1)
at org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:340)
"Worker-2" prio=10 tid=0x00007f5760001000 nid=0x5fc4 in Object.wait() [0x00007f57d92e4000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:52)
"RMI TCP Accept-46597" daemon prio=10 tid=0x00007f581475c800 nid=0x5fb1 runnable [0x00007f57da879000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at java.net.ServerSocket.accept(ServerSocket.java:498)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:399)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:371)
at java.lang.Thread.run(Thread.java:745)
"GC Daemon" daemon prio=10 tid=0x00007f581475a800 nid=0x5fad in Object.wait() [0x00007f57d93e5000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186ac18> (a sun.misc.GC$LatencyLock)
at sun.misc.GC$Daemon.run(GC.java:117)
- locked <0x000000041186ac18> (a sun.misc.GC$LatencyLock)
"RMI Reaper" prio=10 tid=0x00007f5814759800 nid=0x5fac in Object.wait() [0x00007f57d94e6000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186ad50> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x000000041186ad50> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
at java.lang.Thread.run(Thread.java:745)
"RMI TCP Accept-0" daemon prio=10 tid=0x00007f5814759000 nid=0x5fab runnable [0x00007f57d95e7000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at java.net.ServerSocket.accept(ServerSocket.java:498)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:399)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:371)
at java.lang.Thread.run(Thread.java:745)
"Worker-1" prio=10 tid=0x00007f575c001000 nid=0x5fa6 in Object.wait() [0x00007f57d96e8000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.sleep(WorkerPool.java:188)
- locked <0x000000041186b388> (a org.eclipse.core.internal.jobs.WorkerPool)
at org.eclipse.core.internal.jobs.WorkerPool.startJob(WorkerPool.java:220)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:52)
"DBeaver: Transfer data" prio=10 tid=0x00007f581467f800 nid=0x5fa2 in Object.wait() [0x00007f57d9f88000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006b456d4d0> (a org.eclipse.ui.internal.Semaphore)
at org.eclipse.ui.internal.Semaphore.acquire(Semaphore.java:43)
- locked <0x00000006b456d4d0> (a org.eclipse.ui.internal.Semaphore)
at org.eclipse.ui.internal.UISynchronizer.syncExec(UISynchronizer.java:164)
at org.eclipse.swt.widgets.Display.syncExec(Display.java:4633)
at org.eclipse.e4.ui.internal.workbench.swt.E4Application$1.syncExec(E4Application.java:211)
at org.eclipse.e4.ui.internal.di.UIEventObjectSupplier$UIEventHandler.handleEvent(UIEventObjectSupplier.java:53)
at org.eclipse.equinox.internal.event.EventHandlerWrapper.handleEvent(EventHandlerWrapper.java:197)
at org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:197)
at org.eclipse.equinox.internal.event.EventHandlerTracker.dispatchEvent(EventHandlerTracker.java:1)
at org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230)
at org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148)
at org.eclipse.equinox.internal.event.EventAdminImpl.dispatchEvent(EventAdminImpl.java:135)
at org.eclipse.equinox.internal.event.EventAdminImpl.sendEvent(EventAdminImpl.java:78)
at org.eclipse.equinox.internal.event.EventComponent.sendEvent(EventComponent.java:39)
at org.eclipse.e4.ui.services.internal.events.EventBroker.send(EventBroker.java:85)
at org.eclipse.e4.ui.internal.workbench.UIEventPublisher.notifyChanged(UIEventPublisher.java:59)
at org.eclipse.emf.common.notify.impl.BasicNotifierImpl.eNotify(BasicNotifierImpl.java:374)
at org.eclipse.e4.ui.model.application.impl.StringToObjectMapImpl.setTypedValue(StringToObjectMapImpl.java:133)
at org.eclipse.e4.ui.model.application.impl.StringToObjectMapImpl.setValue(StringToObjectMapImpl.java:285)
at org.eclipse.emf.common.util.BasicEMap.putEntry(BasicEMap.java:297)
at org.eclipse.emf.common.util.BasicEMap.put(BasicEMap.java:578)
at org.eclipse.emf.common.util.BasicEMap$DelegatingMap.put(BasicEMap.java:793)
at org.eclipse.ui.internal.e4.compatibility.CompatibilityPart$4.propertyChanged(CompatibilityPart.java:368)
at org.eclipse.ui.part.WorkbenchPart.firePropertyChange(WorkbenchPart.java:129)
at org.eclipse.ui.texteditor.AbstractTextEditor.firePropertyChange(AbstractTextEditor.java:6387)
at org.eclipse.ui.part.WorkbenchPart.setTitleImage(WorkbenchPart.java:321)
at org.jkiss.dbeaver.ui.editors.sql.SQLEditor.access$14(SQLEditor.java:1)
at org.jkiss.dbeaver.ui.editors.sql.SQLEditor$SQLEditorQueryListener.onEndQuery(SQLEditor.java:1794)
at org.jkiss.dbeaver.runtime.sql.SQLQueryJob.executeSingleQuery(SQLQueryJob.java:417)
at org.jkiss.dbeaver.runtime.sql.SQLQueryJob.extractData(SQLQueryJob.java:708)
at org.jkiss.dbeaver.ui.editors.sql.SQLEditor$QueryResultsContainer.readData(SQLEditor.java:1659)
at org.jkiss.dbeaver.tools.transfer.database.DatabaseTransferProducer.transferData(DatabaseTransferProducer.java:113)
at org.jkiss.dbeaver.tools.transfer.database.DatabaseTransferProducer.transferData(DatabaseTransferProducer.java:1)
at org.jkiss.dbeaver.tools.transfer.wizard.DataTransferJob.transferData(DataTransferJob.java:96)
at org.jkiss.dbeaver.tools.transfer.wizard.DataTransferJob.run(DataTransferJob.java:65)
at org.jkiss.dbeaver.model.runtime.AbstractJob.run(AbstractJob.java:103)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
"EMF Reference Cleaner" daemon prio=10 tid=0x00007f578003b800 nid=0x5f96 in Object.wait() [0x00007f57da18c000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000004118ef2c8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x00000004118ef2c8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at org.eclipse.emf.common.util.CommonUtil$1ReferenceClearingQueuePollingThread.run(CommonUtil.java:70)
"Worker-JM" prio=10 tid=0x00007f5774429000 nid=0x5f90 in Object.wait() [0x00007f57da28d000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000004118ef368> (a java.util.ArrayList)
at org.eclipse.core.internal.jobs.InternalWorker.run(InternalWorker.java:59)
- locked <0x00000004118ef368> (a java.util.ArrayList)
"Bundle File Closer" daemon prio=10 tid=0x00007f57742f9000 nid=0x5f87 in Object.wait() [0x00007f57da3c8000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000004118fb1e8> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:503)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <0x00000004118fb1e8> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)
"[Timer] - Main Queue Handler" daemon prio=10 tid=0x00007f5778002000 nid=0x5f7c in Object.wait() [0x00007f57da778000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041190b1c8> (a java.lang.Object)
at org.eclipse.equinox.internal.util.impl.tpt.timer.TimerImpl.run(TimerImpl.java:141)
- locked <0x000000041190b1c8> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:745)
"Start Level: Equinox Container: 10bf70b8-9cc3-0016-1107-951f8b06c91e" daemon prio=10 tid=0x00007f5814593000 nid=0x5f7a in Object.wait() [0x00007f57da97a000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000041191b130> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:503)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <0x000000041191b130> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)
"Framework Event Dispatcher: Equinox Container: 10bf70b8-9cc3-0016-1107-951f8b06c91e" daemon prio=10 tid=0x00007f577c015000 nid=0x5f6f in Object.wait() [0x00007f57daa7b000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000004118fb260> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:503)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <0x00000004118fb260> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)
"Refresh Thread: Equinox Container: 10bf70b8-9cc3-0016-1107-951f8b06c91e" daemon prio=10 tid=0x00007f5814563000 nid=0x5e4a in Object.wait() [0x00007f57dab7c000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000411898620> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at java.lang.Object.wait(Object.java:503)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:400)
- locked <0x0000000411898620> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:336)
"Active Thread: Equinox Container: 10bf70b8-9cc3-0016-1107-951f8b06c91e" prio=10 tid=0x00007f5814529800 nid=0x5e3f waiting on condition [0x00007f57dac7d000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000004118fb340> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
"Service Thread" daemon prio=10 tid=0x00007f581429a800 nid=0x5e22 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007f5814298800 nid=0x5e21 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00007f5814295800 nid=0x5e20 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00007f5814293000 nid=0x5e1f runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00007f5814269800 nid=0x5e1e in Object.wait() [0x00007f57e0142000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000411843f48> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x0000000411843f48> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"Reference Handler" daemon prio=10 tid=0x00007f5814267800 nid=0x5e1d in Object.wait() [0x00007f57e0243000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000411843a40> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x0000000411843a40> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x00007f5814008000 nid=0x5e0e runnable [0x00007f5818bd0000]
java.lang.Thread.State: RUNNABLE
at org.eclipse.swt.internal.gtk.OS._pango_layout_get_pixel_size(Native Method)
at org.eclipse.swt.internal.gtk.OS.pango_layout_get_pixel_size(OS.java:16362)
at org.eclipse.swt.graphics.GC.computeStringSize(GC.java:2973)
at org.eclipse.swt.graphics.GC.textExtent(GC.java:4124)
at org.eclipse.swt.graphics.GC.textExtent(GC.java:4084)
at org.eclipse.ui.internal.progress.ProgressManagerUtil.shortenText(ProgressManagerUtil.java:205)
at org.eclipse.ui.internal.progress.ProgressViewerLabelProvider.getText(ProgressViewerLabelProvider.java:30)
at org.eclipse.ui.internal.progress.ProgressCanvasViewer$2.paintControl(ProgressCanvasViewer.java:221)
at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:230)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4481)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1329)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1353)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1338)
at org.eclipse.swt.widgets.Control.gtk_expose_event(Control.java:3250)
at org.eclipse.swt.widgets.Composite.gtk_expose_event(Composite.java:760)
at org.eclipse.swt.widgets.Canvas.gtk_expose_event(Canvas.java:181)
at org.eclipse.swt.widgets.Widget.windowProc(Widget.java:1973)
at org.eclipse.swt.widgets.Control.windowProc(Control.java:5685)
at org.eclipse.swt.widgets.Display.windowProc(Display.java:4717)
at org.eclipse.swt.internal.gtk.OS._gtk_main_do_event(Native Method)
at org.eclipse.swt.internal.gtk.OS.gtk_main_do_event(OS.java:9326)
at org.eclipse.swt.widgets.Display.eventProc(Display.java:1225)
at org.eclipse.swt.internal.gtk.OS._g_main_context_iteration(Native Method)
at org.eclipse.swt.internal.gtk.OS.g_main_context_iteration(OS.java:2435)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3428)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$4.run(PartRenderingEngine.java:1127)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:337)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1018)
at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:156)
at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:694)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:337)
at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:606)
at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150)
at org.jkiss.dbeaver.core.application.DBeaverApplication.start(DBeaverApplication.java:212)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:669)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:608)
at org.eclipse.equinox.launcher.Main.run(Main.java:1515)
at org.eclipse.equinox.launcher.Main.main(Main.java:1488)
"VM Thread" prio=10 tid=0x00007f5814263000 nid=0x5e1c runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007f581401d800 nid=0x5e0f runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007f581401f800 nid=0x5e10 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x00007f5814021800 nid=0x5e11 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x00007f5814023800 nid=0x5e12 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x00007f5814025800 nid=0x5e13 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x00007f5814027000 nid=0x5e14 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x00007f5814029000 nid=0x5e15 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x00007f581402b000 nid=0x5e16 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x00007f581402d000 nid=0x5e17 runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x00007f581402f000 nid=0x5e18 runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x00007f5814031000 nid=0x5e19 runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x00007f5814033000 nid=0x5e1a runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x00007f5814034800 nid=0x5e1b runnable
"VM Periodic Task Thread" prio=10 tid=0x00007f58142a5800 nid=0x5e23 waiting on condition
JNI global references: 647
|
Thanks. Now I have a clue... |
Will be fixed in 3.8.2. |
Perhaps this will help. My initial query which resulted in 1027 rows for full initial pull took 11.5 sec. The export resultset for that query took 583 mins. When I look at the csv file produced, there is a 14 sec difference between the created and modified date (Win7). In that time period, I see in dbeaver-debug.log a recurring 37-line entry from 13 sec before the created date to the modified date. Here I show the first of 38 such 37-line entries --the last of which coincides with the modified date of the csv file: 2016-12-16 19:01:22.707 - org.eclipse.jface.text.BadLocationException |
Sorry - didn't see that 3.8.2 will address this. |
This error above is just a warning but it may produce huge log file. |
Hello. |
DBeaver version 5.0.4 I am having issue to export large resultset in CSV. The query works fine because is a simple SELECT but it's very big (>10 billion of record) It seems that dbeaver completed the operation (on the status bar the progress is 100%) but he is not writing the file to the disk. The CPU usage of DBEaver is 0%. I wonder why if the resultfetch size can improve the performace so much as said by stongaHotmailCom the default is just 200. Any clue here ? Edit: I didn't open a new Issue because the topic is the same, and also for the trick suggested by stonga. If you want i can open a new issue. |
with 3.7.2 , an export (Resulset) takes about 800 ms for about 4000 lines.
Since 3.7.8, the same export (Resulset) takes about 5 minutes for the same number of lines
We are on RHEL 6 and I've tried different versions of Java (1.7 and 1.8)
The text was updated successfully, but these errors were encountered: