Required MariaDB/MySQL connection count is confusing #3947
Milestone
Comments
|
Did you make sure you put your db credentials in spine.conf ?
Also what is your thread/process count
…On Tue, Nov 24, 2020, 08:25 Babat28119 ***@***.***> wrote:
Dear community,
We observed some performance issue on our cacti platform and we went ahead
to upgrade Cacti to version 1.2.14 and change the poller to use spine but
we get so many error message in the log file. see below/attached.
*errors:*
a. Maximum runtime of 298 seconds exceeded. Exiting.
b. Method:spine Processes:1 Threads:1 Hosts:112 HostsPerProcess:112
DataSources:7624 RRDsProcessed:831
c. SNMP OID! (oid: ), Set MAX_OIDS to 1 for this host to isolate bad OID
d. ERROR: SQL Failed! Error:'2013', Message:'Lost connection to MySQL
server during query', SQL Fragment:'UPDATE poller_reindex SET
Most of the graphs are either breaking or empty or showing NAN
Await your swift response.
[image: poller 1]
<https://user-images.githubusercontent.com/69158129/100100215-c0b8b280-2e60-11eb-973c-9ce9b99d2f9a.JPG>
[image: spine error]
<https://user-images.githubusercontent.com/69158129/100099869-47b95b00-2e60-11eb-827a-bd808f7067b9.JPG>
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#3947>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ADGEXTBJOKYMGF4TVVLCZNDSROX47ANCNFSM4UA4J2IA>
.
|
|
Sorry I didn't see the picture at first
What is your thread/process count ?
…On Tue, Nov 24, 2020, 08:46 Sean Mancini ***@***.***> wrote:
Did you make sure you put your db credentials in spine.conf ?
Also what is your thread/process count
On Tue, Nov 24, 2020, 08:25 Babat28119 ***@***.***> wrote:
> Dear community,
>
> We observed some performance issue on our cacti platform and we went
> ahead to upgrade Cacti to version 1.2.14 and change the poller to use spine
> but we get so many error message in the log file. see below/attached.
>
> *errors:*
> a. Maximum runtime of 298 seconds exceeded. Exiting.
> b. Method:spine Processes:1 Threads:1 Hosts:112 HostsPerProcess:112
> DataSources:7624 RRDsProcessed:831
> c. SNMP OID! (oid: ), Set MAX_OIDS to 1 for this host to isolate bad OID
> d. ERROR: SQL Failed! Error:'2013', Message:'Lost connection to MySQL
> server during query', SQL Fragment:'UPDATE poller_reindex SET
>
> Most of the graphs are either breaking or empty or showing NAN
>
> Await your swift response.
>
> [image: poller 1]
> <https://user-images.githubusercontent.com/69158129/100100215-c0b8b280-2e60-11eb-973c-9ce9b99d2f9a.JPG>
>
> [image: spine error]
> <https://user-images.githubusercontent.com/69158129/100099869-47b95b00-2e60-11eb-827a-bd808f7067b9.JPG>
>
> —
> You are receiving this because you are subscribed to this thread.
> Reply to this email directly, view it on GitHub
> <#3947>, or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ADGEXTBJOKYMGF4TVVLCZNDSROX47ANCNFSM4UA4J2IA>
> .
>
|
|
Thanks for your swift response. The credentials in spine.conf was changed to DB credentials. See below the thread and processes Method:spine Processes:1 Threads:1 Hosts:112 HostsPerProcess:112 DataSources:7624 RRDsProcessed:831 |
|
There is your problem you need to raise your proc and process count
Try something like 2 threads 10 process
Check the docs on GitHub for tuning spine
…On Tue, Nov 24, 2020, 08:59 Babat28119 ***@***.***> wrote:
Thanks for your swift response. The credentials in spine.conf was changed
to DB credentials. See below the thread and processes
Method:spine Processes:1 Threads:1 Hosts:112 HostsPerProcess:112
DataSources:7624 RRDsProcessed:831
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#3947 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/ADGEXTE7XKXXXN2FFCMAP33SRO34XANCNFSM4UA4J2IA>
.
|
|
how can i go about changing the thread and process. any guide? |
|
|
|
I have been able to change the threads and processes as advice but i still have error as below/attached. |
|
The thread setting is at the Data Collector level. Edit the Data Collector and set the threads there. I know that this is confusing. We'll be making it a bit simpler to interpret in the 1.2.16 release. Also, those 2013 issues, we've been seeing them a lot. What MariaDB version are you on right now? |
|
Going to update to this shortly. Hope that helps.
|
|
Wow that is nice
…On Wed, Nov 25, 2020, 08:56 TheWitness ***@***.***> wrote:
Going to update to this shortly. Hope that helps.
[image: image]
<https://user-images.githubusercontent.com/1439914/100236694-ff4f7b00-2efb-11eb-832b-30e002907095.png>
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#3947 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/ADGEXTHO66UPSE2P6QOFZF3SRUEHBANCNFSM4UA4J2IA>
.
|
TheWitness
changed the title
|
Just update CACTI_TOP/utilities.php from the 1.2.x branch. |
|
I have changed the thread from Data collector. The Database is currently on 10.1.47-MariaDB. However, i will need some clarification as highlighted below. a. what is your recommendation/setting for an enterprise monitoring, we currently have over 10,000 data source. lastly how can i update the CACTI_TOP/utilities.php |
|
I can help here
First to get the formula for recommended connections look at the spine doc
in the cacti documentation repo I updated the doc not long ago
To update utilities go to the 1.2.x repo find the utilities.php file and
download it
…On Wed, Nov 25, 2020, 10:02 Babat28119 ***@***.***> wrote:
I have changed the thread from Data collector. The Database is currently
on 10.1.47-MariaDB. However, i will need some clarification as highlighted
below.
a. what is your recommendation/setting for an enterprise monitoring, we
currently have over 10,000 data source.
b. can we have more than one poller as i tried using Spine but got some
much error message as shown above.
lastly how can i update the CACTI_TOP/utilities.php
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#3947 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/ADGEXTEMYASNEXUMHPA3N7DSRUL67ANCNFSM4UA4J2IA>
.
|
|
Also yes you can use multi pollers just need to ensure you connection count
is set properly and that you setup your spine thread/process count properly
…On Wed, Nov 25, 2020, 10:08 Sean Mancini ***@***.***> wrote:
I can help here
First to get the formula for recommended connections look at the spine doc
in the cacti documentation repo I updated the doc not long ago
To update utilities go to the 1.2.x repo find the utilities.php file and
download it
On Wed, Nov 25, 2020, 10:02 Babat28119 ***@***.***> wrote:
> I have changed the thread from Data collector. The Database is currently
> on 10.1.47-MariaDB. However, i will need some clarification as highlighted
> below.
>
> a. what is your recommendation/setting for an enterprise monitoring, we
> currently have over 10,000 data source.
> b. can we have more than one poller as i tried using Spine but got some
> much error message as shown above.
>
> lastly how can i update the CACTI_TOP/utilities.php
>
> —
> You are receiving this because you commented.
> Reply to this email directly, view it on GitHub
> <#3947 (comment)>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ADGEXTEMYASNEXUMHPA3N7DSRUL67ANCNFSM4UA4J2IA>
> .
>
|
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Dear community,
We observed some performance issue on our cacti platform and we went ahead to upgrade Cacti to version 1.2.14 and change the poller to use spine but we get so many error message in the log file. see below/attached.
errors:
a. Maximum runtime of 298 seconds exceeded. Exiting.
b. Method:spine Processes:1 Threads:1 Hosts:112 HostsPerProcess:112 DataSources:7624 RRDsProcessed:831
c. SNMP OID! (oid: ), Set MAX_OIDS to 1 for this host to isolate bad OID
d. ERROR: SQL Failed! Error:'2013', Message:'Lost connection to MySQL server during query', SQL Fragment:'UPDATE poller_reindex SET
Most of the graphs are either breaking or empty or showing NAN
Await your swift response.
The text was updated successfully, but these errors were encountered: