Devices still show in lists despite being deleted

[bmfmancini]

Hey Guys

So I deleted about 100 Devices to re-inport them via automation into cacti
when I try to re-import cacti skips the IP's reporting device already in cacti

I tried the remove_device script and used a regex which found all the sites I used --confirm the script reports back successful

yet AutoM8 still skips the IP's and if you run the script again the devices are still there !!

[netniV]

Are you running this on the poller that normally collects from the devices?

[bmfmancini]

I actually ran it from the main poller first which showed the devices in the DB then ran it on the remote poller that time it didnt show the devices in the db

[netniV]

I believe that now when a device gets deleted in Cacti, it is flagged as deleted using the deleted column and then this is replicated. This was a change in 1.2 to ensure that deleted devices were properly replicated for deletion rather than simply removing the record only to have it recreated because the main or remote thought it should be there.

I'm wondering if there is a conflict between this deleted flag being set and the record not removed yet, and automation checking if a device exists without filtering on the deleted column.

[bmfmancini]

its weird I did a full sync as well and that didn't seem to help
I restored from a DB backup to resolve for now but its something for sure to look into

[cigamit]

The only time that this could possibly happens is when:

1. When devices are removed while the remote poller is running
2. When the main data collector can not reach the remote database over a mysql connection.

Case 1) is difficult to completely overcome. We do have a purge command that happens at the bottom of each poller run, but if the remote database is not accessible, the purge will not complete successfully.

[bmfmancini]

It's got me scratching my head because even the remove device php script comes back as successful I ran the script on both the main and remote pollers as well The main poller found all of the devices that I was looking for I ran with a --confirm result came back as successful The devices did not show up in the device group and red cleaner marked the rrrds as orphaned

…

On Sun., Sep. 15, 2019, 10:38 a.m. Jimmy Conner, ***@***.***> wrote: The only time that this could possibly happens is when: 1. When devices are removed while the remote poller is running 2. When the main data collector can not reach the remote database over a mysql connection. Case 1) is difficult to completely overcome. We do have a purge command that happens at the bottom of each poller run, but if the remote database is not accessible, the purge will not complete successfully. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2937?email_source=notifications&email_token=ADGEXTGKGXH3ONNN4BP5JK3QJZCFDA5CNFSM4IWJVQA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6XSA5Y#issuecomment-531570807>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADGEXTAXY7LEVSRQ476JW4TQJZCFDANCNFSM4IWJVQAQ> .

[cigamit]

From the main system, edit the Remote Data Collector and test the connection. Is everything coming back successful?

[bmfmancini]

I'll check that tomorrow and let you know Thanks!

…

On Sun., Sep. 15, 2019, 10:58 a.m. Jimmy Conner, ***@***.***> wrote: From the main system, edit the Remote Data Collector and test the connection. Is everything coming back successful? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2937?email_source=notifications&email_token=ADGEXTH4LEOX2HK2XN74MJDQJZERLA5CNFSM4IWJVQA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6XSPBA#issuecomment-531572612>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADGEXTFWFC2PAGSWTKSULWTQJZERLANCNFSM4IWJVQAQ> .

[bmfmancini]

Just a thought though If the remote pollers couldn't access the main poller wouldn't I have bigger issues The graphs from that poller work just fine and that poller gets all the settings properly even when updated at the main poller Also there are no errors with poller syncs On Sun., Sep. 15, 2019, 11:42 a.m. Sean Mancini, <sean@seanmancini.com> wrote:

…

I'll check that tomorrow and let you know Thanks! On Sun., Sep. 15, 2019, 10:58 a.m. Jimmy Conner, ***@***.***> wrote: > From the main system, edit the Remote Data Collector and test the > connection. Is everything coming back successful? > > — > You are receiving this because you authored the thread. > Reply to this email directly, view it on GitHub > <#2937?email_source=notifications&email_token=ADGEXTH4LEOX2HK2XN74MJDQJZERLA5CNFSM4IWJVQA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6XSPBA#issuecomment-531572612>, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/ADGEXTFWFC2PAGSWTKSULWTQJZERLANCNFSM4IWJVQAQ> > . >

[bmfmancini]

Ok tested

The main poller is able to reach the remote pollers DB just fine
tested by messing around with the credentials

Still very weird

[bmfmancini]

Ok so I revisited this and something is still no right

When you delete the device off the main poller it is gone you can add the site back manually but through AUTOM8 is will show as still in cacti

If you select the hostname table the entry is still in the DB !

The main poller can reach the remote pollers just fine replication works as well
no sql errors in the log and no errors in the mariadb log either

[netniV]

That is likely that AUTOM8 isn't ignoring devices that are set to deleted in the hosts table. Because of replication, they are not totally removed until all replication is complete.

[bmfmancini]

I forced replication and still the same It's like the table is not actually replicating

…

On Sun., Oct. 6, 2019, 12:32 p.m. Mark Brugnoli-Vinten, < ***@***.***> wrote: That is likely that AUTOM8 isn't ignoring devices that are set to deleted in the hosts table. Because of replication, they are not totally removed until all replication is complete. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2937?email_source=notifications&email_token=ADGEXTCO2TQIIS33CVX2DDLQNIHIHA5CNFSM4IWJVQA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAOOFFI#issuecomment-538763925>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADGEXTGRKC7SOSRAGWHRWFTQNIHIHANCNFSM4IWJVQAQ> .

[bmfmancini]

Deleted a device directly from the DB

here is the command I ran

(delete from host where hostname like 'Ip address;)

I re-ran autom8 and it picked up the device and re-added it
I did notice duplicate records of the device that I added manually I don't think cacti is marking the device as deleted

No errors are seen from the SQL call and no troubles issuing the command as the same user that cacti uses so not a permissions issue

I am not sure if this is specific to 1.2.5