Googlebot is generating hits

[rubenvanerk]

Is there an option to filter out bots or is something wrong with my configuration?
Anyway, thanks for this project. Looking promising so far!

[milesmcc]

Googlebot hits are recoded, but they don’t affect your overall stats (sessions, pageviews, etc). Or at least they shouldn’t. If you’re looking for a more drastic approach that even excludes Googlebot from the session list, you could add Google’s crawler IP range to your Ignored IPs.

Hope this helps.

[rubenvanerk]

That's weird because Googlebot hits are definitely affecting my overall stats.

Device types section:

Totals:

I took a quick look and I expected the hits to be filtered out on the line below, but I can't find anything that filters out the device_type of ROBOT.

shynet/shynet/core/models.py

Line 125 in 1b344fb

service=self, start_time__gt=start_time, start_time__lt=end_time

[milesmcc]

You're right--I'm mixing this up with another change I made. A few weeks ago I made a commit that removed crawlers from showing up as mobile devices (because sometimes Googlebot will try to request the mobile site, sometimes tricking the device type field), and got that mixed up with an overall exclude.

Eventually, I'd like to implement much more advanced filtering (i.e., by far more than just date), and bots will certainly be a filter option.

[rubenvanerk]

What you're describing is also happening in my case:

I have 44 real sessions in the past ~24 hours

[rubenvanerk]

Google themselves discourage to ignore IPs

For now, I just regularly delete robot sessions through the admin.

[milesmcc]

Maybe the best thing to do is an an option to ignore all bots? Then they won’t ever be logged in the database, thus saving you space.