Finish the Plugin Live! Reports detailed information on the last N visitors

[mattab]

ALPHA version currently

Current Piwik contains a disabled-by-default plugin called Live! that, when enabled, add a new widget in the widget list, that will show your latest visitors in real time. However this plugin is not very useful as such, and was built as a proof of concept. Improving the plugin has been one of the most requested user feature for months! If you would like to help, please post a comment, or submit a patch. Enjoy

Concept

The page should be entertaining to watch, fed with real time data, and open the webmaster to dig more into the other reports that Piwik offer.

Background
This feature is heavily requested by the community (http://feedback.phpmyvisites.net/feedbacks/2630-last-n-visitor-details-config-info-path-etc) and would be really providing a plus to Piwik feature set.

Data provided
- at top of screen, clear summary:
– Today you had: N visits, M pages today
– In the last 30 minutes you had: X visits, Y pages
- list of the last N visitors with their information
– settings (os, browser, resolution, plugins) – icons only, details on icon hover
– referer (keyword, name, icon, clickable url – useful for SEO)
– country icon
– IP for piwik users with admin permission or super user
– count of pages seen during this visit
– time spent during this visit
– number of goals converted, click on goals would show the list of pages with goals highlighted (see below)
- for each visit, it is possible to view pages:
– page title,
– page url that links to it,
– outlinks are shown different colors (icon ?)
– downloads are shown different colors (icon ?)
– when the page view was a Goal trigger, different color (icon ?) along with goal name and revenue.

UI features
- this page should make it possible to view all past visits for a current returning visitor. The idea would be to have an icon when the visitor is a returning visitor. Clicking on this icon would show the past visits for this visit. This is a UI challenge to make it look good and make it usable. for examples, previous visits rows could be shown below the visit row with a left margin and below a title “This visitor previously visited the website:”.
- by default, the spy mode would be enabled, therefore the page would reload regularly (every 2 seconds?) and show the new visits. We need a way to pause/resume the spy mode, if traffic is too big or if user wants to take more time to analyze existing traffic snapshot
- all the data would be shown in a one page interface, to simplify browsing and discovery; this poses UI challenges to make the page usable and looking clean.
- all data would be provided through the Live! plugin API.
- there is an open question on how to refresh visits for which visitors view a new page. For example, we could highlight the visit row in yellow background and add the new page row below the visit. Or we could automatically move the visit with the new page view at the top of the page and highlight (eg. yellow background) the new page view.

in V2
- on the right of the spy, or on a different “spy page”, we could show a auto-refreshing google map with the new visits in real time. see #5466

Any feedback? Anybody would like to help implementing this interesting new plugin and UI challenge?

[mattab]

Attachment: example submitted by user
[-24-01-2009-17.38.54.jpg](http://issues.piwik.org/attachments/5464/-24-01-2009-17.38.54.jpg)

[robocoder]

Supra Mega Ultra Spy! In all seriousness, are there any other spy requirements?

[mattab]

vipsoft, because you asked, I just updated the ticket with my latest thought on what this plugin could be. This is an interesting UI challenge, and would def be a feature killer once done :)

[mattab]

see also #838

[anonymous-matomo-user]

I found another example :

http://jehiah.cz/projects/pathstats/

I think it's better with the list of small colored files icons ; it takes less space and we only have to over the mouse on each icon to see what page it is.

[robocoder]

From #840:

When I add the live! widget, I have two buttons at the button. When I press the "play"-Button, the websites duplicates and stops working. Please see attached screenshot for more informations.

Also:

In the Widgets preview (Widgetize), hovering over "Live Visitors!" causes the browser to be less responsive (as if processing a lot of JavaScript in the background).

[anonymous-matomo-user]

Attachment:
screenshot.png

[anonymous-matomo-user]

Attachment:
Live.tar.gz

[anonymous-matomo-user]

I have added some features: See Screenshot

Now following Data provided

* at top of screen, clear summary:
      o Today you had: N visits, M pages today
      o In the last 30 minutes you had: X visits, Y pages 
* list of the last N visitors with their information
      o settings (os, browser, resolution, plugins) - icons only, details on icon hover
      o referer (keyword, name, icon, clickable url - useful for SEO)
      o country icon
      o IP for piwik users with admin permission or super user
      o count of pages seen during this visit

* for each visit, it is possible to view pages:
      o page title,

[mattab]

Hey jr-ewing, thanks for following up! it looks really interesting. Are you planning to finish implementation of this ticket? what features are still missing from the ticket description?
Thanks!

[anonymous-matomo-user]

Is there any meaning for the color of the folder icons ?

By the way, they are pretty.

The spacing between them could be reduced though.

[anonymous-matomo-user]

Missing are:

* time spent during this visit
* number of goals converted, click on goals would show the list of pages with goals highlighted (see below) 

* page url that links to it,
* outlinks are shown different colors (icon ?)
* downloads are shown different colors (icon ?)
* when the page view was a Goal trigger, different color (icon ?) along with goal name and revenue. 

[anonymous-matomo-user]

@TulipVorlax
the colors shows only a history.

[anonymous-matomo-user]

am new here - please forgive me if this is in the wrong place...

This has been working fine and is really useful. However I found that after a few hours the website host had blocked my ip address due to the following:

"Your ip address x.x.x.x was blocked in our server firewall for initiating huge number of apache connections. "

This was when I connected from IE. I had the block removed and a few hours later was blocked again. I stopped accessing piwik and had no further problem.

I had previously connected for a couple of days from Firefox with no problem.

This is using the latest Live.tar.gz from 4 days ago.

Not completely sure if this is browser related or whether it was related to website activity at the time. The block coincided with use of IE and with increased website activity (but no more than 3 visitors an hour)

[robocoder]

See also: http://github.com/primski/Piwik-Live/tree/master

[mattab]

increasing priority to ensure the code is reviewed asap, so that jr-ewing has enough time to update the code and have another round of code review, before the integration in core in 0.5.

[robocoder]

TuplipVortax's post http://forum.piwik.org/index.php?showtopic=1503 reminded me that we rolled #219 into this ticket. I'm guessing it wouldn't take much to add a non-updating variant of the Live widget which uses the specified calendar date & period.

[anonymous-matomo-user]

So i will realize an detail View.
I think on this details screen we can add some filters for periods in the next steps.

[robocoder]

Re-targeting for next release.

[anonymous-matomo-user]

Attachment:
Live.tar.2.gz

[robocoder]

jr-ewing: What's left on the todo list? (Hmm...attaching a file doesn't generate a notification to the piwik-trac mailing list.)

It doesn't look like these files are used. Do we need these?

• Live/templates/lastVisitsInner.tpl
• Live/templates/liveLogView.tpl
• Live/templates/structure.tpl
• Live/templates/scripts/spy (Kopie).js

[robocoder]

In [1621], refs #5464 - check in updated Live plugin by jr-ewing

[pebosi]

you missed adding totalVisits.tpl in Changeset [1621].

regards

[robocoder]

Thanks pebosi.

In [add file (missed in 1621)

[anonymous-matomo-user]

Hi,
i like the new version of the Live plugin very much, but one thing is annoying:
you can see where the visitor was but you can't go there.
So i propose to add one little <a> tag to the "last Visits.tpl":

{/php}
<a href="{$action.pageUrl}" target="_blank"><img align="middle" src="plugins/Live/templates/images/file{php} echo $col; {/php}.png" title="{$action.pageUrl}"></a>
{/foreach}

it saves a lot of time ^^

[robocoder]

In [1672], fixes #1074 - missing parameters for module=Live&action=index

[robocoder]

In [1673], refs comment🎫44:42 - wrap URL of visited page with anchor tag

[robocoder]

In [1675], remove 'label' from getLastVisitsDetails (undefined)

jr-ewing: what column did you intend to be here?

[robocoder]

In [1680], Only initialize spy once, if repeatedly previewing Live widget.

[robocoder]

In [1681], refs #5464 - translate columns in Live "Visitor Log"

rename typo'd translation string *OperatinsSystem to *OperatingSystem

upcase submenu titles for consistency

[robocoder]

This appears to be the outstanding list:

• number of goals converted
• page title
• click on goals would show the list of pages with goals highlighted along with goal name & revenue
• V2 Live map
• should we keep the current color scheme for icons (which represent order)?
  • outlinks are shown in different color
  • downloads are shown in different color
  • goals show in different color

Discuss: what "must have" items have to be implemented to close this ticket, so we can defer remaining requirements to a post-1.0 ticket

[anonymous-matomo-user]

Heuh, i'm sorry but how can we test the latest version so i can awnser the last question ?
A zip to decompress in the proper folder would be marvelous.
In the list of attachement, by their date, all files seems old.

[robocoder]

TulipVortax: use the "Download in other formats: Zip Archive" link at the bottom of the page of http://dev.piwik.org/trac/browser/trunk or use svn or wait for the 0.5.2 release (tomorrow, if all goes well).

[anonymous-matomo-user]

Ok, it's in place.
Updated from 0.5.1 to the trunk.
Now the pages icons are clickables.
To me, it's sad it only show the last NN visitors even while i choose yesterday as a date.
But i understand that it's a perfectly normal behavior for a Live! plugin.

[anonymous-matomo-user]

Replying to vipsoft:

This appears to be the outstanding list:

• number of goals converted
• page title
• click on goals would show the list of pages with goals highlighted along with goal name & revenue
• V2 Live map
• should we keep the current color scheme for icons (which represent order)?
  • outlinks are shown in different color
  • downloads are shown in different color
  • goals show in different color

Discuss: what "must have" items have to be implemented to close this ticket, so we can defer remaining requirements to a post-1.0 ticket

So i think the overview Page are also interessting for 1.0.
I have some Problems to implement more than one column icons for the default DataTable. So it is an core problem.

[anonymous-matomo-user]

I just noticed that some file icon aren't on a transparent background. Perticularly the orange one.

[robocoder]

(In [1760]) refs #5464 - fix broken images links in the CSS

[mattab]

We created a new ticket for remaining bugs and changes that we would like to make to the Live! plugin. see #1120 Finish Live! plugin: bugs and small enhancements

Closing this ticket for now.