Import / export all data #211
Replies: 47 comments 95 replies
-
Agreed, defining an import spec would make things easier for sure. Couple thoughts:
|
Beta Was this translation helpful? Give feedback.
-
this is a very legit use-case. I totally see this coming and this can addressed by keeping a consistent data format (spec) for both exporting and importing data. This keeps the implementation simple.
You are right. Free Plan on GA provides only aggregated stats. Only premium plan members are able to extract full raw event data.
I think there should be a way to import aggregated data and "spread" this data (of course this factually will not be true data). as a first step, I believe we need to get the data format (spec) prepared. |
Beta Was this translation helpful? Give feedback.
-
Is there any active interest in this at the moment? |
Beta Was this translation helpful? Give feedback.
-
Not that I'm aware of |
Beta Was this translation helpful? Give feedback.
-
Hi there. In order to write a migration tool, the data schema for the various other analytics platforms have to be known to the team. I'll start off with the schema from Simple Analytics. Since I can't directly upload CSVs here, I have uploaded it as a gist: https://gist.github.com/vincentdoerig/7b108450b46c8ad2de433f7cdd47486b The data is cleaned up from a personal site, everything should be pretty self-explanatory. // cc @metmarkosaric |
Beta Was this translation helpful? Give feedback.
-
Hey, adding to this I have the schema for http://get.gaug.es - they don't offer an export but I wrote a tool today (https://github.com/dewey/gaug.es-analytics-export) to export the daily aggregated data. In this case I use the same format they return it in the API but it could be adapted to support whatever "aggregated events" schema we come up with. In this case the format is just:
|
Beta Was this translation helpful? Give feedback.
-
+1. Would be much appreciated if we could import data from Google Analytics (just like Matomo does too). |
Beta Was this translation helpful? Give feedback.
-
+1 As mentioned in the forum I am interested in exporting features mostly (Goal Conversions in combination with campaign tracking data). |
Beta Was this translation helpful? Give feedback.
-
I haven't had a lot of time in the past months to do some work here. I will muster some time during Christmas and get something done to help this task. @ukutaht did you manage to do anything wrt to this topic? |
Beta Was this translation helpful? Give feedback.
-
Not yet @tckb |
Beta Was this translation helpful? Give feedback.
-
I just moved from cloud to self hosted and it would be really cool if I could migrate my old data over. |
Beta Was this translation helpful? Give feedback.
-
I would really appreciate to be able to import datas from a previous Matomo installation. |
Beta Was this translation helpful? Give feedback.
-
Just found Plausible randomly from Reddit. Sounds amazing, but the lack of import of data would be a non-starter. Is there any server log import workflow from Apache to Plausible? Or no way at all currently? |
Beta Was this translation helpful? Give feedback.
-
If you are looking for more use-case information, I would really appreciate just a way to import # of visitors to each page over time. I hope we can get this feature soon! |
Beta Was this translation helpful? Give feedback.
-
I was hoping to switch from Fathom to Plausible (because I love your Open Source philosophy & want to support 🇪🇪 businesses!) but I don't want to abandon all of my existing data or maintain 2 systems. I'm subscribing to this issue so that when it's finished, I'll make the switch! 💚 felix |
Beta Was this translation helpful? Give feedback.
-
We are aiming to migrate from the on-premise to the hosted version. |
Beta Was this translation helpful? Give feedback.
-
For the hosted version is there no way to truly export all data from a site as a (non-limited) CSV even though the data is just sitting somewhere in a database anyways? The API seems quite weak and limited for analytics purposes and we need to retrieve multiple metrics across multiple dimensions (which includes hundreds of pages). Self-hosting seems like it would have been the better option given how closed off data access appears to be at first glance but I don't make those decisions. |
Beta Was this translation helpful? Give feedback.
-
FYI Eric, [Simple Analytics](https://referral.simpleanalytics.com/w4rner) have that feature.
You can export back to Plausible once these guys have built it ;)
…------- Original Message -------
On Friday, July 8th, 2022 at 7:05 PM, Eric A Stalee 'notifications at github.com' ***@***.***> wrote:
For the hosted version is there no way to truly export all data from a site as a (non-[limited](https://plausible.io/docs/export-stats)) CSV even though the data is just sitting somewhere in a database anyways?
The API seems quite weak and limited for analytics purposes and we need to retrieve multiple metrics across multiple dimensions (which includes hundreds of pages). Self-hosting seems like it would have been the better option given how closed off data access appears to be at first glance but I don't make those decisions.
—
Reply to this email directly, [view it on GitHub](#211 (comment)), or [unsubscribe](https://github.com/notifications/unsubscribe-auth/AHP6SEQK7GONZJFGP6XATITVTBUXHANCNFSM4V7JZ7JA).
You are receiving this because you were mentioned.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
I've recently started using Plausible, and I'm considering converting and dropping google analytics, but I don't want to lose the years and years of data I already have there. Just to give you some additional motivation: I'd be willing to pay a reasonable one-time fee for the import if it were sufficiently automated and I could rely on it to work correctly. // edit: I've finally found https://plausible.io/docs/google-analytics-import and it's disabled 😭 |
Beta Was this translation helpful? Give feedback.
-
Google Analytics import is now back! |
Beta Was this translation helpful? Give feedback.
-
Would love the feature of importing/exporting between self hosted and the cloud solution, is there any news on this so far? 🙏 |
Beta Was this translation helpful? Give feedback.
-
@metmarkosaric we would like to migrate to the cloud version. Is there a timeline you can share for this feature? |
Beta Was this translation helpful? Give feedback.
-
Hi its june 2023 now. Is there a way to import apache or nginx server logging for self-hosting? Perhaps by using a csv import? thanks |
Beta Was this translation helpful? Give feedback.
-
@metmarkosaric Any chance, that you could use this gist to get a matomo import to plausible up and running? See: https://gist.github.com/ampaze/3a22d3c2adbc1d0bbeff409966ccd132 We are using plausible cloud version since your first days. Unfortunately we moved from Google Analytics to Matomo Self hosted before Plausible was there and all data from GA was imported to Matomo and for privacy reasons deleted from GA. Now we have all old data in Matomo and we would love to have them in our beloved place: Plausible. As mentioned before: GA import doesn't help for us. I would predict, that there are many customers like us, who would love to import old data from Matomo. |
Beta Was this translation helpful? Give feedback.
-
We had to migrate our Plausible CE instance to a new server because of a corruption that happened on the original one. In the process, this thread came up a lot of times. While we didn't face this exact issue, we needed to export all data from one instance and then import it into another. Took a lot of time, but I wrote everything down in case anyone faces the same issue. Migrating Plausible Data Between Instances/Servers Thank you @metmarkosaric for the awesome project! |
Beta Was this translation helpful? Give feedback.
-
Update: The GA4 import is ready! You can see how it works here: https://plausible.io/docs/google-analytics-import It’s now possible to import both UA and GA4 properties into the same Plausible dashboard. We’ll automatically detect time ranges to prevent double counting of periods and to avoid any gaps in the data. The same considerations apply to the GA4 import as to the UA import: Imported data is less functional than native data. It cannot be filtered, exported and some metrics may be missing due to limitations with the Google APIs. More details in the link above. If you encounter any issues with the import, do contact our support please: https://plausible.io/contact We’ll now continue working to further enhance the import feature. You can follow the progress in these threads:
|
Beta Was this translation helpful? Give feedback.
-
Does this also work with Matomo export? |
Beta Was this translation helpful? Give feedback.
-
Update: You can now import external data into Plausible using CSV files. The CSV import supports Plausible data by default but can also be used to import data from other sources if the external data is formatted according to our guidelines. See the full details: https://plausible.io/docs/csv-import |
Beta Was this translation helpful? Give feedback.
-
Would it be possible to export all data, including the Google Analytics UA data? Since starting from tomorrow it will not be possible to reimport UA data into a new instance (in particular when migrating from CE to EE and vice versa) |
Beta Was this translation helpful? Give feedback.
-
Are all these import and export features limited to the cloud offering and not the community edition? |
Beta Was this translation helpful? Give feedback.
-
Prerequisites
Similar features were requested in #210 and #142 asking about importing data into Plausible.
Feature request
The Idea of this feature is that we need to enable an easy import of events into Plausible from the external vendors such as GA or other analytic solutions. To make an external import easier I propose the following --
Define Import Data format
Since, the idea is to import only analytics data, i.e, the event data it is possible to import this directly into Clickhouse. Clickhouse already suppports data import via CSV (related docs here). We can define any additional fields required in the format and enable import.
Exporter plugins/scripts
Since, we now have a "pre-defined" format of data to be imported, we can now start writing exporters for different vendors or different use-cases:
Update: We now have the CSV export and the stats API too.
Update 2: You can now import your historical Google Analytics (Universal Analytics and GA4) stats into your Plausible dashboard. See more here.
Update 3: You can now import external data into Plausible using CSV files. The CSV import supports Plausible data by default but can also be used to import data from other sources if the external data is formatted according to our guidelines. See the full details: https://plausible.io/docs/csv-import
Beta Was this translation helpful? Give feedback.
All reactions