Google Timeline import fails to upload due to size, underneath documented maximum

[FoxxMD]

Trying to import Google Timeline JSON (Timeline.json) file that is 75MB, less than the 100MB max shown on the import page, results in an error in the UI:

Import Failed
Request failed with status code 413

and geopulse-ui service logs this:

2025/10/22 17:24:41 [error] 12#12: *115 client intended to send too large body: 75347190 bytes, client: 10.0.2.57, server: localhost, request: "POST /api/import/google-timeline/upload HTTP/1.1", host: "REMOVED", referrer: "https://REMOVED/app/data-export-import"

[tess1o]

Thanks for reporting. Mine was 1MB only :) I will check this out.

[FoxxMD]

@tess1o its also occurring on GPX import, if that matters. Failed to upload 16MB .gpx file with the same error.

[tess1o]

It's the default nginx configuration that needs to be updated. I'll do today.

[tess1o]

I've added client_max_body_size 200M; so it should work now. I pushed new image for frontend to dockerhub (the same tag name for now), so please pull new image for frontend and recreate frontend container (make sure new image is pulled and container is created with new image). If everything is OK - I will push the fix to version 1.0.1

Image ID:
tess1o/geopulse-ui:1.0.0@sha256:03ed65a7266303d14fbc18409fa8a6b0456facac22cbc58242f5e0c82f87952c

P.S. Since you try to upload pretty big files I'd suggest to update "mem_limit" in your docker compose (for backend part). Current value 512Mb might be low for such big files.

Thank you.

[FoxxMD]

I'm able to successfully upload files but both my imports are failing for other reasons, now.

For gpx (from dawarich)

geopulse-backend  | 2025-10-22 19:38:30,476 INFO  [org.git.tes.geo.imp.res.ImportResource] (executor-thread-4) Received GPX import request for user: 91da95af-3517-46c1-a711-5a11a1ebcf92
geopulse-backend  | 2025-10-22 19:38:30,484 INFO  [org.git.tes.geo.imp.ser.ImportService] (executor-thread-4) Created GPX import job efd2723f-15e4-4f61-8baf-179becf2e8bc for user 91da95af-3517-46c1-a711-5a11a1ebcf92 with file: export_from_2025-01-01_to_2025-10-22.gpx
geopulse-backend  | 2025-10-22 19:38:30,999 INFO  [org.git.tes.geo.imp.ser.ImportDataService] (quarkus-virtual-thread-26) Validating import data for format: gpx and user: 91da95af-3517-46c1-a711-5a11a1ebcf92
geopulse-backend  | 2025-10-22 19:38:31,001 INFO  [org.git.tes.geo.imp.ser.BaseGpsImportStrategy] (quarkus-virtual-thread-26) Validating gpx data for user 91da95af-3517-46c1-a711-5a11a1ebcf92
geopulse-backend  | 2025-10-22 19:38:31,011 ERROR [org.git.tes.geo.imp.ser.ImportService] (quarkus-virtual-thread-26) Failed to validate import job efd2723f-15e4-4f61-8baf-179becf2e8bc: Invalid gpx format: Unrecognized field "schemaLocation" (class org.github.tess1o.geopulse.gps.integrations.gpx.model.GpxFile), not marked as ignorable (7 known properties: "validWaypoints", "version", "wpt", "creator", "allTrackPoints", "metadata", "trk"])
geopulse-backend  |  at [Source: (StringReader); line: 2, column: 276] (through reference chain: org.github.tess1o.geopulse.gps.integrations.gpx.model.GpxFile["schemaLocation"]): java.lang.IllegalArgumentException: Invalid gpx format: Unrecognized field "schemaLocation" (class org.github.tess1o.geopulse.gps.integrations.gpx.model.GpxFile), not marked as ignorable (7 known properties: "validWaypoints", "version", "wpt", "creator", "allTrackPoints", "metadata", "trk"])
geopulse-backend  |  at [Source: (StringReader); line: 2, column: 276] (through reference chain: org.github.tess1o.geopulse.gps.integrations.gpx.model.GpxFile["schemaLocation"])
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.BaseGpsImportStrategy.validateAndDetectDataTypes(BaseGpsImportStrategy.java:65)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.GpxImportStrategy_ClientProxy.validateAndDetectDataTypes(Unknown Source)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportDataService.validateAndDetectDataTypes(ImportDataService.java:30)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportDataService_ClientProxy.validateAndDetectDataTypes(Unknown Source)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService.processAvailableJobs(ImportService.java:217)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService.processImportJobs(ImportService.java:199)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService_ClientProxy.processImportJobs(Unknown Source)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService_ScheduledInvoker_processImportJobs_0f300e332ad99ca81116475ae6c2150ed42afafe.invokeBean(Unknown Source)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DefaultInvoker.invoke(DefaultInvoker.java:25)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DelegateInvoker.invokeDelegate(DelegateInvoker.java:29)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.StatusEmitterInvoker.invoke(StatusEmitterInvoker.java:35)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DelegateInvoker.invokeDelegate(DelegateInvoker.java:29)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DelegateInvoker.invokeComplete(DelegateInvoker.java:36)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.OffloadingInvoker$1$1.run(OffloadingInvoker.java:45)
geopulse-backend  | 	at io.quarkus.virtual.threads.ContextPreservingExecutorService$ContextPreservingRunnable.run(ContextPreservingExecutorService.java:45)
geopulse-backend  | 	at java.base@25/java.util.concurrent.ThreadPerTaskExecutor$TaskRunner.run(ThreadPerTaskExecutor.java:291)
geopulse-backend  | 	at java.base@25/java.lang.Thread.runWith(Thread.java:1487)
geopulse-backend  | 	at java.base@25/java.lang.VirtualThread.run(VirtualThread.java:456)
geopulse-backend  | 	at java.base@25/java.lang.VirtualThread$VThreadContinuation$1.run(VirtualThread.java:248)
geopulse-backend  | 

For google timeline

geopulse-backend  | 2025-10-22 19:39:18,890 INFO  [org.git.tes.geo.imp.res.ImportResource] (executor-thread-5) Received Google Timeline import request for user: 91da95af-3517-46c1-a711-5a11a1ebcf92
geopulse-backend  | 2025-10-22 19:39:18,924 INFO  [org.git.tes.geo.imp.ser.ImportService] (executor-thread-5) Created Google Timeline import job 698e25ab-19a7-4284-adc7-4a624f580832 for user 91da95af-3517-46c1-a711-5a11a1ebcf92 with file: Timeline.json
geopulse-backend  | 2025-10-22 19:39:18,999 INFO  [org.git.tes.geo.imp.ser.ImportDataService] (quarkus-virtual-thread-50) Validating import data for format: google-timeline and user: 91da95af-3517-46c1-a711-5a11a1ebcf92
geopulse-backend  | 2025-10-22 19:39:18,999 INFO  [org.git.tes.geo.imp.ser.BaseGpsImportStrategy] (quarkus-virtual-thread-50) Validating google-timeline data for user 91da95af-3517-46c1-a711-5a11a1ebcf92
geopulse-backend  | 2025-10-22 19:39:19,099 ERROR [org.git.tes.geo.imp.ser.ImportService] (quarkus-virtual-thread-50) Failed to validate import job 698e25ab-19a7-4284-adc7-4a624f580832: Invalid google-timeline format: Cannot deserialize value of type `java.util.ArrayList` from Object value (token `JsonToken.START_OBJECT`)
geopulse-backend  |  at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1, column: 1]: java.lang.IllegalArgumentException: Invalid google-timeline format: Cannot deserialize value of type `java.util.ArrayList` from Object value (token `JsonToken.START_OBJECT`)
geopulse-backend  |  at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1, column: 1]
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.BaseGpsImportStrategy.validateAndDetectDataTypes(BaseGpsImportStrategy.java:65)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.GoogleTimelineImportStrategy_ClientProxy.validateAndDetectDataTypes(Unknown Source)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportDataService.validateAndDetectDataTypes(ImportDataService.java:30)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportDataService_ClientProxy.validateAndDetectDataTypes(Unknown Source)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService.processAvailableJobs(ImportService.java:217)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService.processImportJobs(ImportService.java:199)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService_ClientProxy.processImportJobs(Unknown Source)
geopulse-backend  | 	at org.github.tess1o.geopulse.importdata.service.ImportService_ScheduledInvoker_processImportJobs_0f300e332ad99ca81116475ae6c2150ed42afafe.invokeBean(Unknown Source)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DefaultInvoker.invoke(DefaultInvoker.java:25)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DelegateInvoker.invokeDelegate(DelegateInvoker.java:29)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.StatusEmitterInvoker.invoke(StatusEmitterInvoker.java:35)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DelegateInvoker.invokeDelegate(DelegateInvoker.java:29)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.DelegateInvoker.invokeComplete(DelegateInvoker.java:36)
geopulse-backend  | 	at io.quarkus.scheduler.common.runtime.OffloadingInvoker$1$1.run(OffloadingInvoker.java:45)
geopulse-backend  | 	at io.quarkus.virtual.threads.ContextPreservingExecutorService$ContextPreservingRunnable.run(ContextPreservingExecutorService.java:45)
geopulse-backend  | 	at java.base@25/java.util.concurrent.ThreadPerTaskExecutor$TaskRunner.run(ThreadPerTaskExecutor.java:291)
geopulse-backend  | 	at java.base@25/java.lang.Thread.runWith(Thread.java:1487)
geopulse-backend  | 	at java.base@25/java.lang.VirtualThread.run(VirtualThread.java:456)
geopulse-backend  | 	at java.base@25/java.lang.VirtualThread$VThreadContinuation$1.run(VirtualThread.java:248)

I can make separate issues for this if you'd prefer

[tess1o]

I know what to do with GPX - will be fixed in next release. In my GPX files I didn't have such fields. Regarding Google Timeline - I'd need to see the structure of your file (obviously you can't share the file itself). How did you get the file? I got mine via Google Takeout.

[tess1o]

For google timeline can you please generate json schema from your json file and provide it? The json schema doesn't contain any personal data, just the structure of your file. It can be done via various online services. This should help with the fix.

[FoxxMD]

Here's a sample of data from Timeline.json, I scrolled through a decent bit and didn't see any other variations as far as data structure goes. I'm sure the semanticType has other enums. I replaced all lat/long with 160xxx for anonymity.

{
  "semanticSegments": [
    {
      "startTime": "2015-09-20T12:00:00.000-04:00",
      "endTime": "2015-09-20T14:00:00.000-04:00",
      "timelinePath": [
        {
          "point": "160.11115°, -160.1111°",
          "time": "2015-09-20T12:15:00.000-04:00"
        },
        {
          "point": "160.11113°, -160.11111°",
          "time": "2015-09-20T12:19:00.000-04:00"
        },
        {
          "point": "160.1111°, -160.11111°",
          "time": "2015-09-20T12:29:00.000-04:00"
        }
      ]
    },
    {
      "startTime": "2015-09-20T12:14:46.000-04:00",
      "endTime": "2015-09-20T12:18:37.000-04:00",
      "startTimeTimezoneUtcOffsetMinutes": -240,
      "endTimeTimezoneUtcOffsetMinutes": -240,
      "activity": {
        "start": {
          "latLng": "160.11115°, -160.1111°"
        },
        "end": {
          "latLng": "160.1111°, -160.1111°"
        },
        "distanceMeters": 212.17379760742188,
        "topCandidate": {
          "type": "WALKING",
          "probability": 0.0
        }
      }
    },
    {
      "startTime": "2015-09-20T12:18:37.000-04:00",
      "endTime": "2015-09-20T12:29:17.000-04:00",
      "startTimeTimezoneUtcOffsetMinutes": -240,
      "endTimeTimezoneUtcOffsetMinutes": -240,
      "visit": {
        "hierarchyLevel": 0,
        "probability": 0.6899999976158142,
        "topCandidate": {
          "placeId": "ndhtSYdhtSYndhtSYaovndhtSYs",
          "semanticType": "UNKNOWN",
          "probability": 0.15664449334144592,
          "placeLocation": {
            "latLng": "160.1111°, -160.1111°"
          }
        }
      }
    }
  ]
}

Fairly certain I got this from a takeout. It was after google switched off location/timeline for maps though, irc, so it might have been a different method. It was importable into dawarich..I guess through Semantic Location History which is not the same as Takeout?

EDIT: ah yeah its not the same as takeout. Unfortunately its the only way my past location data is exported, now, since takeout no longer stores timeline data there.

[tess1o]

GPX issue is fixed - I will deliver version 1.0.1 later.

Regarding Google Timeline - is you file the same like this example:
https://github.com/Freika/dawarich/blob/493db274f5f7ed7160e3b65ae58ae3cc941605ca/spec/fixtures/files/google/phone-takeout_w_3_duplicates.json

From the sample you showed looks like yes.

Google Takeout I could do generated file like this:
https://github.com/Freika/dawarich/blob/493db274f5f7ed7160e3b65ae58ae3cc941605ca/spec/fixtures/files/google/location-history.json

That's why it fails for you now.

Thanks.

[cchrkk]

Thanks for reporting. Mine was 1MB only :) I will check this out.

Uhm, my timeline file is like a huge 1,5GB json file🥲 Any tip?

[tess1o]

Probably increase max file size in nginx (currently 200mb), increase mem_limit for backend container (currently 512Mb, you would propably need about 10GB RAM with current approach). Currently whole JSON is loaded to memory but with such huge files (1.5 GB) we definitely need to do streaming reading.

[tess1o]

@FoxxMD ,
max file size (during upload), GPX import is fixed in version 1.0.1. Google Timeline issue is not fixed yet, waiting for your feedback about file format. Once I confirm the file format I will try to do implementation.
To upgrade to new version update .env (variable GEOPULSE_VERSION) and redeploy the app.

[FoxxMD]

https://github.com/Freika/dawarich/blob/493db274f5f7ed7160e3b65ae58ae3cc941605ca/spec/fixtures/files/google/phone-takeout_w_3_duplicates.json

yes this looks like my file. I'll be able to try gpx file tomorrow

[tess1o]

Ok, thanks. But as you can see the data from Google doesn't contain speed and pretty limited set of GPS points. So the accuracy of timeline generation will be low. if you have GPX data or OwnTracks data it's much more preferable format since it contain more GPS data + your speed at different points.

[FoxxMD]

GPX data import worked.

if you have GPX data or OwnTracks data it's much more preferable format

I didn't start recording this kind of data until dawarich! the timeline data is the only historical data I have pre 2025. I think you'll find most new users coming to dawarich/geopulse don't have rich historical data either, google takeout is going to be a primary source.