[BUG] Can't import entire db when using postgres #89

landoephan · 2022-12-08T14:01:32Z

Describe the bug
When I export the entire db from a postgres db and try to import it again I get a 403 error on POST /import-export-entries/import and a 500 error afterwards on GET http://localhost:1337/import-export-entries/import/model-attributes/custom:db

The logs from my strapi application look like this:

[2022-12-08 14:43:41.957] error: Cannot read properties of undefined (reading 'attributes')
TypeError: Cannot read properties of undefined (reading 'attributes')
    at getModelAttributes (.../node_modules/strapi-plugin-import-export-entries/server/utils/models.js:89:46)
    at Object.getModelAttributesEndpoint [as getModelAttributes] (.../node_modules/strapi-plugin-import-export-entries/server/controllers/admin/import-controller/get-model-attributes.js:8:26)
    at dispatch (.../node_modules/koa-compose/index.js:42:32)
    at returnBodyMiddleware (.../node_modules/@strapi/strapi/lib/services/server/compose-endpoint.js:52:24)
    at dispatch (.../node_modules/koa-compose/index.js:42:32)
    at policiesMiddleware (.../node_modules/@strapi/strapi/lib/services/server/policy.js:24:11)
    at dispatch (.../node_modules/koa-compose/index.js:42:32)
    at .../node_modules/@strapi/strapi/lib/services/server/compose-endpoint.js:33:12
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
[2022-12-08 14:43:46.827] http: POST /import-export-entries/import (37 ms) 403
[2022-12-08 14:43:46.857] error: Cannot read properties of undefined (reading 'attributes')
TypeError: Cannot read properties of undefined (reading 'attributes')
    at getModelAttributes (.../node_modules/strapi-plugin-import-export-entries/server/utils/models.js:89:46)
    at Object.getModelAttributesEndpoint [as getModelAttributes] (.../node_modules/strapi-plugin-import-export-entries/server/controllers/admin/import-controller/get-model-attributes.js:8:26)
    at dispatch (.../node_modules/koa-compose/index.js:42:32)
    at returnBodyMiddleware (.../node_modules/@strapi/strapi/lib/services/server/compose-endpoint.js:52:24)
    at dispatch (.../node_modules/koa-compose/index.js:42:32)
    at policiesMiddleware (.../node_modules/@strapi/strapi/lib/services/server/policy.js:24:11)
    at dispatch (.../node_modules/koa-compose/index.js:42:32)
    at .../node_modules/@strapi/strapi/lib/services/server/compose-endpoint.js:33:12
    at processTicksAndRejections (node:internal/process/task_queues:96:5)

In the browser console I'm getting the following error messages:

main.a5adda14.js:9121          GET http://localhost:1337/import-export-entries/import/model-attributes/custom:db 500 (Internal Server Error)
...
main.a5adda14.js:9121 Uncaught (in promise) Error: Internal Server Error
    at main.a5adda14.js:9121:12290
(anonymous) @ main.a5adda14.js:9121
...
main.a5adda14.js:9121          POST http://localhost:1337/import-export-entries/import 403 (Forbidden)
Tr @ main.a5adda14.js:9121
...
main.a5adda14.js:9121          GET http://localhost:1337/import-export-entries/import/model-attributes/custom:db 500 (Internal Server Error)
...
main.a5adda14.js:9121 Uncaught (in promise) Error: Internal Server Error
    at main.a5adda14.js:9121:12290

Three requests are made:
1.

Request URL: http://localhost:1337/import-export-entries/import/model-attributes/custom:db
Request Method: GET
Status Code: 500 Internal Server Error
Remote Address: 127.0.0.1:1337
Referrer Policy: no-referrer

Request URL: http://localhost:1337/import-export-entries/import
Request Method: POST
Status Code: 403 Forbidden
Remote Address: 127.0.0.1:1337
Referrer Policy: no-referrer

Request URL: http://localhost:1337/import-export-entries/import/model-attributes/custom:db
Request Method: GET
Status Code: 500 Internal Server Error
Remote Address: 127.0.0.1:1337
Referrer Policy: no-referrer

To Reproduce
Steps to reproduce the behavior:

Go to http://localhost:1337/admin/plugins/import-export-entries
Click on export --> fetch data --> Download file --> save file
Click on import --> select the saved file --> import
See error in browser console and application logs

Expected behavior
The import from a complete db export works. The data is imported in the database and visible in the admin panel

Additional context
Version: "strapi-plugin-import-export-entries": "^1.18.0"

database version: "pg": "^8.8.0"

I'm a superuser in my postgres db

The text was updated successfully, but these errors were encountered:

mikebcbc · 2022-12-08T16:57:35Z

I'm encountering the same issue.

mikebcbc · 2022-12-08T17:59:40Z

@landoephan one workaround that just worked for me is individually importing/exporting each model instead of the whole DB at once. I was able to import it all, just a tad more tediously. Maybe that'll work for you too?

landoephan · 2022-12-09T09:12:56Z

@mikebcbc I tried that, too, but then I have another problem, see #88. Maybe you could check, if you're encountering that problem, too?

VrTech · 2022-12-09T17:59:24Z

Same problem here cannot import when using postgres

gfsd3v · 2022-12-10T23:40:54Z

Same here.

cooperwfloyd · 2022-12-12T15:56:21Z

same problem here. exporting from Postgres is successful, but when importing locally into the default SQLite database is when that same TypeError: Cannot read properties of undefined (reading 'attributes') at getModelAttributes error comes up

mbkkong · 2022-12-14T21:25:01Z

+10

hpmax00 · 2022-12-19T09:25:41Z

+1

sts-ryan-holton · 2022-12-21T11:47:49Z

Experiencing the same thing

JoshuaRobertson · 2022-12-21T11:57:03Z

I'm experiencing the same issue as a Super Admin. After selecting a file it throws a 500 error for custom:db and then when attempting an import it results in a 403 error. The only difference for my project is I'm using MariaDB instead of postgres.

Could this be related to the recent Strapi CMS update and a change in user permissions?

rgouzal · 2023-01-01T15:56:53Z

@landoephan one workaround that just worked for me is individually importing/exporting each model instead of the whole DB at once. I was able to import it all, just a tad more tediously. Maybe that'll work for you too?

When you imported the DB , what deepness level you set or you set it to none?

landoephan · 2023-01-03T09:42:21Z

I can't test it at the moment since strapi always crashes after a while of loading. I guess my database became too big already

rgouzal · 2023-01-05T18:10:25Z

I can't test it at the moment since strapi always crashes after a while of loading. I guess my database became too big already

@landoephan I did came across that too

cyruskorn · 2023-01-09T18:39:23Z

Same here. Tried to import locally on a SQLite database, and on a PostgreSQL database. Neither worked.

oyenigun · 2023-01-15T19:35:43Z

Same here.
When i tried to export and import on Content Manager for one collection it succeed.
Export whole database is working but import whole database is not working.

molul · 2023-03-21T07:44:25Z

+1. Production db is postgres, development is sqlite, I can export from production but can't import to development. I see the same errors mentioned in the first post.

rtkac · 2023-04-22T15:56:56Z

Same issue here.
Export from postgres is working fine, but import the same exported JSON to postgres failed.
error: Cannot read properties of undefined (reading 'attributes')

Baboo7 · 2023-04-23T12:56:58Z

This issue is fixed in version 1.19.0!

molul · 2023-04-23T16:12:47Z

I confirm this is working for me now. Thanks! <3

rtkac · 2023-04-24T07:57:01Z

@Baboo7 thanks for the update.

I can see 500 error response while uploading:
{"data":null,"error":{"status":500,"name":"InternalServerError","message":"Internal Server Error"}}

Payload:
{"slug":"custom:db","data":"{\n\t\"version\": 2,\n\t\"data\": {\n\t\t\"plugin::upload.folder\": {},\n\t\t\"plugin::upload.file\": {},\n\t\t\"api::test1.test1\": {\n\t\t\t\"1\": {\n\t\t\t\t\"id\": 1,\n\t\t\t\t\"name1\": \"test 1 name\",\n\t\t\t\t\"createdAt\": \"2023-04-24T07:54:55.073Z\",\n\t\t\t\t\"updatedAt\": \"2023-04-24T07:54:55.073Z\",\n\t\t\t\t\"publishedAt\": null,\n\t\t\t\t\"media1\": null,\n\t\t\t\t\"createdBy\": null,\n\t\t\t\t\"updatedBy\": null\n\t\t\t}\n\t\t}\n\t}\n}","format":"json","idField":"id"}

Do you know what could be a problem?

FYI: export works fine

Thanks!

Baboo7 · 2023-04-24T18:13:05Z

Discussion moved to #113

landoephan assigned Baboo7 Dec 8, 2022

Baboo7 closed this as completed Apr 23, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BUG] Can't import entire db when using postgres #89

[BUG] Can't import entire db when using postgres #89

landoephan commented Dec 8, 2022

mikebcbc commented Dec 8, 2022

mikebcbc commented Dec 8, 2022

landoephan commented Dec 9, 2022

VrTech commented Dec 9, 2022

gfsd3v commented Dec 10, 2022

cooperwfloyd commented Dec 12, 2022

mbkkong commented Dec 14, 2022

hpmax00 commented Dec 19, 2022

sts-ryan-holton commented Dec 21, 2022

JoshuaRobertson commented Dec 21, 2022

rgouzal commented Jan 1, 2023 •

edited

landoephan commented Jan 3, 2023

rgouzal commented Jan 5, 2023 •

edited

cyruskorn commented Jan 9, 2023

oyenigun commented Jan 15, 2023

molul commented Mar 21, 2023

rtkac commented Apr 22, 2023

Baboo7 commented Apr 23, 2023

molul commented Apr 23, 2023

rtkac commented Apr 24, 2023 •

edited

Baboo7 commented Apr 24, 2023 •

edited

[BUG] Can't import entire db when using postgres #89

[BUG] Can't import entire db when using postgres #89

Comments

landoephan commented Dec 8, 2022

mikebcbc commented Dec 8, 2022

mikebcbc commented Dec 8, 2022

landoephan commented Dec 9, 2022

VrTech commented Dec 9, 2022

gfsd3v commented Dec 10, 2022

cooperwfloyd commented Dec 12, 2022

mbkkong commented Dec 14, 2022

hpmax00 commented Dec 19, 2022

sts-ryan-holton commented Dec 21, 2022

JoshuaRobertson commented Dec 21, 2022

rgouzal commented Jan 1, 2023 • edited

landoephan commented Jan 3, 2023

rgouzal commented Jan 5, 2023 • edited

cyruskorn commented Jan 9, 2023

oyenigun commented Jan 15, 2023

molul commented Mar 21, 2023

rtkac commented Apr 22, 2023

Baboo7 commented Apr 23, 2023

molul commented Apr 23, 2023

rtkac commented Apr 24, 2023 • edited

Baboo7 commented Apr 24, 2023 • edited

rgouzal commented Jan 1, 2023 •

edited

rgouzal commented Jan 5, 2023 •

edited

rtkac commented Apr 24, 2023 •

edited

Baboo7 commented Apr 24, 2023 •

edited