-
-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Must restart CSV import until all transactions are imported #3272
Comments
Mmmm. It says Firefly III runs into an error. Do you have that error perhaps? |
This is part of the current latest log entry:
is there anywhere else I can check? |
Yes, check out Firefly III itself. In the mean time, I'll build something that will make sure the CSV importer doesn't break when Firefly III throws 500 errors. |
Hi, Firefly itself seems to be ok. Transactions are slowly created. The db gets populated accordingly (I think). When I restart the firefly container, however, i noticed two things:
Thanks, |
That's strange, because this error message:
Comes from Firefly III itself, not the CSV importer. I recognize the stop/start troubles. This is a limitation in Laravel I haven't found a way around yet. |
Alright I've pushed a fix for the CSV importer (also Docker) that should make sure Firefly III handles 500 errors from Firefly III better. |
Yeah that could work. But again, isn't there anything in the logs of Firefly III itself? So not the CSV importer but the Firefly III instance you're talking to? That should also complain about the 500 error. |
sorry for the delay. here's the firefly-iii logs from the period approx. like the one above:
|
Thx. I hoped 5.2.2 fixed that bug. I’ll pick it up! |
I've pushed a fix (see above). I'd greatly appreciate it if you could hack it in your installation. It works for me(tm) but I could use the validation. |
I’ll set up another environment some time tomorrow and let you know how it works. |
I added those lines to the running container. The rules get applied now. I guess you can keep the changes for the next release. Thanks for the quick fix! |
This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
I am running Firefly III version 5.2.2 in Docker (OKD).
Import jobs via docker-csv-importer need to run multiple times untill all transactions are imported
Description
I am trying to catch up and to import about 5-600 transactions. Unfortunately I need to restart the import job until all transactions get imported. I checked and evetualy all rows are imported.
Bonus points
The node has about 32Gb RAM and 8 cores, so there should not be any memory issues. This is a screenshot of my memory usage. The peaks are 5 minutes apart - the import script runs as a cronjob (without concurrent runs)
The text was updated successfully, but these errors were encountered: