Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Export file list - file missing #36951

Closed
1 of 5 tasks
ClemenF opened this issue Mar 3, 2023 · 26 comments
Closed
1 of 5 tasks

Export file list - file missing #36951

ClemenF opened this issue Mar 3, 2023 · 26 comments
Labels
Area: Admin UI Component: ImportExport Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed Priority: P2 A defect with this priority could have functionality issues which are not to expectations. Progress: done Reported on 2.4.5-p1 Indicates original Magento version for the Issue report. Reproduced on 2.4.x The issue has been reproduced on latest 2.4-develop branch

Comments

@ClemenF
Copy link

ClemenF commented Mar 3, 2023

Preconditions and environment

  • Magento version : 2.4.5-p1
  • Multiple export files created

Steps to reproduce

  1. Go to System > Data Transfer > Export
  2. Display a list of available file

Expected result

I have around 2400 files exported in folder var/export/xml/Archives/order_export/.
Need to see all those file

Actual result

I have only 19 files listed.

Additional information

I investigate in code and found out in the file :
src/vendor/magento/module-import-export/Ui/DataProvider/ExportFileDataProvider.php:174
that it creates a variable $sortedFiles and uses the file's mtime stat as a key (last modification time) and as a sort.

In my case, multiple files are created and it seems that it's modified at the same time sometimes. This results in not displaying all my available exported files.

To have files with a "last modify" time set to the same, you can rsync or scp from a distant server and some of them will have the same information.

Release note

No response

Triage and priority

  • Severity: S0 - Affects critical data or functionality and leaves users without workaround.
  • Severity: S1 - Affects critical data or functionality and forces users to employ a workaround.
  • Severity: S2 - Affects non-critical data or functionality and forces users to employ a workaround.
  • Severity: S3 - Affects non-critical data or functionality and does not force users to employ a workaround.
  • Severity: S4 - Affects aesthetics, professional look and feel, “quality” or “usability”.
@m2-assistant
Copy link

m2-assistant bot commented Mar 3, 2023

Hi @ClemenF. Thank you for your report.
To speed up processing of this issue, make sure that the issue is reproducible on the vanilla Magento instance following Steps to reproduce. To deploy vanilla Magento instance on our environment, Add a comment to the issue:


Join Magento Community Engineering Slack and ask your questions in #github channel.
⚠️ According to the Magento Contribution requirements, all issues must go through the Community Contributions Triage process. Community Contributions Triage is a public meeting.
🕙 You can find the schedule on the Magento Community Calendar page.
📞 The triage of issues happens in the queue order. If you want to speed up the delivery of your contribution, join the Community Contributions Triage session to discuss the appropriate ticket.

@m2-assistant
Copy link

m2-assistant bot commented Mar 3, 2023

Hi @engcom-Dash. Thank you for working on this issue.
In order to make sure that issue has enough information and ready for development, please read and check the following instruction: 👇

    1. Verify that issue has all the required information. (Preconditions, Steps to reproduce, Expected result, Actual result).
    1. Verify that issue has a meaningful description and provides enough information to reproduce the issue.
    1. Add Area: XXXXX label to the ticket, indicating the functional areas it may be related to.
    1. Verify that the issue is reproducible on 2.4-develop branch
      Details- Add the comment @magento give me 2.4-develop instance to deploy test instance on Magento infrastructure.
      - If the issue is reproducible on 2.4-develop branch, please, add the label Reproduced on 2.4.x.
      - If the issue is not reproducible, add your comment that issue is not reproducible and close the issue and stop verification process here!

@engcom-Dash
Copy link

@magento give me 2.4-develop instance

@magento-deployment-service
Copy link

Hi @engcom-Dash. Thank you for your request. I'm working on Magento instance for you.

@magento-deployment-service
Copy link

@engcom-Dash
Copy link

Hi @ClemenF ,

Thanks for raising this issue,

Could you please provide More Information about this issue and Provide exact use case test steps for this issue as well as if you any screenshots for this issue Kindly share here,Because its very easy to proceed further and helpful to reproduce the issue quickly.

Regards,

@engcom-Dash engcom-Dash added the Issue: needs update Additional information is require, waiting for response label Mar 3, 2023
@m2-community-project m2-community-project bot moved this from Ready for Confirmation to Needs Update in Issue Confirmation and Triage Board Mar 3, 2023
@ClemenF
Copy link
Author

ClemenF commented Mar 6, 2023

Hello,

In my production environment, I have an automatic cron that creates an export of my orders. It creates a .xml file and a .log file.
In admin/export/index, you can see that I have one file names orders_20230305_190018_1.log :
image
whereas on my server, I have one orders_20230305_180018_1.log and orders_20230305_180018_1.xml :
image

With the following command, I get the last modification time stat :
stat -c %Y filename
It's the same for both my file :
image

I can reproduce it in my local environment by running a command rsync of all my files in the export folder.

NB : The display name change from the file name because of the hour.

@engcom-Dash
Copy link

@magento give me 2.4-develop instance

@magento-deployment-service
Copy link

Hi @engcom-Dash. Thank you for your request. I'm working on Magento instance for you.

@magento-deployment-service
Copy link

@engcom-Dash
Copy link

engcom-Dash commented Mar 7, 2023

Hi @ClemenF ,

Thanks for contribution and collaboration,

Verified the issue in 2.4-Develop instance,its not reproducible.

Description:
Export file list - file missing

Precondtions:
Magento version 2.4-develop instance
PHP version 8.1
Multi export file created

Steps:

  • Go to System > Data Transfer > Export

  • Display a list of available file

Screenshot:
t1

we created around 50 files and all the 50 files listed ,We are getting expected result as per the description.

Let us know if we are missing any steps,if the issue still reproducible.

Regards,

@ClemenF
Copy link
Author

ClemenF commented Mar 7, 2023

I think the issue is not reproducible with manual action because it's not possible to create files at the exact same time.

To reproduce you should connect to the server with the command line and copy multiple files (with "cp" command) in the folder var/export. As the cp command is fast, they will all have the same "last_modify" stat

@engcom-Dash
Copy link

@magento give me 2.4-develop instance

@magento-deployment-service
Copy link

Hi @engcom-Dash. Thank you for your request. I'm working on Magento instance for you.

@magento-deployment-service
Copy link

@engcom-Hotel engcom-Hotel added the Reported on 2.4.5-p1 Indicates original Magento version for the Issue report. label Mar 8, 2023
@engcom-Dash
Copy link

engcom-Dash commented Mar 9, 2023

HI @ClemenF ,

Thanks for your contribution,

As per your last comments ,We verified the issue in 2.4-develop instance,it is not reproducible.
Kindly refer the below screenshots:
csv
We created more then 2000 csv files at the same time,But its not reflecting in Back end admin panel,Only one file listed.
Kindly provide more information or screenshots if the issue still reproducible.

Regards,

@ClemenF
Copy link
Author

ClemenF commented Mar 14, 2023

Hello @engcom-Dash

If I understand well, the issue is confirmed ? Do I have to do something now?

Regards

@engcom-Dash
Copy link

Hi @ClemenF ,

As per Main Description,this issue is not producible,Because when we creating more number of exported files at the same time as per the actual result 19 files listed,But we got only one file is listed.its closely to the actual result,But exact actual result.

Regards,

@ClemenF
Copy link
Author

ClemenF commented Mar 16, 2023

Hi @engcom-Dash

I don't understand your response. The issue is not that there are one or 19 files listed. It's that not all the files from the export folder are listed in the BO.

Regards,

@engcom-Dash
Copy link

Hi @ClemenF ,

Issue confirmed,

Verified the issue in 2.4-Develop instance and the issue is reproducible,Hence we are confirming the issue.

Preconditions:

Magento Version 2.4-Develop
PHP Version 8.1

Steps to reproduce:

1.Install Fresh Magento instance
2.Create Multiple Export file
3.Go to Stores >> System
4.Click on Export and Check Exported files is listed or not

Kindly Refer the below Screenshots:

image
ex1

We created more then thousand csv files but it not reflected in backend,only few files only showing in,we are getting actual behaviour as per the description,Hence we are confirming the issue.

Regards,

@engcom-Dash engcom-Dash added Component: ImportExport Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed Reproduced on 2.4.x The issue has been reproduced on latest 2.4-develop branch labels Mar 17, 2023
@m2-community-project m2-community-project bot removed Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed labels Mar 17, 2023
@m2-community-project m2-community-project bot moved this from Needs Update to Confirmed in Issue Confirmation and Triage Board Mar 17, 2023
@m2-community-project m2-community-project bot added Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed and removed Issue: needs update Additional information is require, waiting for response labels Mar 17, 2023
@github-jira-sync-bot
Copy link

✅ Jira issue https://jira.corp.adobe.com/browse/AC-8301 is successfully created for this GitHub issue.

@m2-assistant
Copy link

m2-assistant bot commented Mar 17, 2023

✅ Confirmed by @engcom-Dash. Thank you for verifying the issue.
Issue Available: @engcom-Dash, You will be automatically unassigned. Contributors/Maintainers can claim this issue to continue. To reclaim and continue work, reassign the ticket to yourself.

@github-jira-sync-bot
Copy link

❌ You don't have permission to export this issue.

@engcom-Hotel engcom-Hotel added the Priority: P2 A defect with this priority could have functionality issues which are not to expectations. label Mar 21, 2023
@m2-community-project m2-community-project bot added this to Ready for Development in High Priority Backlog Mar 21, 2023
@ducquywp92
Copy link

Hello,
Is there a patch to fix this bug? What version of magento do you plan to fix this on?
Thank you.

@dhorytskyi
Copy link
Contributor

The internal team is working on a solution for this issue.

@m2-community-project m2-community-project bot moved this from Ready for Development to Pull Request In Progress in High Priority Backlog Sep 14, 2023
@m2-community-project m2-community-project bot moved this from Pull Request In Progress to Done in High Priority Backlog Oct 4, 2023
@chittima
Copy link
Contributor

chittima commented Nov 17, 2023

Here is the Commit Id: 1bde57e

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Admin UI Component: ImportExport Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed Priority: P2 A defect with this priority could have functionality issues which are not to expectations. Progress: done Reported on 2.4.5-p1 Indicates original Magento version for the Issue report. Reproduced on 2.4.x The issue has been reproduced on latest 2.4-develop branch
Projects
Development

No branches or pull requests

7 participants