Report Generation: Improve performance of report generation time

[adiralashiva8]

Expected: Improve performance of report generation using Thread or Multiprocess

[jessezach]

@adiralashiva8 Still need help here?

[adiralashiva8]

@jz-jess Yes. I'm facing performance issue while processing big size output.xml files

When output.xml is more than 500mb robotframework-metrics is taking more time (then usual data).

My XML Data:

• Suites: > 100
• Tests: > 800
• Keywords: > 2 Lakhs
• Time took to process xml: 80sec
• Time took to load html page: 120sec

What I'm doing in report:
I have three class. Which are responsible to capture metrics as follows

• Class 1 - Suite Metrics
• Class 2 - Test Metrics
• Class 3 - Keyword Metrics (more time at here)

I loop for every element in class and add them to data-table. These classes are executed in sequence

What I plan to improve performance:
I want to run three class in parallel using multipleprocessing from Process

[jessezach]

@adiralashiva8 Understood. Seems fairly easy to do from your description.
Are these 3 calls dependent on each other in any way? I see a lot of code other than the class implementation in between result.visit(SuiteResults()), result.visit(TestCaseResults()) and result.visit(KeywordResults()) calls

[adiralashiva8]

Yes, Other code stuff is to generate html using beautiful soup.
Those three class are independent. Let's have all three class's definition at top and call's need to be in parallel (need to check compatiable)

[adiralashiva8]

Implement as part of #52 using gevent. Will re-open this issue if user concern about performance