Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Collect workaround frequency data for larger data sets #27

Closed
mcfadden8 opened this issue Jun 5, 2018 · 3 comments
Closed

Collect workaround frequency data for larger data sets #27

mcfadden8 opened this issue Jun 5, 2018 · 3 comments
Assignees

Comments

@mcfadden8
Copy link
Collaborator

Using optimized versions of umapsort and churn, run tests with configurations that have a buffer that is 128GB for 300GB of data.

It would also be good to see if the workaround frequency is > 0 for the case when data will fit into the buffer (buffer size = 300GB, data size = 300GB).

@mcfadden8 mcfadden8 self-assigned this Jun 5, 2018
@mcfadden8
Copy link
Collaborator Author

mcfadden8 commented Jun 6, 2018

umapsort --noinit -p 2000000 -b 10000000 -f /mnt/intel/test --directio -t 80
2000000 pages, 8192000000 bytes, 80 threads
1024000000
Sorting in Ascending Order
Sort took 208335.450869 us
Validate took 656.146100 us
Stats before flush
4015590 Faults
2000000 READ Faults
0 WRITE Faults
2000000 WP Messages
0 Dirty Evictions
15590 Clean Evictions
0 SIGBUS Errors
15590 Stuck WP Workarounds
4117 Dropped Duplicates

Stats after flush
4015590 Faults
2000000 READ Faults
0 WRITE Faults
2000000 WP Messages
2000000 Dirty Evictions
15590 Clean Evictions
0 SIGBUS Errors
15590 Stuck WP Workarounds
4117 Dropped Duplicates

@mcfadden8
Copy link
Collaborator Author

mcfadden8 commented Jun 6, 2018

umapsort --noinit -p 2000000 -b 10000000 -f /mnt/intel/test --directio -t 80
2000000 pages, 8192000000 bytes, 80 threads
Sorting in Ascending Order
Sort took 208335.450869 us
Validate took 656.146100 us
Stats before flush
4015590 Faults
2000000 READ Faults
0 WRITE Faults
2000000 WP Messages
0 Dirty Evictions
15590 Clean Evictions
0 SIGBUS Errors
15590 Stuck WP Workarounds
4117 Dropped Duplicates

Stats after flush
4015590 Faults
2000000 READ Faults
0 WRITE Faults
2000000 WP Messages
2000000 Dirty Evictions
15590 Clean Evictions
0 SIGBUS Errors
15590 Stuck WP Workarounds
4117 Dropped Duplicates

@mcfadden8
Copy link
Collaborator Author

Data has been collected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant