Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MAPREDUCE-6729. Accurately compute the test execute time in DFSIO #111

Closed
wants to merge 13 commits into from
Closed

Commits on Jul 7, 2016

  1. MAPREDUCE-6729. Hitting performance and error when lots of files to w…

    …rite or read.
    
    When doing DFSIO test as a distributed i/o benchmark tool. Then especially writes plenty of files to disk or read from, both can cause performance issue and imprecise value in a way. The question is that existing practices needs to delete files when before running a job and that will cause extra time consumption and furthermore cause performance issue, statistical time error and imprecise throughput while the files are lots of. So we need to replace or improve this hack to prevent this from happening in the future.
    zhangminglei committed Jul 7, 2016
    Copy the full SHA
    380cea9 View commit details
    Browse the repository at this point in the history
  2. HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR d…

    …efault permissions. Contributed by Wellington Chevreuil.
    umbrant committed Jul 7, 2016
    Copy the full SHA
    b8f93cd View commit details
    Browse the repository at this point in the history
  3. Copy the full SHA
    0e0f45f View commit details
    Browse the repository at this point in the history
  4. MAPREDUCE-6717. Remove deprecated StringUtils.getFormattedTimeWithDif…

    …f. Contributed by Shen Yinjie.
    aajisaka committed Jul 7, 2016
    Copy the full SHA
    d1626a7 View commit details
    Browse the repository at this point in the history
  5. Copy the full SHA
    0185de0 View commit details
    Browse the repository at this point in the history
  6. HDFS-10592:Fix intermittent test failure of TestNameNodeResourceCheck…

    …er#testCheckThatNameNodeResourceMonitorIsRunning. Contributed by Rakesh R
    Uma Maheswara Rao G committed Jul 7, 2016
    Copy the full SHA
    ab092c5 View commit details
    Browse the repository at this point in the history
  7. Copy the full SHA
    a003566 View commit details
    Browse the repository at this point in the history
  8. HADOOP-13283. Support reset operation for new global storage statisti…

    …cs and per FS storage stats. Contributed by Mingliang Liu.
    jnp committed Jul 7, 2016
    Copy the full SHA
    6e59760 View commit details
    Browse the repository at this point in the history
  9. HADOOP-13320. Fix arguments check in documentation for WordCount v2.0…

    …. Contributed by niccolo becchi.
    
    This closes #108
    aajisaka committed Jul 7, 2016
    Copy the full SHA
    9d46a49 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2016

  1. MAPREDUCE-6729. Refine the patch

    mingleizhang authored and mingleizhang committed Jul 8, 2016
    Copy the full SHA
    a1933cd View commit details
    Browse the repository at this point in the history
  2. MAPREDUCE-6729. Resolve conflict

    mingleizhang authored and mingleizhang committed Jul 8, 2016
    Copy the full SHA
    59fe211 View commit details
    Browse the repository at this point in the history
  3. Refine patch

    mingleizhang authored and mingleizhang committed Jul 8, 2016
    Copy the full SHA
    06ec043 View commit details
    Browse the repository at this point in the history
  4. refine code

    mingleizhang authored and mingleizhang committed Jul 8, 2016
    Copy the full SHA
    30f5a0b View commit details
    Browse the repository at this point in the history