Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jialei gh270 connect cuda ei to optimization algorithm #365

Merged

Conversation

jialeiwang
Copy link
Contributor

********* PEOPLE *************
Primary reviewer: @suntzu86

Reviewers: @sc932

********* DESCRIPTION **************
Branch Name: jialei_gh270_connect_cudaEI_to_optimization_algorithm
Ticket(s)/Issue(s): Closes #270

********* TESTING DONE *************
make test
cpplint.py

jialeiwang and others added 5 commits July 9, 2014 19:01
…ct_cudaEI_to_optimization_algorithm

Conflicts:
	moe/optimal_learning/cpp/gpp_core.cpp
	moe/optimal_learning/cpp/gpp_expected_improvement_gpu.cpp
	moe/optimal_learning/cpp/gpp_expected_improvement_gpu.hpp
	moe/optimal_learning/cpp/gpp_expected_improvement_gpu_test.cpp
…github.com:sc932/MOE into jialei_gh270_connect_cudaEI_to_optimization_algorithm
@suntzu86
Copy link
Contributor

Couple of super broad comments:

  1. since the code is pretty much all copypaste, let's shorten the comments. Any place where you copypasted a huge block, I'd like two things. A. Remove comments that aren't input/output parameter lists. B. Specifically reference the file, class, and function where the code was copied from. Do this at fcn declarations and definitions, please.
  2. can you pull master? i don't think this has all of your GPU speedup stuff in it
  3. just for my curiosity, how long does the GPU test take to run?

@jialeiwang
Copy link
Contributor Author

On Cornell server, it is 149.73s for testing with GPU enabled(including EI/gradEI consistency check and optimization unit test), 92.61s for testing with GPU enabled(without optimization unit test), and 89.85s without GPU.

@suntzu86
Copy link
Contributor

~1 minute for the optimization test? Is there any way to make this run faster? Like fewer MC iterations, fewer multistarts or GD steps, etc?

lmk when the other changes are up

…educing num_steps to 100 and increasing tolerance of gradEI at endpoint to 7e-3
}

/*!\rst
This function is same as ComputeOptimalPointsToSample in gpp_math.cpp, except that it is
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you put the double backticks around fcn and file names? so:

``ComputeOptimalPointsToSample``
``gpp_math.cpp``

here & elsewhere

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@suntzu86
Copy link
Contributor

couple more cleanup things

// special analytic case when we are not using (or not accounting for) multiple, simultaneous experiments
NormalRNG dummy_rng;
EvaluateEIAtPointList(gaussian_process, thread_schedule, initial_guesses, points_being_sampled, num_multistarts,
1, 0, best_so_far, max_int_steps, found_flag, &dummy_rng, function_values, best_next_point);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

instead of "1" and "0", i'd create or use explicit variables with these values so that the reader immediately knows what they mean

also i believe you can pass nullptr in place of &dummy_rng.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@suntzu86
Copy link
Contributor

few more comments + a test for the analytic case as we discussed in person

@suntzu86
Copy link
Contributor

one more thing, please update the changelog, thanks!

@suntzu86
Copy link
Contributor

move the changelog line and shipit!

jialeiwang added a commit that referenced this pull request Aug 19, 2014
…mization_algorithm

Jialei gh270 connect cuda ei to optimization algorithm
@jialeiwang jialeiwang merged commit d6f5b5b into master Aug 19, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Connect cudaEI to optimization algorithm
2 participants