Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Google Summer of Code: new loss functions in XGBoost #4242

Closed
tdhock opened this issue Mar 8, 2019 · 20 comments
Closed

Google Summer of Code: new loss functions in XGBoost #4242

tdhock opened this issue Mar 8, 2019 · 20 comments

Comments

@tdhock
Copy link

@tdhock tdhock commented Mar 8, 2019

I was wondering if there is any xgboost maintainers who would be interested to co-mentor a Google Summer of Code (GSOC) student with me? I am a machine learning researcher who is interested in using xgboost for some standard loss/objective functions which are not included in xgboost. I am also an expert R package developer and admin/mentor for R in GSOC so we could probably get the student funded under R-GSOC, https://github.com/rstats-gsoc/gsoc2019/wiki/table%20of%20proposed%20coding%20projects

However I am not an expert about xgboost internals, so it would be great if somebody who is could co-mentor. Any takers?

For (left, right, and interval) censored outputs, AFT (https://en.wikipedia.org/wiki/Accelerated_failure_time_model) losses:

I found some related issues:
#749
#513
#326

@RAMitchell

This comment has been minimized.

Copy link
Member

@RAMitchell RAMitchell commented Mar 8, 2019

Don't have time myself but great idea.

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 9, 2019

So you don’t have to be a Google employee to be a mentor in GSOC? I am interested

@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 9, 2019

no you don't have to be a google employee!

It would be great to co-mentor with you @hcho3

I have started writing a wiki page for the project here https://github.com/rstats-gsoc/gsoc2019/wiki/xgboost-loss-functions

can you please add some info to the project and tests sections? The tests should be some simple to complex tasks that the student can do prior to GSOC in order to demonstrate to us mentors that he would be capable of doing the project.

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 10, 2019

@tdhock Can candidates code in C++? I can add some tests related to C++ core and XGBoost internals

@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 10, 2019

yes that would be great if you could add tests related to C++ core and xgboost internals

we probably should not accept any student who has not demonstrated C++ coding skills (that is the point of writing these tests)

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 10, 2019

@tdhock I'll get to writing tests soon. What would be my responsibilities as a co-mentor? I'm trying to gauge my time commitment. Also, are mentees all hosted on the Google campus?

@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 11, 2019

no students are hosted on google campus --everything is online

mentor responsibility is basically for one of us to be available for a 1 hour skype call each week during the summer, and to answer student questions via email https://developers.google.com/open-source/gsoc/help/responsibilities

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 11, 2019

@tdhock Got it. Thanks for clarification. I'd be more than happy to help.

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 11, 2019

@tdhock What's the deadline for the tests? When do you want them by?

@hcho3 hcho3 changed the title loss functions for GSOC? Google Summer of Code: new loss functions in XGBoost Mar 11, 2019
@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 11, 2019

asap! students need to do the tests in the next week or two, then work on an app to submit to google due Apr 7

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 11, 2019

Got it. I'll try to post tests as early as possible. Expect them no later than in three two days from now.

@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 11, 2019

I added a test about using the functionality in the current xgboost package, but it would be great if you could add some tests about C++ coding / xgboost internals

@thvasilo

This comment has been minimized.

Copy link
Contributor

@thvasilo thvasilo commented Mar 12, 2019

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 14, 2019

@tdhock Almost there, it should be done by tomorrow

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 14, 2019

@tdhock I've put up five tests (three Easy, one Medium, one Hard). Can you review?

@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 15, 2019

the first five easy questions are a bit theoretical (gsoc test usually tend to be more practical coding exercises) but for this project I think that is OK, as the student should understand the theory.

median and hard tests look great.

thanks for your help and let's hope we find a good student.

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 15, 2019

@tdhock Maybe we should move the binary classification question to "Medium." What do you think?

@tdhock

This comment has been minimized.

Copy link
Author

@tdhock tdhock commented Mar 15, 2019

either way is fine with me

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented Mar 15, 2019

Done. Let's hope for the best.

@hcho3

This comment has been minimized.

Copy link
Collaborator

@hcho3 hcho3 commented May 23, 2019

Closing this in favor of #4491

@lock lock bot locked as resolved and limited conversation to collaborators Aug 21, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
4 participants
You can’t perform that action at this time.