Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error:buffer_indexexceed num_pbuffer #10

Closed
pprett opened this issue May 20, 2014 · 6 comments
Closed

Error:buffer_indexexceed num_pbuffer #10

pprett opened this issue May 20, 2014 · 6 comments
Assignees

Comments

@pprett
Copy link

pprett commented May 20, 2014

I sometimes got this error when I ran xgboost on the data that is used in Elements of Statistical Learning Example 10.2

Its available in sklearn via sklearn.datasets.make_hastie_10_2

@pprett
Copy link
Author

pprett commented May 20, 2014

I set 'bst:gamma': 0.0 in case that matters

@tqchen
Copy link
Member

tqchen commented May 20, 2014

hmm.. can you post a script that can produces the error? I can't produce this error with my script.

#!/usr/bin/python
import sys
import sklearn.datasets
sys.path.append('../')
import xgboost as xgb
x, y = sklearn.datasets.make_hastie_10_2()
y[y==-1] = 0

dtrain = xgb.DMatrix(x, label=y)

param = {'bst:max_depth':2, 'bst:eta':1, 'bst:gamma':0, 'objective':'binary:logistic', 'silent':1 }
num_round = 10
evallist  = [(dtrain,'train')]
bst = xgb.train( param, dtrain, num_round, evallist )

@pprett
Copy link
Author

pprett commented May 20, 2014

this is strange: I fail to create an isolated script to reproduce it. Even stranger: the error only occurs if I run either Rgbm (via rpy2) or sklearn's GradientBoostingClassifier before... but in this case its 100% reproducible. BTW: it happens in bst.predict not xgb.train

@tqchen
Copy link
Member

tqchen commented May 20, 2014

i have some idea what happened.
This can due to the fact that we are using pointer to check if a matrix a cached. If a matrix get freed and another allocation gets the same address, we can run into trouble.
There is a update in dev branch that fixed this problem, but we would like to test before we release it

@pprett
Copy link
Author

pprett commented May 20, 2014

checked with the dev branch - you fixed it!

@tqchen
Copy link
Member

tqchen commented May 20, 2014

Thanks peter! Indeed this is a problem that we overlooked:)

@tqchen tqchen closed this as completed May 20, 2014
@tqchen tqchen added the bug label May 20, 2014
tqchen added a commit that referenced this issue Apr 5, 2015
b15f6cd rabit unifires with dmlc
5634ec3 ok
2dd6c2f Merge branch 'master' of ssh://github.com/dmlc/rabit
38d7f99 checkin wormhole spliter
8acb96a Merge pull request #10 from ryanzz/master
911a1f0 fixed a mistake
732d8c3 inteface changing
684ea0a inteface changing
8cb4c02 add dmlc support
be2ff70 allow adapting wormhole

git-subtree-dir: subtree/rabit
git-subtree-split: b15f6cd
@lock lock bot locked as resolved and limited conversation to collaborators Oct 27, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants