Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problems with 2D XOR dataset experiments #5

Open
wusj0723 opened this issue Jun 28, 2021 · 1 comment
Open

Problems with 2D XOR dataset experiments #5

wusj0723 opened this issue Jun 28, 2021 · 1 comment

Comments

@wusj0723
Copy link

We reproduced the experiment on the XOR data set of your paper, and produced two sets of data respectively for experiment. However, the results were not ideal and there were some deviations from the images in your paper. Did you use any techniques not mentioned in the paper when conducting these experiments? Or is there something special about the distribution of the data you're using? We use two kinds of data:
XOR_data
XOR_data_2

The results are:
confidence_1
confidence_2

We look forward to hearing from you.

@TDeVries
Copy link
Collaborator

I don't think the experiment had anything fancy. It was a pretty straightforward implementation of an MLP + confidence branch trained on a 2D dataset. The dataset was sampled from a continuous uniform distribution in range [-1, 1] and then split into classes based on quadrants. Your dataset looks like it has been rounded to integer values, although I don't think that should make much difference.

How well does your trained model separate the two classes? If the main model is not learning properly then the confidence estimates will also not be great.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants