Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a more open dataset #3

Closed
somewacko opened this issue Sep 27, 2016 · 7 comments
Closed

Use a more open dataset #3

somewacko opened this issue Sep 27, 2016 · 7 comments

Comments

@somewacko
Copy link
Owner

The RaFD data used for this project is not open data, but there is a lot of potential for this to be used in interesting ways outside of academic research.

It would be really great if we could find other data that could be used to generate faces that has a more permissive license. That way non-researchers would be able to tinker around with this, and we would be able to share the weights publicly.

I don't have much time at the moment to do more work for this, but because this project's gotten a lot of interest lately I want to open this as an issue in case anyone's interested in pursuing it.

@nakosung
Copy link

nakosung commented Oct 6, 2016

I have tested against non RaFD data(which is leeched from internet...) and this is the result.
http://imgur.com/gallery/mId5x

@somewacko
Copy link
Owner Author

@nakosung that's interesting! How did you source the data / do you have more details about it? It seems to "fade" between examples more than with the RaFD data.

@nakosung
Copy link

nakosung commented Oct 6, 2016

@zo7 Actually the dataset is 1-d(identity only). So we can expect overfitting (much more fade). The data was grabbed from http://www.faceresearch.org/demos/average.

@somewacko
Copy link
Owner Author

Ah, there also seems to be much fewer examples as well, which is probably the bigger reason why it overfits.

Perhaps Extended Yale Face Database B might be worthwhile to try? (I actually might have a free moment later today / this weekend, so I may try this myself..)

@somewacko
Copy link
Owner Author

Just added this, letting it train overnight since my GPU isn't doing anything at the moment. It'll be interesting to see since this data is less consistent than RaFD (background and head position is very inconsistent) but it's 7x the size and varies lighting/pose instead of emotion/orientation.

@somewacko
Copy link
Owner Author

Some results here. It can't interpolate identities as well because of the variation (we should expect that) but it does pose and lighting pretty well.

Video of random generations

This was referenced Oct 24, 2016
@somewacko
Copy link
Owner Author

Closing this since the Yale Faces and JAFFE datasets were added and this really needs more refactoring before we can add another

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants