Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Teacher/Student Parameter ratio #7

Closed
iiSeymour opened this issue Nov 12, 2019 · 2 comments
Closed

Teacher/Student Parameter ratio #7

iiSeymour opened this issue Nov 12, 2019 · 2 comments

Comments

@iiSeymour
Copy link

Hey @HobbitLong, nice paper. Do you have any guidelines on the effectiveness of the approach as the number of parameters decrease in the student model vs the teacher (same architecture) and what a sensible ratio is a good starting point?
@HobbitLong
Copy link
Owner

Hi, @iiSeymour ,

This is an interesting question! I haven't got chance to look into it, but my guess is somewhere between 2~10 for teacher-student ratio.

@iiSeymour
Copy link
Author

Great, thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@iiSeymour @HobbitLong