Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Are the Teacher and Student the same pretrained model with the same initialization? #2

Open
zhangxinyu-xyz opened this issue Jul 12, 2022 · 2 comments
Open

Are the Teacher and Student the same pretrained model with the same initialization? #2

zhangxinyu-xyz opened this issue Jul 12, 2022 · 2 comments

Comments

@zhangxinyu-xyz
Copy link

Dear authors,

Thanks for your excellent work. After carefully reading the paper, May I ask that whether the Teacher and Student are the same pretrained model with the same initialization?

Thanks for your help.
@NikAleksFed
Copy link

Same question

@ancientmooner
Copy link
Member

The student model is randomly initialized.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ancientmooner @zhangxinyu-xyz @NikAleksFed