๐Ÿ–๏ธ
Knowledge Distilation
  • Knowledge Distillation
  • Distilling the Knowledge in a Neural Network
  • Deep Mutual Learning (์ž‘์„ฑ์˜ˆ์ •)
Powered by GitBook
On this page
  • Introduction
  • Sota ์Šค๋Ÿฌ์›Œ ๋ณด์ด๋Š” ๊ธ€

Was this helpful?

Knowledge Distillation

NextDistilling the Knowledge in a Neural Network

Last updated 5 years ago

Was this helpful?

Introduction

  • SDS์—์„œ ์ž‘์„ฑํ•œ Knowledge Distilation ์†Œ๊ฐœ๊ธ€

ํ•„์š”์—†๋Š” ๊ฐ€์ค‘์น˜๋ฅผ ์ œ๊ฑฐํ•˜๋Š” ๊ธฐ๋ฒ•์ธ Network pruning๊ณผ Knowledge Distilation์˜ ๊ธฐ๋ณธ ๊ฐœ๋…, ๊ทธ๋ฆฌ๊ณ  Teacher-Student Network๊นŒ์ง€ ์ž˜ ์ •๋ฆฌ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

  • Awesome Knowledge Distilation - Github

  • Tensorflow KR์—์„œ ์ฐพ์„ ๊ธ€ - Github

๊ด€๋ จ ์—ฐ๊ตฌ๋ถ„์•ผ ๋…ผ๋ฌธ์ด ์ž˜ ์ •๋ฆฌ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

Sota ์Šค๋Ÿฌ์›Œ ๋ณด์ด๋Š” ๊ธ€

์ธ๊ณต์ง€๋Šฅ ๊ฒฝ๋Ÿ‰ํ™” ๊ธฐ์ˆ  ๋™ํ–ฅ
GitHub - dkozlov/awesome-knowledge-distillation: Awesome Knowledge DistillationGitHub
A Comprehensive Overhaul of Feature Distillation (ICCV 2019)Clova AI Research Blog
GitHub - sseung0703/KD_methods_with_TF: Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)GitHub
Logo
Logo
Logo