Knowledge Distillation

Introduction

  • SDS์—์„œ ์ž‘์„ฑํ•œ Knowledge Distilation ์†Œ๊ฐœ๊ธ€

ํ•„์š”์—†๋Š” ๊ฐ€์ค‘์น˜๋ฅผ ์ œ๊ฑฐํ•˜๋Š” ๊ธฐ๋ฒ•์ธ Network pruning๊ณผ Knowledge Distilation์˜ ๊ธฐ๋ณธ ๊ฐœ๋…, ๊ทธ๋ฆฌ๊ณ  Teacher-Student Network๊นŒ์ง€ ์ž˜ ์ •๋ฆฌ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

  • Awesome Knowledge Distilation - Github

  • Tensorflow KR์—์„œ ์ฐพ์„ ๊ธ€ - Github

๊ด€๋ จ ์—ฐ๊ตฌ๋ถ„์•ผ ๋…ผ๋ฌธ์ด ์ž˜ ์ •๋ฆฌ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.

Sota ์Šค๋Ÿฌ์›Œ ๋ณด์ด๋Š” ๊ธ€

โ€‹