🖍️
Knowledge Distilation
  • Knowledge Distillation
  • Distilling the Knowledge in a Neural Network
  • Deep Mutual Learning (작성예정)
Powered by GitBook
On this page
  • Introduction
  • Sota 스러워 보이는 글

Was this helpful?

Knowledge Distillation

NextDistilling the Knowledge in a Neural Network

Last updated 5 years ago

Was this helpful?

Introduction

  • SDS에서 작성한 Knowledge Distilation 소개글

필요없는 가중치를 제거하는 기법인 Network pruning과 Knowledge Distilation의 기본 개념, 그리고 Teacher-Student Network까지 잘 정리되어 있습니다.

  • Awesome Knowledge Distilation - Github

  • Tensorflow KR에서 찾을 글 - Github

관련 연구분야 논문이 잘 정리되어 있습니다.

Sota 스러워 보이는 글

인공지능 경량화 기술 동향
LogoGitHub - dkozlov/awesome-knowledge-distillation: Awesome Knowledge DistillationGitHub
LogoGitHub - sseung0703/KD_methods_with_TF: Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)GitHub
LogoA Comprehensive Overhaul of Feature Distillation (ICCV 2019)Clova AI Research Blog