Distilling Giants: Making BERT Models Lightweight and Interpretable with DIET COKE
This past semester, I embarked on an exciting NLP project: building DIET COKE — short for Decision trees Interpreting Efficient Transformers - Compression Of Knowledge Extraction. It's a project that sits at the crossroads of deep learning and classi...
Apr 24, 20254 min read21