DistilBERT Base Uncased

DistilBERT Base Uncased is a compact, fast distilled version of BERT base, trained via knowledge distillation for general English language understanding tasks. It is case-insensitive and designed for fine-tuning on downstream NLP tasks such as text classification, named entity recognition, and question answering. Source: supabase.