ELECTRA Base Discriminator

ELECTRA Base Discriminator is a pretrained transformer encoder from Google Research that learns by detecting replaced tokens rather than masking, making pretraining more compute-efficient than BERT while achieving strong benchmark results on NLP tasks such as classification, QA, and sequence labeling. Source: supabase.