GitHub

MitraKin/model-distillation-project

A complete knowledge distillation pipeline that compresses BERT (110M params) to DistilBERT (67M params) while maintaining high accuracy on SST-2 sentiment classification.
GitHub

JakeClark-chan/smart_contract_detection_xAI

smart_contract_detection_xAI/ ├── config.py # Central configuration (paths, models, hyperparameters) ├── utils.py # Logging, GPU detection, timing, pickle caching ├── data_loader.py # Dataset loading, ...
IEEE

Real-Time Email Phishing Detection Using a Custom DistilBERT Model

Abstract: This paper presents a real-time email phishing detection system that utilizes a custom DistilBERT model. The custom DistilBERT architecture incorporates dynamic threshold adjustment and an ...
IEEE

Analysis of Public Sentiment on the 17+8 People's Demands Issue Using IndoBERT and DistilBERT with LLM-Based Data Annotation

Abstract: We analyze public sentiment on the 17+8 movement (Aug 2025) using IndoBERT and DistilBERT. A corpus of 4,441 texts from Google News, YouTube, and Reddit was labeled via two LLMs (SahabatAI, ...