Nature

AI-generated artwork detection using self-distilled transformers with global–local feature learning and Grad-CAM interpretability

This study presents a strong framework for the detection of artificial intelligence-generated artwork using digital imaging and deep learning–based transformers models, which helps in art community to ...
InfoWorld

Researchers propose a self-distillation fix for ‘catastrophic forgetting’ in LLMs

LLMs tend to lose prior skills when fine-tuned for new tasks. A new self-distillation approach aims to reduce regression and simplify model management. A new fine-tuning technique aims to solve ...
Nature

SPEED-TR: a self-distilled and pre-trained transformer model for enhanced ECG detection of tricuspid regurgitation

Tricuspid regurgitation (TR) remains underdiagnosed due to the lack of effective screening tools. We developed a self-distilled and pre-trained transformer model for detecting TR (SPEED-TR) from ...
Forbes

Did DeepSeek Copy Off Of OpenAI? And What Is Distillation?

Forbes contributors publish independent expert analyses and insights. There’s a new wrinkle in the saga of Chinese company DeepSeek’s recent announcement of a super-capable R1 model that combines high ...