Blog
Scaling RCL Language Models
April 21, 2022 Authored by: Dr. Morten Middelfart, Sam Martin, and Ben Martin Abstract In this paper, we demonstrate that RCL scales sublinearly with dataset size and linearly with compute. We also indicate how RCL both differs from transformer architecture and...
Random Contrast Learning: A New Approach to Supercomputing and Machine Learning
February 16, 2022 Authored by: Dr. Morten Middelfart, Sam Martin, and Ben Martin Abstract In this paper, we demonstrate that, compared to deep learning, random contrast learning (RCL) produces unsupervised language models with faster training, faster inference, and...
Subscribe to Our Newsletter