Google Patents a Learnable Sparsity Mask Technique for Efficient ML Models
Most AI models carry a lot of dead weight — literally. Google's new patent describes a way to teach a model, during…
The unglamorous machinery underneath: training methods, inference speedups, model compression, and the scheduling tricks that make AI affordable to run.
Most AI models carry a lot of dead weight — literally. Google's new patent describes a way to teach a model, during…
What if your servers could safely host more workloads than they're technically 'supposed' to handle? Google is patenting a machine learning system…
Instead of asking an AI to invent molecules from scratch, Microsoft's new patent describes a smarter approach: find the chemical neighbors of…
Training a small AI model to match the performance of a large one is notoriously hard — especially when you want it…
Nvidia is building AI models that don't just see what's happening on screen — they predict what to do next. This patent…
This Google patent, co-invented by Geoffrey Hinton and Oriol Vinyals, covers one of the most influential ideas in modern AI: knowledge distillation…
Training a good AI model is only as good as the data you feed it — and most companies are drowning in…
What if you could take a massive, expensive AI model and compress its knowledge into a tiny one that runs cheaply on…
Three of the biggest names in deep learning — Hinton, Dean, and Vinyals — are on a Google patent for knowledge distillation,…
What if your phone only had to do part of the AI thinking, and the cloud quietly filled in the gaps? That's…
Training graph neural networks is notoriously wasteful — most batching methods ignore the graph's own structure, so each training step spends half…
Teaching a robot to do something useful requires enormous amounts of demonstration data — and collecting that data by hand is slow,…
One Big Tech patent every Sunday. Free.