Tag
Inference
Every published article tagged with Inference.
Mythic Unveils Analog Compute In Memory Architecture For AI Inference
Run neural networks directly inside flash memory arrays. Use mythic analog compute memory to slash edge AI power draw and latency.
DeepSeek V4 Flash Crashes the Single-GPU Barrier on AMD MI300X
Someone got DeepSeek's V4 Flash model running on a single AMD MI300X GPU. What that means for the NVIDIA monopoly on high-end inference and whether it's actually practical.
How Cloudflare Runs Kimi and GLM Models Smaller and Faster at Scale
Cloudflare's approach to serving compact AI models with tighter latency budgets shows what production inference actually looks like when you strip away the GPU excess.
4 min read