RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing
Personalized recommendation systems leverage deep learning models and account for the majority of data center AI cycles. Their performance is dominated by memory-bound sparse embedding operations...
First-Generation Inference Accelerator Deployment at Facebook
In this paper, we provide a deep dive into the deployment of inference accelerators at Facebook. Many of our ML workloads have unique characteristics, such as sparse memory accesses, large model...
Glow: Graph Lowering Compiler Techniques for Neural Networks
This paper presents the design of Glow, a machine learning compiler for heterogeneous hardware. It is a pragmatic approach to compilation that enables the generation of highly optimized code for...