Nuwan Jayasena
41 papers 71 citations h-index 4 2000–2026
Computation vs. Communication Scaling for Future Transformers on Future Hardware
Scaling neural network models has delivered dramatic quality gains across ML problems. However, this scaling has increased the reliance on efficient distributed training techniques. Accordingly,...
Demystifying BERT: Implications for Accelerator Design
Transfer learning in natural language processing (NLP), as realized using models like BERT (Bi-directional Encoder Representation from Transformer), has significantly improved language...
SeqPoint: Identifying Representative Iterations of Sequence-based Neural Networks
The ubiquity of deep neural networks (DNNs) continues to rise, making them a crucial application class for hardware optimizations. However, detailed profiling and characterization of DNN training...
CODA: Enabling Co-location of Computation and Data for Near-Data Processing
Recent studies have demonstrated that near-data processing (NDP) is an effective technique for improving performance and energy efficiency of data-intensive workloads. However, leveraging NDP in...