Title

Login

Join

Book's by Ananda Samajdar

Covers

List

Data Orchestration in Deep Learning Accelerators

By: Tushar Krishna,Hyoukjun Kwon,Angshuman Parashar,Michael Pellauer,Ananda Samajdar

Write a review Read reviews Take a Quiz Solve Book Puzzle

Data Orchestration in Deep Learning Accelerators

By: Tushar Krishna,Hyoukjun Kwon,Angshuman Parashar,Michael Pellauer,Ananda Samajdar

This Synthesis Lecture focuses on techniques for efficient data orchestration within DNN accelerators. The End of Moore's Law, coupled with the increasing growth in deep learning and other AI applications has led to the emergence of custom Deep Neural Network (DNN) accelerators for energy-efficient inference on edge devices. Modern DNNs have millions of hyper parameters and involve billions of computations; this necessitates extensive data movement from memory to on-chip processing engines. It is well known that the cost of data movement today surpasses the cost of the actual computation; therefore, DNN accelerators require careful orchestration of data across on-chip compute, network, and memory elements to minimize the number of accesses to external DRAM. The book covers DNN dataflows, data reuse, buffer hierarchies, networks-on-chip, and automated design-space exploration. It concludes with data orchestration challenges with compressed and sparse DNNs and future trends. The target audience is students, engineers, and researchers interested in designing high-performance and low-energy accelerators for DNN inference.

Average ratings

N/A

5

0%

4

0%

3

0%

2

0%

1

0%

Solve jigsaw puzzle

Age

Page Count

158

Publisher

Springer Nature

Published Date

ISBN 10

3031017676

ISBN 13

9783031017674

Data Orchestration in Deep Learning Accelerators

By: Tushar Krishna,Hyoukjun Kwon,Angshuman Parashar,Michael Pellauer,Ananda Samajdar

Write a review Read reviews Take a Quiz Solve Book Puzzle

Data Orchestration in Deep Learning Accelerators

By: Tushar Krishna,Hyoukjun Kwon,Angshuman Parashar,Michael Pellauer,Ananda Samajdar

This Synthesis Lecture focuses on techniques for efficient data orchestration within DNN accelerators. The End of Moore's Law, coupled with the increasing growth in deep learning and other AI applications has led to the emergence of custom Deep Neural Network (DNN) accelerators for energy-efficient inference on edge devices. Modern DNNs have millions of hyper parameters and involve billions of computations; this necessitates extensive data movement from memory to on-chip processing engines. It is well known that the cost of data movement today surpasses the cost of the actual computation; therefore, DNN accelerators require careful orchestration of data across on-chip compute, network, and memory elements to minimize the number of accesses to external DRAM. The book covers DNN dataflows, data reuse, buffer hierarchies, networks-on-chip, and automated design-space exploration. It concludes with data orchestration challenges with compressed and sparse DNNs and future trends. The target audience is students, engineers, and researchers interested in designing high-performance and low-energy accelerators for DNN inference.

Average ratings

N/A

5

0%

4

0%

3

0%

2

0%

1

0%

Solve jigsaw puzzle

Age

Page Count

158

Publisher

Springer Nature

Published Date

ISBN 10

3031017676

ISBN 13

9783031017674