Number Systems for Deep Neural Network Architectures, 1st ed. 2024 Synthesis Lectures on Engineering, Science, and Technology Series

This book provides readers a comprehensive introduction to alternative number systems for more efficient representations of Deep Neural Network (DNN) data. Various number systems (conventional/unconventional) exploited for DNNs are discussed, including Floating Point (FP), Fixed Point (FXP), Logarithmic Number System (LNS), Residue Number System (RNS), Block Floating Point Number System (BFP), Dynamic Fixed-Point Number System (DFXP) and Posit Number System (PNS). The authors explore the impact of these number systems on the performance and hardware design of DNNs, highlighting the challenges associated with each number system and various solutions that are proposed for addressing them.

Introduction.- Conventional number systems.- DNN architectures based on Logarithmic Number System (LNS).- DNN architectures based on Residue Number System (RNS).- DNN architectures based on Block Floating Point (BFP) number system.- DNN architectures based on Dynamic Fixed Point (DFXP) number system.- DNN architectures based on Posit number system.

Ghada Alsuhli received her B.S. and M.S. degrees in electronics and communication engineering from Damascus University, Syria, in 2009 and 2015, respectively. She obtained her Ph.D. degree in electronics and communication engineering from Cairo University, Egypt, in 2019. Throughout her academic journey, she has been actively involved in research at esteemed institutions such as the National Research Center in Egypt, The American University in Cairo, Egypt, and the SOC Center at Khalifa University, UAE. Currently, Ghada holds the position of Post-Doctoral Researcher at Khalifa University, UAE, where she focuses on the design and implementation of Artificial Intelligence accelerators. Her research interests encompass a wide range of areas, including Artificial Intelligence applications in wireless communications, airborne and ground ad-hoc networks, and biomedical engineering.

Vasilis Sakellariou received his Bachelor/Master Degree in Electrical Engineering and Computer Science in University of Patras, Greece, in 2015. He is currently pursuing his PhD title in Khalifa University in Abu Dhabi. During his master he specialized in the field of microelectronics, embedded systems, integrated circuits and VLSI design, while his thesis involved designing hardware accelerators for neuromorphic computing. His current research interests are focused on designing low-power accelerators for edge-AI devices by employing non-conventional arithmetic systems, with emphasis on the Residue Numbering System, as well as emerging in-memory computing paradigms.

Hani Saleh is an associate professor of electronic engineering at Khalifa University since 2017, he joined Khalifa as assistant professor on 2012. He was a co-founder of the KSRC (Khalifa University Research Center 2012-2018) and a co-founder and a theme-lead in the System on Chip Research Center (SOCC 2019-present) where he led multiple IoT projects for the development of wearable blood glucose monitoring SOC,