Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image Processing
Document Type
Conference Proceeding
Publication Date
11-7-2024
Abstract
This paper proposes a high-performance and energy-efficient optical near-sensor accelerator for vision applications, called Lightator. Harnessing the promising efficiency offered by photonic devices, Lightator features innovative compressive acquisition of input frames and fine-grained convolution operations for low-power and versatile image processing at the edge for the first time. This will substantially diminish the energy consumption and latency of conversion, transmission, and processing within the established cloud-centric architecture as well as recently designed edge accelerators. Our device-to-architecture simulation results show that with favorable accuracy, Lightator achieves 84.4 Kilo FPS/W and reduces power consumption by a factor of ∼24× and 73× on average compared with existing photonic accelerators and GPU baseline.
Identifier
85201206402 (Scopus)
ISBN
[9798400706011]
Publication Title
Proceedings - Design Automation Conference
External Full Text Location
https://doi.org/10.1145/3649329.3656261
ISSN
0738100X
Grant
#FA9550-22-1-0253
Fund Ref
Semiconductor Research Corporation
Recommended Citation
Morsali, Mehrdad; Reidy, Brendan; Najafi, Deniz; Tabrizchi, Sepehr; Imani, Mohsen; Nikdast, Mahdi; Roohi, Arman; Zand, Ramtin; and Angizi, Shaahin, "Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image Processing" (2024). Faculty Publications. 96.
https://digitalcommons.njit.edu/fac_pubs/96