Field programmable gate arrays based multi camera thermal and day vision video processing and distribution system


Basli A., Kahraman C., Ates B., ÇELEBİ A.

2021 International Conference on INnovations in Intelligent SysTems and Applications, INISTA 2021, Kocaeli, Türkiye, 25 - 27 Ağustos 2021 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/inista52262.2021.9548352
  • Basıldığı Şehir: Kocaeli
  • Basıldığı Ülke: Türkiye
  • Anahtar Kelimeler: 360-degree vision, Day camera, Ethernet, FPGA, Image processing, Thermal camera
  • Kocaeli Üniversitesi Adresli: Evet

Özet

In this paper, a real-time video management system for automotive that can capture and process video streams from up to 24 cameras is proposed. The system is composed of two different type of modules one capture module and the other is management module. System can be scaled up to 4 capture modules that a number of 12 day vision and 12 thermal cameras can be integrated in total. Both capture module and video management module have their own image processing capabilities. The video management module can stream out raw video via HD-SDI or Ethernet interfaces. The video is transferred in RFC4175 form via Gigabit ethernet interface which is also novel to this work. The total glass-to-glass delay of the implemented system is achieved under 150 ms. The system contains 5 FPGA chips fabricated at 16nm process technology for the highest configuration. Each module in the system contains one FPGA chip. A GPU based module may also be installed into the video management system thanks to its scalable architecture. The total video throughput of the highest configuration of the system is 12×1080p×30 fps + 12×640×512×25 fps.