SmartCam - Design and Implementation of Distributed Embedded Smart Cameras

SmartCam - Design and Implementation of an Embedded Smart Camera

[Overview]  [Project Members]  [Open Master's Theses & IT-Projects]  [Publications]  [Partners and Sponsors]


News

Back to top

Project Overview

This project focuses on the design, implementation and evaluatation an embedded smart camera targeted for various surveillance applications such as traffic control. A smart camera combines video sensing, video processing and communication within a single device. Thus, smart cameras not only capture images or video sequences, they further perform high-level video processing and compression on-board and transmit the (compressed) video data as well as the extracted video information via a network. The targeted traffic surveillance applications require high-quality images as sensor input and extraordinary on-board computing performance. The system architecture of the embedded smart camera is shown in the figure below. It is realized using a CMOS image sensor, high-performance digital signal processors (DSP) and dedicated hardware subject to several constraints such as low-power consumption, real-time operation and fault tolerance.

Architecture of the SmartCam

Overall Architecture of the Embedded Smart Camera

The scientific challenges in this research projects are focused on the specification, modeling, design, implementation, configuration and evaluation of a “smart” distributed embedded system. From our perspective this includes (i) the combination of complex and intelligent algorithms with real-time capabilities, (ii) the system-level specification of hard- and software for an embedded system with high flexibility, (iii) the efficient implementation of high-level algorithms, e.g., in MATLAB, onto target platforms for embedded system, (iv) fault tolerance mechanisms to support autonomous operation, and (v) low-power design and dynamic power management. The major challenge we are facing is to address the above issues in the highly distributed setting of a network of many smart cameras, where each of which is a heterogeneous multiprocessor system.

This research project is joint work with the Austrian Research Centers Seibersdorf (ARCS) and the Institute for Computer Graphics and Vision (ICG) at the Graz University of Technology. It is further supported by Texas Instruments.

SmartCam
SmartCam as dedicated embedded device
Download our SmartCam video (8 MB MPEG2)

Back to top

Project Members

Principal Investigator PhD students Master Students (Thesis Work) Master Students (Project Work)

Back to top

Open Master's Theses & IT-Projects

We are continuously looking for students to join our team. Currently, there are several opportunities for students to start an IT-Project or to complete their studies with one of our Master's Thesis. The list of topics below is not a complete collection of interesting issues in the SmartCam project. Please feel free to contact us for further opportunities in the SmartCam project team!

Master's Theses

IT-Projects

Currently, there are no dedicated IT-Projects announced. But you can investigate in the topics announced as master thesis also in the form of an IT-Project (and continue your work as a master's thesis)

Back to top

Selected Publications and Presentations

  • Milan Jovanovic, Bernhard Rinner Middleware for Dynamic Reconfiguration in Distributed Camera Systems. In Proceedings of the 5th IEEE Workshop on Intelligent Solutions in Embedded Systems(WISES 07). Madrid, Spain, June 2007.
    [Get Paper (PDF)] [WISES 2007]

  • Bernhard Rinner, Milan Jovanovic, Markus Quaritsch. Embedded Middleware on Distributed Smart Cameras. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007). . pages 1381-1384, Honolulu, Hawaii, USA. April 2007. (invited paper)
    [Get Paper (PDF)] [ICASSP 2007]

  • Markus Quaritsch, Markus Kreuzthaler, Bernhard Rinner, Horst Bischof, Bernhard Strobl. Autonomous Multi-Camera Tracking on Embedded Smart Cameras. EURASIP Journal on Embedded Systems. (special issue on Embedded Vision Systems). 2007.
    [Get Paper (PDF)] [EURASIP Journal on Embedded Systems]

  • Andreas Doblander. A Novel Software Framework for Multi-Processor Embedded Smart Cameras. PhD thesis Graz University of Technology, Nov 2006.
    [Get Thesis (PDF)]

  • Markus Quaritsch, Markus Kreuzthaler, Bernhard Rinner, Bernhard Strobl. Decentralized Object Tracking in a Network of Embedded Smart Cameras. In Proceedings of the International Workshop on Distributed Smart Cameras (DSC-06). pages 99-104, Boulder, CO, USA. October 2006.
    [Get Paper (PDF)] [DSC 2006]

  • Andreas Doblander, Arnold Maier, Bernhard Rinner, Helmut Schwabach. A Novel Software Framework for Power-Aware Service Reconfiguration in Multi-Reconfiguration in Distributed Embedded Smart Cameras. In Proceedings of the 12th IEEE International Conference on Parallel and Distributed Systems (ICPADS'06). pages 281-288, Minneapolis, Minnesota, USA. 12-15 July 2006.
    [Get Paper (PDF)] [ICPADS 2006]

  • Andreas Doblander, Arnold Maier, Bernhard Rinner, Andreas Zoufal. An Efficient Middleware for Power-Aware Service Reconfiguration in Multi-DSP Smart Cameras. In Proceedings of the 2nd IEEE International Conference on Information and Communication Technologies: from Theory to Applications (ICTTA'06). pages 1093-1094, Damaskus, Syria. 24-28 April 2006.
    [Get Paper (PDF)] [ICTTA 2006]

  • Arnold Maier. Dynamic Power-Aware Camera Configuration in Distributed Embedded Surveillance Clusters. PhD thesis Graz University of Technology, Feb 2006.
    [Get Thesis (PDF)]

  • Andreas Doblander, Bernhard Rinner, Norbert Trenkwalder, Andreas Zoufal. A Middleware Framework for Dynamic Reconfiguration and Component Composition in Embedded Smart Cameras. WSEAS Transactions on Computers, 5(3) pages 574-581, WSEAS Press. March 2006.
    [Get Paper (PDF)] [WSEAS Journals]

  • Andreas Doblander, Bernhard Rinner, Norbert Trenkwalder, Andreas Zoufal. A light-weight Publisher-Subscriber Middleware for Dynamic Reconfiguration in Networks of Embedded Smart Cameras. In Proceedings of the 5th WSEAS International Conference on Software Engineering, Parallel and Distributed Systems (SEPADS'06). Madrid, Spain. February 2006.
    [Get Paper (PDF)] [SEPADS 2006]

  • Arnold Maier, Bernhard Rinner, Helmut Schwabach. Online Multi-Criterion Optimization for Dynamic Power-Aware Camera Configuration in Distributed Embedded Surveillance Clusters. In Proceedings The IEEE 20th International Conference on Advanced Information Networking and Applications (AINA 2006). pages 307-312, Vienna, Austria. April 2006.
    [Get Paper (PDF)] [AINA 2006]

  • Michael Bramberger, Andreas Doblander, Milan Jovanovic, Andreas Klausner, Arnold Maier, Bernhard Rinner, Allan Tengg. Embedded Smart Cameras as Key Components in Reactive Sensor Systems. In Proceedings Cognitive Systems with Interactive Sensors (COGIS 2006). Paris, France. March 2006.
    [Get Paper (PDF)] [COGIS06]

  • Michael Bramberger, Andreas Doblander, Arnold Maier, Bernhard Rinner, Helmut Schwabach. Distributed Embedded Smart Cameras for Surveillance Applications. IEEE Computer 39(2) pages 68-75, February 2006.
    [Get Paper (PDF)] [IEEE Computer]

  • Michael Bramberger, Bernhard Rinner, Helmut Schwabach. A Method for Dynamic Allocation of Tasks in Clusters of Embedded Smart Cameras. In Proceedings of the IEEE International Conferens on Systems, Man and Cybernetics. pages 2595-2600, Hawaii, USA, October 2005.
    [Get Paper (PDF)] [SMC 2005]

  • Michael Bramberger, Markus Quaritsch, Thomas Winkler, Bernhard Rinner, Helmut Schwabach. Integrating Multi-Camera Tracking into a Dynamic Task Allocation System for Smart Cameras. In Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance. Como, Italy, September 2005.
    [Get Paper (PDF)] [AVSS 2005]

  • Arnold Maier, Bernhard Rinner, Helmut Schwabach. A Hierarchical Approach for Energy-Aware Distributed Embedded Intelligent Surveillance. In Proceedings of the IEEE/IFIP International Workshop on Parallel and Distributed Embedded Systems. Fukuoka, Japan, July 2005.
    [Get Paper (PDF)] [PDES 2005]

  • Michael Bramberger. Distributed Dynamic Task Allocation in Clusters of Embedded Smart Cameras. PhD thesis Graz University of Technology, June 2005.
    [Get Thesis (PDF)]

  • Michael Bramberger, Bernhard Rinner and Helmut Schwabach. Resource-Aware Dynamic Task-Allocation in Clusters of Embedded Smart Cameras by Mobile Agents. In Proceedings of the IEE International Workshop on Intelligent Environments. Colchester, United Kingdom, June 2005.
    [Get Paper (PDF)] [IE 2005]

  • Andreas Doblander, Arnold Maier, Bernhard Rinner and Helmut Schwabach. Improving Fault-Tolerance in Intelligent Video Surveillance by Monitoring, Diagnosis and Dynamic Reconfiguration. In Proceedings of the 3rd IEEE Workshop on Intelligent Solutions in Embedded Systems. Hamburg, Germany, May 2005.
    [Get Paper (PDF)] [WISES 2005]

  • Michael Bramberger, Bernhard Rinner and Helmut Schwabach. A Mobile Agent-based System for Dynamic Task Allocation in Clusters of Embedded Smart Cameras. In Proceedings of the 3rd IEEE Workshop on Intelligent Solutions in Embedded Systems. Hamburg, Germany, May 2005.
    [Get Paper (PDF)] [WISES 2005]

  • Andreas Doblander, Dietmar Goesseringer, Bernhard Rinner and Helmut Schwabach. An Evaluation of Model-Based Software Synthesis from Simulink Models for Embedded Video Applications. In International Journal of Software Engineering and Knowledge Engineering. Vol. 15, No. 2, Page 343-348, World Scientific Publishing Company, April 2005.
    [IJSEKE]

  • Andreas Doblander, Arnold Maier, Bernhard Rinner and Helmut Schwabach. Increasing Service Availability in Intelligent Video Surveillance Systems by Fault Detection and Dynamic Reconfiguration. In Proceedings of the Telecommunications and Mobile Computing Workshop on Wearable and Pervasive Computing (TCMC'05), Austrian Electrotechnical Association (öVE), Graz, Austria, March 2005.
    [Get Paper (PDF)] [TCMC 2005]

  • Michael Bramberger, Bernhard Rinner and Helmut Schwabach. Dynamic Task Allocation in Clusters of Embedded Smart Cameras. In Proceedings of the Telecommunications and Mobile Computing Workshop on Wearable and Pervasive Computing (TCMC'05), Austrian Electrotechnical Association (öVE), Graz, Austria, March 2005.
    [Get Paper (PDF)] [TCMC 2005]

  • Arnold Maier, Bernhard Rinner, Helmut Schwabach, and Thomas Trathnigg. Combined Management of Power- and Quality of Service in Distributed Embedded Video Surveillance Systems. In Proceedings of 1st International Workshop on Power-Aware Real-Time Computing (PARC2004). Pisa, Italy, September 2004.
    [Get Paper (PDF)] [PARC]

  • Michael Bramberger, Bernhard Rinner, and Helmut Schwabach. An Embedded Smart Camera on a Scalable Heterogenous Multi-DSP System. In Proceedings of the European DSP Education and Research Symposium (EDERS2004). Birmingham, United Kingdom, November 2004.
    [Get Paper (PDF)]

  • Andreas Doblander, Dietmar Gösseringer, Bernhard Rinner, Helmut Schwabach. Synthesis of Embedded Image Processing Applications from SIMULINK Models. In Proceedings of the 2nd Workshop on Intelligent Solutions in Embedded Systems. Graz, Austria, June 2004.
    [Get Paper (PDF)] [WISES 2004]

  • Arnold Maier, Bernhard Rinner, Helmut Schwabach, Thomas Trathnigg. Combined Dynamic Power- and QoS-Management in Embedded Video Surveillance Systems. In Proceedings of the 2nd Workshop on Intelligent Solutions in Embedded Systems. Graz, Austria, June 2004.
    [Get Paper (PDF)] [WISES 2004]

  • Michael Bramberger, Josef Brunner, Bernhard Rinner, and Helmut Schwabach. Real-Time Video Analysis on an Embedded Smart Camera for Traffic Surveillance. In Proceedings of the 10th IEEE Real-Time and Embedded Technology and Applications Symposium. Toronto, Canada, May 2004.
    [Get Paper (PDF)] [RTAS 2004]

  • Bernhard Rinner, Horst Bischof, Michael Bramberger, Andreas Doblander, Arnold Maier, Roman Pflugfelder and Helmut Schwabach. Eine intelligente Kamera zur Verkehrsüberwachung. Bulletin SEV/VSE 95(11):19-23 2004.
    [Get Paper (PDF)] [SEV Bulletin]

  • Michael Bramberger, Roman Pflugfelder, Arnold Maier, Bernhard Rinner, Bernhard Strobl and Helmut Schwabach. A Smart Camera for Traffic Surveillance. In Proceedings of the First Workshop on Intelligent Solutions in Embedded Systems (WISES 2003). Wien, Austria, June 2003.
    [Get Paper (PDF)] [WISES 2003]

  • Michael Bramberger, Roman Pflugfelder, Bernhard Rinner, Helmut Schwabach, and Bernhard Strobl. Intelligent Traffic Video Sensor: Architecture and Applications. In Proceedings of the Workshop on Telecommunications and Mobile Computing (TCMC 2003). Graz, Austria, March 2003.
    [Get Paper (PDF)] [TCMC 2003]

    • Back to top

    Partners and Sponsors

    Institute for Technical Informatics Austrian Research Centers Seibersdorf Institute for Computer Graphics and Vision Texas Instruments FFG

    Back to top

    Last update: 20.02.2006