EURASIP Journal on Embedded Systems 
Volume 2007 (2007), Article ID 49236, 12 pages
doi:10.1155/2007/49236
Research Article

Dataflow-Based Mapping of Computer Vision Algorithms onto FPGAs

Mainak Sen,1 Ivan Corretjer,1 Fiorella Haim,1 Sankalita Saha,1 Jason Schlessman,2 Tiehan Lv,2 Shuvra S. Bhattacharyya,1 and Wayne Wolf2

1Department of Electrical and Computer Engineering, University of Maryland, College Park 20742, MD, USA
2Department of Electrical Engineering, Princeton University, Princeton 08544, NJ, USA

Received 1 May 2006; Revised 8 October 2006; Accepted 9 October 2006

Recommended by Moshe Ben-Ezra

Abstract

We develop a design methodology for mapping computer vision algorithms onto an FPGA through the use of coarse-grain reconfigurable dataflow graphs as a representation to guide the designer. We first describe a new dataflow modeling technique called homogeneous parameterized dataflow (HPDF), which effectively captures the structure of an important class of computer vision applications. This form of dynamic dataflow takes advantage of the property that in a large number of image processing applications, data production and consumption rates can vary, but are equal across dataflow graph edges for any particular application iteration. After motivating and defining the HPDF model of computation, we develop an HPDF-based design methodology that offers useful properties in terms of verifying correctness and exposing performance-enhancing transformations; we discuss and address various challenges in efficiently mapping an HPDF-based application representation into target-specific HDL code; and we present experimental results pertaining to the mapping of a gesture recognition application onto the Xilinx Virtex II FPGA.