Table of Contents Author Guidelines Submit a Manuscript
Journal of Sensors
Volume 2010 (2010), Article ID 920693, 17 pages
http://dx.doi.org/10.1155/2010/920693
Review Article

CMOS Image Sensor with On-Chip Image Compression: A Review and Performance Analysis

Smart Sensory Integrated Systems (S2IS) Lab, Electronic and Computer Engineering Department, Hong Kong University of Science and Technology, Kowloon, Hong Kong

Received 4 May 2010; Revised 16 August 2010; Accepted 21 September 2010

Academic Editor: Isao Takayanagi

Copyright © 2010 Milin Zhang and Amine Bermak. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. A. El Gamal and H. Eltoukhy, “CMOS image sensors,” IEEE Circuits and Devices Magazine, vol. 21, no. 3, pp. 6–20, 2005. View at Publisher · View at Google Scholar · View at Scopus
  2. N. Ahmed, T. Natarajan, and K. R. Rao, “Discrete cosine transfom,” IEEE Transactions on Computers, vol. 23, no. 1, pp. 90–93, 1974. View at Google Scholar
  3. R. C. Reininger and J. D. Gibson, “Distribution of the two-dimensional DCT coefficients for images,” IEEE Transactions on Communications, vol. 31, no. 6, pp. 835–839, 1983. View at Google Scholar · View at Scopus
  4. K. Rose, A. Heiman, and I. Dinstein, “DCT/DST alternate-transform image coding,” IEEE Transactions on Communications, vol. 38, no. 1, pp. 94–101, 1990. View at Google Scholar · View at Scopus
  5. R. Wilson, “Wavelets?” in IEE Colloquium on Applications of Wavelet Transforms in Image Processing, pp. 1/1–1/6, London, UK, 1993.
  6. E. Cetin and O. N. Gerek, “Block wavelet transform for image coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 3, no. 6, pp. 433–435, 1993. View at Publisher · View at Google Scholar · View at Scopus
  7. D. Park and M. HO. Lee, “Image compression based on best wavelet packet bases,” IEEE Transactions on Consumer Electronics, vol. 40, no. 3, pp. 527–537, 1994. View at Google Scholar · View at Scopus
  8. L. H. Croft and J. A. Robinson, “Subband image coding using watershed and watercourse lines of the wavelet transforms,” IEEE Transactions on Image Processing, vol. 3, no. 6, pp. 759–772, 1994. View at Publisher · View at Google Scholar · View at Scopus
  9. W. Pennebaker and J. Mitchell, JPEG, Still Image Data Compression Standard, Van Nostrand, New York, NY, USA, 1993.
  10. ISO/IEC 14495-1:1999, “Information Technology-Lossless and Near-Lossless Compression of Continuous-Tone Still Images:Baseline[S],” December 1999. View at Google Scholar
  11. T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560–576, 2003. View at Publisher · View at Google Scholar
  12. D. J. Le Gall, “MPEG (moving pictures expert group) video compression algorithm: a review,” in Image Processing Algorithms and Techniques II, vol. 1452 of Proceedings of SPIE, pp. 444–457, San Jose, Calif, USA, February 1991. View at Publisher · View at Google Scholar
  13. B.-F. Wu and C.-F. Lin, “Memory-efficient architecture for JPEG 2000 coprocessor with large tile image,” IEEE Transactions on Circuits and Systems II, vol. 53, no. 4, pp. 304–308, 2006. View at Publisher · View at Google Scholar · View at Scopus
  14. Y. Li and M. Bayoumi, “VLSI architectures for JPEG 2000 EBCOT,” in Proceedings of the 40th Asilomar Conference on Signals, Systems, and Computers (ACSSC '06), pp. 907–911, October-November 2006. View at Publisher · View at Google Scholar · View at Scopus
  15. L. Liu, N. Chen, H. Meng, L. Zhang, Z. Wang, and H. Chen, “A VLSI architecture of JPEG2000 encoder,” IEEE Journal of Solid-State Circuits, vol. 39, no. 11, pp. 2032–2040, 2004. View at Publisher · View at Google Scholar · View at Scopus
  16. D. Litwiller, “CCD vs. CMOS: facts and fiction,” Photonics Spectra, vol. 35, no. 1, pp. 154–158, 2001. View at Google Scholar · View at Scopus
  17. B. S. Carlson, “Comparison of modern CCD and CMOS image sensor technologies and systems for low resolution imaging,” in Proceedings of the 1st IEEE International Conference on Sensors (Sensors '02), vol. 1, pp. 171–176, June 2002. View at Scopus
  18. W. D. León-Salas, S. Balkir, K. Sayood, N. Schemm, and M. W. Hoffman, “A CMOS imager with focal plane compression using predictive coding,” IEEE Journal of Solid-State Circuits, vol. 42, no. 11, pp. 2555–2572, 2007. View at Publisher · View at Google Scholar · View at Scopus
  19. A. Nilchi, J. Aziz, and R. Genov, “Focal-plane algorithmically-multiplying CMOS computational image sensor,” IEEE Journal of Solid-State Circuits, vol. 44, no. 6, pp. 1829–1839, 2009. View at Publisher · View at Google Scholar · View at Scopus
  20. S. Kawahito, M. Yoshida, M. Sasaki et al., “A CMOS image sensor with analog two-dimensional DCT-based compression circuits for one-chip cameras,” IEEE Journal of Solid-State Circuits, vol. 32, no. 12, pp. 2030–2040, 1997. View at Google Scholar · View at Scopus
  21. K. Aizawa, H. Ohno, Y. Egi et al., “On sensor image compression,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 3, pp. 543–548, 1997. View at Google Scholar · View at Scopus
  22. Z. Lin, M. W. Hoffman, N. Schemm, W. D. Leon-Salas, and S. Balkir, “A CMOS image sensor for multi-level focal plane image decomposition,” IEEE Transactions on Circuits and Systems I, vol. 55, no. 9, pp. 2561–2572, 2008. View at Publisher · View at Google Scholar · View at Scopus
  23. S. Chen, A. Bermak, and Y. Wang, “A CMOS image sensor with on-chip image compression based on predictive boundary adaptation and memoryless QTD algorithm,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, no. 99, pp. 1–10, 2010. View at Publisher · View at Google Scholar
  24. M. Zhang and A. Bermak, “Compressive acquisition CMOS image sensor: from the algorithm to hardware implementation,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, vol. 18, no. 3, pp. 490–500, 2009. View at Publisher · View at Google Scholar · View at Scopus
  25. D. A. Huffman, “A method for the construction of minimum-redundancy codes,” Proceedings of the IRE, vol. 40, no. 9, pp. 1098–1101, 1952. View at Google Scholar
  26. J. Abrahams, “Code and parse trees for lossless source encoding,” in Proceedings of the International Conference on Compression and Complexity of Sequences, pp. 145–171, June 1997. View at Scopus
  27. P. G. Howard and J. S. Vitter, “Arithmetic coding for data compression,” Proceedings of the IEEE, vol. 82, no. 6, pp. 857–865, 1994. View at Publisher · View at Google Scholar · View at Scopus
  28. A. Moffat, R. Neal, and I. H. Witten, “Arithmetic coding revisited,” in Proceedings of the 5th Data Compression Conference (DCC '95), pp. 202–211, March 1995. View at Scopus
  29. A. Lempel and J. Ziv, “On the complexity of finite sequences,” IEEE Transactions on Information Theory, vol. 22, no. 1, pp. 75–81, 1976. View at Google Scholar · View at Scopus
  30. J. Ziv and A. Lempel, “A universal algorithm for sequential data compression,” IEEE Transactions on Information Theory, vol. 23, no. 3, pp. 337–343, 1977. View at Google Scholar · View at Scopus
  31. J. Ziv and A. Lempel, “Compression of individual sequences via variable-rate coding,” IEEE Transactions on Information Theory, vol. 24, no. 5, pp. 530–536, 1978. View at Google Scholar · View at Scopus
  32. ISO/IEC JTCl/SC29/WG1 N505, “Call for contributions for JPEG 2000 (JTC 1.29.14, 15444): Image Coding System,” March 1997. View at Google Scholar
  33. ISO/IEC JTCl/SC29/WG11 N390R, “New work item: JPEG 2000 image coding system,” March 1997. View at Google Scholar
  34. C. Christopoulos, Ed., “JPEG2000 Verification Model 8.0 (technical description),” ISO/IEC JTC1/SC29/WGI N1822, July 2000.
  35. M. Boliek, C. Christopoulos, and E. Majani , “JPEG2000 Part I Final Drafi International Standard,” (ISO/IEC FDIS 15444-1), ISO/IEC JTC1/SC29/WG1 N1855, August 2000.
  36. C. Christopoulos, “The jpeg2000 still image coding system: an overview,” IEEE Transactions on Consumer Electronics, vol. 46, no. 4, pp. 1103–1127, 2000. View at Google Scholar
  37. “Video Codec for Audiovisual Services at p×64 kbit=s ITU-T Recommendation H.261, Version 1,” ITU-T, ITU-T Recommendation H.261 Version 1, 1990.
  38. “Generic Coding of Moving Pictures and Associated Audio Information-Part 2: Video,” ITU-T and ISO/IEC JTC 1, ITU-T Recommendation H.262 and ISO/IEC 13 818-2 (MPEG-2), 1994.
  39. “Video Coding for Low Bit Rate Communication,” ITU-T, ITU-T Recommendation H.263 version 1, 1995.
  40. “Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H.264/ISO/IEC 14 496-10 AVC,” in Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVTG050, 2003.
  41. ISO/IEC 11172-2, “Information Technology-Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/s vodep,” Geneva, Switzerland, 1993.
  42. ISO/IEC 13818-1, “Information technology—generic coding of moving pictures and associated audio information,” 2004. View at Google Scholar
  43. T. Sikora, “The MPEG-4 video standard verification model,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 1, pp. 19–31, 1997. View at Google Scholar · View at Scopus
  44. T. Sikora, “MPEG-4 very low bit rate video,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '97), pp. 1440–1443, June 1997. View at Scopus
  45. T. Sikora and L. Chiariglione, “MPEG-4 video and its potential for future multimedia services,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '97), pp. 1468–1471, June 1997. View at Scopus
  46. A. Aaron, R. Zhang, and B. Girod, “Wyner-Ziv coding of motion video,” in Proceedings of the 36th Asilomar Conference on Signals Systems and Computers, pp. 240–244, November 2002. View at Scopus
  47. B. Girod, A. M. Aaron, S. Rane, and D. Rebollo-Monedero, “Distributed video coding,” Proceedings of the IEEE, vol. 93, no. 1, pp. 71–83, 2005. View at Publisher · View at Google Scholar · View at Scopus
  48. R. Puri, A. Majumdar, and K. Ramchandran, “PRISM: a video coding paradigm with motion estimation at the decoder,” IEEE Transactions on Image Processing, vol. 16, no. 10, pp. 2436–2448, 2007. View at Publisher · View at Google Scholar · View at Scopus
  49. D. Slepian and J. K. Wolf, “Noiseless coding of correlated information sources,” IEEE Transactions on Information Theory, vol. 19, no. 4, pp. 471–480, 1973. View at Google Scholar · View at Scopus
  50. A. D. Wyner and J. Ziv, “Rate-distortion function for source coding with side information at the decoder,” IEEE Transactions on Information Theory, vol. 22, no. 1, pp. 1–10, 1976. View at Google Scholar · View at Scopus
  51. D. León, S. Balkir, K. Sayood, and M. W. Hoffman, “A CMOS imager with pixel prediction for image compression,” in Proceedings of the IEEE International Symposium on Circuits and Systems, vol. 1, pp. 776–779, May 2003. View at Scopus
  52. W. D. Leon, S. Balkir, K. Sayood, and M. W. Hoffman, “Charge-based prediction circuits for focal plane image compression,” in Proceedings of the IEEE International Symposium on Cirquits and Systems (ISCAS '04), pp. 936–939, May 2004. View at Scopus
  53. W. D. Leon-Salas, S. Balkir, K. Sayood, M. W. Hoffman, and N. Schemm, “A CMOS imager with focal plane compression,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '06), pp. 3570–3573, May 2006. View at Scopus
  54. W. D. Leon-Salas, S. Balkir, N. Schemm, M. W. Hoffman, and K. Sayood, “Predictive coding on-sensor compression,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '08), pp. 1636–1639, May 2008. View at Publisher · View at Google Scholar · View at Scopus
  55. Q. Luo and J. G. Harris, “A novel integration of on-sensor wavelet compression for a CMOS imager,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '02), pp. 325–328, May 2002. View at Scopus
  56. A. Olyaei and R. Genov, “CMOS wavelet compression imager architecture,” in Proceedings of the 7th IEEE Emerging Technologies Workshop: Circuits and Systems for 4G Mobile Communications (ETW '05), pp. 104–107, June 2005. View at Scopus
  57. A. Olyaei and R. Genov, “Focal-plane spatially oversampling CMOS image compression sensor,” IEEE Transactions on Circuits and Systems I, vol. 54, no. 1, pp. 26–34, 2007. View at Publisher · View at Google Scholar · View at Scopus
  58. A. Bandyopadhyay, J. Lee, R. W. Robucci, and P. Hasler, “MATIA: a programmable 80 μW/frame CMOS block matrix transform imager architecture,” IEEE Journal of Solid-State Circuits, vol. 41, no. 3, pp. 663–671, 2006. View at Publisher · View at Google Scholar · View at Scopus
  59. A. Nilchi, J. Aziz, and R. Genov, “CMOS image compression sensor with algorithmically-multiplying ADCs,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '09), pp. 1497–1500, May 2009. View at Publisher · View at Google Scholar · View at Scopus
  60. Y. Nishikawa, S. Kawahito, M. Furuta, and T. Tamura, “A high-speed CMOS image sensor with on-chip parallel image compression circuits,” in Proceedings of the IEEE Custom Integrated Circuits Conference (CICC '07), pp. 833–836, September 2007. View at Publisher · View at Google Scholar · View at Scopus
  61. S. Kawahito, M. Yoshida, M. Sasaki et al., “Compressed digital output CMOS image sensor with analog 2-D DCT processors and ADC/quantizer,” in Proceedings of the 43rd IEEE International Solid-State Circuits Conference. Digest of Technical Papers (ISSCC '97), pp. 184–185, San Francisco, Calif, USA, February 1997. View at Publisher · View at Google Scholar
  62. S. Kawahito, Y. Tadokoro, and A. Matsuzawa, “CMOS image sensors with video compression,” in Proceedings of the 3rd Conference of the Asia and South Pacific Design Automation (ASP-DAC '98), pp. 595–600, February 1998. View at Scopus
  63. S. Kawahito, M. Yoshida, M. Sasaki et al., “A CMOS smart image sensor LSI for focal-plane compression,” in Proceedings of the 3rd Conference of the Asia and South Pacific Design Automation (ASP-DAC '98), pp. 339–340, February 1998. View at Scopus
  64. D. Kim and E. Culurciello, “A compact-pixel tri-mode vision sensor,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '10), pp. 2434–2437, Paris, France, May 2010. View at Publisher · View at Google Scholar
  65. T. Kuroda, T. Fujita, S. Mita et al., “A 0.9-V, 150-MHz, 10-mW, 4 mm2, 2-D discrete cosine transform core processor with variable threshold-voltage (VT) scheme,” IEEE Journal of Solid-State Circuits, vol. 31, no. 11, pp. 1770–1777, 1996. View at Publisher · View at Google Scholar
  66. K.-Y. Min and J.-W. Chong, “A real-time JPEG encoder for 1.3 mega pixel CMOS image sensor SoC,” in Proceedings of the 30th Annual Conference of IEEE Industrial Electronics Society (IECON '04), pp. 2633–2636, November 2004. View at Scopus
  67. R. P. Kleihorst, A. van der Avoird, A. A. Abbo, M. J. R. Op de Beeck, H. J. L. van Herten, and L. H. M. Sevat, “A low-power high-performance single-chip digital camera,” Philips Research Laboratories, Eindhoven, The Netherlands.
  68. J. Y. F. Hsieh, A. van der Avoird, R. P. Kleihorst, and T. H. Y. Meng, “Transpose memory for video rate JPEG compression on highly parallel single-chip digital CMOS imager,” in International Conference on Image Processing (ICIP 2000), pp. 102–105, September 2000. View at Scopus
  69. M. Schwarzenberg, M. Traeber, M. Scholles, and R. Schueffny, “VLSI chip for wavelet image compression,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '99), vol. 4, pp. 271–274, Orlando, Fla, USA, May 1999.
  70. K. Aizawa, Y. Egi, T. Hamamoto et al., “Computational image sensor for on sensor compression,” IEEE Transactions on Electron Devices, vol. 44, no. 10, pp. 1724–1730, 1997. View at Google Scholar · View at Scopus
  71. S. Narisawa, K. Masuda, and T. Hamamoto, “High speed digital smart image sensor with image compression function,” in Proceedings of 2004 IEEE Asia-Pacific Conference on Advanced System Integrated Circuits, pp. 128–131, August 2004. View at Scopus
  72. P. Lichtsteiner, C. Posch, and T. Delbruck, “A 128 × 128 120dB 30mW asynchronous vision sensor that responds to relative intensity change,” in Proceedings of the IEEE International Solid-State Circuits Conference (ISSCC '06), pp. 491–508, February 2006. View at Scopus
  73. P. Lichtsteiner, C. Posch, and T. Delbruck, “A 128 × 128 120 dB 15 μs latency asynchronous temporal contrast vision sensor,” IEEE Journal of Solid-State Circuits, vol. 43, no. 2, pp. 566–576, 2008. View at Publisher · View at Google Scholar · View at Scopus
  74. Yu. M. Chi, U. Mallik, M. A. Clapp, E. Choi, G. Cauwenberghs, and R. Etienne-Cummings, “CMOS camera with in-pixel temporal change detection and ADC,” IEEE Journal of Solid-State Circuits, vol. 42, no. 10, pp. 2187–2196, 2007. View at Publisher · View at Google Scholar · View at Scopus
  75. C. Posch, D. Matolin, and R. Wohlgenannt, “A QVGA 143dB dynamic range asynchronous address-event PWM dynamic image sensor with lossless pixel-level video compression,” in IEEE International Solid-State Circuits Conference (ISSCC '10), pp. 400–401, San Francisco, Calif, USA, February 2010. View at Publisher · View at Google Scholar
  76. W. D. Leon, S. Balkir, K. Sayood, and M. W. Hoffman, “Charge-based prediction circuits for focal plane image compression,” in Proceedings of the IEEE International Symposium on Cirquits and Systems (ISCAS '04), vol. 4, pp. 936–939, May 2004. View at Scopus
  77. Z. Lin, M. W. Hoffman, W. D. Leon-Salas, N. Schemm, and S. Balkir, “A CMOS image sensor for focal plane decomposition,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '05), pp. 5322–5325, May 2005. View at Publisher · View at Google Scholar · View at Scopus
  78. Z. Lin, M. W. Hoffman, W. D. Leon, N. Schemm, and S. Balkir, “Effects of charge-based computation non-idealities on CMOS image compression sensors,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '06), pp. 5187–5190, May 2006. View at Scopus
  79. Z. Lin, M. W. Hoffman, W. D. Leon, N. Schemm, and S. Balkir, “A CMOS front-end for a lossy image compression sensor,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '07), pp. 2838–2841, May 2007. View at Scopus
  80. Z. Lin, M. W. Hoffman, W. D. Leon, N. Schemm, and S. Balkir, “A CMOS image sensor with focal plane SPIHT image compression,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '08), pp. 2134–2137, May 2008. View at Publisher · View at Google Scholar · View at Scopus
  81. B. Fowler, A. El Gamal, and D. X. D. Yand, “CMOS area image sensor with pixel-level A/D conversion,” in Proceedings of the IEEE International Solid-State Circuits Conference (ISSCC '94), pp. 226–227, February 1994. View at Scopus
  82. S. Kleinfelder, S. Lim, X. Liu, and A. El Gamal, “A 10000 frames/s CMOS digital pixel sensor,” IEEE Journal of Solid-State Circuits, vol. 36, no. 12, pp. 2049–2059, 2001. View at Publisher · View at Google Scholar · View at Scopus
  83. A. Kitchen, A. Bermak, and A. Bouzerdoum, “PWM digital pixel sensor based on asynchronous self-resetting scheme,” IEEE Electron Device Letters, vol. 25, no. 7, pp. 471–473, 2004. View at Publisher · View at Google Scholar · View at Scopus
  84. A. Kitchen, A. Bermak, and A. Bouzerdoum, “A digital pixel sensor array with programmable dynamic range,” IEEE Transactions on Electron Devices, vol. 52, no. 12, pp. 2591–2601, 2005. View at Publisher · View at Google Scholar · View at Scopus
  85. J. M. Margarit, J. Sabadell, L. Terés, and F. Serra-Graells, “A novel DPS integrator for fast CMOS imagers,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '08), pp. 1632–1635, May 2008. View at Publisher · View at Google Scholar · View at Scopus
  86. S. Chen, A. Bermak, W. Yan, and D. Martinez, “A CMOS image sensor with on chip image compression based on predictive boundary adaptation and QTD algorithm,” in Proceedings of the 6th IEEE Conference on SENSORS (SENSORS '07), pp. 531–534, October 2007. View at Publisher · View at Google Scholar · View at Scopus
  87. M. Zhang and A. Bermak, “Architecture of a digital pixel sensor array using 1-bit hilbert predictive coding,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '09), pp. 1501–1504, May 2009. View at Publisher · View at Google Scholar · View at Scopus
  88. M. Zhang and A. Bermak, “Compressive acquisition CMOS image sensor using on-line sorting scheme,” in Proceedings of the International SoC Design Conference (ISOCC '09), pp. 169–172, Busan, Korea, November 2009. View at Publisher · View at Google Scholar
  89. M. Zhang and A. Bermak, “Digital pixel sensor with on-line spatial and temporal compression scheme,” in Proceedings of the 12th International Symposium on Integrated Circuits (ISIC '09), pp. 155–158, Singapore, 2009.
  90. J. Dubois, D. Ginhac, M. Paindavoine, and B. Heyrman, “A 10 000 fps CMOS sensor with massively parallel image processing,” IEEE Journal of Solid-State Circuits, vol. 43, no. 3, pp. 706–717, 2008. View at Publisher · View at Google Scholar · View at Scopus