OpenVIDIA : Parallel GPU Computer Vision




Home

Features

Screenshots & Videos

Installation
Instructions


Quickstart

Programming
Example v0-0.07x


Programming
Example v0.8


Computer Vision with CUDA (new 1May08)

Framebuffer Objects

Download

Papers

Contributing

Project
sf.net project page
Tracker Tracker

 - Bugs ( 0 open / 0 total )
Bug Tracking System

 - Support Requests ( 1 open / 1 total )
Tech Support Tracking System

 - Patches ( 1 open / 1 total )
Patch Tracking System

 - Feature Requests ( 0 open / 1 total )
Feature Request Tracking System


Forums Forums ( 246 messages in 2 forums )
Docs Doc Manager
Mail Lists Mailing Lists ( 0 mailing lists )
Screenshots Screenshots
Tasks Task Manager
There are no public subprojects available
CVS CVS Tree ( commits, adds ) known bug
FTP Released Files

Related Projects

Comparametric Toolkit

Reference Links

Open GL Reference

nVIDIA cg homepage

GeForce FX Overclocking

GPGPU

gpu's arent just good for vision and computation - some clever folks have started using them for games as well. ;) har har linux-games.net

7 Years of Graphics Card History

SourceForge.net Logo

Page design based on Blosxom (which was used originally before the move to sourceforge).

This page best viewed with Dillo, Lynx, w3m, Mozilla-Firefox, Galeon, Epiphany, konqueror . . .

   
There's much activity in the area of GPU processing. Here's some links specifically related to computer/machine vision. Email us to add a link

Index

Papers, -2005
Papers, 2006-2008
GPU Vision/Imaging Tools/Toolkits
OpenVIDIA papers

Papers

2005 and previous

Jan Woetzel and Reinhard Koch "Multi-camera real-time depth estimation with discontinuity handling on PC graphics hardware" , 17th International Conference on Pattern Recognition (ICPR 2004), Cambridge, United Kingdom, August 2004

Jan Woetzel and Reinhard Koch "Real-time multi-stereo depth estimation on GPU with approximative discontinuity handling", 1st European Conference on Visual Media Production (CVMP 2004), London, United Kingdom, March 2004

James Fung, Felix Tang, Steve Mann, "Mediated Reality Using Computer Graphics Hardware for Computer Vision", Proceedings of the International Symposium on Wearable Computing 2002 (ISWC2002), Seattle, Washington, USA, Oct 7-10, 2002, pp. 83--89.

Robert Strzodka, Ivo Ihrke, and Marcus Magnor. A graphics hardware implementation of the Generalized Hough Transform for fast object recognition, scale, and 3d pose detection. In Proceedings of IEEE International Conference on Image Analysis and Processing (ICIAP'03), pages 188193, 2003. (PDF)

Robert Strzodka and Alexandru Telea. Generalized Distance Transforms and skeletons in graphics hardware. In Proceedings of EG/IEEE TCVG Symposium on Visualization (VisSym '04), pages 221230, 2004. (PDF)

Robert Strzodka and Christoph Garbe. Real-time motion estimation and visualization on graphics cards. In Proceedings IEEE Visualization 2004, pages 545552, 2004. (PDF)

R. Yang, M. Pollefeys, H. Yang, G. Welch, A Unified Approach to Real-Time, Multi-Resolution, Multi-Baseline 2D View Synthesis and 3D Depth Estimation using Commodity Graphics Hardware, International Journal of Image and Graphics (to appear). [pdf]

R. Yang, M. Pollefeys, and S. Li, Improved Real-Time Stereo on Commodity Graphics Hardware, Workshop on Real Time 3D Sensors and Their Use 2004 (in conjunction with CVPR) (to appear). [pdf]

R. Yang and M. Pollefeys. Multi-Resolution Real-Time Stereo on Commodity Graphics Hardware, Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 211-218, 2003. [pdf]

M. Hopf, T. Ertl, Accelerating 3D Convolution using Graphics Hardware (pdf +), in D. Ebert, M. Gross, B. Hamann (ed.), Visualization '99, San Francisco, CA, pp. 471-474, IEEE Computer Society Press, 1999. (5 pages, 1351 KB)

M. Hopf, T. Ertl, Accelerating Morphological Analysis with Graphics Hardware (pdf), Workshop on Vision, Modeling, and Visualization VMV '00, Saarbrü Germany, 2000. (9 pages, 157 KB)

I. Geys, T.P. Koninckx, L. Van Gool, Fast Interpolated Cameras by combining a GPU based Plane Sweep with a Max-Flow Regularisation Algorithm, Proceedings of second international symposium on 3D Data Processing Visualization & Transmission - 3DPVT'04, Sept 6-

A.Griesser, T.P. Koninckx, L. Van Gool, Adaptive Real-Time 3D Acquisition and Contour Tracking within a Multiple Structured Light System, to be published in 12th Pacific Conference on Computer Graphics and Applications - Pacific Graphics 04, October 6-8, 2004, Seoul, Korea

F. Kelly and A. Kokaram, General Purpose Graphics Hardware for Accelerating Motion Estimation, Irish Machine Vision and Image Processing Conference (IMVIP), September 2003, University of Ulster, Coleraine, Ireland.

Fast Image Interpolation for Motion Estimation using Graphics Hardware, F. Kelly and A. Kokaram, in IS&T/SPIE Electronic Imaging - Real-Time Imaging VIII, January 2004, San Jose, California, USA.

Graphics Hardware for Gradient Based Motion Estimation, F. Kelly and A. Kokaram, in IS&T/SPIE Electronic Imaging - Embedded Processors for Multimedia and Communications, January 2004, San Jose, California, USA.

Andreas Griesser, Stefaan De Roeck, Alexander Neubeck and Luc Van Gool. GPU-Based Foreground-Background Segmentation using an Extended Colinearity Criterion. Vision, Modeling, and Visualization (VMV), 2005

Andreas Griesser. Real-Time, GPU-based Foreground-Background Segmentation. Technical Report 269, 2005

M. Flagg, J. Summet, and J. M. Rehg, "Improving the speed of virtual rear projection: A gpu-centric architecture," in Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, vol. 3, p. 105, 2005.

M. Gong and Y.-H. Yang, "Near real-time reliable stereo matching using programmable graphics hardware," in Proceedings of the 2005 IEEE Computer Society Conference on Com- puter Vision and Pattern Recognition (CVPR'05), vol. 1, pp. 924­931, 2005.

N. Cornelis and L. V. Gool, "Real-time connectivity constrained depth map computation using programmable graphics hardware," in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, pp. 1099­1104, 2005.

S. Sinha, J. Frahm, M. Pollefeys, and Y. Genc, "GPU-based video feature tracking and match- ing," in EDGE 2006, workshop on Edge Computing Using New Commodity Architectures, (Chapel Hill), May 2006.

P. Labatut, R. Keriven, and J-P. Pons. Fast Level Set Multi-View Stereo on Graphics Hardware In 3rd International Symposium on 3D Data Processing, Visualization and Transmission, Chapel Hill, USA, 2006.

J. Mairal, R. Keriven, and A. Chariot. Fast and efficient dense variational stereo on GPU In 3rd International Symposium on 3D Data Processing, Visualization and Transmission, Chapel Hill, USA, 2006.

Jodoin P-M, Mignotte M Markovian Segmentation and Parameter Estimation on Graphics Hardware Journal of Electrical Imaging, accepted.

Jodoin P-M, St-Amour J-F and Mignotte M Unsupervised Markovian Segmentation on Graphics Hardware in Proc. of ICAPR '05, Bath (pdf)

Lanvin, P. Noyer, J.-C. Benjelloun, M. , An hardware architecture for 3D object tracking and motion estimation, Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on, 6-8 July 2005

Implementation of Kernel Methods on the GPU Ohmer, J.; Maire, F.; Brown, R. Digital Image Computing: Techniques and Applications, 2005. DICTA apos;05. Proceedings 2005 Volume , Issue , 06-08 Dec. 2005 Page(s): 78 - 78

2006 and on



Gernot Ziegler, Art Tevs, Christian Theobalt, Hans-Peter Seidel, GPU Point List Generation through HistogramPyramids Technical Report, June 2006

Alan Brunton and Chang Shu and Gerhard Roth, Belief Propagation on the GPU for Stereo Vision, 3rd Canadian Conference on Computer and Robot Vision (CRV'06), vol. 0, pp. 76, 2006

GPU accelerated image registration. in two and three dimensions. A. Kohn, J. Drexl, F. Ritter, M. Konig, and H. O. Peitgen, Proceedings of Bildverarbeitung fü Medizin (Hamburg, March 19.21), pp. 261.265. Springer Verlag. PDF

Multi-resolution 3D Nonrigid Registration via Optimal Mass Transport on the GPU, Tauseef ur Rehman, Gallagher Pryor, John Melonakos , and Allen Tannenbaum , In CDC, 2007. PDF

M. Lalonde, D. Byrns, L. Gagnon, N. Teasdale, D. Laurendeau, Real-time eye blink detection with GPU-based SIFT tracking, International Workshop on Video Processing and Recognition, 4th Canadian Conference on Computer and Robot Vision, Montreal, 2007 ACM IEEE PDF

On the computation of the Circle Hough Transform by a GPU rasterizer, Manuel Ujaldón, Antonio Ruiz, Nicolás Guil February 2008 Pattern Recognition Letters, Volume 29 Issue 3 Publisher: Elsevier Science Inc.

Pathological Image Analysis Using the GPU: Stroma Classification for Neuroblastoma Antonio Ruiz, Olcay Sertel, Manuel Ujaldon, Umit Catalyurek, Joel Saltz, Metin Gurcan November 2007 BIBM '07: Proceedings of the 2007 IEEE International Conference on Bioinformatics and Biomedicine

Fast k Nearest Neighbor Search using GPU Authors: Vincent Garcia, Eric Debreuve, Michel Barlaud (Submitted on 9 Apr 2008)

GPUCV: A Framework for Image Processing Acceleration with Graphics Processors Farrugia, J.-P.; Horain, P.; Guehenneux, E.; Alusse, Y. Multimedia and Expo, 2006 IEEE International Conference on Volume , Issue , 9-12 July 2006 Page(s):585 - 588 Digital Object Identifier 10.1109/ICME.2006.262476

Yoshiki Mizukami, Katsumi Tadamura, "Optical Flow Computation on Compute Unified Device Architecture," ICIAP, pp. 179-184, 14th International Conference on Image Analysis and Processing (ICIAP 2007), 2007

Hicham Ghorayeb, Bruno Steux and Claude Laurgeau1, Boosted Algorithms for Visual Object Detection on Graphics Processing Units Lecture Notes in Computer Science, Computer Vision – ACCV 2006, Volume 3852/2006, Pages 254-263

Feature tracking and matching in video using programmable graphics hardware S Sinha, JM Frahm, M Pollefeys, Y Genc - Machine Vision and Applications, 2007

Fast evolutionary image processing using Multi-GPUs Ando, J.; Nagao, T. Systems, Man and Cybernetics, 2007. ISIC. IEEE International Conference on Volume , Issue , 7-10 Oct. 2007 Page(s):2927 - 2932

Multiresolution and Local Search Methods for Optimizing Visual Tracking Processes on GPU (Raúl Cabido, Antonio S. Montemayor, Juan José Pantrigo, Bryson Payne) Accepted ACM SIGGRAPH2007, The 34rd International Conference on Computer Graphics and Interactive Techniques San Diego (EEUU), Agost 4-9, 2007

Planar Tracking using the GPU for Augmented Reality and Games (Luis A. Leiva, Antonio Sanz, José M. Buenaposada) Accepted ACM SIGGRAPH2007, The 34rd International Conference on Computer Graphics and Interactive Techniques San Diego (EEUU), Agost 4-9, 2007

Andrea Francesco Abate, Michele Nappi, Stefano Ricciardi and Gabriele Sabatino, GPU Accelerated 3D Face Registration / Recognition Lecture Notes in Computer Science, Advances in Biometrics, Volume 4642/2007, Pages 938-947, 2007

Automatic Pose Estimation for Range Images on the GPU Germann, M. 3-D Digital Imaging and Modeling, 2007. 3DIM apos;07. Sixth International Conference on Volume , Issue , 21-23 Aug. 2007 Page(s):81 - 90

Pinar Muyan-Ozcelik, John D. Owens, Junyi Xia, Sanjiv S. Samant, Fast Deformable Registration on the GPU: A CUDA Implementation of Demons The 2008 International Conference on Computational Science and Its Applications Editor(s) M. Gavrilova, O. Gervasi, A. Laganà, Y. Mun, A. Iglesias, Perugia, Italy, June 30th to July 3rd, 2008, ICCSA 2008

Ohmer, J.F.; Maire, F.; Brown, R. Real-Time Tracking with Non-Rigid Geometric Templates Using the GPU Computer Graphics, Imaging and Visualisation, 2006 International Conference on Volume , Issue , 26-28 July 2006 Page(s): 200 - 206

GPU-accelerated real-time 3D tracking for humanoid locomotion and stair climbing Michel, P. Chestnut, J. Kagami, S. Nishiwaki, K. Kuffner, J. Kanade, T. Carnegie Mellon Univ., Pittsburgh; This paper appears in: Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference on Publication Date: Oct. 29 2007-Nov. 2 2007 On page(s): 463-469 Location: San Diego, CA

Tools and Libraries

GPUCV https://picoforge.int-evry.fr/cgi-bin/twiki/view/Gpucv/Web

MinGPU: A minimum GPU library for Computer Vision http://server.cs.ucf.edu/~vision/MinGPU/

GPU Imaging Toolkit http://forge.abcd.harvard.edu/gf/project/gpuit/

CUDA Photoshop Plug-ins Development Samples

OpenVIDIA

These papers specifically discuss what's in OpenVIDIA.

James Fung, Felix Tang, Steve Mann, "Mediated Reality Using Computer Graphics Hardware for Computer Vision", Proceedings of the International Symposium on Wearable Computing 2002 (ISWC2002), Seattle, Washington, USA, Oct 7-10, 2002, pp. 83--89.

C. Aimone, J. Fung, S. Mann, "An EyeTap video-based featureless projective motion estimation assisted by gyroscopic tracking for wearable computer mediated reality" ACM Personal and Ubiquitous Computing published by Springer Verlag, Vol.7, Iss. 3, 2003

James Fung, Steve Mann, "Computer Vision Signal Processing on Graphics Processing Units", Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), Montreal, Quebec, Canada, May 17--21, 2004.

James Fung, Steve Mann, "Using Multiple Graphics Cards as a General Purpose Parallel Computer : Applications to Computer Vision", Proceedings of the 17th International Conference on Pattern Recognition (ICPR2004) , Cambridge, United Kingdom, August 23-26, 2004, volume 1, pages 805-808. [ Adobe PDF ]

Rosco Hill, James Fung, Steve Mann, "Reality Window Manager: A User Interface For Mediated Reality", Proceedings of the 2004 IEEE International Conference on Image Processing (ICIP2004), Singapore, October 24-27, 2004. [ Adoble PDF ] [ HTML ]

James Fung. "Computer Vision on the GPU", in GPU Gems 2,Addison Wesley, 2005, chapter 40, pages 649-665, edited by Matt Pharr [ HTML ]

James Fung, Steve Mann, Chris Aimone, "OpenVIDIA: Parallel GPU Computer Vision", Proceedings of the ACM Multimedia 2005 , Singapore, Nov. 6-11, 2005, pages 849-852 [ Adoble PDF ] [ HTML ]

Also see http//eyetap.org/papers for a more extensive listing.