Copyright © 2006 The Institute of Electronics, Information and Communication Engineers
Special Section on Machine Vision Applications -- Papers -- Stereo and Multiple View Analysis |
Removal of Adherent Waterdrops from Images Acquired with a Stereo Camera System*
The authors are with the Department of Mechanical Engineering, Shizuoka University, Hamamatsu-shi, 432–8561 Japan. E-mail: yamashita{at}ieee.org
In this paper, we propose a new method that can remove view-disturbing noises from stereo images. One of the thorny problems in outdoor surveillance by a camera is that adherent noises such as waterdrops on the protecting glass surface lens disturb the view from the camera. Therefore, we propose a method for removing adherent noises from stereo images taken with a stereo camera system. Our method is based on the stereo measurement and utilizes disparities between stereo image pair. Positions of noises in images can be detected by comparing disparities measured from stereo images with the distance between the stereo camera system and the glass surface. True disparities of image regions hidden by noises can be estimated from the property that disparities are generally similar with those around noises. Finally, we can remove noises from images by replacing the above regions with textures of corresponding image regions obtained by the disparity referring. Experimental results show the effectiveness of the proposed method.
Key Words: image restoration, stereo images, noise removal, template matching, disparity estimation
Manuscript received November 1, 2005. Manuscript revised January 24, 2006.
* This paper was partly presented at IAPR Conference on Machine Vision Applications (MVA2005)[1] and 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2005) [2].
References
[1] Y. Tanaka, A. Yamashita, T. Kaneko, and K.T. Miura, "Restoration of images stained with waterdrops on a protection glass surface by using a stereo image pair," Proc. IAPR Conference on Machine Vision Applications (MVA2005), pp.152–155, 2005.
[2] A. Yamashita, Y. Tanaka, and T. Kaneko, "Removal of adherent waterdrops from images acquired with stereo camera," Proc. 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2005), pp.953–958, 2005.
[3] A.C. Kokaram, R.D. Morris, W.J. Fitzgerald, and P.J.W. Rayner, "Detection of missing data in image sequences," IEEE Trans. Image Process., vol.4, no.11, pp.1496–1508, 1995.[Medline]
[4] A. Nagai, Y. Kuno, and Y. Shirai, "Surveillance system based on spatio-temporal information," Proc. 1996 IEEE International Conference on Image Processing (ICIP1996), vol.2, pp.593–596, 1996.
[5] H. Hase, K. Miyake, and M. Yoneda, "Real-time snowfall noise elimination," Proc. 1999 IEEE International Conference on Image Processing (ICIP1999), vol.2, pp.406–409, 1999.
[6] T. Matsuyama, T. Ohya, and H. Habe, "Background subtraction for non-stationary scenes," Proc. 4th Asian Conference on Computer Vision (ACCV2002), pp.662–667, 2002.
[7] K. Garg and S.K. Nayar, "Detection and removal of rain from videos," Proc. 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR2004), vol.1, pp.528–535, 2004.
[8] A.C. Kokaram, R.D. Morris, W.J. Fitzgerald, and P.J.W. Rayner, "Interpolation of missing data in image sequences," IEEE Trans. Image Process., vol.4, no.11, pp.1509–1519, 1995.[Medline]
[9] S. Masnou and J.-M. Morel, "Level lines based disocclusion," Proc. 5th IEEE International Conference on Image Processing (ICIP1998), pp.259–263, 1998.
[10] L. Joyeux, O. Buisson, B. Besserer, and S. Boukir, "Detection and removal of line scratches in motion picture films," Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR1999), pp.548–553, 1999.
[11] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," Computer Graphics (SIGGRAPH 2000), pp.417–424, 2000.
[12] S.H. Kang, T.F. Chan, and S. Soatto, "Inpainting from multiple views," Proc. 1st International Symposium on 3D Data Processing Visualization and Transmission, pp.622–625, 2002.
[13] T.F. Chan and J. Shen, "Variational image inpainting," IMA Preprint, 1868, pp.1–28, 2002.
[14] M. Bertalmio, L. Vese, G. Sapiro, and S. Osher, "Simultaneous structure and texture image inpainting," IEEE Trans. Image Process., vol.12, no.8, pp.882–889, 2003.[Medline]
[15] Y. Matsushita, E. Ofek, X. Tang, and H.-Y. Shum, "Full-frame video stabilization," Proc. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol.1, pp.50–57, 2005.
[16] A. Yamashita, T. Kaneko, and K.T. Miura, "A virtual wiper—Restoration of deteriorated images by using a pan-tilt camera," Proc. 2004 IEEE International Conference on Robotics and Automation (ICRA2004), pp.4724–4729, 2004.
[17] A. Yamashita, T. Harada, T. Kaneko, and K.T. Miura, "Removal of adherent noises from images of dynamic scenes by using a pan-tilt camera," Proc. 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2004), pp.437–442, 2004.
[18] A. Yamashita, T. Harada, T. Kaneko, and K.T. Miura, "Virtual wiper—Removal of adherent noises from images of dynamic scenes by using a pan-tilt camera," Advanced Robotics, vol.19, no.3, pp.295–310, 2005.
[19] A. Yamashita, M. Kuramoto, T. Kaneko, and K.T. Miura, "A virtual wiper—Restoration of deteriorated images by using multiple cameras," Proc. 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2003), pp.3126–3131, 2003.
[20] S.G. Lipson, H Lipson, and D.S. Tannhauser, Optical Physics, Third ed., Cambridge University Press, 1995.
[21] L.G. Brown, "A survey of image registration techniques," ACM Comput. Surv., vol.24, no.4, pp.325–376, 1992.
[22] S.G. Narasimhan and S.K. Nayar, "Vision and the atmosphere," Int. J. Comput. Vis., vol.48, no.3, pp.233–254, 2002.
[23] S.G. Narasimhan and S.K. Nayar, "Interactive (De)weathering of an image using physical models," Proc. IEEE Workshop on Color and Photometric Methods in Computer Vision (CPMCV), 2003.
CiteULike 
Connotea 
Del.icio.us What's this?
| ||||||||||||||||||||||||||||||||||||||||||||||||||