Stochastic Textures Modeling and Its Application in Texture Structure Decomposition
Samah Khawaled, Yehoshua Y. Zeevi
Electrical Engineering Department,
Technion – Israel Institute of Technology, Haifa, Israel
Manuscript [PDF coming soon]
Supplemental Material [PDF]
Abstract
Natural stochastic textures coexist in images with complementary edge type structural elements that constitute the cartoon-type skeleton of an image. Separating texture from the structure of natural image is an important inverse problem in image analysis. The concept behind this decomposition is to extract the textural layer, which conveys fine details and small-scale variations, and separate them from the image macrostructures (edges and contours). In this paper, we propose a variational texture-structure separation scheme. Our approach involves texture modeling by a stochastic field; The 2D fractional Brownian motion (fBm), a non-stationary Gaussian self-similar process, has been shown to be a suitable model for pure natural stochastic textures. We therefore use it as a reconstruction prior to extract the corresponding textural element and show that this separation is crucial for improving the execution of various image processing and computer vision tasks (e.g. clustering, classification and enhancement). Here we show the applicability of this decomposition in image denoising. Lastly, we highlight how manifold-based representation of texture-structure data, can be implemented in extraction of geometric features and thereby construction of a classification space.
Decomposition Results
Notations
I | Input Image |
u | Separated Structural Image |
v | Separated Textural Image |
Examples
Denoising
Here we compare the enhanced images, obtained by our proposed, with those obtained by applying BM3D [3]. For each example, the noisy image was obtained by adding synthetic additive Gaussian noise (AWGN) with standard deviation of 0.1 and reference images are normalized to be in the gray-level range of [0,1) . Some of these examples are presented in the manuscript.
The following figures present Comparison between our denoising result (bottom-left) and the denoised image obtained by applying BM3D method (bottom-right) [3]. PSNR (dB) and SSIM measures are highlighted in each of the resultant denoised images.
Original (noiseless) image adopted from Kylbreg library [2].
Example 1
Example 2
Example 3
Example 4
Example 5
Example 6
References
-
- Samah Khawaled and Yehoshua Y. Zeevi. “Stochastic Textures Modeling and Its Application in Texture Structure Decomposition”. to be submitted to IEEE-TIP 2020.
- Kylberg, Gustaf. Kylberg Texture Dataset v. 1.0. Centre for Image Analysis, Swedish University of Agricultural Sciences and Uppsala University, 2011.
- Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2006, February). Image denoising with block-matching and 3D filtering. In Image Processing: Algorithms and Systems, Neural Networks, and Machine Learning (Vol. 6064, p. 606414). International Society for Optics and Photonics.