Issue 
Int. J. Metrol. Qual. Eng.
Volume 7, Number 4, 2016



Article Number  406  
Number of page(s)  10  
DOI  https://doi.org/10.1051/ijmqe/2016024  
Published online  22 November 2016 
Average surface roughness evaluation using 3source photometric stereo technique
College of Engineering, Design, and Physical Sciences, Brunel University London,
Uxbridge, UK
^{⁎} Corresponding author: Qingping.Yang@brunel.ac.uk
Received:
21
March
2016
Accepted:
12
October
2016
This paper presents a technique for measuring surface roughness (Ra), using photometric stereo method. The method utilizes three or more images of the measured surface from the same viewpoint, taken sequentially under different illumination conditions. The scenes captured by the camera were reconstructed by the least square method to obtain surface normal from surface topography. Threedimensional surface textural patterns were recovered from those surface normal. The system was validated with five standard surface roughness specimens. The Ra calculated from the recovered surface was compared with the values measured from contacting roughness measurement (stylus instrument). The best coefficient of the slant angles can also be determined through the linear regression. The experimental results indicate that the technique can be applied to well recover standard surface roughness.
Key words: surface texture / photometric stereo / measurement / imaging techniques / metrology
© EDP Sciences, 2016
1 Introduction
Computer graphics techniques have been extensively popular in the measurement system. The quality of components produced is of major concern in industrial manufacturing, and it is closely related to dimensional accuracy, form and surface finish. Surface topography, especially surface roughness, has an essential role to determine the functional performance of machine parts. The measurement of engineering surface roughness is becoming increasingly important. The traditional way of measuring surface topography is mechanical – most existing roughness standards are defined using stylus instruments that normally use a diamond stylus. Stylus can usually scratch the measured surface and may not be suitable when the measured surfaces are very soft, for example, in biological systems or polymers. In the last few decades, alternative methods rather than stylus have been developed. Those can be loosely divided into optical methods (such as vertical scanning interferometry) and nonoptical methods (such as scanning tunneling microscopy) [1,2].
Recently, photometric stereo method has been considered as a technique for roughness measurement. The photometric stereo is a method for evaluation of shape and reflectance of an object using three or more images under different lighting positions [3]. The method uses different lighting conditions to mainly measure the gradient field of the surface, which is calculated from an array of surface normal. The gradient field can be therefore considered to be the measurement results. The surface texture can be calculated from the obtained depth information [4–6].
In this paper, we consider the slant and tilt angles which are suitable for measuring different roughness ranging from 3.2 μm to 50 μm. The Ra is then reconstructed by combining three images, each at a tilt angle with the object. By using the reconstructed Ra of the objects, parameters of a reflection model are estimated in a robust manner. The key point of the proposed method is that the linear regression technique was applied to find the best coefficient between image intensities and roughness.
2 Operating principle
2.1 The reflectance model
Intensity values are known from image sets that recorded a reflected radiance from the illuminated objects. There are many contributing factors relating to the reflected radiance when the incident light has constant direction and intensity, e.g. the physical properties and shape of the measured object. If the surfaces are rough enough so that all incident light beams are diffusively reflected to all directions, these surfaces are socalled lambertian surfaces [3]. According to the lambertian reflectance surface [3], this intensity is given by (1) where i is the emittance (reflected power per unit area) from the surface, ρ is the albedo representing the amount of light reflected back from the surface, the intensity of light source is represented by k (incident power per unit area) and the angle between the light vector and the surface normal is represented by θ_{i}.
2.2 Photometric stereo (PS)
The photometric stereo method was firstly proposed by Woodham in 1980. It is a method that calculates local surface reflection and orientation through the variation of incident light source, with several images taken from a constant viewing direction [3,4]. The basic idea of the PS method is to solve equation (2) for the unknown surface normal (Fig. 1).
When three images with the same view are taken under different lighting directions, three reflectance maps are provided for solving a linear system of three unknowns surface normal (n_{x}, n_{y}, n_{z}). The cosine of the incident angle can also be denoted as dot product, as shown in equation (2), where represents the unit vector of light source direction and the unit vector represents the surface normal: (2)
In case of three images being utilized by the measurement system, (3)
In equation (3), (I_{1}, I_{2}, I_{3}) represent the image intensity values at image location (x, y). Unknown surface albedo is denoted by ρ. The unknown components of the surface normal is represented by (n_{x}, n_{y}, n_{z}), and (s_{x}, s_{y}, s_{z}) are the known components of light source vector, where numbers 1, 2 and 3 indicate light direction. To solve the unknown surface reflectance factor and surface normal, the following relation has been used: (4)
To determine the surface normal, N, in equation (4), the following relation can be utilized from equation (5), where the lighting directions, S, must not be coplanar to a plane. (5)
The least squares technique can be utilized to calculate PseudoInverse and local surface gradients p(x,y) and q(x,y). The local surface normal can also be calculated from the PseudoInverse using equations (6)–(8) where . (6) (7) (8) (9)
Fig. 1 Photometric stereo system. 
3 Surface texture
Surface measurement usually yields the information in two types, i.e. the roughness and the waviness. These parameters can be used to explain and predict the performance and problems of machine tools. Filtering techniques are applied to separate roughness and waviness from the surface topography [7,8].
The surface profile parameters are defined by ISO 4287:1997 which encompasses five groups of texture parameters, including amplitude parameters (peak and valley), amplitude parameter (average of ordinates), spacing parameters, hybrid parameters, and curves and related parameters [9].
The surface roughness parameter used throughout this study is the arithmetical mean of the surface profile (Ra). This parameter is also the most widely used surface finish parameter by researchers and industries. Ra is the arithmetic average of the absolute value of the heights of roughness irregularities from the measured mean value [7,10,11]. It can be described in mathematical function as (10) where Z_{i} is the height of roughness irregularities from the mean value and N is the number of measured points in a sampling length. Ra value can be calculated from the mean height [9,10].
4 System designs
4.1 Proposed photometric stereo system
Figure 2 illustrates the PS system set up on a Coordinate Measuring Machine (CMM) for surface roughness measurement. The CMM is defined by ISO103601 as a measuring system with the means to move a probing system and the capability of determining spatial coordinates on a work piece surface [12,13]. The roughness standard was mounted at centre of the measuring table. The light source was assumed to be a point source with a constant incident illumination over the scene as shown in Figure 2. When images were captured from the system, the external lighting source was controlled. The measurements were performed in a dark room to prevent the effects of the ambient light.
The purpose of the experimental work was to investigate the practical application of PS techniques for measuring Ra from surface texture. The nominal values of standard surface roughness which included 3.2 μm, 6.3 μm, 12.5 μm, 25 and 50 μm were applied to validate the PS system [11]. Five differing surface roughness standards were viewed by a vision system. The light source was attached with the CMM's probe, which was able to move tilt and slant angles. The sensitivity of the technique to the slant angle was investigated. Three slant angles were examined: θ = 37.5°, 45° and 52.5°. The optimal illumination configuration with regard to tilt angle is considered to be an intuitive result since the three vectors are equally spaced at 120° apart.
Fig. 2 The PS system on the CMM for measuring surface texture. 
4.2 Optimal lighting position
Spence and Chantler [14,15] worked with three lights of equal slant and using numerical optimisation. They concluded that the normal are best recreated when the light sources are 120° apart, and of slant 55°. This corresponds to orthogonal light directions and is in full agreement with the results derived from the theory presented here.
In Figure 3, the angle between light source (l) and viewing vector (v) is the slant angle (θ). Tilt (φ) is the angle between the projection of l onto the viewing plane (x–y) and the xaxis. In this experiment, the slant angles (θ) were investigated at 37.5°, 45° and 52.5° to find the optimum angle for measuring surface roughness standard. The slant angle was held constant whilst the tilt angle was swept through a complete rotation in 120° intervals. Three images were captured at 120° intervals over a complete rotation at each of the three slant angles (Fig. 4).
Fig. 3 Slant and tilt of a light source. 
Fig. 4 Illumination conditions for the tilt angle experiments. 
4.3 Light source
A neutral white LED was used as the light source. It is properly designed for industrial lighting and provides high illumination intensity 230 lumens at 700 mA driver. A narrow beam (17.7°) optical lens was used for increasing the efficiency of light source. The light source and captured images were controlled by the Arduino board and LabVIEW software shown in Figures 5 and 6. The angle of light was moveable via the movement of the CMM to find the suitable tilt and slants angles. In terms of tilt angles, the samples were illuminated at angles 0°, 120°, and 240°. With regard to the slant angle, the measurement results were found dependent on the characteristics of the material and texture of the specimen. In this study, we found that the optimal slant angle for measuring the roughness standard between 3.2 μm and 50 μm was 45°.
Fig. 5 Light source. 
Fig. 6 Arduino board and LabVIEW software. 
4.4 Measurement method
Using the PS method for measuring surface texture can be written as block diagrams in Figure 7.
The block diagram shows the six steps for measurement method. The light source is used to create a stable and wellcontrolled illumination condition. The images with dimensional size 659 × 494 pixels are captured from the Basler Ace Digital Gigabit Ethernet camera with a 25× optical zoom lens. Those images acquired from each tilt angle are taken precisely at position determined by the CMM's movement. In case of mark images, the area of interest is selected by Matlab programming. Data acquisition process is done by using Arduino board controlled by LabVIEW software. Gradient space plots are generated and analysed for all standard surface roughness. The surface normal is therefore calculated by the least squares technique following by equation (6). Therefore, accurate surface reconstruction results can be achieved. Twelve profiles from the measured surfaces are then chosen for intensity calculation and compared with the roughness standards.
Fig. 7 Inspection strategy. 
5 Experimental results
5.1 Standard roughness calibration
According to ISO 54361 [10], the surface roughness standards can be separated by purposes and metrological characteristics and are used for five types of measurements including type A, B, C, D and E. The surface roughness standard type D characterized Ra was utilized as the reference of our system (Fig. 8).
Surface roughness standards used in the experiment comprised Ra values of 3.2, 6.3, 12.5, 25 and 50 μm, respectively. They were calibrated with the standard contact method, using a stylus instrument (Surfcorder ET4000A) to determine the average roughness values and measurement uncertainties. The uncertainty of measurement of the stylus instrument was stated in the calibration certificate as , where R_{a} is the measured roughness value in μm. The measurement results were shown in Table 1 and the roughness standard profiles measured from the stylus instrument were presented in Figure 9.
The original images of the surface roughness standard under three light directions are shown in Figure 10. The idealised simulated surface roughness standard from the PS system is shown in Figure 11. The 3D recovery of the surface roughness standard measured using from the PS system is illustrated in Figure 12.
Fig. 8 Surface roughness standard Type D following ISO 54361. 
Surface roughness standards measured by the stylus instrument.
Fig. 9 Surface roughness standard profiles measured from the stylus instrument. 
Fig. 10 Three images of roughness standard illuminated from a tilt angle of 0°, 120° and 240°. 
Fig. 11 Idealised simulated surface roughness standard. 
Fig. 12 Recovered three dimensional surface roughness standard at 6.3 μm. 
5.2 Computing average surface roughness using Photometric stereo method
The sample profiles are captured, with its centre coincides with the image centre. Each image acquired from the camera covers an area of specimen around 512 × 340 mm. For measuring Ra profiles according to the ISO 4288:1996 [11], the 12 lines selected from the recovered threedimensional profiles are calculated by equation (10). The polynomial curve fitting is utilized to find reference line as shown in Figure 13. The Ra profile measured from the PS method is illustrated in Figure 14. All measurements performed at the metrology laboratory of Brunel University London were controlled environmental conditions, especially in temperature and vibration.
Fig. 13 The polynomial curve fitting. 
Fig. 14 Surface roughness standard profiles 6.3 μm after using the polynomial curve fitting. 
5.3 Measurement of roughness with high pass filters
Roughness is mathematically described as a high frequency deviation from the ideal surface [16]. To determine the roughness of a surface, form and waviness must be separated from the raw measured data. A high pass filter has been applied to eliminate them. For further examinations the weighting function for the phase correct filter corresponding to the equation of the Gaussian density function would be utilized. The definition of weighting function is explained in the ISO 1661061:2015 standard [17]. Its weight function is given by (11) where x is the surface roughness profiles determined in X direction, λ_{co} is the cutoff wavelength and the constant α is given by
The different weight function results would be varied with the λ_{co}. In the value of surface roughness standards, the λ_{co} = 2 and λ_{co} = 6 were created as cutoff wavelength as illustrated in Figure 15.
To obtain the transfer function H(λ) of the respective filter, a Fourier transformation of h(x) is necessary. (13)
The Gaussian transfer function created from equation (13) is the typical characteristic of a low pass filter. In term of calculating high pass filter, the transmission characteristic of the short wave component is obtained by 1 − H(λ). The Gaussian transfer functions applied on surface roughness standard profiles before filtering are able to separate roughness profile from form and waviness profiles illustrated in Figure 16. In addition, the x axis of measurement results in Figures 16 and 17 have been converted from pixel sizes to length measurement in mm unit based on the camera calibration. To reduce the statistical error of a measurement, it is necessary to perform several averages per position. There are a few points which show a high deviation from surface model. It can be then expected that the standard deviation would be very small. The result of Ra profiles measured from the PS method after high pass filter is shown in Table 2.
For each value of surface texture measured from the PS method, the surface roughness standard values are solved by the system of linear equation [18,19]. The solution for the coefficients is given by (14)
A and B are metrics whose elements are known, and X is a column vector whose elements are unknown. The equation can be drawn from the measurement system as follows (15) (16) (17) where x_{1}, x_{2},…, x_{n} are the data determined from the PS method, and y_{1}, y_{2},…,y_{n} are the surface roughness standard values determined from the stylus instrument. Slope or gradient of line are shown by constant m, and b is a point at which the line crosses the yaxis. The best coefficient was found at 45° of slant angle. The linear regression model at 45° of slant angle can work well for recovering three dimensional surface roughness standards. The measurement results are summarized in Table 3 as the coefficients of determination between the estimated Ra by the PS system against surface roughness determined from the stylus instrument.
Ra_{PS} is roughness standard profiles averaged from 12 lines from image measurement system, and Ra_{std} is value measured by the stylus instrument. Five values of surface roughness standards were utilized for evaluation of the PS system. The best coefficient was found at 45° of slant angle. This equation was offered for roughness average estimation form recovered surface.
Fig. 15 Gaussian density function at λ_{co} = 2 and λ_{co} = 6. 
Fig. 16 Surface roughness standard profiles 6.3 μm separated from primary profile by high pass filter. 
Fig. 17 Surface roughness standard profiles 6.3 μm measured from the PS method after filtering. 
The measurement results of Ra determined from the PS method under different slant angles.
Linear regression between surface roughness standard determined from the stylus instrument and PS technique results under different slant angles.
6 Conclusion
The experimental results have shown that the new approach to surface textural measurement using photometric stereo method and CMM is capable of measuring surface roughness of work pieces. Moreover, the errors in the light source positioning can be significantly reduced by the CMM, and the PS system can improve the measurement accuracy. The surface roughness preliminarily tested ranges from 3.2 to 50 μm (Ra) and the measurement result can be correctly filtered to remove low frequency signals. The results of slant angle experiment can be easily used to optimize the system of roughness measurement. The work is potentially useful for accuracy improvement for PS method based on metrology and reverse engineering. In addition, the work can be well applied to measure the Ra for online industrial measurement. The further investigation includes characterization of the measurement performance and evaluation of measurement uncertainty of the PS method.
References
 S. Damodarasamy, S. Raman, Texture analysis with computer vision, Comput. Ind. 16, 25–34 (1991) [CrossRef] [Google Scholar]
 G.A. AlKindi, R.M. Baul, K.F. Gill, An application of machine vision in the automated inspection of engineering surfaces, Int. J. Prod. Res. 30, 241–253 (1992) [CrossRef] [Google Scholar]
 R.J. Woodham, Determining surface curvature with photometric stereo, IEEE Int. Conf. Robot. Autom. 1, 36–42 (1989) [Google Scholar]
 M.L. Smith, The analysis of surface texture using photometric stereo acquisition and gradient space domain mapping, Image Vis. Comput. 17, 1009–1019 (1999) [CrossRef] [Google Scholar]
 M.L. Smith, G. Smith, T. Hill, Gradient space analysis of surface defects using a photometric stereo derived bump map, Image Vis. Comput. 17, 321–332 (1999) [CrossRef] [Google Scholar]
 E. North Coleman, R. Jain, Obtaining 3dimensional shape of textured and specular surfaces using foursource photometry, Comput. Graph. Image Process. 18, 309–328 (1982) [CrossRef] [Google Scholar]
 D. Whitehouse, Surface and Their Measurement (Hermes Penton, London, 2002), p. 10 [Google Scholar]
 R. Leach, Good Practice Guide No. 37 The Measurement of Surface Texture using Stylus Instruments (National Physical Laboratory, United Kingdom, 2001) [Google Scholar]
 ISO 4287:1997, Geometrical Product Specifications (GPS) – Surface texture: Profile method – Terms, definitions and surface texture parameters (International Organization for Standardization, Geneva, Switzerland, 1997), pp. 10–16 [Google Scholar]
 ISO 4288:1996, Geometrical Product Specifications (GPS) – Surface texture: Profile method – Rules and procedures for the assessment of surface texture (International Organization for Standardization, Geneva, Switzerland, 1996), p. 2 [Google Scholar]
 ISO 5436:2000, Geometrical Product Specifications (GPS) – Surface texture: Profile method; Part 1: Material measures (International Organization for Standardization, Geneva, Switzerland, 2000), p. 7 [Google Scholar]
 S. Hammad Mian, A. AlAhmari, New developments in coordinate measuring machines for manufacturing industries, Int. J. Metrol. Qual. Eng. 5, 101 (2014) [CrossRef] [EDP Sciences] [Google Scholar]
 ISO 103601, Geometrical Product Specification (SPC). Acceptance and reverification tests for coordinate measuring machines (CMM). Part 1: Vocabulary (International Organization for Standardization, Geneva, Switzerland, 2000) [Google Scholar]
 A. Spence, M. Chantler, Optimal illumination for threeimage photometric stereo acquisition of texture, in Proceedings of the 3rd International Workshop on Texture Analysis and Synthesis (2003), pp. 89–94 [Google Scholar]
 O. Drbohlav, M. Chantler, On optimal light configurations in photometric stereo, in Proceedings of the 10th IEEE International Conference on Computer Vision (2005), pp. 1707–1712 [Google Scholar]
 J. Lieb, H. Biskup, S. Draxinger, R. Rascher, C. Wunsche, Process development for the reproducible roughness measurement of optical surfaces using white light interferometry, Int. J. Metrol. Qual. Eng. 5, 104 (2014) [CrossRef] [EDP Sciences] [Google Scholar]
 ISO 1661061:2015, Geometrical Product Specifications (GPS) – Filtration Part 61: Linear areal filters – Gaussian filters (BSI Standards Limited, UK, 2015) [Google Scholar]
 W.J. Palm III, Introduction to MATLAB 7 for Engineers (McGrawHill, New York, 2005), p. 312 [Google Scholar]
 S.T. Karris, Numerical Analysis Using MATLAB and Excel (Orchard Publication, Fremont, CA, 2007), pp. 4–25 [Google Scholar]
Cite this article as: Thammarat Somthong, Qingping Yang, Average surface roughness evaluation using 3source photometric stereo technique, Int. J. Metrol. Qual. Eng. 7, 406 (2016)
All Tables
The measurement results of Ra determined from the PS method under different slant angles.
Linear regression between surface roughness standard determined from the stylus instrument and PS technique results under different slant angles.
All Figures
Fig. 1 Photometric stereo system. 

In the text 
Fig. 2 The PS system on the CMM for measuring surface texture. 

In the text 
Fig. 3 Slant and tilt of a light source. 

In the text 
Fig. 4 Illumination conditions for the tilt angle experiments. 

In the text 
Fig. 5 Light source. 

In the text 
Fig. 6 Arduino board and LabVIEW software. 

In the text 
Fig. 7 Inspection strategy. 

In the text 
Fig. 8 Surface roughness standard Type D following ISO 54361. 

In the text 
Fig. 9 Surface roughness standard profiles measured from the stylus instrument. 

In the text 
Fig. 10 Three images of roughness standard illuminated from a tilt angle of 0°, 120° and 240°. 

In the text 
Fig. 11 Idealised simulated surface roughness standard. 

In the text 
Fig. 12 Recovered three dimensional surface roughness standard at 6.3 μm. 

In the text 
Fig. 13 The polynomial curve fitting. 

In the text 
Fig. 14 Surface roughness standard profiles 6.3 μm after using the polynomial curve fitting. 

In the text 
Fig. 15 Gaussian density function at λ_{co} = 2 and λ_{co} = 6. 

In the text 
Fig. 16 Surface roughness standard profiles 6.3 μm separated from primary profile by high pass filter. 

In the text 
Fig. 17 Surface roughness standard profiles 6.3 μm measured from the PS method after filtering. 

In the text 
Current usage metrics show cumulative count of Article Views (fulltext article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 4896 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.