Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Restoration of Motion-Blurred Image Based on Border Deformation Detection: A Traffic Sign Restoration Model

  • Yiliang Zeng ,

    ustbzengyiliang@163.com (YZ); ustblanjinhui@gmail.com (JL)

    Affiliation Department of Instrument Science and Technology, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, P.R. China

  • Jinhui Lan ,

    ustbzengyiliang@163.com (YZ); ustblanjinhui@gmail.com (JL)

    Affiliation Department of Instrument Science and Technology, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, P.R. China

  • Bin Ran,

    Affiliation School of Transportation, Southeast University, Nanjing, Jiangsu Province, P.R. China

  • Qi Wang,

    Affiliation Department of Instrument Science and Technology, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, P.R. China

  • Jing Gao

    Affiliation Department of Instrument Science and Technology, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, P.R. China

Abstract

Due to the rapid development of motor vehicle Driver Assistance Systems (DAS), the safety problems associated with automatic driving have become a hot issue in Intelligent Transportation. The traffic sign is one of the most important tools used to reinforce traffic rules. However, traffic sign image degradation based on computer vision is unavoidable during the vehicle movement process. In order to quickly and accurately recognize traffic signs in motion-blurred images in DAS, a new image restoration algorithm based on border deformation detection in the spatial domain is proposed in this paper. The border of a traffic sign is extracted using color information, and then the width of the border is measured in all directions. According to the width measured and the corresponding direction, both the motion direction and scale of the image can be confirmed, and this information can be used to restore the motion-blurred image. Finally, a gray mean grads (GMG) ratio is presented to evaluate the image restoration quality. Compared to the traditional restoration approach which is based on the blind deconvolution method and Lucy-Richardson method, our method can greatly restore motion blurred images and improve the correct recognition rate. Our experiments show that the proposed method is able to restore traffic sign information accurately and efficiently.

Introduction

With the development of urbanization and the popularization of the automobile, problems associated with road traffic congestion, frequent traffic accidents, and the low efficiency level of road transport has become increasingly more serious [1]. In order to alleviate these problems, a Driver Assistance System (DAS) was designed to help or even substitute human drivers to enhance the safety of driving [2,3]. This system films the road information in its natural scene using a camera that is mounted inside the vehicle, and this information is subsequently processed in real time using a relevant circuit system. Then, the system provides information, such as warnings and tips, to the driver. This can greatly reduce driving risks and enhance road traffic and the driver's personal safety. Strictly complying with the traffic rules can improve vehicle safety performance, and it can also effectively reduce traffic accidents. A variety of important traffic signs placed on the road by the traffic department communicates and supports road traffic rules for the driver [4]. Traffic signs are designed to help drivers with piloting tasks while providing information, such as the maximum or minimum speed allowed, the shape of the road, and any forbidden maneuvers. Therefore, recognition of traffic signs is one of the important tasks of the DAS in Intelligent Transportation.

The fast detection and accurate identification of traffic signs hold great significance for automatic vehicles. The ability to project a sharp image is one of the preconditions to correctly recognizing a traffic sign. However, the relative motion between the camera and the natural scene during the exposure time usually causes motion-blurred images, which will severely affect the image's visual quality. It is a challenge to quickly and accurately identify traffic signs in motion-blurred images. There are two main approaches used to solve this problem. First, by improving the performance index of the camera, we can avoid the motion blur from a hardware perspective of image processing. However, there are bottlenecks in technology that affect the camera's performance. The second way is to enhance and restore the motion-blurred images by means of a motion-blurred image restoration algorithm. There are also additional things we can do in this field to enhance image quality.

In recent years, many scholars across the world have performed extensive research on the algorithm to resolve image blur degradation. An early and popular method tried to estimate the parameters of motion blur by inspecting the zero pattern of the blurred image in the spectral domain, as there were regular patterns of zeros, depending on the blur scale (L) and the blur direction (θ). This method was usually used in uniform velocity or close to it, but it failed to deal with images that featured noise. With the advancement of research, some new or modified algorithms have been proposed to improve recognition precision. Ji and Liu [5] and Sun [6] utilized image gradients to enhance this periodic pattern. In addition to Radon transformation, image gradients provided a robust algorithm to catch this periodic pattern, even in cases of noisy images. Ko and Kim [7] extracted the main ripple components from the log spectrum and then determined the angle of motion by measuring the direction of the main ripple along the x-axis. The authors utilized the width of the main ripple to estimate the length. A unified framework, which used bilateral filtering and gradient attenuation based on the Richardson-Lucy algorithm [8,9], was proposed to by Yang et al solve the notorious ringing problem for both blur kernel estimation and non-blind image deconvolution from single blurred image [10]. In addition, Kotera et al. [11] presented a straightforward maximum a posteriori method, combined with sparse priors and an efficient numerical method, which based on blind deconvolution, to recover the unknown features of a single observed blurred image. In another study, Zhang et al. [12] quickly estimated the extent of image blur via wavelet analysis. Furthermore, Deahpande and Patnail [13] used improved dual Fourier spectrum to accurately estimate specific parameters, and they also prevented the ringing effect from occurring at the image boundaries. Wang et al. [14] took both the Hough transform and error-parameters to estimate the blur parameters for linear motion blur, and they also applied curve-fitting and polar transformations to estimate the parameters used to rotate the motion blur. Singh, Tiwary and Kim [15] used an exponent for the correction ratio of Richardson-Lucy (RL) method and accelerated RL method adaptively. Paclik et al. [16] used a correlation function between the logarithm power spectrum, as well as a detecting function to restore the image, and their results also seemed promising in the presence of noise.

Nowadays, the recognition of traffic sign has also made great progress. The Hough transformation and a multi-frames validation method were used by Gonzalez and Garrido [17]. A system based on deformable models was studied, and it was immune to lighting changes, occlusions and other forms of image variance and noise [2]. Support vector machines (SVMs) were utilized to detect and recognize traffic signs by Bascon et al [18]. In addition, Khan et al. [19] proposed a method based on image segmentation and joint transform correlation, which also integrated shape analysis. Barnes et al. [20] also presented the radial symmetry detector to detect speed signs in real time.

All of these algorithms that have been used to restore motion-blurred images took place in the frequency space. Moreover, traffic sign recognition algorithms tend to focus on traffic sign detection and recognition. They do little to deal with traffic signs in blurred images. In order to solve this problem, a new algorithm based on traffic sign border extraction is proposed as a method that can be used to restore motion-blurred images in the spatial domain. The border of the traffic sign is extracted using the image’s color information, and then the width of the border can be measured in all directions. According to the width measured and the corresponding direction analyzed, the motion direction and scale of the image can be confirmed, and then it can be used to restore the motion-blurred image. This method has a lower computational cost and better performance. Meanwhile, the restored image ensures accurate and reliable detection of the traffic sign.

The remainder of this paper is organized as follows: Section II presents the generation of the motion-blurred image and the restoration principle of the motion-blurred image. In Section III, the parameters extraction model, which is based on border deformation detection, is given. Border parameter extraction algorithms are discussed in detail in Section IV. Experimental results are presented in Section V. Finally, a conclusion is presented in Section VI.

Methods

All of the experimental images in the paper are from the German Traffic Sign Recognition Benchmark (GTSRB) [21]. Physical traffic sign instances are unique within the dataset. There are more than 40 classes and more than 50000 images in total. In addition, the GTSRB dataset is free to use.

2.1 Restoration principle of motion-blurred images

A motion-blurred image is generated by the relative motion between the target and the camera during the image’s exposure time. The study of motion blur produced by uniform motion is of general significance, because the variable speed and the linear motion blur can be approximately considered as uniform motion in the shooting moment. Following motion-blurred degradation and additive noise superposition, the output result is a blurred image [22]. This degradation process can be shown in Fig 1.

In this model, the output is calculated by means of the following formula [23] (1) where g(x,y) is the blurred image, f(x,y) is the undegraded image, n(x,y) is system noise, h(x,y) is the point spread function (PSF), and ⨂ is the convolution in spatial domain. Since the space domain convolution is equal to frequency domain multiplication, the frequency domain representation of Eq (1) is G(u,v) = F(u,v)H(u,v)+N(u,v).

Motion-blurred restoration involves reversing the image degradation process and adopting the inverse process to obtain clear images. Motion-blurred is one case that was featured in the model of Lin et al [22]. The model assumes that the target or camera moves at a certain speed and direction, and a distance, s, is moved during the exposure time, T. Regardless of the effect of noise, it can be presented by the formula. In addition x(t),y(t) are the time-varying components of motion in the x-direction and y-direction.

The Fourier transform of g(x,y) is

(2)

The spectrogram of the blurred image is the modulus square of Eq (2), which leads to an un-degraded image where the phase shift is absorbed, since its value multiplied by its complex conjugate is equal to unity. By defining . Eq (2) can be expressed in the form of G(u,v) = F(u,v)•H(u,v), so it is possible to restore the motion blurred image if H(u,v) is known.

The inverse Fourier transform of H is h(x,y) = 1/vT = 1/s. This shows that, the unknown variable is s, which includes the direction and scale. So theoretically, if the two parameters are known, it is possible to obtain the spectrogram and restored image of the blurred image. Therefore, a new method based on the border in the spatial domain is proposed to extract the parameters quickly and efficiently.

From the perspective of image restoration, the minimum mean square error filtering (Wiener Filtering) method is adopted, which can avoid the effect of white noise. The method is shown by the expression (3) where K is a modifying factor representing the power ratio of the noise and the signal. Because this value cannot be accurately obtained, a fixed value is replaced in practice. The inverse Fourier transform of is the restored image.

2.2 Parameter extraction based on border in the spatial domain

Through the above description about the restoration algorithms of motion-blurred images, it is obvious that extracting the movement direction and scale is a key step in the process, and that determining how to detect the two parameters quickly and accurately is the key problem. There were already some algorithms in existence that can extract these parameters, and most of these algorithms try to do it in the frequency domain by measuring the zero pattern of the blurred image. However, these methods lack of robustness and are easily affected by noise. Therefore, it is necessary to find a new method that can calculate the two parameters.

2.2.1 Border deformation description of motion-blurred traffic signs.

Traffic signs usually have a color circle border and a black number, or some other patterns, within it, as shown in Fig 2(a) and 2(b). By analyzing the traffic signs in motion-blurred images, we found that no matter what the direction of motion is, the width of the border will deform regularly. Fig 2(c) and 2(d) feature the motion-blurred images of Fig 2(a) and 2(b). When comparing the blurred image with the sharp image, we can conclude that the border will become wider on the front and back sides in the direction of motion, and that the blurred image has lower color saturation. On the right and left sides, the boundary change is small compared with the sharp image.

thumbnail
Fig 2. Traffic signs images.

(a) and (b) sharp images. (c) and (d) motion-blurred images.

https://doi.org/10.1371/journal.pone.0120885.g002

In order to explain the changing laws of the border clearly, the blurring process is simulated. Fig 3(a) shows the border of the traffic sign. We were then able to produce motion blur in the direction of 0° and 30°, and we were able to extend it by 15 pixels. Lastly, we obtained the border's motion-blurred images [see Fig 3(b) and 3(c)].

thumbnail
Fig 3. Motion-blurred simulation of traffic sign's border.

(a) Original border of the traffic sign. (b) motion-blurred image of the border by 0° and 15 pixels, and (c) motion-blurred image of the border by 30° and 15 pixels.

https://doi.org/10.1371/journal.pone.0120885.g003

It can be clearly observed that motion causes the border's regularity to change. Fig 3(a) is the original border before it became motion blurred. Fig 3(b) moved in a direction of 0°. The border around the 0° direction had apparently become blurred and its boundary became wider. Moreover, its color saturation dropped much more markedly than in the border around the 90° direction. Fig 3(c) is an image that presents similar features, though the direction is 30°.

2.2.2 Parameter extraction model.

In the case of horizontal motion [Fig 3(b)], each line of the image is a sequence that could be expressed as f(x,y), and each sequence is considered as a one-dimensional sequence, which can be expressed as f(x). Assuming that the value of the border pixels is 1, and others are 0..Both a and b are the boundaries of the traffic sign borders.

The sequence moved n pixels towards the right, and n<b-a. Through inverse Fourier transform, it can be known that h(x) = 1/n (0≤xn-1).Ignoring the effect of noise, we can express the sequence after motion as (4) By simplifying Eq (4), we can get

(5)

The corresponding illustration of the function x solution of Eq (5) is shown in Fig 4.

From Eq 11 and Fig 4, we can see that when a≤x≤a+n, g(x) grows from 0 to 1. When a+n≤x≤b, the value of g(x) is 1, and when b<x<b+n, g(x) decreases from 1 to 0. In the image the saturation of the pixels in the middle of the border is the highest, and it decreases gradually from the middle to the edge of the border. The threshold is set as 1, a+n≤x≤b, and we consider it as the width of the sequence after blurring. This is to say that the width of the pixels whose saturation equals 1 in original sequence is d, and the scale of motion is n. Thus, the width following motion is d' = d+n.

When considering the entire border, the width of the border along the motion direction would apparently change, while the width of the border perpendicular to the motion direction changes little. Finally, the width between the two directions changes gradually, which is shown in Fig 5.

thumbnail
Fig 5. Binary image of motion-blurred border segmented by a certain threshold.

(a) Motion-blurred border by 0°, and (b) Motion-blurred border by 30°.

https://doi.org/10.1371/journal.pone.0120885.g005

Given that the circle is isotropic, no matter which direction is the image blurred in, the width of the border would change in the same way, which makes it possible to confirm both the blurred direction and scale. Specifically, after measuring the width of all the directions, two maximum values (dmax) and two minimum values (dmin) could be extracted. By connecting two groups of points, respectively, these two lines are perpendicular, and the blurred direction is the direction of the minimum value line.

We can also obtain the scale from the width of the border. Assuming that the width of the border before the motion is d, it is easy to know that the maximum value is dmax = d and that the minimum value is dmin = d-n, so the scale is n = dmax-dmin. However, the result is easily affected by threshold determination, so the results should be corrected. An appropriate coefficient (K) is introduced to the result, so we could obtain the corrected result, n = K (dmax-dmin).

Thus far, the parameters of direction and scale are extracted from the motion-blurred images.

2.3 Border deformation detection for image restoration

According to the border deformation characteristics of the motion-blurred images of traffic signs, the process of realizing the algorithm is drawn in Fig 6. The first step in the process is to remodel the image from RGB (Red, Green, Blue) to HIS (Hue, Saturation, Intensity); then, the traffic sign border should be extracted by defining the appropriate threshold of HSI. After setting the center of the border, we can measure the width of the border in all directions. Then, the two parameters of direction and scale can be calculated. At last, the motion-blurred image of the traffic sign can be restored using the results obtained with this method.

2.3.1 Border extraction.

There are some methods that can be used in border extraction [24, 25]. Since the border is blurred, the traditional method cannot meet the requirements needed to extract the borders with accuracy and integrity.

The traffic sign's borders are red, so it is possible to confirm whether the pixel belongs to the border or not by checking its color. The RGB image cannot confirm the color directly, so the method is based on the HSI model. The HSI color space is well suited to describe color in a way that is practical for human interpretation [26]. In the HSI model, the variation of light does not greatly affects the value of hue [27], so it is easy to confirm what the color of the pixel is. The border of the traffic sign is red, and according to the statistical results, the H values of most border pixels fall in the range of 0° ~36° and 324 ° ~360°. In addition, in this method the intensity component was not used in the calculation, which reduces much computational capacity. There may be some noise in the resulting extraction; as such, we use a filter to remove it. The results of this method are shown in Fig 7.

thumbnail
Fig 7. Result of border extraction using the HSI model.

(a) Motion-blurred image of traffic sign, (b) result of the border extraction with some noise, and (c) denoised image as a result of border extraction.

https://doi.org/10.1371/journal.pone.0120885.g007

2.3.2 Measurement of border width in all directions.

In order to measure the width of the border in all directions, we should count the pixels from the center of the circle to the edge of the image in all directions, confirming the center of the border is the first step. Theoretically, the blurred border is centrosymmetric, so the center of the border is the center of gravity. Assuming the size of the image is M×N, the center of the border O(Ox,Oy) is represented by and . In addition, f(n) and f(m) are the summation of the white pixels in the m column or in the n row.

To measure the width of the border, we compute the border by a step of 1°. Through theoretical analysis and experimental verification, we found that the parameters are the same when the motion blurred directions are θ° and (θ+180) °. So, the direction of the motion-blurred image can be normalized from 0° to 180°. The result of the measurement is shown in Fig 8(a). In order to eliminate noise, the result is processed by the mean filter. Fig 8(b) is the result after filtering.

thumbnail
Fig 8. Measurement result of motion-blurred traffic sign.

(a) Original measurement result, and (b) result after filtering.

https://doi.org/10.1371/journal.pone.0120885.g008

Following this, we can then determine the two extreme points (the maximum point and the minimum point), and the direction of the minimum point is the motion direction. To ensure that the results are more precise, we use the direction of the maximum point to correct any errors.

Results and Discussion

Two different kinds of experiments were designed to test the two parameters respectively. One was to change the blurred scale while the blurred direction remained invariant, and the other was to change the blurred direction while the blurred scale was invariant. These experiments could indicate the accuracy, robustness, and scope of the application of these methods.

3.1 Evaluation criteria of image restoration

3.1.1 Evaluation criteria of parameter extraction.

The absolute error Ea is the measured value between the real value Vr and the measured value Vm. This can be calculated by the formula Ea = |Vr-Vm|.Then the relative error of direction Edr and the relative error of scale Esr are respectively defined as

(6)

3.1.2 Quality evaluation of image restoration.

(1) Improved assessment of Gray Mean Grads

The purpose of image restoration is to improve the quality of the image. This paper uses the Gray mean grads (GMG) to evaluate the restored image, (7) where M and N, respectively, refer to the height and width of the image. The larger the value, the sharper the texture, and that leads to improved image quality. In order to better evaluate the image, we first calculate the GMG of the undegraded image (GMG_ui), the blurred image (GMG_bi) and the restored image (GMG_ri) respectively, and we then calculate the ratio of the GMG of the blurred image (GMG_bi) to the GMG of the undegraded image (GMG_ui), (8) as well as the ratio of the GMG of the restored image (GMG_ri) to the GMG of the undegraded image.

(9)

Greater values indicate that the two images are closer.

(2) Laplacian Sum

The Laplacian sum (LS) is a global sum value of the image, and is calculated with the following formula, (10) When an image is much clearer, its edge is more distinct and the LS value is much greater. The GMG and LS values are the most common No-Reference Quality Assessment for motion blurred image.

(3) Recognition rate

The restored traffic sign images using this algorithm are recognized using a recognition system that has been used to test the effectiveness of the algorithm in this paper. (11) where Ns represents the total number of test samples, and Nc is the number of test samples that are recognized correctly.

3.2 Validation of parameter extraction

When the blurred direction is fixed and the scale changes from 2 pixels to 18 pixels, the results of the measurements obtained in this method are shown in Table 1.

thumbnail
Table 1. Results of measurement when direction is fixed at 30° and scale is variation.

https://doi.org/10.1371/journal.pone.0120885.t001

In order to make the results more intuitive, the relative error of the parameters is shown in Fig 9.

thumbnail
Fig 9. Relative error of scale and direction with fixed direction.

https://doi.org/10.1371/journal.pone.0120885.g009

From Table 1. and the corresponding curve in Fig 9, it can be known that when direction is invariant, the results of the direction measurement are more precise than the scale measurement; this is because it is hard to confirm the threshold and the coefficient (K) at the border extraction step when illumination changes. The accuracy of the direction measurement is low when the scale is less than 5 pixels. However, there is no need to restore the image because the image is clear enough to recognize. The accuracy of the scale measurement is acceptable when the scale is between 5 and 12 pixels. When the scale is higher than 12 pixels, the error is too large to accept. Additional observations show that the traffic sign border's width of in the sharp image is about 10 pixels, so the algorithm is not fit for use in a situation when the blurred scale is much larger than the width of the border.

The blurred scale was also fixed at 10 pixels and the direction was changed from 0° to 180°, the results of this measurement are shown in Table 2.

thumbnail
Table 2. Results of measurement when the scale is fixed at 10 pixels and direction is variable.

https://doi.org/10.1371/journal.pone.0120885.t002

To make this result more intuitive, the relative error of the parameters is shown in Fig 10.

thumbnail
Fig 10. Relative error of scale and direction with fixed scale.

https://doi.org/10.1371/journal.pone.0120885.g010

From Table 2. and Fig 10, it can be shown that the results are fairly accurate, the relative error of the direction measurement was below 2%, and the scale measurement was below 8%. Compared with the scale, the directions are measured more accurately and are stable.

3.3 Validation of image restoration

Using the parameters measured by this method to restore the motion-blurred image, we obtained good restoration results. Fig 11 shows part of the blurred images and the corresponding restored images. We also compared our proposed method with two commonly used methods of restoration. The first one is based on the blind deconvolution method, which was introduced by Jan Kotera et al. in [11], and the second one based on Lucy-Richardson method was introduced by Manoj Kumar Singh et al.in [13]. Both of these methods do not require any information about the image, and the iteration was set to around 30 iterations in the experiment. Fig 12 shows part of the restoration results obtained by both method [11] and [13], which can result in slightly better visualization from these blurred images. Fig 12(a) shows the results obtained using the blind deconvolution method [11], and Fig 12(b) shows the results obtained using the Lucy–Richardson method [13].

thumbnail
Fig 11. Results of traffic sign restoration by our method.

(a) Motion-blurred images of traffic sign, and (b) restored images of traffic sign.

https://doi.org/10.1371/journal.pone.0120885.g011

thumbnail
Fig 12. Part of the restoration results of comparison methods.

(a) restoration results using method [11], and (b) restoration results using method [13].

https://doi.org/10.1371/journal.pone.0120885.g012

From the results of the restoration, we can see that the proposed method yields the best restoration results whenever the overall visual effect and local visual details are less noisy and are of higher integrity. As such, our method is efficient in automatic detection system.. Most of these motion-blurred traffic sign images can be restored well, while some of these restorations led to the generation of stripes, as caused by the Wiener Filter. Our method can also be used for motion blurred images featuring different contrast levels.

In Fig 12, the method proposed by Jan Kotera et al. and the method proposed by Manoj Kumar Singh et al. both led to the problems with noise amplification and ringing effects, and the details of texture and edge were not clear enough for subsequent processing. In addition, they did not work particularly well for motion blurring images, because most the test data cannot be deblurred in these experiments.

Some images were randomly selected from a total of 217 samples and their GMG ratio was subsequently calculated, and the results are shown in Fig 13. The texture information following restoration was worse when compared to that of the blurred image in each individual image, because the direction and scale differences led to errors in parameter extraction. However, it can be determined that most of the traffic sign image restorations can improve the image quality, as it features, clearer texture. This shows that the algorithm is both stable and reliable. Table 3 shows the LS values of the motion blurred images and the restored results in Fig 12. In general, the proposed method obtained the best visual effect and featured the highest values when meeting the assessment criteria, thus, its restoration result is better than that of the blind deconvolution and Lucy-Richardson methods.

The traffic sign images restored by this algorithm are recognized using the recognition system based on the SVM, which is employed to test the effectiveness of the algorithm. There are 217 samples in all, and the recognition rates of the motion-blurred traffic sign images and their corresponding restored images are shown in Table 4. The results of the image recognition show that the motion-blurred traffic signs are hard to recognize, there were only 22 traffic signs that were recognized in a total of 217 images, and the recognition rate was low at 10.14%. However, following restoration, 191 traffic signs can be recognized, and the recognition rate subsequently increases to 88.02%. In real data featuring traffic signs, about 10% images are blurred by motion. Using this method, the recognition rate can be improved to about 77.84%. This demonstrates that the restoration algorithm is effective, and that the restoration of motion-blurred images is necessary in image detection.

Conclusions

This paper proposed a new method to measure two important parameters—direction and scale—of motion-blurred traffic signs in the spatial domain. Through our experiments, it was determined that the results are accurate and that the error rates are acceptable. This method is robust, and it can reduce the impact of changing illumination on parameter extraction. Using the measured parameters to restore the motion-blurred traffic sign images, we obtained good results that could meet the system's requirements in image recognition. The results illustrated that the method can deal with recognition-based problems associated with motion-blurred traffic sign images. Compared with the methods based on the frequency domain, the impact of noise on parameters extraction is much smaller. In conclusion, application of the algorithm offers an advantage in traffic signs recognition. This method can improve the performance of the DAS and help to improve automatic driving and road safety.

As for future work, we will continue to investigate this subject by providing a more detailed background of this problem, and we will work to improve the robustness of border extraction with more suitable features in reducing the effects of the environment.

Author Contributions

Conceived and designed the experiments: YLZ JHL BR QW JG. Performed the experiments: YLZ JHL BR QW JG. Analyzed the data: YLZ JHL BR QW JG. Contributed reagents/materials/analysis tools: YLZ JHL BR QW JG. Wrote the paper: YLZ JHL BR QW JG.

References

  1. 1. Ji RR, Duan LY, Chen J, Yao HX, Yuan JS, Rui Y, et al. Location discriminative vocabulary coding for mobile landmark search. International Journal of Computer Vision, 2012; 96: 290–314.
  2. 2. De la Escalera A, Armingol JM, Pastor JM, and Rodríguez FJ. Visual Sign Information Extraction and Identification by Deformable Models for Intelligent Vehicles. IEEE Transactions on Intelligent Transportation Systems, 2004; 5: 57–68.
  3. 3. Gao Y, Tang JH, Hong RC, Dai QH, Chua TS, Jain R. W2Go: a travel guidance system by automatic landmark ranking. Proceedings of the international conference on Multimedia, 2010; 123–132.
  4. 4. Franke U, Gavrila D, Gorzig S, Lindner F, Paetzold F, Wohler C. Autonomous driving goes downtown. IEEE Intelligent Systems, 1998; 13: 40–48.
  5. 5. Ji H, Liu CQ. Motion blurred identification from image gradients. IEEE Conference on Computer Vision and Pattern Recognition, 2008; 1–8.
  6. 6. Sun HW, Desvignes M., Yan YH, Liu WW. Motion blurred parameters identification from Radon transform image gradients. IEEE IECON'09. 35th Annual Conference on Industrial Electronics, 2009; 2098–2103.
  7. 7. Ko J, Kim C. Low cost blurred image detection and estimation for mobile devices. 11th International Conference on Advanced Communication Technology, 2009; 3: 1605–1610.
  8. 8. Richardson WH. Bayesian-based iterative method of image restoration. Journal of the Optical Society of America, 1972; 62:55–59.
  9. 9. Lucy LB. An iterative technique for the rectification of observed distributions. Astronomical Journal. 1974; 79:745–765.
  10. 10. Yang HL, Huang PH, Lai SH. A novel gradient attenuation Richardson–Lucy algorithm for image motion deblurring. Signal Processing, 2014; 103: 399–414.
  11. 11. Kotera J, Sroubek F, Milanfar P. Blind deconvolution using alternating maximum a posteriori estimation with heavy-tailed priors. Computer Analysis of Images and Patterns, 2013; 8048: 59–66.
  12. 12. Zhang FQ, Wang GF, Ye JC, Liu QH, Xiao XD. A new approach to estimate image blurred extent based on wavelet module maximum. 2010 International Conference on Intelligent Computing and Integrated Systems 2010; 193–196.
  13. 13. Deahpande AM, Patnail S. Single image motion deblurring: An accurate PSF estimation and ringing reduction. International Journal for Light and Electron Optics, 2014; 125: 3612–3618.
  14. 14. Wang W, Zheng JJ, Liu X, Shen LG, Zhou HJ. Adaptive detection method of degraded parameters in motion blur image. 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery, 2011; 4: 2158–2162.
  15. 15. Singh MK., Tiwary US. Kim YH. An Adaptively Accelerated Lucy-Richardson Method for Image Deblurring, EURASIP Journal on Advances in Signal Processing, 2008; 2008:1–10.
  16. 16. Paclik P, Novovicova J, Duin RP. Building Road-Sign Classifiers Using a Trainable Similarity Measure. IEEE Transactions on Intelligent Transportation Systems, 2006; 7: 309–321.
  17. 17. Gonzalez A, Garrido MA, Llorca DF, Gavilan M, Fernandez JP, Alcantarilla PF, et al. Automatic Traffic Signs and Panels Inspection System Using Computer Vision. IEEE Transactions on Intelligent Transportation Systems, 2011; 12: 485–499.
  18. 18. Maldonado-Bascon S, Lafuente-Arroyo S., Gil- Jimenez P., Gomez-Moreno H., Lopez-Ferreras F. Road-Sign Detection and Recognition Based on Support Vector Machines. IEEE Transactions on Intelligent Transportation Systems, 2007; 8: 264–278
  19. 19. Khan JF., Bhuiyan SMA., Adhami RR. Image Segmentation and Shape Analysis for Road-Sign Detection. IEEE Transactions on Intelligent Transportation Systems, 2011; 12: 83–96.
  20. 20. Barnes N, Zelinsky A, Fletcher LS. Real-Time Speed Sign Detection Using the Radial Symmetry Detector. IEEE Transcations on Intelligent Transportation Systems, 2008; 9: 322–332.
  21. 21. Stallkamp J, Schlipsing M, Salmen J, Igel C. The German Traffic Sign Recognition Benchmark: A multi-class classification competition. In Proceedings of the IEEE International Joint Conference on Neural Networks, 2011; 1453–1460.
  22. 22. Lin HT, Tai YW, Brown MS. Motion Regularization for Matting Motion Blurred Objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011; 33: 2329–2336. pmid:21576738
  23. 23. Jiang XY, Cheng DC, Wachenfeld S, Rothaus K. Motion Deblurring, Available: http://cvpr.uni-muenster.de/teaching/ws04/seminarWS04/downloads/MotionDeblurring-Ausarbeitung.pdf.
  24. 24. Fang C, Fuh CS, Chen SW, Yen PS. A road sign recognition system based on dynamic visual model. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003; 1: 750–755.
  25. 25. Fleyeh H., Davami E. Eigen-based traffic sign recognition. IET Intelligent Transport Systems, 2011; 5:190–196.
  26. 26. Alvarez JMA., Lopez AM. Road Detection Based on Illuminant Invariance. IEEE Transactions on Intelligent Transportation Systems, 2011; 12: 184–193.
  27. 27. Gomez-Moreno H, Maldonado-Bascon S, Gil-Jimenez P, Lafuente-Arroyo S. Goal Evaluation of Segmentation Algorithms for Traffic Sign Recognition. IEEE Transactions on Intelligent Transportation Systems, 2010; 11: 917–930.