Defect Detection and Segmentation

Defect detection and segmentation on assembly line

This is a project for industial purpose and is in use now.

On the assembly line, the rate of defective products is often very low, which makes the cost of manual inspection very high.

Quality inspection can be done quickly with the help of computer vision. For a general defect detection task, the focus of the task is to build a dataset of related categories of defects and label them. However, in this project, there are some challenging defects, for example, screws need to be screwed into specific holes, while other holes need to be left empty. So we design our methods based on comparison. Homography matrix is estimated to align detected image with template image, then stack them together for later defect detection and segmentation.

Image alignment before detection.

The probability of a defect on the assembly line is about 0.5%, while the probability of detecting a defective item when encountered is over 95%.