Detection of Defects on Silicon Wafers
This playbook demonstrates how to detect silicon wafers and classify each detected wafer as Good, Small Defect, or Big Defect. A detector identifies the wafers, followed by a classifier that assigns each detected wafer to the appropriate category. Both models are combined into a single inspection pipeline.
The dataset
The dataset contains 70 original images, mostly of defective wafers, and 64 augmented images that contain only good wafers. The three wafer classes are all annotated in LabelMe format, as shown below.
.jpg)
Load the annotated dataset
- Request access to ReliVision Learning Center and download the silicon wafer image set and its LabelMe annotation files.
- In ReliUI, import the image set with Import Data.
- Import the annotation file for each image folder with Import Annotated Dataset, choosing the LabelMe annotation format.
- Your annotated dataset is now available in the Gallery.
.jpg)
Train the wafer detector
The detector finds every wafer in the image, whatever its condition, and outputs a bounding box.
Prepare the training data
- Make a copy of the annotated dataset for detector training.
- Merge all wafer labels into a single class called Wafer.
Train the model
- In ReliTrainer, select Object Detection as the model type.
- Select the wafer detector training dataset you prepared.
- Split the data into train and test sets, automatically or manually, to hold back some data for validation.
- Set the hyperparameters and start training.
Hyperparameters used in this use case
- Epochs: 40 (default)
- X-Y resolution: 704 (default)
- Learning rate: 0.0001 (default)
- Momentum: 0.937 (default)
- Weight decay: 0.0001 (default)
.jpg)
Train the wafer classifier
The classifier looks at one cropped wafer at a time and labels it Good, Small Defect or Big Defect.
Prepare the training data
- Extract the rectangle annotations with the ReliUI data curation functions, so each wafer becomes its own image.
- Keep the three labels on the extracted images — this is your classification dataset.
Train the model
- In ReliTrainer, select Classification as the model type.
- Select the wafer classifier training dataset you prepared.
- Split the data into train and test sets, automatically or manually, to hold back some data for validation.
- Set the hyperparameters and start training.
Hyperparameters used in this use case
- Epochs: 300
- X-Y resolution: 224 (default)
- Learning rate: 0.0001 (default)
- Momentum: 0.99 (default)
- Weight decay: 0.0005 (default)
.jpg)
Build and run the pipeline
Use the pipeline editor to build your pipeline by dragging and dropping the AI/Basic blocks. You will need to select an input data source (your raw image set) and a detection AI Block, a size filter, a defect classifier (the classifier you trained) and a position filter connected in series as depicted below.
- Open the pipeline editor.
- Add an input data source and point it at your raw silicon wafer image set.
- Add the wafer detector AI block and connect it after the input.
- Add a size filter block and connect it after the detector.
- Add the wafer classifier AI block and connect it after the size filter.
- Add a prediction position filter and connect it after the classifier.
- Add an Output Imageset or End Branch block, depending on the desired output: generate an Imageset file from the executed pipeline or proceed to the audit stage.
- Run the pipeline with the execute button at the top.
.jpg)
Review the results
Review the results in the ReliUI data annotation interface. The pipeline saves its outputs as a separate set of annotations for each image it runs on, so you can compare predictions against your labels image by image.
.jpg)
Related User Guide sections
- Import annotated data
- ROI annotation
- Extract ROIs
- Merge and download datasets
- Training an AI block
- Create and edit a pipeline
Try it yourself
Download ReliVision to run this playbook on your own wafer images, or browse the other use cases.
Download ReliVision