:::

【2020 Application Example】 Full Inspection AI Implementation in AOI Sealing Process, Reducing Screening Volume by 50%

Miniaturization of products, client demands full inspection

A listed electronic component manufacturer in Taichung, responding to the 5G era injecting new growth momentum into the quartz component industry, especially under the explosion of 5G opportunities, the importance of quartz components will play a more crucial role than in the past in consumer products.

As frequency components move towards miniaturization and at the same time demand high precision, the manufacturing processes are more susceptible to subtle factors, necessitating manufacturers to manage comprehensive data across all aspects including human, machine, material, method, and environment to quickly identify key defective factors in complex production environments.

Differing perceptions of defects, difficulty in enhancing quality consistency

With the trend of miniaturization and complexity of electronic components, visual inspection on the production line has four main functions including measurement, identification, positioning, and inspection, with inspection being the most challenging part as most electronics manufacturers still rely on traditional manual visual inspection.

Taking the PCB industry, where Automated Optical Inspection (AOI) technology has the highest penetration rate, as an example, a research institution once investigated and found that when two individuals inspect the same PCBA board four times, their mutual agreement rate was less than 28%, and the self-agreement rate was only about 44%. Due to differing perceptions of defects among on-site personnel, even automated machine vision can still lead to inconsistencies in product quality due to system settings or differences among quality control staff.

偲捷科技檢測AI化,降低過篩率20%~30%

With the support of the advisory team, collaboration with Sijie Technology aimed at the defects in the sealing process. Based on CNN (Convolutional Neural Network), the integration of multiple models introduced an AI recognition module to aid in the optimization of subsequent AOI tests, aiming to improve the accuracy of inspection equipment.

It is estimated that after introducing AI visual recognition, the over-screening rate could be effectively reduced to 20~30%. Thus, the industry, needing smarter inspection systems, has started applying AI technology to assist AOI equipment in optimizing subsequent screening tests.

AI-powered AOI Inspection Solution Cross-Model Design Concept

▲AI-powered AOI Inspection Solution Cross-Model Design Concept

Sealing AOI Inspection Trial Results

▲Sealing AOI Inspection Trial Results

Reducing false rejects, cutting manual screening workload by 50%

The project, through a deep learning network architecture, reclassifies defects detected including true and false defects, and further classifies them to reduce the false reject rate of the traditional AOI solution. This is anticipated to further aid manual inspectors in reducing more than 50% of the inspection screening volume, addressing current production line issues of relying heavily on manual re-inspection and low efficiency.

Future goals include integrating robotic arms for automatic loading and unloading, and analyzing defect causes to optimize production process parameters.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

這是一張圖片。 This is a picture.
AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOIAIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us Our company's current development We are committed toIOTsmart manufacturing our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification After discussing with IT service providers, we defined it asAOIAIa feasible operational model Tzuhong Technology has invested inAOIAIan inspection plan to checkSMTtext on components, solder joints, polarity, missing partsand usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates Industry pain points Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections Previous consumer products with undetected anomalies were acceptable within a certain ratio However, in the automotive industry today, undetected defects could lead to fatalities hence, the automotive industry has extremely high quality demands To survive in the automotive supply chain, we must address the issue of undetectable anomalies Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry Application technology and explanation Initially,Figure 1,PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products At this point, the 'suspected defective' portion accounts for20manual review for these20parts, further classifying the 'suspected defective' portion into good and defective products With We aim to leverageAItechnology, to shift from manual re-inspection of these20technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3thus reducing the workload of Tzuhong's employees from20down to only3In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0IAIDetectionFigure 2。 The original AOI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI information on defective products, then manually re-inspect one by one to determine if they are defective AOIAI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after, then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward, then manually re-inspect one by one to determine if they are defective Process differences By introducing theAOIAIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees Difference between pre and post-introduction Promotion strategy 1 Similar field diffusion allSMTmanufacturers face bottlenecks in inspections leading to shipment delays introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs 2 Cross-industry expansion plans negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness Profit strategy 1 In collaboration withAOImanufacturers, collect licensing fees 2 Direct sales toSMTthe manufacturing industryAIsystems 3 ProvideSMTmanufacturing industryAOIAIsystem subscription model「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」

這是一張圖片。 This is a picture.
AI Assists the Red Cross for Smarter Emergency Response

More Preparation Less Loss The Taiwan Food Bank Association, a non-profit organization, collects donations daily from wholesalers, retailers, manufacturers, and even kind-hearted individuals across Taiwan They also rescue consumable materials that are about to be discarded, properly allocate and deliver to households in need, aiding local underprivileged populations When natural disasters such as earthquakes, landslides, mudslides, typhoons, floods, and droughts occur in Taiwan, the food bank's resources can be immediately deployed for disaster relief This field verification unit is the Nantou County Red Cross AssociationOne of the food bank locations, hereinafter referred to as the Nantou Red CrossIs responsible for tasks like pre-disaster supplies preparation and disaster relief material distribution, helping the government bear the responsibility of disaster relief and aid In Taiwan, various natural disasters have characteristics of different duration and spatial coverage, wide or narrow With the normalization of extreme weather, the scale and number of disasters are gradually increasing and becoming harder to predict The required amount and type of materials differ by disaster, and they must address the lifestyles of the affected areas, rescue needs, traffic conditions, geographical restrictions, and other factors for varied material allocation, facing numerous challenges Typhoon Kanu severely damaged transportation in Nantou mountain areas Nantou County Red Cross planned the mountainous route Puli gt Fazhi Elementary School gt Qin'ai Village gt Aowanda to deliver supplies Disasters happen repeatedly We need to be prepared at all times Effective disaster preparedness can mitigate the impact, including swift response to material needs in affected areas, aid distribution, and even psychological support, providing added security for life and property of those in disaster zones Lack of Timeliness in Disaster Information To improve the living conditions and address the lack of supplies in remote areas, the Taiwan Food Bank Association has partnered with the Nantou Red Cross and has successively established food bank points in Nantou City, Puli, and Ren'aiLixing, Ruiyan, XinyiWangmei, Tongfu, Shuili, Lugu and Caotun among others9establish food bank locations, providing supplies worth a certain amount per household every month6001000in New Taiwan Dollars However, many challenges still need to be overcome during natural disasters For example, when typhoons, earthquakes, and landslides occur, the information source for disaster relief dispatch systems relies on post-disaster reports The time lag between reporting, response, and execution prevents timely adjustment and distribution of 'disaster relief' supplies based on the needs of affected areas, affecting rescue efficiency due to lack of timely information The 'preparedness' supplies of the Nantou Red Crosssuch as dry food, water, instant noodles, etc,are recorded manually in terms of stock, expiration dates, and distribution,When a disaster occurs, there is a chance that 'preparedness' supplies have expired and cannot become 'disaster relief' supplies It’s also possible that both conditions mentioned above occur simultaneously, leading to a need for more time to reassign 'preparedness' supplies into usable 'disaster relief' materials On the other hand, upon receiving information about shortages in disaster areas, the supplies donated by the public often grossly differ from the actual needs of the disaster zone, leading to an excess of supplies The Process of Material Operations Before and After a Natural Disaster AIAnticipating Natural Disasters Reinforcing the Accuracy of Preparedness Material Dispatch Application API Technology connects to compute the state of the climate, the intensity of disaster rescues, prioritizing the main tasks of the Nantou Red Cross and the needed areas of search and rescue Coordinated with the existing heavy rain and typhoon simulation disaster training of the Nantou Red Cross, a 'Natural Disaster Emergency Preparedness Material Dispatch and Supplement Decision System' is establishedreferred to as the Emergency Preparedness Material System。 In material management, inventory data along with immediate supply data are entered into the Emergency Preparedness Material System for comparison and analysis, helping the Nantou Red Cross quickly recognize materials like cookiesdry food, beverages, frozen food, toilet paper, etc, and determining whether they should be 'preparedness' materials or regularly distributed materials Adding to this, information forecasting understands the potential disaster conditions in remote areas, facilitating food delivery, addressing both front-end food wastage and backend practical needs When a natural disaster occurs, it enables faster response and decision-making, completing material deployment, hence increasing the speed of material operation transition20。 AI Emergency Preparedness Material System Helps Rapidly Adapt Material Distribution Through the field verification of the Nantou Red CrossAIthe system, material management, and related applications are promoted to more emergency response organizations in different areas, while continuously improving the alert functions within the Emergency Preparedness Material System, strengthening the technological foundation for alerts, enhancing prediction accuracySystem immediacy, and optimizing the data collection and analysis process Simultaneously, it can collaborate with government agencies, meteorological departments, or other rescue teams to discuss integrating more data sources, establishing a mechanism to share resources and data promptly, sharing information in real-time, helping more emergency response organizations enhance their disaster response abilities, seizing the golden rescue time 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

這是一張圖片。 This is a picture.
CCTV Intelligent Video Search System

Search for a specific person, find someone with a suitcase entering the factory in Gao'an area Color features of the person and the object confirmed, person in blue and black top, suitcase in black color, throughCCTV the intelligent video search system, by setting object and color retrieval conditions, it can successfully locate three video clips containing the target subject This greatly aids operational staff in finding the target items, and through this system, search speed can far surpass manual effort6fold Pain Points The CSE-Kaohsiung Plant is densely equippedCCTVto monitor every corner of the plant area, but when an incidenthappens, it's impossible within a limited time throughCCTVvideo playback to find the incident, the implications and risks behind this are self-evident Many areas that are usually unmanned can easily become security blind spots Thus, how to monitor a vast plant area more intelligently and effectively is one of the crucial aspects of building a smart plant for the semiconductor industry The AES Plant in Kaohsiung covers a vast area, with many important sites requiring monitoring of personnel movements to ensure corporate secrets and employee safety 1 Automated production lines and warehouses In semiconductor enterprises’ automated production lines and warehouses, oftenAGV(Automated Guided VehicleAGVs automated guided vehicles travel at high speeds if plant personnel inadvertently enterAGVthe moving area and cannot issue a warning to the person, then the regrettable accidents that occur will be too late to reverse 2 Material and product storage areas Materials used in semiconductor-related processes are costly if areas storing materials or products are breached, there is a risk of loss of high-value materialsproducts 3 High-security areas Trade secrets relate to the core technological competitiveness of semiconductor-related enterprises if someone breaches the high-security areas, there is a risk of corporate secrets being leaked The safety of trade secrets has always been one of the most critical issues for semiconductor enterprises 4 Loading docks At AESLButthe dock area often has loading vehicles coming and going if someone intrudes into the dock area, there is a risk of vehicle collisions and accidents Additionally, goods awaiting shipment at the dock area could be stolen or potentially damaged from collisions, thus causing significant reputation and financial losses for the company, further leading to production and shipping inconvenience When an abnormal event occurs, how to quickly search for the relevant key footage from massive data Many important locations within the AES Kaohsiung Plant need to be equippedCCTVfor safety checks, butCCTVWith thousands to tens of thousands of cameras, manually searching through footage for an event requires laborious frame-by-frame review which is time-consuming and inefficient In light of advancements in computer vision, it's beneficial to utilizeAIto replace manual playback and searching Problem Scenario Object Detection The data source for object detection comprises two parts Open-source datasetsOIDv4and AES Kaohsiung PlantCCTVImage files For these files, search for usable data, specificallyOIDv4image files For these files, extract the defined nine major categories of objects for training data among them, two object categories, knives and gasoline barrels, were not found inOIDv4found usable data for knives and gasoline barrels, while the remaining seven categories of objects are available fromOIDv4useful training data found for the remaining seven categories of objects, all marked Regarding the Kaohsiung PlantCCTVimage files, select some frames Frame of the footage, and manually annotate the objects to be_detected for training and testing data Nine Major Objects Color Recognition The data source for color recognition is divided into two partsInternet image screenshots, and Kaohsiung PlantCCTVimage files Currently, no publicly available open-source datasets specifically for color recognition applications have been found, so images are collected from the web Search the web for images of the defined nine major object categories, save the images after separating the objects from the background, keeping only the object sections, and mark the images according to color Additionally, for the Kaohsiung PlantCCTVimage files, use the already-markedbounding boxextractCCTVimage files from variousFramesections of objects identified by color, and finally, visually identifiable images are marked according to color Each object category has its specific color definition, depending on the usual colors seen in these objects in real life Dynamic Ignore during Training FromOIDv4during the training of the object detection pilot model, since each image in this dataset is only marked for a single category, but the image may contain other desired detection categories unmarked For such cases, dynamic ignore techniques will be employed during training to avoid confusion Next, use the extracted training data from the Kaohsiung Plant toFine-Tuneenhance the detection rate of the object in specific designated areas Finally, select the model that computes the lowest loss value in the test set during the training process as the main object_detection model Dynamic Ignoring AIHelp You View CCTV The intelligent video search system primarily serves as an assistive system for searching surveillance footage, capable of speeding up the process of finding target events by setting search conditions for objects By simply defining the search conditions, you can quickly produce thumbnails of critical objects and playback for review, shortening the time required for manual case retrieval of the past The search time is quickly6doubled, allowing the front-end security unit to use this platform to strengthen the first line of risk management supervision and take timely preventive measures 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」