:::

【2024 Application Example】 AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOI+AIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue. Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us.

Our company's current development

We are committed toIOTsmart manufacturing; our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems. We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification. After discussing with IT service providers, we defined it asAOI+AIa feasible operational model.

Tzuhong Technology has invested inAOI+AIan inspection plan to checkSMTtext on components, solder joints, polarity, missing parts....and usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates.

Industry pain points

    Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections. Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections. Previous consumer products with undetected anomalies were acceptable within a certain ratio. However, in the automotive industry today, undetected defects could lead to fatalities; hence, the automotive industry has extremely high quality demands. To survive in the automotive supply chain, we must address the issue of undetectable anomalies.

    Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry.

Application technology and explanation

    Initially,(Figure 1)PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products. At this point, the 'suspected defective' portion accounts for20%manual review for these20%parts, further classifying the 'suspected defective' portion into good and defective products. With

    We aim to leverageAItechnology, to shift from manual re-inspection of these20%technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3%thus reducing the workload of Tzuhong's employees from20%down to only3%In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0I+AIDetection(Figure 2)

The original AOI inspection process
The original AOI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI

information on defective products, then manually re-inspect one by one to determine if they are defective.

AOI+AI inspection process
AOI+AI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after,

then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward,

then manually re-inspect one by one to determine if they are defective.

Process differences

    By introducing theAOI+AIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees.

Difference between pre and post-introduction
Difference between pre and post-introduction

Promotion strategy

(1)       Similar field diffusion: allSMTmanufacturers face bottlenecks in inspections leading to shipment delays; introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs.

(2)       Cross-industry expansion plans: negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness.

 

Profit strategy

(1)       In collaboration withAOImanufacturers, collect licensing fees.

(2)       Direct sales toSMTthe manufacturing industryAIsystems.

(3)       ProvideSMTmanufacturing industryAOI+AIsystem subscription model

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-12-09」

Recommend Cases

【導入案例】挺進智慧物流50 新竹物流醫材配送班表超高效率
Advancing to Smart Logistics 5.0: Hsinchu Logistics Delivers Medical Materials with Ultra-High Efficiency

After incorporating AI technology, traditional logistics companies have seen significant improvements in transportation efficiency and reductions in transportation costs, especially in the transfer of medical materials which involves timely service and rights of hospitals and patients The implementation of intelligent logistics can save medical material businesses the cost of constructing GDP warehouses and other expenses up to millions A major domestic logistics leader, Hsinchu Transport HCT, owns a fleet of 3,500 vehicles and a storage area of 60,000 square meters, providing customized logistics solutions including logistics, commerce, finance, information, distribution, storage, and processing The company handles up to 580,000 parcels per day, with a maximum capacity reaching 900,000 parcels, making the enhancement of transshipment efficiency crucial for HCT Medical materials transportation at hospitals need optimization of current operational processes and enhancements in systematization and intelligence Especially the transportation of hospital medical materials, which encounters various challenges Medical materials suppliers need to cater to varying customer product demands, temperature requirements, and delivery times through multiple logistics providers This highly depends on the experience and careful control of operations staff Whether it is the product shipment or actual logistics process, each step must be interconnected Any human errors can impact the service timing and rights of the hospitals and patients Thus, all concerned businesses, along with the government and hospitals, are working to optimize current operational processes and elevate the level of systematization, automation, and intelligence to minimize service errors and cost losses HCT's distribution process prior to AI implementation Currently, with the government's push for standardized platform operations on the demand side of hospitals, supply-side businesses collaborate through data coordination to improve the accuracy and efficiency of product shipments, enhancing operational quality and management benefits at the demand side At the same time, some businesses are also investing in the standardization and systematization of internal operational processes, thus enhancing operational efficiency and quality In the freight logistics sector, logistics companies' warehouse staff need to expend labor to control different logistics shipment operations If they often receive emergency task notifications for shipments to medical facilities, they usually depend on small regional logistics providers to provide customized delivery services Although this improves delivery times, it does not allow for integrated informational services The new GDP regulations for medical materials require suppliers to undergo GDP compliance certification Therefore, Hsinchu Transport, assisted by the Ministry of Economic Affairs' AI coaching program, not only extends existing logistics services compliant with GDP regulations but will also use data integration and optimized AI technologies to help medical material businesses streamline and improve their logistics operations Complex logistics issues are solved using the Simulated Annealing SA algorithm To meet the 'Good Distribution Practices for Medical Devices,' Hsinchu Transport is not only actively introducing new logistics vehicles but will also implement artificial intelligence-based mathematical optimization technologies to assist in intelligent scheduling at nationwide business points and transshipment stations They aim to optimize the routing of medical materials between business points or regions thereby enhancing efficiency in the distribution process Currently, during the transshipment process of medical materials at Hsinchu Transport, detachable tractor heads and containers are used Each business point and transshipment station differ in location design and staffing, impacting the throughput per unit of time Furthermore, daily cargo conditions size, destination vary, and due to these fluctuating and distinct demands, the deployment of tractor heads and containers changes accordingly Under these circumstances, Hsinchu Transport relies on past experiences to schedule departures at each satellite depot and adjusts daily according to the cargo needs Due to the reliance on empirical scheduling, it is often difficult to consider all variables and considerations, leaving room for improvement in the current departure schedules The cargo delivery planning inherently constitutes an NP-Hard problem, difficult to solve with traditional analytical methods Hsinchu Transport, in collaboration with Singular Infinity, utilizes the Simulated Annealing SA algorithm to find solutions The new logistic service introduced by Hsinchu Transport is 'GDP Container Shift Planning' This planning involves estimating future volumes of medical materials between stations and scheduling container truck shifts accordingly, ensuring timely and quality delivery of medical materials while maximizing operational benefits and reducing travel distances Hsinchu Transport introduces AI-optimized shift planning, constructing the most efficient route from its origin to destination Hsinchu Transport introduces 'Optimized Shift Planning' service, reducing transportation costs by 5 The introduction method involves using cloud software services Hsinchu Transport regularly inputs 'Interchange Item Tables' from station to station into the 'Optimized Shift Planning' service After setting the algorithm parameters, a GDP container shift schedule is generated At the same time, developing a Hsinchu Transport medical material scheduling system allows Hsinchu Transport's medical transport units to compile suitable schedules through the Interchange Item Tables Under the same level of service, it's estimated that this can reduce transportation costs by 5, saving medical material businesses millions in construction costs for GDP warehouses and distribution Due to its requirements for sanitation, temperature, and its fragility, the transportation and transshipment of medical materials should be minimized to reduce exposure and risk However, logistics efficiency and costs must still be considered AI designs the most efficient route for each cargo from its origin to destination, effectively completing daily transportation tasks In response to the future high development demand of industrial logistics, distribution and transshipment AI optimization will be a key issue Through this project, a dedicated project promotion organization will be established, staffed with AI technology, IT, and process domain talents After accumulating implementation experience, the application of AI will gradually expand, comprehensively optimizing and transforming Hsinchu Transport's operational system, and partnering with AIOT and various AI domain partners to accelerate and expand the achievement of benefits「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】防患於未然 麗臺科技研發心臟衰竭AI辨識技術可及早發現病徵
Preventing Problems Before They Arise: Leadtek Research Develops AI Technology for Early Detection of Heart Failure Symptoms

With the increase in the elderly population, the incidence of various chronic diseases is rising daily Among these, heart failure is not only a silent killer it has a very long disease course with a high recurrence rate, leading to increased burden on healthcare personnel However, by using medically certified electrocardiography acoustics devices, coupled with AI predictive assessment of heart failure risk and remote care systems, diagnosis can be aided significantly, helping doctors make accurate diagnoses for subsequent patient medical care or referrals Heart failure has a lengthy course and medical expenditure is five times that of diabetes If you find yourself short of breath even with minimal movement, or if you wake up from sleep needing to sit up to feel comfortable, or if you have symptoms such as swollen lower limbs, anxiety, restlessness, fatigue, or a loss of appetite, be cautious These could be signs of heart failure According to statistics, there are about 60 million people with heart failure worldwide, with 5 million new cases every year In China, nearly 290 million people suffer from cardiovascular diseases, accounting for the second leading cause of death among urban residents around 12 million of these are heart failure patients, accounting for over 59 of cardiac-related deaths The disease course of heart failure is exceptionally long, and both its recurrence and rehospitalization rates are exceedingly high, resulting in medical costs that are twice that of hypertension and five times those of diabetes According to US research statistics, the 30-day mortality rates for patients with myocardial infarction and heart failure are respectively 166 and 111, and the rehospitalization rates within 30 days are 199 and 244 The symptoms of heart failure, because they are similar to those of other diseases such as chronic obstructive pulmonary disease and asthma, have an 185 misdiagnosis rate, which poses a challenging problem for healthcare institutions Leadtek, a major graphics card manufacturer, has been investing in the medical and healthcare sector since 2000 Following two heart attacks in 2011 and 2015 experienced by Chairman Lu Kunshan, Leadtek has focused on health big data, independently developing AI technology for heart failure recognition This AI application reads patients' electrocardiograms and phonocardiograms to perform anomaly detection and model prediction of heart failure risk, enabling early detection of disease symptoms Leadtek independently developed heart failure AI recognition technology to predict medical history and risk Leadtek's independently developed heart failure AI recognition technology has the following three judgment functions 1 Prediction of heart failure history Classifies electrocardiogram and phonocardiogram data into 'with hospitalization history of heart failure' and 'no history of heart failure' 2 Risk prediction of heart failure Provides a predictive risk value of heart failure occurrence based on the electrocardiogram and phonocardiogram data 3 Prediction of heart failure recurrence risk For patients with heart failure, it reads their phonocardiogram and electrocardiogram data, assessing the risk prediction of heart failure recurrence Leadtek states that the application of heart failure AI recognition technology can assist doctors in making more efficient and accurate diagnoses, facilitating subsequent medical treatment or referrals for patients As an instance, in studies of heart failure patients discharged from Taipei Veterans General Hospital, using the EMAT Electromechanical Activation Time index and SDI Systolic Dysfunction Index calculated by the synchronized electrocardiography-acoustic device as treatment guidelines resulted in a higher survival rate compared to those treated based on traditional symptoms This research has also been published in the authoritative international cardiology journal JACC, receiving recognition in the international market System manufacturers can apply heart failure AI recognition technology for other value-added applications Leadtek states that cooperating system manufacturers can choose to build their own heart failure AI risk prediction engine, uploading their system's electrocardiogram and phonocardiogram data to Leadtek's heart failure AI risk prediction engine, which then returns risk prediction values for integration by system manufacturers cooperating manufacturers as a value-added application input Not just for clinical use, the heart failure AI risk prediction engine can also be extended for use at home or in the workplace Additionally, this system can be extended to other applications, including One, hospital outpatient screening Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to conduct a 10-second rapid test in outpatient and emergency departments to assess a patient's cardiac history and heart failure risk Two, discharge risk assessment Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to assess the heart failure risk during a patient's hospital stay The test data can serve as a pre-discharge risk assessment and prognostic indicator Three, continuous home care Patients can use the electrocardiogram and phonocardiogram recorder, wearable electrocardiogram recorder, and transmit through a home transmission box gateway to measure electrocardiogram and phonocardiogram signals at home and upload them to the amor health cloud platform for heart failure AI risk prediction analysis Patients can manage their health autonomously via an APP, reviewing historical physiological trends disease management nurses can manage member health through the health management backend Web Four, home rehabilitation training Patients can wear a health bracelet to monitor activity, fatigue, circulation, and sleep, autonomously managing their health through the mobile APP and observing the risk of heart failure, engaging in exercise and rehabilitation training to aid in swift recovery The heart failure AI recognition technology system can also be extended to employee home care applications Additionally, in factories or offices, this system can also achieve employee health management goals, with applications including One, workplace safety units Provide employees with wearable electrocardiogram recorders before they start work duties Two, physiological monitoring for business executors While executing business duties or training, employees wear wearable electrocardiogram recorders for fatigue warnings, signaling whether physiological conditions allow continued execution of tasks Task segments can use data transmission boxes or apps to upload physiological monitoring information to the health management platform, assessing the heart failure risk for operations staff, with test data serving as an indicator for enterprise resource human units and public safety Three, workplace physiological monitoring center care The workplace physiological monitoring center can inspect and record employees' historicalphysiological trends through the health cloud platform Four, workplace nursing units Nursing units receiving instructions from the physiological monitoring center can provide health management advice based on employees' physiological trends nursing centers can manage employee health through the health management backend Web Five, employees can wear health bracelets to monitor activity, fatigue, circulation, and sleep, autonomously managing their health and observing the risk of heart failure through the mobile APP, engaging in exercise and rehabilitation training to aid in rapid recovery Workplace application of heart failure cloud care and big data center diagram「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】維繫遊艇王國美譽 嘉信遊艇導入國內第一套FRP複材超音波智慧檢測
Maintaining the reputation of the “Kingdom of Yachts” - Kha Shing Enterprise introduces the first domestic FRP ultrasonic smart inspection of composite materials

The Kaohsiung-based Kha Shing Enterprise Co, Ltd was established over 40 years ago, and is Taiwan's largest customized yacht company with customers all over America, Europe, Asia, and Australia, earning Taiwan the reputation of the "Kingdom of Yachts" Current FRP hull inspection still relies on traditional methods, such as visual inspection and knocking sounds, which is time-consuming and labor-intensive Kha Shing has applied PAUT array ultrasonic inspection to hull FRP composite materials for the first time, and combined it with AI to interpret ultrasound images, develop complete intelligent solutions, and create emerging markets for inspection companies Kha Shing Enterprise Co, Ltd was formerly Kha Shing Wood Industry Co, Ltd, and was a factory specializing in wood import in Kaohsiung Linhai Industrial Park when it was first established It began to design, manufacture, and sell yachts in 1977 After the second-generation successor of the company, President Kung Chun-Hao entered the company, he made a breakthrough in the previous manufacturing model that relied mainly on the skills of master craftsmen, introduced digital manufacturing to accelerate shipbuilding, and began to make larger yachts, ranking in the top 20 manufacturers worldwide among manufacturers of large yachts over 24 feet It also set a record of delivering 94 yachts within one year, earning Taiwan the reputation of "Kingdom of Yachts" Defect detection ensures yacht quality, using AI to replace humans to achieve higher efficiency Defect detection is very important to ensuring yacht quality At present, the yacht industry still uses very traditional defect detection methods The hull structure is usually made by hand lay-up or the vacuum infusion process, using visual inspection or knocking and the frequency of the sound to determine defects It requires time-consuming manual inspection If there are any defects, they must be reworked and repaired, and a gel coat subsequently sprayed The hull must be constructed in sections to facilitate inspection For large yachts over 24 meters long, construction in sections is very time-consuming and labor-intensive To shorten the time of the yacht manufacturing process, Kha Shing Enterprise will first carry out the gel coating process for the hull, and then perform the hand lay-on process The hull manufacturing process has two types of composite material test specimen structures In terms of 54-foot yacht hulls, the hull contains gel coat, core material, fiber and resin, and the total thickness is about 32cmplusmn01cm, which is twice the total thickness of FRP hull without core material of about 16cmplusmn01cm Defects such as incomplete impregnation of glass fiber or residual air bubbles between glass fiber and resin occasionally occur during the manufacturing process The types of defects include insufficient resin, voids, and delamination Once defects occur, the supply of hull materials will be insufficient and yacht delivery will be delayed Schematic diagram of types of FRP hull In order to solve this problem, Kha Shing Enterprise has engaged in technical cooperated with the metal materials industry and the AI technology industry, combining the ultrasonic inspection expertise of the metal materials industry with AI technologies developed by the AI technology industry in recent years to help solve issues of Kha Shing Enterprise with defect detection The method uses PAUT on the composite material structure of yachts, conducts FRP ultrasonic evaluation to determine the thickness of the yacht hull and material properties, and evaluates the ultrasonic probe frequency applicable to the hull structure based on professional ultrasonic experience After testing, a frequency of 5MHz and a probe width of 45mm can successfully find the location and size of defects in the simulated defect test specimen The three parties jointly found defect detection solutions from array ultrasonic evaluation, AI technology model development, and actual application in yachts The image inspected is an ultrasound image The image displays different colors based on the ultrasonic feedback signal An AI model that automatically identifies defective parts is established through the YOLO algorithm If the amount of abnormal data collected is insufficient for training, the CNN-based Autoencoder algorithm is used to collect normal image data for training and construct an AI model for abnormality detection The object detection YOLO model is trained by inputting image data marked as having defects, while the abnormality detection model is trained by inputting image data without defects Simulated defective specimen corresponding to PAUT results Defect detection by and AI system can shorten the construction period by 15 months and speed up determination by 50 After the development of this AI system is completed, it will be validated on actual 54-foot yachts of Kha Shing Enterprise, and can effectively resolve issues with defects The application of AI technology in ultrasonic inspection for intelligent determination is expected to accelerate determination by approximately 50, and will also shortens the construction period by 15 months, effectively improving the speed and quality of the yacht manufacturing process As Taiwan develops larger and more refined yachts, it will create opportunities for industry optimization and transformation, as well as opportunities for the development of key technologies The application of an AI ultrasonic inspection solution for composite materials is the first of its kind in the yacht industry, and is expected to attract more yacht manufacturers with inspection needs The AI ultrasonic inspection solution for composite materials has three major competitive advantages 1 Professional inspection experience and digital database to facilitate process management and analysis 2 Automatic AI determination and identification quickly identifies defects and provides immediate feedback to process engineers 3 High-efficiency process inspection provides defect repair recommendations, reduces damage rate, and improves the strength and quality of composite materials The application of AI technology can optimize the yacht manufacturing process, reduce manual inspection, create added value through the application of AI in Taiwanrsquos yacht industry, increase international purchase orders, and allow Taiwan yachts to continue to enjoy a good reputation in the world Furthermore, this business model has also spread to fields of application related to composite materials, increasing cross-sector market usage It is estimated to contribute approximately NT14 to NT2 billion in economic benefits to Taiwan's equipment maintenance and non-destructive testing market