:::

【2024 Application Example】 AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOI+AIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue. Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us.

Our company's current development

We are committed toIOTsmart manufacturing; our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems. We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification. After discussing with IT service providers, we defined it asAOI+AIa feasible operational model.

Tzuhong Technology has invested inAOI+AIan inspection plan to checkSMTtext on components, solder joints, polarity, missing parts....and usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates.

Industry pain points

    Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections. Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections. Previous consumer products with undetected anomalies were acceptable within a certain ratio. However, in the automotive industry today, undetected defects could lead to fatalities; hence, the automotive industry has extremely high quality demands. To survive in the automotive supply chain, we must address the issue of undetectable anomalies.

    Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry.

Application technology and explanation

    Initially,(Figure 1)PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products. At this point, the 'suspected defective' portion accounts for20%manual review for these20%parts, further classifying the 'suspected defective' portion into good and defective products. With

    We aim to leverageAItechnology, to shift from manual re-inspection of these20%technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3%thus reducing the workload of Tzuhong's employees from20%down to only3%In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0I+AIDetection(Figure 2)

The original AOI inspection process
The original AOI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI

information on defective products, then manually re-inspect one by one to determine if they are defective.

AOI+AI inspection process
AOI+AI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after,

then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward,

then manually re-inspect one by one to determine if they are defective.

Process differences

    By introducing theAOI+AIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees.

Difference between pre and post-introduction
Difference between pre and post-introduction

Promotion strategy

(1)       Similar field diffusion: allSMTmanufacturers face bottlenecks in inspections leading to shipment delays; introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs.

(2)       Cross-industry expansion plans: negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness.

 

Profit strategy

(1)       In collaboration withAOImanufacturers, collect licensing fees.

(2)       Direct sales toSMTthe manufacturing industryAIsystems.

(3)       ProvideSMTmanufacturing industryAOI+AIsystem subscription model

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-12-09」

Recommend Cases

【導入案例】赫銳特科技VCSEL封裝元件瑕疵導入AOI檢測 提升產能效率20
HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95 VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and ARVR VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics VCSEL technology has a wide range ofnbsp applications, including in drones Pictured Zoyi Technology's Agricultural Drone VCSEL technology has a wide range of applications, AI technology assists in defect detection HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness One of the key problems is the replacement of glass lens with epoxy resin lens The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized The release of stress caused by heat during the mounting process will directly cause the optical lens to break HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important Under the constraints of packaging space, the space for fitting the package and optical lens is limited Moreover, the optical lenses will be confined to a metal frame If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10 in the VCSEL package reliability verification, resulting in an increase in production costs In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality The problem of image collection needs to be solved first to successfully collect image data Therefore, HRT Technology first developed an Automated Optical Inspection AOI device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening Manual labeling is carried out according to the image classification above, including samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out Residual neural network ResNet or other related algorithms are used for deep learning to identify the quality of lenses Implementation of AOI inspection improves production efficiency by 20 and above Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance The lens is packaged on the VCSEL package that has completed die bonding After passing the general light up test, the final reliability test high temperature reflow is performed Failed samples go into the rework process However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95 and above in the reliability verification This is expected to help companies reduce production costs by 10 and increase production efficiency by 20 and above The difference before and after implementing AI image detection HRT Technology pointed out that this technology is an AI application developed based on tiny images It uses deep learning algorithms to identify defects in the images The trained network automatically classifies image data to predetermined categories Defect categories can be determined through reference images, so cumbersome programming is not required In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future

這是一張圖片。 This is a picture.
AI Assists the Red Cross for Smarter Emergency Response

More Preparation Less Loss The Taiwan Food Bank Association, a non-profit organization, collects donations daily from wholesalers, retailers, manufacturers, and even kind-hearted individuals across Taiwan They also rescue consumable materials that are about to be discarded, properly allocate and deliver to households in need, aiding local underprivileged populations When natural disasters such as earthquakes, landslides, mudslides, typhoons, floods, and droughts occur in Taiwan, the food bank's resources can be immediately deployed for disaster relief This field verification unit is the Nantou County Red Cross AssociationOne of the food bank locations, hereinafter referred to as the Nantou Red CrossIs responsible for tasks like pre-disaster supplies preparation and disaster relief material distribution, helping the government bear the responsibility of disaster relief and aid In Taiwan, various natural disasters have characteristics of different duration and spatial coverage, wide or narrow With the normalization of extreme weather, the scale and number of disasters are gradually increasing and becoming harder to predict The required amount and type of materials differ by disaster, and they must address the lifestyles of the affected areas, rescue needs, traffic conditions, geographical restrictions, and other factors for varied material allocation, facing numerous challenges Typhoon Kanu severely damaged transportation in Nantou mountain areas Nantou County Red Cross planned the mountainous route Puli gt Fazhi Elementary School gt Qin'ai Village gt Aowanda to deliver supplies Disasters happen repeatedly We need to be prepared at all times Effective disaster preparedness can mitigate the impact, including swift response to material needs in affected areas, aid distribution, and even psychological support, providing added security for life and property of those in disaster zones Lack of Timeliness in Disaster Information To improve the living conditions and address the lack of supplies in remote areas, the Taiwan Food Bank Association has partnered with the Nantou Red Cross and has successively established food bank points in Nantou City, Puli, and Ren'aiLixing, Ruiyan, XinyiWangmei, Tongfu, Shuili, Lugu and Caotun among others9establish food bank locations, providing supplies worth a certain amount per household every month6001000in New Taiwan Dollars However, many challenges still need to be overcome during natural disasters For example, when typhoons, earthquakes, and landslides occur, the information source for disaster relief dispatch systems relies on post-disaster reports The time lag between reporting, response, and execution prevents timely adjustment and distribution of 'disaster relief' supplies based on the needs of affected areas, affecting rescue efficiency due to lack of timely information The 'preparedness' supplies of the Nantou Red Crosssuch as dry food, water, instant noodles, etc,are recorded manually in terms of stock, expiration dates, and distribution,When a disaster occurs, there is a chance that 'preparedness' supplies have expired and cannot become 'disaster relief' supplies It’s also possible that both conditions mentioned above occur simultaneously, leading to a need for more time to reassign 'preparedness' supplies into usable 'disaster relief' materials On the other hand, upon receiving information about shortages in disaster areas, the supplies donated by the public often grossly differ from the actual needs of the disaster zone, leading to an excess of supplies The Process of Material Operations Before and After a Natural Disaster AIAnticipating Natural Disasters Reinforcing the Accuracy of Preparedness Material Dispatch Application API Technology connects to compute the state of the climate, the intensity of disaster rescues, prioritizing the main tasks of the Nantou Red Cross and the needed areas of search and rescue Coordinated with the existing heavy rain and typhoon simulation disaster training of the Nantou Red Cross, a 'Natural Disaster Emergency Preparedness Material Dispatch and Supplement Decision System' is establishedreferred to as the Emergency Preparedness Material System。 In material management, inventory data along with immediate supply data are entered into the Emergency Preparedness Material System for comparison and analysis, helping the Nantou Red Cross quickly recognize materials like cookiesdry food, beverages, frozen food, toilet paper, etc, and determining whether they should be 'preparedness' materials or regularly distributed materials Adding to this, information forecasting understands the potential disaster conditions in remote areas, facilitating food delivery, addressing both front-end food wastage and backend practical needs When a natural disaster occurs, it enables faster response and decision-making, completing material deployment, hence increasing the speed of material operation transition20。 AI Emergency Preparedness Material System Helps Rapidly Adapt Material Distribution Through the field verification of the Nantou Red CrossAIthe system, material management, and related applications are promoted to more emergency response organizations in different areas, while continuously improving the alert functions within the Emergency Preparedness Material System, strengthening the technological foundation for alerts, enhancing prediction accuracySystem immediacy, and optimizing the data collection and analysis process Simultaneously, it can collaborate with government agencies, meteorological departments, or other rescue teams to discuss integrating more data sources, establishing a mechanism to share resources and data promptly, sharing information in real-time, helping more emergency response organizations enhance their disaster response abilities, seizing the golden rescue time 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【解決方案】連聯合國都買單 悠由數據應用運用農業數據搶攻全球商機
Even the United Nations is on board! Yoyo Data Application captures global business opportunities with agricultural data

Nearly 2,000 days in the fields have made Yoyo Data Application a top player in Taiwan’s agricultural data sector Their comprehensive grasp of crop yields, production periods, and prices has enabled them to collaborate with the United Nations The service area for agricultural land skyrocketed from 24 hectares to over 6,000 hectares in less than three years—a 250-fold increase For Wu Junxiao, founder and CEO of Yoyo Data Application, aligning with global environmental trends and becoming a data company at the intersection of climate technology and the green economy to serve the global market is his ultimate entrepreneurial goal Wu Junxiao, originally an engineer, joined the Industrial Technology Research Institute in 2010, where he honed his profound technical and data science analytic skills 'At that time, I was working in data analysis engineering, and almost all data-related materials would be directed to me Additionally, I worked on indoor cultivation boxes, planting vegetables and mushrooms, hence planting the seed of entrepreneurship by integrating agriculture with data analysis,' Wu recalls Since 2016, Wu Junxiao has been frequently visiting farms to 'embed' himself among farmers and agricultural researchers, chatting and sharing information systematically, which quickly established his agricultural know-how Solid data analysis capabilities have even convinced the United Nations In 2017, he left the Institute to start his own business and founded Yoyo Data Application in 2019 Today, many agricultural businesses are his clients, with service areas rapidly climbing from 24 hectares to over 6,000 hectares, expected to surpass 7,000 hectares in 2022 His clientele includes markets in Japan, Central America, and even entities under the United Nations like the World Farmers Organization, which utilizes the 'Yoyo Crop Algorithm System' supported by Yoyo Data How exactly does Yoyo Data Application manage to impress even UN agencies The 'Yoyo Crop Algorithm System' developed by Yoyo Data Application accurately predicts the production period, yield, and prices Firstly, due to Wu Junxiao's precise mastery over agricultural data, Yoyo Data Application's clients don't necessarily need sensors or other hardware devices 'Sensors are expensive and if you buy cheap devices, you just collect a lot of noise or flawed data, which is useless,' Wu explains He continues, 'Collecting data doesn't necessarily require sensors our data solutions can solve problems more directly and effectively' For instance, one of Yoyo Data Application's products, the Yoyo Money Report Agri-price Linebot, developed in collaboration with LINE in 2020, gathers data on origin, wholesale, and terminal prices spanning over 10 years, driven by Yoyo Data’s proprietary AI algorithms This enables the system to autonomously learn about agricultural product trading prices, using big data and AI to perform price prediction analysis, thereby helping buyers reduce transaction risks and expanding the data application to the entire agricultural supply chain Regarding banana prices, the accuracy of price predictions increased from the original 70 to 998 Wu Junxiao notes that both buyers and farmers are very sensitive to prices Now, through the Yoyo Money Report service, both buyers and farmers can precisely understand the fluctuations in agricultural product prices Yoyo Data can also provide customers with optimal decision-making advice based on predictive models for crop growth, yield, and price estimations Currently, price predictions cover 28 types of crops Precise estimates of production periods and price fluctuations allow Yoyo Data to provide differentiated services based on data analysis The 'Yoyo Crop Algorithm System' provided by Yoyo Data Application incorporates a 'Parameter Bank', usually collecting 200-300 parameters, not just straightforward data like temperature and humidity, but also data divided according to the physiological characteristics of the crops Through effective dynamic data algorithms, it can accurately calculate when crops will flower and when they can be harvested, what the yield will be, and so forth For instance, the prediction accuracy of the broccoli production period is 0-4 days, with the flowering period predicted this year to be precisely 0 days, perfectly matching the actual flowering time in the field In these dynamic calculations, a 7-day range is considered reasonable, and the average error value of Yoyo Data's predictions typically ranges from 2-4 days, with most crop production period accuracies above 80 Through effective dynamic data algorithms, over 120 global crops can have their production periods and yields accurately estimated Using these effective dynamic data algorithms can set estimates for production quantities, helping adjust at the production end Yoyo Data Application's clientele primarily includes exporters of fruit crops like pineapples, bananas, guavas, mangos, pomelos, sugar apples, Taiwan's agricultural production is highly homogenized, often leading to a rush to plant the same crops and resulting in price crashes Yoyo Data Application helps clients differentiate their offerings Thus, Wu Junxiao positions his company as a boutique digital consultant, carefully selecting clients for quality over quantity He notes that Taiwanese agricultural clients focus on how to improve yield rates, even categorizing yield rates by quality, aiming for high-quality, specialized export markets whereas international clients prioritize maximizing per-unit yields, showing different operational approaches in domestic and international markets In addition to agricultural fruit, Yoyo Data Application has also extended its services to the fisheries sector, including species like milkfish, sea bass, and white shrimp, all using the same system to establish various parameters related to the growth of fish and shrimp, such as when to feed and when to harvest, and the anticipated yield, timing, and prices Yoyo Data Application harnesses the power of data to create miracles in smart agriculture In response to the company's rapid development, Yoyo Data Application introduced venture capital funds in 2021 to expand its staff and promote its business Wu Junxiao states that in response to the global trend towards net zero carbon emissions by 2050, he plans to help clients plant carbon in the soil, effectively retaining carbon in the land while also connecting clients to carbon trading platforms, creating environmental business opportunities together Wu Junxiao says that from the start of his entrepreneurial journey, he positioned the company as a global entity, thus continuous international collaborations are planned As a data company serving a global clientele and focused on climate technology and the green economy, this represents Wu’s expectations for himself and his company's long-term goals Yoyo Data Application founder and CEO Wu Junxiao「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」