:::

【2024 Application Example】 AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOI+AIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue. Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us.

Our company's current development

We are committed toIOTsmart manufacturing; our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems. We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification. After discussing with IT service providers, we defined it asAOI+AIa feasible operational model.

Tzuhong Technology has invested inAOI+AIan inspection plan to checkSMTtext on components, solder joints, polarity, missing parts....and usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates.

Industry pain points

    Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections. Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections. Previous consumer products with undetected anomalies were acceptable within a certain ratio. However, in the automotive industry today, undetected defects could lead to fatalities; hence, the automotive industry has extremely high quality demands. To survive in the automotive supply chain, we must address the issue of undetectable anomalies.

    Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry.

Application technology and explanation

    Initially,(Figure 1)PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products. At this point, the 'suspected defective' portion accounts for20%manual review for these20%parts, further classifying the 'suspected defective' portion into good and defective products. With

    We aim to leverageAItechnology, to shift from manual re-inspection of these20%technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3%thus reducing the workload of Tzuhong's employees from20%down to only3%In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0I+AIDetection(Figure 2)

The original AOI inspection process
The original AOI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI

information on defective products, then manually re-inspect one by one to determine if they are defective.

AOI+AI inspection process
AOI+AI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after,

then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward,

then manually re-inspect one by one to determine if they are defective.

Process differences

    By introducing theAOI+AIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees.

Difference between pre and post-introduction
Difference between pre and post-introduction

Promotion strategy

(1)       Similar field diffusion: allSMTmanufacturers face bottlenecks in inspections leading to shipment delays; introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs.

(2)       Cross-industry expansion plans: negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness.

 

Profit strategy

(1)       In collaboration withAOImanufacturers, collect licensing fees.

(2)       Direct sales toSMTthe manufacturing industryAIsystems.

(3)       ProvideSMTmanufacturing industryAOI+AIsystem subscription model

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-12-09」

Recommend Cases

這是一張圖片。 This is a picture.
[2023 Case Study] AI Steps into Philanthropy: Stylish Tech at Food Banks

Taiwan Food Bank AssociationHereinafter referred to as 'the Association'With the mission of providing food aid, poverty relief, reducing food waste, and building a hunger-free network, there are locations across Taiwan that gather donations from wholesalers, intermediaries, retailers, manufacturers, and even generous individuals These sites also rescue food that would otherwise be discarded, properly allocate and distribute it to needy households, thus aiding local vulnerable families55Food banks at various locations collect daily donations from wholesale stores, intermediaries, retailers, manufacturers, and even benevolent individuals from all over Taiwan These places also rescue about-to-be-discarded edible materials, properly sort them, and distribute to needy households, assisting local vulnerable populations However, each location requires significant human and volunteer resources to manage daily operations using traditional methods of communication with non-profit organizations and donors After receiving donations, these resources are then allocated to needy families or individuals There is a potential issue of uneven distribution of resources due to a lack of digitalization and integrated information management in these processes Warehouse and Transportation Centers and Mini Food Banks Distributing Resources to the Disadvantaged The location under validation by the Kaohsiung Charitable Organizations Association,Hereinafter referred to as 'Kaohsiung Charity' In109year6month24Officially inaugurated Taiwan's first 'Food Bank-Warehouse and Transportation Center' at a location measuring200square meters, enhancing the efficiency of food resource redistribution, proper storage, and management So far, nearly two hundred tons of vegetables and fruits have been saved, serving over a hundred organizations and benefiting over5thousand vulnerable households, and continues to serve19mini food banks, with planned completion across multiple districts in Kaohsiung, distributing food resources to over10ten thousand vulnerable families Kaohsiung Charity 'Food Bank-Warehouse and Transportation Center' in the Dasha Community Photo Source Kaohsiung Charitable Organizations Association Challenges in Labor and Food Resource Management Facing the needs of a large number of economically disadvantaged families, the management of the 'Food Bank-Warehouse and Transportation Center' is particularly critical During procurement, tasks such as sorting, purging, and bookkeeping must be performed, while during shipment, food resource needs suggested by social workers must be followed These activities rely on manual judgment and accumulated experience Many volunteers involved are elderly and have limited physical strength, making warehouse tasks physically demanding and recruitment challenging If a large batch of food resources arrives, space and manpower are consumed in sorting and inventory management, raising concerns about the effective use of resources and turnover rate This highlights the challenge of scaling up food bank services while lacking corresponding labor and material management systems At the same time, food bank resources come from various donations, thus they vary greatly in type, shelf life, standards, and quantity Volunteers at mini food banks, mostly also elderly, must handle multiple responsibilities such as case services, food resource management,resource allocation, and resource development Sometimes they must also explain and accept immediate, large quantities of specific resources, such as adults receiving baby formula 'Food Bank-Warehouse and Transportation Center' Resource Inventory Relies Entirely on Manual Labor Mini Food Bank Volunteers Handle Multiple Responsibilities Photo Source Taiwan Food Bank Association Reducing Scrap Resources60 Increasing Speed of Resource Transfer80 To enhance resource management and ensure effective use of materials, and to address personnel shortages, this field validation case has introduced 'Food Bank Warehouse Resource CollectionAITo advance resource management, ensure effective use of resources, and solve manpower shortages, this validation site has implemented an 'Automated Early Warning Needs Assessment System' for the food bank's warehouse resource gathering The first part involves building a classification model, setting up and collecting warehouse information at the site, andAItraining the model Past sitewarehouse information is collected and stored in a database, allowingAIfor preprocessing, classification, and other tasks At the same time, depending on the dependency conditions of the types of goods as features, algorithms are introduced for computation and modeling, and the data collected is used for retraining, ultimately validating the field and organizing data for the five most common types of goods into training and test datasets as required The second part involves constructing the classification model using AI techniques further use of reinforcement learning constructs the management mechanism for the food bank's warehouse, perfecting the classification of donated goodsRNNTechnical construction of classification models further use of reinforcement learning constructs food bank warehouse management mechanisms, making the classification of donated goods perfectlike white rice, instant drinks, noodles, instant noodles, and canned goodscan then be automatically assigned storage based on storage assignment principles AI Service System Process and Description Source Taiwan Food Bank Association AtAIUnder forecasts, it can optimize the speed of resource transfer and allocation, effectively and accurately match resource donations reducing the loss in the donation process, increase the accuracy of resource distribution, and improve the service rate—the successful donation rate—reducing the waste of resources due to incorrect items, and enabling instant monitoring of food resource stock, ensuring operators can respond quickly to needs, effectively providing resource assistance WithAIthe system's introduction and the establishment of data intelligence, it helps the operations of the warehouse and transportation center, allowing more time for the allocation of donated goods The introduction aims to accelerate the digital service rollout for social welfare organizations, thoroughly addressing the needs of the overall vulnerable segments of society Using the system for resource allocation and dispatching Photo Source Kaohsiung Charitable Organizations Association Following this field validation, it is possible to expand the system to other food bank service pointsAIThe system can also collaborate with more non-profit organizations, public welfare groups, and charitable organizations, expanding 'Food Bank Warehouse Resource CollectionAIAutomated Early Warning Demand Assessment System' application range such as medical supply distribution, helping more organizations manage and distribute more intelligently, reducing resource wastage, and enhancing social welfare 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【導入案例】海量數位工程AOI機器智能手臂檢測系統 大幅提高瑕疵檢測精準度
Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection Generally, the yield rate of products affects the costs for enterprises and the return rate for customers The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor Although there is AOI equipment to assist, these tools are mostly fixed detection machines Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5, and can be as high as 20 Three major pain points in manufacturing quality detection Robotic Arm AOI with dynamic multi-angle inspection helps to solve these issues According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry Pain point one, manual inspection of product quality is prone to errors Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production Pain point two, inability to quantify and record data from quality inspections Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet Pain point three, limitations of traditional AOI visual inspection systems Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations This method may handle flat or linear-shaped products like rectangular or square items at a single inspection point However, it is more challenging to implement for products with complex shapes eg, irregular automotive parts, requiring multi-point and multi-degree inspections Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular Selected the automotive industry as the real-world testing ground to quickly respond to customer needs The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates Automotive components are high in unit price and demand a stricter defect detection accuracy In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy Therefore, the automotive sector was chosen as the area for introduction By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs Helps to reduce communication costs and aims to become an industry standard In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis Data Analysis, based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain Supply Chain more swiftly Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application Self-driving vehicle developed by Massive Digital Engineering「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】巨量遙測空間數據AI分析雲端服務平台 使衛星遙測影像順利落地應用
AI Analysis Cloud Service Platform for Remote Sensing Big Data Enables the Smooth Application of Satellite Remote Sensing Images

Although satellite remote sensing images can make all surface objects visible, it still requires a lot of time and manpower to be truly applied to the industry In order to effectively solve the problems that customers face in digesting huge amounts of image data and eliminate technical obstacles for cross-domain users to process satellite remote sensing images, ThinkTron has developed an "AI Analysis Cloud Service Platform for Remote Sensing Big Data" as a new beginning for cross-domain AI applications for spatial information In recent years, in response to the impact of industrial globalization, Taiwan's agriculture has continued to transition towards technology-based and higher quality, improving the yield and quality of crops by solving problems, such as microclimate impacts and pest and disease control The demand of agriculture on images has expanded endlessly to accurately grasp the growing environment of crops In the early years when UAVs unmanned aerial vehicles were not yet popular, manual field surveys were the most basic but most labor-intensive work With the emergence of UAV drones, aerial photography operations might not be difficult, but the range that can be photographed is limited Furthermore, surveying expertise is required to accurately capture spatial information At this time, the use of satellite remote sensing data may break away from the past imagination of using image data Taiwan Space Agency TASA ODC data warehouse services In the past ten years, with the breakthrough of modern satellite remote sensing application technology, Digital Earth has become a new trend in global data collection Countries have developed data cube image storage technology, and the development of smart agriculture has become one of the largest image users Determining planting distribution is the first step in understanding crop yields Free satellite remote sensing images, powerful data warehousing support, and the team's robust image recognition technology are important supports for accelerating agricultural transformation Using satellite remote sensing image data can accelerate the development of smart agriculture However, in the past, it was difficult to extract large-area crop distribution through satellite remote sensing images, not to mention the cost If you wanted to use free information, you had to visit all websites of international space agencies, look through the wide variety of satellite specifications, and carefully evaluate the sensor specifications, image resolution, and revisit cycle After finding suitable images, you had to look at them one by one to filter the ones you need Next is downloading dozens of images that are often several hundreds of Megabytes MB each, which might exceed the capacity of your computer Also, after overcoming image access and preparing data, you must then start to confirm the downloaded image products and which bands you want, because the image you see is not just an image file jpg or png, but rather complex multi-spectral information, attribute fields and coordinate information It takes a lot of effort just to confirm the correct information Facing GIS software packages with complex functions is the start of another trouble The complex image pre-processing process and the inflexible machine learning package greatly reduce the efficiency of analyzing data After finally getting the results of crop identification, you might find that the best time for using map information may have already passed The above-mentioned complex and time-consuming satellite image processing problems are precisely the pain points of the market ThinkTron expanded from traditional machine learning to modern deep learning applications, and developed an "AI Analysis Cloud Service Platform for Remote Sensing Big Data" under the GeoAI framework, breaking through the constraints of details in the spatial information for customers Differences between the process before and after introducing the AI analysis cloud service platform ThinkTron said that Taiwan's ODC Open Data Cube system has been completed and began providing services after years of efforts from the Taiwan Space Agency TASA, formally becoming aligned with international trends The powerful warehousing technology allows users to easily capture and use image data of a specific time and spatial range according to their needs The warehouse stores multiple satellite image resources from international space agencies, including the ESA's Sentinel-1 one image every 6 days, Sentinel-2 one image every 6 days, USGS's Landsat-7 one image every 16 days, Landsat-8 one image every 16 days, and the domestic Formosat-2 one image every day and Formosat-5 one image every 2 days ThinkTron develops satellite image recognition tools based on Python Breaking free from the limitations of GIS Geographic Information System software packages, ThinkTron integrated GDAL Geospatial Data Abstraction Library based on Python, and considered computing efficiency and parallel processing when developing all tools required for satellite image processing and image recognition modeling, including coordinate system and data format conversion, grid and vector data interaction, and data intra-difference and normalization All of the tools are designed with AI applications in mind, and some commonly used tools are packaged into an open source package under the name TronGisPy to benefit the technical community ThinkTron utilized the team's understanding of satellite remote sensing images and the collected tagged data crop distribution maps to preset the image recognition modeling process, the required training data specifications, and dataset definitions This is imported into the machine learning LightGBM or deep learning CNN framework that was completed in advance, and the entire training process to be performed in the Web GIS interface, providing users with partial flexibility to freely filter images, confirm spatial and temporal ranges, select models, and adjust hyperparameters In addition to the operation of training models, it also provides historical models to output identification results, and finally displays the identification results of crop distribution on the Web GIS map In fact, agriculture is not the only industry that needs satellite remote sensing applications AI applications of spatial information have also appeared in various fields as companies in different industries aim to enhance their global competitiveness For example, surveying and mapping companies that have a large amount of map data can use the AI analysis cloud service platform to store map data while also accelerating the efficiency of digital mapping Under the severe global climate change and the risk of strong earthquakes, there is a wide variety industrial insurance, agricultural insurance, financial insurance, or disaster insurance are all inseparable from spatial information The use of remote sensing image recognition to understand insurance targets has long been an international trend AI Analysis Cloud Service Architecture for Remote Sensing Big Data