:::

【2024 Application Example】 AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOI+AIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue. Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us.

Our company's current development

We are committed toIOTsmart manufacturing; our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems. We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification. After discussing with IT service providers, we defined it asAOI+AIa feasible operational model.

Tzuhong Technology has invested inAOI+AIan inspection plan to checkSMTtext on components, solder joints, polarity, missing parts....and usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates.

Industry pain points

    Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections. Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections. Previous consumer products with undetected anomalies were acceptable within a certain ratio. However, in the automotive industry today, undetected defects could lead to fatalities; hence, the automotive industry has extremely high quality demands. To survive in the automotive supply chain, we must address the issue of undetectable anomalies.

    Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry.

Application technology and explanation

    Initially,(Figure 1)PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products. At this point, the 'suspected defective' portion accounts for20%manual review for these20%parts, further classifying the 'suspected defective' portion into good and defective products. With

    We aim to leverageAItechnology, to shift from manual re-inspection of these20%technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3%thus reducing the workload of Tzuhong's employees from20%down to only3%In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0I+AIDetection(Figure 2)

The original AOI inspection process
The original AOI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI

information on defective products, then manually re-inspect one by one to determine if they are defective.

AOI+AI inspection process
AOI+AI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after,

then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward,

then manually re-inspect one by one to determine if they are defective.

Process differences

    By introducing theAOI+AIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees.

Difference between pre and post-introduction
Difference between pre and post-introduction

Promotion strategy

(1)       Similar field diffusion: allSMTmanufacturers face bottlenecks in inspections leading to shipment delays; introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs.

(2)       Cross-industry expansion plans: negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness.

 

Profit strategy

(1)       In collaboration withAOImanufacturers, collect licensing fees.

(2)       Direct sales toSMTthe manufacturing industryAIsystems.

(3)       ProvideSMTmanufacturing industryAOI+AIsystem subscription model

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-12-09」

Recommend Cases

這是一張圖片。 This is a picture.
[2023 Case Study] AI Steps into Philanthropy: Stylish Tech at Food Banks

Taiwan Food Bank AssociationHereinafter referred to as 'the Association'With the mission of providing food aid, poverty relief, reducing food waste, and building a hunger-free network, there are locations across Taiwan that gather donations from wholesalers, intermediaries, retailers, manufacturers, and even generous individuals These sites also rescue food that would otherwise be discarded, properly allocate and distribute it to needy households, thus aiding local vulnerable families55Food banks at various locations collect daily donations from wholesale stores, intermediaries, retailers, manufacturers, and even benevolent individuals from all over Taiwan These places also rescue about-to-be-discarded edible materials, properly sort them, and distribute to needy households, assisting local vulnerable populations However, each location requires significant human and volunteer resources to manage daily operations using traditional methods of communication with non-profit organizations and donors After receiving donations, these resources are then allocated to needy families or individuals There is a potential issue of uneven distribution of resources due to a lack of digitalization and integrated information management in these processes Warehouse and Transportation Centers and Mini Food Banks Distributing Resources to the Disadvantaged The location under validation by the Kaohsiung Charitable Organizations Association,Hereinafter referred to as 'Kaohsiung Charity' In109year6month24Officially inaugurated Taiwan's first 'Food Bank-Warehouse and Transportation Center' at a location measuring200square meters, enhancing the efficiency of food resource redistribution, proper storage, and management So far, nearly two hundred tons of vegetables and fruits have been saved, serving over a hundred organizations and benefiting over5thousand vulnerable households, and continues to serve19mini food banks, with planned completion across multiple districts in Kaohsiung, distributing food resources to over10ten thousand vulnerable families Kaohsiung Charity 'Food Bank-Warehouse and Transportation Center' in the Dasha Community Photo Source Kaohsiung Charitable Organizations Association Challenges in Labor and Food Resource Management Facing the needs of a large number of economically disadvantaged families, the management of the 'Food Bank-Warehouse and Transportation Center' is particularly critical During procurement, tasks such as sorting, purging, and bookkeeping must be performed, while during shipment, food resource needs suggested by social workers must be followed These activities rely on manual judgment and accumulated experience Many volunteers involved are elderly and have limited physical strength, making warehouse tasks physically demanding and recruitment challenging If a large batch of food resources arrives, space and manpower are consumed in sorting and inventory management, raising concerns about the effective use of resources and turnover rate This highlights the challenge of scaling up food bank services while lacking corresponding labor and material management systems At the same time, food bank resources come from various donations, thus they vary greatly in type, shelf life, standards, and quantity Volunteers at mini food banks, mostly also elderly, must handle multiple responsibilities such as case services, food resource management,resource allocation, and resource development Sometimes they must also explain and accept immediate, large quantities of specific resources, such as adults receiving baby formula 'Food Bank-Warehouse and Transportation Center' Resource Inventory Relies Entirely on Manual Labor Mini Food Bank Volunteers Handle Multiple Responsibilities Photo Source Taiwan Food Bank Association Reducing Scrap Resources60 Increasing Speed of Resource Transfer80 To enhance resource management and ensure effective use of materials, and to address personnel shortages, this field validation case has introduced 'Food Bank Warehouse Resource CollectionAITo advance resource management, ensure effective use of resources, and solve manpower shortages, this validation site has implemented an 'Automated Early Warning Needs Assessment System' for the food bank's warehouse resource gathering The first part involves building a classification model, setting up and collecting warehouse information at the site, andAItraining the model Past sitewarehouse information is collected and stored in a database, allowingAIfor preprocessing, classification, and other tasks At the same time, depending on the dependency conditions of the types of goods as features, algorithms are introduced for computation and modeling, and the data collected is used for retraining, ultimately validating the field and organizing data for the five most common types of goods into training and test datasets as required The second part involves constructing the classification model using AI techniques further use of reinforcement learning constructs the management mechanism for the food bank's warehouse, perfecting the classification of donated goodsRNNTechnical construction of classification models further use of reinforcement learning constructs food bank warehouse management mechanisms, making the classification of donated goods perfectlike white rice, instant drinks, noodles, instant noodles, and canned goodscan then be automatically assigned storage based on storage assignment principles AI Service System Process and Description Source Taiwan Food Bank Association AtAIUnder forecasts, it can optimize the speed of resource transfer and allocation, effectively and accurately match resource donations reducing the loss in the donation process, increase the accuracy of resource distribution, and improve the service rate—the successful donation rate—reducing the waste of resources due to incorrect items, and enabling instant monitoring of food resource stock, ensuring operators can respond quickly to needs, effectively providing resource assistance WithAIthe system's introduction and the establishment of data intelligence, it helps the operations of the warehouse and transportation center, allowing more time for the allocation of donated goods The introduction aims to accelerate the digital service rollout for social welfare organizations, thoroughly addressing the needs of the overall vulnerable segments of society Using the system for resource allocation and dispatching Photo Source Kaohsiung Charitable Organizations Association Following this field validation, it is possible to expand the system to other food bank service pointsAIThe system can also collaborate with more non-profit organizations, public welfare groups, and charitable organizations, expanding 'Food Bank Warehouse Resource CollectionAIAutomated Early Warning Demand Assessment System' application range such as medical supply distribution, helping more organizations manage and distribute more intelligently, reducing resource wastage, and enhancing social welfare 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

這是一張圖片。 This is a picture.
CCTV Intelligent Video Search System

Search for a specific person, find someone with a suitcase entering the factory in Gao'an area Color features of the person and the object confirmed, person in blue and black top, suitcase in black color, throughCCTV the intelligent video search system, by setting object and color retrieval conditions, it can successfully locate three video clips containing the target subject This greatly aids operational staff in finding the target items, and through this system, search speed can far surpass manual effort6fold Pain Points The CSE-Kaohsiung Plant is densely equippedCCTVto monitor every corner of the plant area, but when an incidenthappens, it's impossible within a limited time throughCCTVvideo playback to find the incident, the implications and risks behind this are self-evident Many areas that are usually unmanned can easily become security blind spots Thus, how to monitor a vast plant area more intelligently and effectively is one of the crucial aspects of building a smart plant for the semiconductor industry The AES Plant in Kaohsiung covers a vast area, with many important sites requiring monitoring of personnel movements to ensure corporate secrets and employee safety 1 Automated production lines and warehouses In semiconductor enterprises’ automated production lines and warehouses, oftenAGV(Automated Guided VehicleAGVs automated guided vehicles travel at high speeds if plant personnel inadvertently enterAGVthe moving area and cannot issue a warning to the person, then the regrettable accidents that occur will be too late to reverse 2 Material and product storage areas Materials used in semiconductor-related processes are costly if areas storing materials or products are breached, there is a risk of loss of high-value materialsproducts 3 High-security areas Trade secrets relate to the core technological competitiveness of semiconductor-related enterprises if someone breaches the high-security areas, there is a risk of corporate secrets being leaked The safety of trade secrets has always been one of the most critical issues for semiconductor enterprises 4 Loading docks At AESLButthe dock area often has loading vehicles coming and going if someone intrudes into the dock area, there is a risk of vehicle collisions and accidents Additionally, goods awaiting shipment at the dock area could be stolen or potentially damaged from collisions, thus causing significant reputation and financial losses for the company, further leading to production and shipping inconvenience When an abnormal event occurs, how to quickly search for the relevant key footage from massive data Many important locations within the AES Kaohsiung Plant need to be equippedCCTVfor safety checks, butCCTVWith thousands to tens of thousands of cameras, manually searching through footage for an event requires laborious frame-by-frame review which is time-consuming and inefficient In light of advancements in computer vision, it's beneficial to utilizeAIto replace manual playback and searching Problem Scenario Object Detection The data source for object detection comprises two parts Open-source datasetsOIDv4and AES Kaohsiung PlantCCTVImage files For these files, search for usable data, specificallyOIDv4image files For these files, extract the defined nine major categories of objects for training data among them, two object categories, knives and gasoline barrels, were not found inOIDv4found usable data for knives and gasoline barrels, while the remaining seven categories of objects are available fromOIDv4useful training data found for the remaining seven categories of objects, all marked Regarding the Kaohsiung PlantCCTVimage files, select some frames Frame of the footage, and manually annotate the objects to be_detected for training and testing data Nine Major Objects Color Recognition The data source for color recognition is divided into two partsInternet image screenshots, and Kaohsiung PlantCCTVimage files Currently, no publicly available open-source datasets specifically for color recognition applications have been found, so images are collected from the web Search the web for images of the defined nine major object categories, save the images after separating the objects from the background, keeping only the object sections, and mark the images according to color Additionally, for the Kaohsiung PlantCCTVimage files, use the already-markedbounding boxextractCCTVimage files from variousFramesections of objects identified by color, and finally, visually identifiable images are marked according to color Each object category has its specific color definition, depending on the usual colors seen in these objects in real life Dynamic Ignore during Training FromOIDv4during the training of the object detection pilot model, since each image in this dataset is only marked for a single category, but the image may contain other desired detection categories unmarked For such cases, dynamic ignore techniques will be employed during training to avoid confusion Next, use the extracted training data from the Kaohsiung Plant toFine-Tuneenhance the detection rate of the object in specific designated areas Finally, select the model that computes the lowest loss value in the test set during the training process as the main object_detection model Dynamic Ignoring AIHelp You View CCTV The intelligent video search system primarily serves as an assistive system for searching surveillance footage, capable of speeding up the process of finding target events by setting search conditions for objects By simply defining the search conditions, you can quickly produce thumbnails of critical objects and playback for review, shortening the time required for manual case retrieval of the past The search time is quickly6doubled, allowing the front-end security unit to use this platform to strengthen the first line of risk management supervision and take timely preventive measures 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【解決方案】連聯合國都買單 悠由數據應用運用農業數據搶攻全球商機
Even the United Nations is on board! Yoyo Data Application captures global business opportunities with agricultural data

Nearly 2,000 days in the fields have made Yoyo Data Application a top player in Taiwan’s agricultural data sector Their comprehensive grasp of crop yields, production periods, and prices has enabled them to collaborate with the United Nations The service area for agricultural land skyrocketed from 24 hectares to over 6,000 hectares in less than three years—a 250-fold increase For Wu Junxiao, founder and CEO of Yoyo Data Application, aligning with global environmental trends and becoming a data company at the intersection of climate technology and the green economy to serve the global market is his ultimate entrepreneurial goal Wu Junxiao, originally an engineer, joined the Industrial Technology Research Institute in 2010, where he honed his profound technical and data science analytic skills 'At that time, I was working in data analysis engineering, and almost all data-related materials would be directed to me Additionally, I worked on indoor cultivation boxes, planting vegetables and mushrooms, hence planting the seed of entrepreneurship by integrating agriculture with data analysis,' Wu recalls Since 2016, Wu Junxiao has been frequently visiting farms to 'embed' himself among farmers and agricultural researchers, chatting and sharing information systematically, which quickly established his agricultural know-how Solid data analysis capabilities have even convinced the United Nations In 2017, he left the Institute to start his own business and founded Yoyo Data Application in 2019 Today, many agricultural businesses are his clients, with service areas rapidly climbing from 24 hectares to over 6,000 hectares, expected to surpass 7,000 hectares in 2022 His clientele includes markets in Japan, Central America, and even entities under the United Nations like the World Farmers Organization, which utilizes the 'Yoyo Crop Algorithm System' supported by Yoyo Data How exactly does Yoyo Data Application manage to impress even UN agencies The 'Yoyo Crop Algorithm System' developed by Yoyo Data Application accurately predicts the production period, yield, and prices Firstly, due to Wu Junxiao's precise mastery over agricultural data, Yoyo Data Application's clients don't necessarily need sensors or other hardware devices 'Sensors are expensive and if you buy cheap devices, you just collect a lot of noise or flawed data, which is useless,' Wu explains He continues, 'Collecting data doesn't necessarily require sensors our data solutions can solve problems more directly and effectively' For instance, one of Yoyo Data Application's products, the Yoyo Money Report Agri-price Linebot, developed in collaboration with LINE in 2020, gathers data on origin, wholesale, and terminal prices spanning over 10 years, driven by Yoyo Data’s proprietary AI algorithms This enables the system to autonomously learn about agricultural product trading prices, using big data and AI to perform price prediction analysis, thereby helping buyers reduce transaction risks and expanding the data application to the entire agricultural supply chain Regarding banana prices, the accuracy of price predictions increased from the original 70 to 998 Wu Junxiao notes that both buyers and farmers are very sensitive to prices Now, through the Yoyo Money Report service, both buyers and farmers can precisely understand the fluctuations in agricultural product prices Yoyo Data can also provide customers with optimal decision-making advice based on predictive models for crop growth, yield, and price estimations Currently, price predictions cover 28 types of crops Precise estimates of production periods and price fluctuations allow Yoyo Data to provide differentiated services based on data analysis The 'Yoyo Crop Algorithm System' provided by Yoyo Data Application incorporates a 'Parameter Bank', usually collecting 200-300 parameters, not just straightforward data like temperature and humidity, but also data divided according to the physiological characteristics of the crops Through effective dynamic data algorithms, it can accurately calculate when crops will flower and when they can be harvested, what the yield will be, and so forth For instance, the prediction accuracy of the broccoli production period is 0-4 days, with the flowering period predicted this year to be precisely 0 days, perfectly matching the actual flowering time in the field In these dynamic calculations, a 7-day range is considered reasonable, and the average error value of Yoyo Data's predictions typically ranges from 2-4 days, with most crop production period accuracies above 80 Through effective dynamic data algorithms, over 120 global crops can have their production periods and yields accurately estimated Using these effective dynamic data algorithms can set estimates for production quantities, helping adjust at the production end Yoyo Data Application's clientele primarily includes exporters of fruit crops like pineapples, bananas, guavas, mangos, pomelos, sugar apples, Taiwan's agricultural production is highly homogenized, often leading to a rush to plant the same crops and resulting in price crashes Yoyo Data Application helps clients differentiate their offerings Thus, Wu Junxiao positions his company as a boutique digital consultant, carefully selecting clients for quality over quantity He notes that Taiwanese agricultural clients focus on how to improve yield rates, even categorizing yield rates by quality, aiming for high-quality, specialized export markets whereas international clients prioritize maximizing per-unit yields, showing different operational approaches in domestic and international markets In addition to agricultural fruit, Yoyo Data Application has also extended its services to the fisheries sector, including species like milkfish, sea bass, and white shrimp, all using the same system to establish various parameters related to the growth of fish and shrimp, such as when to feed and when to harvest, and the anticipated yield, timing, and prices Yoyo Data Application harnesses the power of data to create miracles in smart agriculture In response to the company's rapid development, Yoyo Data Application introduced venture capital funds in 2021 to expand its staff and promote its business Wu Junxiao states that in response to the global trend towards net zero carbon emissions by 2050, he plans to help clients plant carbon in the soil, effectively retaining carbon in the land while also connecting clients to carbon trading platforms, creating environmental business opportunities together Wu Junxiao says that from the start of his entrepreneurial journey, he positioned the company as a global entity, thus continuous international collaborations are planned As a data company serving a global clientele and focused on climate technology and the green economy, this represents Wu’s expectations for himself and his company's long-term goals Yoyo Data Application founder and CEO Wu Junxiao「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」