:::

【2021 Application Example】 Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines. While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates. Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection.

Generally, the yield rate of products affects the costs for enterprises and the return rate for customers. The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor. Although there is AOI equipment to assist, these tools are mostly fixed detection machines. Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates. Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5%, and can be as high as 20%.

Three major pain points in manufacturing quality detection: Robotic Arm + AOI with dynamic multi-angle inspection helps to solve these issues

According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry:

Pain point one, manual inspection of product quality is prone to errors. Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc. The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production.

Pain point two, inability to quantify and record data from quality inspections. Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur. Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet.

Pain point three, limitations of traditional AOI visual inspection systems. Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations. This method may handle flat or linear-shaped products (like rectangular or square items) at a single inspection point. However, it is more challenging to implement for products with complex shapes (e.g., irregular automotive parts), requiring multi-point and multi-degree inspections.

Massive Digital Engineering developed an AOI intelligent robotic arm detection system that effectively improves the accuracy of defect detection.

▲Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection.

To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision. By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular.

Selected the automotive industry as the real-world testing ground to quickly respond to customer needs

The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses. This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates.

▲Automotive components are high in unit price and demand a stricter defect detection accuracy.

In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground. Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy. Therefore, the automotive sector was chosen as the area for introduction. By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries; and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise.

This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production. At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs.

Helps to reduce communication costs and aims to become an industry standard

In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain. Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration. Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis (Data Analysis), based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality. In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain (Supply Chain) more swiftly.

Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard. Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application.

▲Self-driving vehicle developed by Massive Digital Engineering

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

這是一張圖片。 This is a picture.
[2023 Case Study] AI Steps into Philanthropy: Stylish Tech at Food Banks

Taiwan Food Bank AssociationHereinafter referred to as 'the Association'With the mission of providing food aid, poverty relief, reducing food waste, and building a hunger-free network, there are locations across Taiwan that gather donations from wholesalers, intermediaries, retailers, manufacturers, and even generous individuals These sites also rescue food that would otherwise be discarded, properly allocate and distribute it to needy households, thus aiding local vulnerable families55Food banks at various locations collect daily donations from wholesale stores, intermediaries, retailers, manufacturers, and even benevolent individuals from all over Taiwan These places also rescue about-to-be-discarded edible materials, properly sort them, and distribute to needy households, assisting local vulnerable populations However, each location requires significant human and volunteer resources to manage daily operations using traditional methods of communication with non-profit organizations and donors After receiving donations, these resources are then allocated to needy families or individuals There is a potential issue of uneven distribution of resources due to a lack of digitalization and integrated information management in these processes Warehouse and Transportation Centers and Mini Food Banks Distributing Resources to the Disadvantaged The location under validation by the Kaohsiung Charitable Organizations Association,Hereinafter referred to as 'Kaohsiung Charity' In109year6month24Officially inaugurated Taiwan's first 'Food Bank-Warehouse and Transportation Center' at a location measuring200square meters, enhancing the efficiency of food resource redistribution, proper storage, and management So far, nearly two hundred tons of vegetables and fruits have been saved, serving over a hundred organizations and benefiting over5thousand vulnerable households, and continues to serve19mini food banks, with planned completion across multiple districts in Kaohsiung, distributing food resources to over10ten thousand vulnerable families Kaohsiung Charity 'Food Bank-Warehouse and Transportation Center' in the Dasha Community Photo Source Kaohsiung Charitable Organizations Association Challenges in Labor and Food Resource Management Facing the needs of a large number of economically disadvantaged families, the management of the 'Food Bank-Warehouse and Transportation Center' is particularly critical During procurement, tasks such as sorting, purging, and bookkeeping must be performed, while during shipment, food resource needs suggested by social workers must be followed These activities rely on manual judgment and accumulated experience Many volunteers involved are elderly and have limited physical strength, making warehouse tasks physically demanding and recruitment challenging If a large batch of food resources arrives, space and manpower are consumed in sorting and inventory management, raising concerns about the effective use of resources and turnover rate This highlights the challenge of scaling up food bank services while lacking corresponding labor and material management systems At the same time, food bank resources come from various donations, thus they vary greatly in type, shelf life, standards, and quantity Volunteers at mini food banks, mostly also elderly, must handle multiple responsibilities such as case services, food resource management,resource allocation, and resource development Sometimes they must also explain and accept immediate, large quantities of specific resources, such as adults receiving baby formula 'Food Bank-Warehouse and Transportation Center' Resource Inventory Relies Entirely on Manual Labor Mini Food Bank Volunteers Handle Multiple Responsibilities Photo Source Taiwan Food Bank Association Reducing Scrap Resources60 Increasing Speed of Resource Transfer80 To enhance resource management and ensure effective use of materials, and to address personnel shortages, this field validation case has introduced 'Food Bank Warehouse Resource CollectionAITo advance resource management, ensure effective use of resources, and solve manpower shortages, this validation site has implemented an 'Automated Early Warning Needs Assessment System' for the food bank's warehouse resource gathering The first part involves building a classification model, setting up and collecting warehouse information at the site, andAItraining the model Past sitewarehouse information is collected and stored in a database, allowingAIfor preprocessing, classification, and other tasks At the same time, depending on the dependency conditions of the types of goods as features, algorithms are introduced for computation and modeling, and the data collected is used for retraining, ultimately validating the field and organizing data for the five most common types of goods into training and test datasets as required The second part involves constructing the classification model using AI techniques further use of reinforcement learning constructs the management mechanism for the food bank's warehouse, perfecting the classification of donated goodsRNNTechnical construction of classification models further use of reinforcement learning constructs food bank warehouse management mechanisms, making the classification of donated goods perfectlike white rice, instant drinks, noodles, instant noodles, and canned goodscan then be automatically assigned storage based on storage assignment principles AI Service System Process and Description Source Taiwan Food Bank Association AtAIUnder forecasts, it can optimize the speed of resource transfer and allocation, effectively and accurately match resource donations reducing the loss in the donation process, increase the accuracy of resource distribution, and improve the service rate—the successful donation rate—reducing the waste of resources due to incorrect items, and enabling instant monitoring of food resource stock, ensuring operators can respond quickly to needs, effectively providing resource assistance WithAIthe system's introduction and the establishment of data intelligence, it helps the operations of the warehouse and transportation center, allowing more time for the allocation of donated goods The introduction aims to accelerate the digital service rollout for social welfare organizations, thoroughly addressing the needs of the overall vulnerable segments of society Using the system for resource allocation and dispatching Photo Source Kaohsiung Charitable Organizations Association Following this field validation, it is possible to expand the system to other food bank service pointsAIThe system can also collaborate with more non-profit organizations, public welfare groups, and charitable organizations, expanding 'Food Bank Warehouse Resource CollectionAIAutomated Early Warning Demand Assessment System' application range such as medical supply distribution, helping more organizations manage and distribute more intelligently, reducing resource wastage, and enhancing social welfare 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【解決方案】優式AI智能割草機器人 搶攻高爾夫藍海市場
USRROBOT's AI Lawn Mowing Robot Enters the Blue Ocean of Golf Market

An AI smart lawn mowing robot, resembling a vacuum robot, shuttles back and forth on the 30-hectare golf course lawn for weeding This robot, independently developed and designed by Taiwanese, is equipped with the world's first electronic fencing positioning technology which utilizes high-precision GPS integrated with cloud AI computation to determine the most efficient mowing paths, targeting the lucrative blue ocean market of golf courses This AI lawn mowing robot was developed by USRROBOT, a Taiwanese startup established in 2019 Chao-Cheng Chen, the president of USRROBOT, once served as the executive vice president of one of the top five ODM tech companies in Taiwan, and specializes in software and hardware integration When he served as the chairman of the Service Robot Alliance, he knew that the service robot industry was bound grow rapidly due to declining birth rates and the growingly severe labor shortage New demand - The horticulture market is large and the has rigid demand "To develop the core technology of service robots, we must find rigid demand Looking at European and American countries, there is a shortage of labor, but demand for horticulture has increased, and there has been a long-term shortage of 7-10 of horticultural workers" Under this strong "rigid demand," Chao-Cheng Chen established USRROBOT, and the company's first product is the AI lawn mowing robot In terms of overseas markets, the United States is the world's largest horticulture market, accounting for 30-40 of the global output value It is estimated that there are about 1 million horticulture workers, but they have been experiencing a labor shortage of 7-10 in recent years and have not been able to improve the situation The main reasons for labor shortage are Aging population and gardening is a labor-intensive job, so young people don't want to do it Unlike in Taiwan, European and American countries attach great importance to lawn maintenance and have expressly stipulated in the law that heavy fines will be imposed for failing to mow the lawn Therefore, the AI lawn mowing robot has considerable market development potential The introduction of AI multi-device collaborative mowing sensor technology is expected to reduce the burden of staff maintaining the golf course The AI lawn mowing robot developed by USRROBOT is currently in its second generation Domestic universities and well-known art museums are using the latest model M1, and it is also being used by some world-renowned high-tech companies and well-known universities in the United States The company is currently involved in negotiations for subsequent business cooperation USRROBOT stated that the professional RTK system currently used can reduce the original GPS positioning error from tens of meters to about 2 centimeters, allowing the robot to move accurately outdoors After setting the boundaries, it can be easily operated using the app New application - Implementation in golf courses solves the problem of labor aging and shortage Chao-Cheng Chen further explained that the National Land Surveying and Mapping Center is a RTK service provider RTK provides the error reference map of the positioning point USRROBOT can access the positioning error value of a specific position through 4G Internet access The AI algorithm of USRROBOT reduces the general 10-20 m error of GPS to 2 cm After positioning, USRROBOT then uses six-axis accelerator positioning, gyroscopes, and wheel differential sensing devices for software and hardware integration Only by matching the wheel's movement pattern and the terrain can accurate mowing path planning be achieved The AI lawn mowing robot, which is 62 cm wide, 84 cm long, 46 cm high, and weighs only 25 kg, can set the mowing boundaries in the cloud It can avoid pools and sand pits through settings, using AI algorithms to automatically calculate the optimal path It is able to mow approximately 150 ping of grass in one hour The battery can be used continuously for more than 6 hours The battery life is currently the highest in the world In addition to general gardening companies, with the assistance of the AI project team of the Industrial Development Bureau, Ministry of Economic Affairs, USRROBOT's AI lawn mowing robot has been applied to golf course lawn mowing A well-known golf course located in Taiping District, Taichung City currently has a staff of 5 people who are responsible for the lawn, planting maintenance, and other landscape maintenance of the entire 30-hectare course However, the average age of staff is as high as 55 years old, and the golf course has been unable to recruit new staff members for a long time In view of the aging staff and the shortage of manpower, the golf course hopes to mitigate the impact with AI technology, and is therefore using AI multi-device collaborative mowing sensor technology, in hopes of reducing the burden of staff maintaining the golf course New challenges - Expert systems are needed to overcome difficulties with different grass species "This AI lawn mowing robot has low noise, low pollution, low labor costs, and is waterproof and anti-theft In the lawn mowing process, it can identify and avoid obstacles through ultrasonic sensors while maintaining mowing quality, maintaining aesthetic and consistent grass length" Chao-Cheng Chen went on to say that the most important part about golf courses is that the grass pattern should be beautiful and free from diseases and pests Based on the site survey, golf courses are mainly divided into three major areas green, fairway and rough There is no problem using the current mowing robot to mow the rough area, and it can overcome slopes within 20 degreesThe short grass in the fairway area may only be two centimeters long, and the grass types are also different, so the cutterhead design needs to be modifiedAs for the grass in the green area, the grass must be mowed close to the ground and maintained in a consistent direction because it affects the putting speed Many factors will affect the green index, and this part requires more research and testing The AI lawn mowing robot can identify and avoid obstacles through ultrasonic sensors while maintaining mowing quality The AI smart lawn mowing robot has a built-in camera that can be used to detect the health condition of the lawn Chao-Cheng Chen said that in the future, an expert system will also be introduced for early determination of whether there are diseases, pests in the lawn or whether there is sufficient moisture, and provide lawn health data analysis to customers, so that they can take preventive and response measures sooner to reduce disaster losses Chao-Cheng Chen, who is also a good golfer himself, said that golf has developed well in Taiwan However, due to weather factors, such as rainy and humid climate and typhoons, Taiwan's golf courses have harder soil and more potholes compared with top tier golf courses overseas If AI lawn mowing robots are to be widely introduced into golf courses, there are still many difficulties that must be overcome However, Taiwan's difficult terrain creates a good testing ground Once Taiwan can overcome the many problems and successfully introduce the robot, it will be able to expand to overseas markets and seize new market opportunities in a blue ocean Chao-Cheng Chen, President of USRROBOT nbsp

這是一張圖片。 This is a picture.
CCTV Intelligent Video Search System

Search for a specific person, find someone with a suitcase entering the factory in Gao'an area Color features of the person and the object confirmed, person in blue and black top, suitcase in black color, throughCCTV the intelligent video search system, by setting object and color retrieval conditions, it can successfully locate three video clips containing the target subject This greatly aids operational staff in finding the target items, and through this system, search speed can far surpass manual effort6fold Pain Points The CSE-Kaohsiung Plant is densely equippedCCTVto monitor every corner of the plant area, but when an incidenthappens, it's impossible within a limited time throughCCTVvideo playback to find the incident, the implications and risks behind this are self-evident Many areas that are usually unmanned can easily become security blind spots Thus, how to monitor a vast plant area more intelligently and effectively is one of the crucial aspects of building a smart plant for the semiconductor industry The AES Plant in Kaohsiung covers a vast area, with many important sites requiring monitoring of personnel movements to ensure corporate secrets and employee safety 1 Automated production lines and warehouses In semiconductor enterprises’ automated production lines and warehouses, oftenAGV(Automated Guided VehicleAGVs automated guided vehicles travel at high speeds if plant personnel inadvertently enterAGVthe moving area and cannot issue a warning to the person, then the regrettable accidents that occur will be too late to reverse 2 Material and product storage areas Materials used in semiconductor-related processes are costly if areas storing materials or products are breached, there is a risk of loss of high-value materialsproducts 3 High-security areas Trade secrets relate to the core technological competitiveness of semiconductor-related enterprises if someone breaches the high-security areas, there is a risk of corporate secrets being leaked The safety of trade secrets has always been one of the most critical issues for semiconductor enterprises 4 Loading docks At AESLButthe dock area often has loading vehicles coming and going if someone intrudes into the dock area, there is a risk of vehicle collisions and accidents Additionally, goods awaiting shipment at the dock area could be stolen or potentially damaged from collisions, thus causing significant reputation and financial losses for the company, further leading to production and shipping inconvenience When an abnormal event occurs, how to quickly search for the relevant key footage from massive data Many important locations within the AES Kaohsiung Plant need to be equippedCCTVfor safety checks, butCCTVWith thousands to tens of thousands of cameras, manually searching through footage for an event requires laborious frame-by-frame review which is time-consuming and inefficient In light of advancements in computer vision, it's beneficial to utilizeAIto replace manual playback and searching Problem Scenario Object Detection The data source for object detection comprises two parts Open-source datasetsOIDv4and AES Kaohsiung PlantCCTVImage files For these files, search for usable data, specificallyOIDv4image files For these files, extract the defined nine major categories of objects for training data among them, two object categories, knives and gasoline barrels, were not found inOIDv4found usable data for knives and gasoline barrels, while the remaining seven categories of objects are available fromOIDv4useful training data found for the remaining seven categories of objects, all marked Regarding the Kaohsiung PlantCCTVimage files, select some frames Frame of the footage, and manually annotate the objects to be_detected for training and testing data Nine Major Objects Color Recognition The data source for color recognition is divided into two partsInternet image screenshots, and Kaohsiung PlantCCTVimage files Currently, no publicly available open-source datasets specifically for color recognition applications have been found, so images are collected from the web Search the web for images of the defined nine major object categories, save the images after separating the objects from the background, keeping only the object sections, and mark the images according to color Additionally, for the Kaohsiung PlantCCTVimage files, use the already-markedbounding boxextractCCTVimage files from variousFramesections of objects identified by color, and finally, visually identifiable images are marked according to color Each object category has its specific color definition, depending on the usual colors seen in these objects in real life Dynamic Ignore during Training FromOIDv4during the training of the object detection pilot model, since each image in this dataset is only marked for a single category, but the image may contain other desired detection categories unmarked For such cases, dynamic ignore techniques will be employed during training to avoid confusion Next, use the extracted training data from the Kaohsiung Plant toFine-Tuneenhance the detection rate of the object in specific designated areas Finally, select the model that computes the lowest loss value in the test set during the training process as the main object_detection model Dynamic Ignoring AIHelp You View CCTV The intelligent video search system primarily serves as an assistive system for searching surveillance footage, capable of speeding up the process of finding target events by setting search conditions for objects By simply defining the search conditions, you can quickly produce thumbnails of critical objects and playback for review, shortening the time required for manual case retrieval of the past The search time is quickly6doubled, allowing the front-end security unit to use this platform to strengthen the first line of risk management supervision and take timely preventive measures 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」