:::

【2021 Application Example】 Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines. While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates. Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection.

Generally, the yield rate of products affects the costs for enterprises and the return rate for customers. The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor. Although there is AOI equipment to assist, these tools are mostly fixed detection machines. Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates. Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5%, and can be as high as 20%.

Three major pain points in manufacturing quality detection: Robotic Arm + AOI with dynamic multi-angle inspection helps to solve these issues

According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry:

Pain point one, manual inspection of product quality is prone to errors. Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc. The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production.

Pain point two, inability to quantify and record data from quality inspections. Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur. Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet.

Pain point three, limitations of traditional AOI visual inspection systems. Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations. This method may handle flat or linear-shaped products (like rectangular or square items) at a single inspection point. However, it is more challenging to implement for products with complex shapes (e.g., irregular automotive parts), requiring multi-point and multi-degree inspections.

Massive Digital Engineering developed an AOI intelligent robotic arm detection system that effectively improves the accuracy of defect detection.

▲Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection.

To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision. By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular.

Selected the automotive industry as the real-world testing ground to quickly respond to customer needs

The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses. This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates.

▲Automotive components are high in unit price and demand a stricter defect detection accuracy.

In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground. Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy. Therefore, the automotive sector was chosen as the area for introduction. By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries; and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise.

This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production. At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs.

Helps to reduce communication costs and aims to become an industry standard

In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain. Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration. Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis (Data Analysis), based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality. In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain (Supply Chain) more swiftly.

Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard. Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application.

▲Self-driving vehicle developed by Massive Digital Engineering

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【解決方案】連聯合國都買單 悠由數據應用運用農業數據搶攻全球商機
Even the United Nations is on board! Yoyo Data Application captures global business opportunities with agricultural data

Nearly 2,000 days in the fields have made Yoyo Data Application a top player in Taiwan’s agricultural data sector Their comprehensive grasp of crop yields, production periods, and prices has enabled them to collaborate with the United Nations The service area for agricultural land skyrocketed from 24 hectares to over 6,000 hectares in less than three years—a 250-fold increase For Wu Junxiao, founder and CEO of Yoyo Data Application, aligning with global environmental trends and becoming a data company at the intersection of climate technology and the green economy to serve the global market is his ultimate entrepreneurial goal Wu Junxiao, originally an engineer, joined the Industrial Technology Research Institute in 2010, where he honed his profound technical and data science analytic skills 'At that time, I was working in data analysis engineering, and almost all data-related materials would be directed to me Additionally, I worked on indoor cultivation boxes, planting vegetables and mushrooms, hence planting the seed of entrepreneurship by integrating agriculture with data analysis,' Wu recalls Since 2016, Wu Junxiao has been frequently visiting farms to 'embed' himself among farmers and agricultural researchers, chatting and sharing information systematically, which quickly established his agricultural know-how Solid data analysis capabilities have even convinced the United Nations In 2017, he left the Institute to start his own business and founded Yoyo Data Application in 2019 Today, many agricultural businesses are his clients, with service areas rapidly climbing from 24 hectares to over 6,000 hectares, expected to surpass 7,000 hectares in 2022 His clientele includes markets in Japan, Central America, and even entities under the United Nations like the World Farmers Organization, which utilizes the 'Yoyo Crop Algorithm System' supported by Yoyo Data How exactly does Yoyo Data Application manage to impress even UN agencies The 'Yoyo Crop Algorithm System' developed by Yoyo Data Application accurately predicts the production period, yield, and prices Firstly, due to Wu Junxiao's precise mastery over agricultural data, Yoyo Data Application's clients don't necessarily need sensors or other hardware devices 'Sensors are expensive and if you buy cheap devices, you just collect a lot of noise or flawed data, which is useless,' Wu explains He continues, 'Collecting data doesn't necessarily require sensors our data solutions can solve problems more directly and effectively' For instance, one of Yoyo Data Application's products, the Yoyo Money Report Agri-price Linebot, developed in collaboration with LINE in 2020, gathers data on origin, wholesale, and terminal prices spanning over 10 years, driven by Yoyo Data’s proprietary AI algorithms This enables the system to autonomously learn about agricultural product trading prices, using big data and AI to perform price prediction analysis, thereby helping buyers reduce transaction risks and expanding the data application to the entire agricultural supply chain Regarding banana prices, the accuracy of price predictions increased from the original 70 to 998 Wu Junxiao notes that both buyers and farmers are very sensitive to prices Now, through the Yoyo Money Report service, both buyers and farmers can precisely understand the fluctuations in agricultural product prices Yoyo Data can also provide customers with optimal decision-making advice based on predictive models for crop growth, yield, and price estimations Currently, price predictions cover 28 types of crops Precise estimates of production periods and price fluctuations allow Yoyo Data to provide differentiated services based on data analysis The 'Yoyo Crop Algorithm System' provided by Yoyo Data Application incorporates a 'Parameter Bank', usually collecting 200-300 parameters, not just straightforward data like temperature and humidity, but also data divided according to the physiological characteristics of the crops Through effective dynamic data algorithms, it can accurately calculate when crops will flower and when they can be harvested, what the yield will be, and so forth For instance, the prediction accuracy of the broccoli production period is 0-4 days, with the flowering period predicted this year to be precisely 0 days, perfectly matching the actual flowering time in the field In these dynamic calculations, a 7-day range is considered reasonable, and the average error value of Yoyo Data's predictions typically ranges from 2-4 days, with most crop production period accuracies above 80 Through effective dynamic data algorithms, over 120 global crops can have their production periods and yields accurately estimated Using these effective dynamic data algorithms can set estimates for production quantities, helping adjust at the production end Yoyo Data Application's clientele primarily includes exporters of fruit crops like pineapples, bananas, guavas, mangos, pomelos, sugar apples, Taiwan's agricultural production is highly homogenized, often leading to a rush to plant the same crops and resulting in price crashes Yoyo Data Application helps clients differentiate their offerings Thus, Wu Junxiao positions his company as a boutique digital consultant, carefully selecting clients for quality over quantity He notes that Taiwanese agricultural clients focus on how to improve yield rates, even categorizing yield rates by quality, aiming for high-quality, specialized export markets whereas international clients prioritize maximizing per-unit yields, showing different operational approaches in domestic and international markets In addition to agricultural fruit, Yoyo Data Application has also extended its services to the fisheries sector, including species like milkfish, sea bass, and white shrimp, all using the same system to establish various parameters related to the growth of fish and shrimp, such as when to feed and when to harvest, and the anticipated yield, timing, and prices Yoyo Data Application harnesses the power of data to create miracles in smart agriculture In response to the company's rapid development, Yoyo Data Application introduced venture capital funds in 2021 to expand its staff and promote its business Wu Junxiao states that in response to the global trend towards net zero carbon emissions by 2050, he plans to help clients plant carbon in the soil, effectively retaining carbon in the land while also connecting clients to carbon trading platforms, creating environmental business opportunities together Wu Junxiao says that from the start of his entrepreneurial journey, he positioned the company as a global entity, thus continuous international collaborations are planned As a data company serving a global clientele and focused on climate technology and the green economy, this represents Wu’s expectations for himself and his company's long-term goals Yoyo Data Application founder and CEO Wu Junxiao「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】維繫遊艇王國美譽 嘉信遊艇導入國內第一套FRP複材超音波智慧檢測
Maintaining the reputation of the “Kingdom of Yachts” - Kha Shing Enterprise introduces the first domestic FRP ultrasonic smart inspection of composite materials

The Kaohsiung-based Kha Shing Enterprise Co, Ltd was established over 40 years ago, and is Taiwan's largest customized yacht company with customers all over America, Europe, Asia, and Australia, earning Taiwan the reputation of the "Kingdom of Yachts" Current FRP hull inspection still relies on traditional methods, such as visual inspection and knocking sounds, which is time-consuming and labor-intensive Kha Shing has applied PAUT array ultrasonic inspection to hull FRP composite materials for the first time, and combined it with AI to interpret ultrasound images, develop complete intelligent solutions, and create emerging markets for inspection companies Kha Shing Enterprise Co, Ltd was formerly Kha Shing Wood Industry Co, Ltd, and was a factory specializing in wood import in Kaohsiung Linhai Industrial Park when it was first established It began to design, manufacture, and sell yachts in 1977 After the second-generation successor of the company, President Kung Chun-Hao entered the company, he made a breakthrough in the previous manufacturing model that relied mainly on the skills of master craftsmen, introduced digital manufacturing to accelerate shipbuilding, and began to make larger yachts, ranking in the top 20 manufacturers worldwide among manufacturers of large yachts over 24 feet It also set a record of delivering 94 yachts within one year, earning Taiwan the reputation of "Kingdom of Yachts" Defect detection ensures yacht quality, using AI to replace humans to achieve higher efficiency Defect detection is very important to ensuring yacht quality At present, the yacht industry still uses very traditional defect detection methods The hull structure is usually made by hand lay-up or the vacuum infusion process, using visual inspection or knocking and the frequency of the sound to determine defects It requires time-consuming manual inspection If there are any defects, they must be reworked and repaired, and a gel coat subsequently sprayed The hull must be constructed in sections to facilitate inspection For large yachts over 24 meters long, construction in sections is very time-consuming and labor-intensive To shorten the time of the yacht manufacturing process, Kha Shing Enterprise will first carry out the gel coating process for the hull, and then perform the hand lay-on process The hull manufacturing process has two types of composite material test specimen structures In terms of 54-foot yacht hulls, the hull contains gel coat, core material, fiber and resin, and the total thickness is about 32cmplusmn01cm, which is twice the total thickness of FRP hull without core material of about 16cmplusmn01cm Defects such as incomplete impregnation of glass fiber or residual air bubbles between glass fiber and resin occasionally occur during the manufacturing process The types of defects include insufficient resin, voids, and delamination Once defects occur, the supply of hull materials will be insufficient and yacht delivery will be delayed Schematic diagram of types of FRP hull In order to solve this problem, Kha Shing Enterprise has engaged in technical cooperated with the metal materials industry and the AI technology industry, combining the ultrasonic inspection expertise of the metal materials industry with AI technologies developed by the AI technology industry in recent years to help solve issues of Kha Shing Enterprise with defect detection The method uses PAUT on the composite material structure of yachts, conducts FRP ultrasonic evaluation to determine the thickness of the yacht hull and material properties, and evaluates the ultrasonic probe frequency applicable to the hull structure based on professional ultrasonic experience After testing, a frequency of 5MHz and a probe width of 45mm can successfully find the location and size of defects in the simulated defect test specimen The three parties jointly found defect detection solutions from array ultrasonic evaluation, AI technology model development, and actual application in yachts The image inspected is an ultrasound image The image displays different colors based on the ultrasonic feedback signal An AI model that automatically identifies defective parts is established through the YOLO algorithm If the amount of abnormal data collected is insufficient for training, the CNN-based Autoencoder algorithm is used to collect normal image data for training and construct an AI model for abnormality detection The object detection YOLO model is trained by inputting image data marked as having defects, while the abnormality detection model is trained by inputting image data without defects Simulated defective specimen corresponding to PAUT results Defect detection by and AI system can shorten the construction period by 15 months and speed up determination by 50 After the development of this AI system is completed, it will be validated on actual 54-foot yachts of Kha Shing Enterprise, and can effectively resolve issues with defects The application of AI technology in ultrasonic inspection for intelligent determination is expected to accelerate determination by approximately 50, and will also shortens the construction period by 15 months, effectively improving the speed and quality of the yacht manufacturing process As Taiwan develops larger and more refined yachts, it will create opportunities for industry optimization and transformation, as well as opportunities for the development of key technologies The application of an AI ultrasonic inspection solution for composite materials is the first of its kind in the yacht industry, and is expected to attract more yacht manufacturers with inspection needs The AI ultrasonic inspection solution for composite materials has three major competitive advantages 1 Professional inspection experience and digital database to facilitate process management and analysis 2 Automatic AI determination and identification quickly identifies defects and provides immediate feedback to process engineers 3 High-efficiency process inspection provides defect repair recommendations, reduces damage rate, and improves the strength and quality of composite materials The application of AI technology can optimize the yacht manufacturing process, reduce manual inspection, create added value through the application of AI in Taiwanrsquos yacht industry, increase international purchase orders, and allow Taiwan yachts to continue to enjoy a good reputation in the world Furthermore, this business model has also spread to fields of application related to composite materials, increasing cross-sector market usage It is estimated to contribute approximately NT14 to NT2 billion in economic benefits to Taiwan's equipment maintenance and non-destructive testing market

【導入案例】救命急如星火 AI病危系統監測掌握黃金搶救期
Life-saving is as urgent as a spark AI critical illness system monitors and grasps the golden rescue period

60-year-old Mr Huang was admitted to the hospital due to a stroke After lying in the intensive care unit for two weeks, his condition suddenly took a turn for the worse After rescue, he was lucky enough to survive In fact, with the assistance of AI critical illness early warning technology, hospitals can detect signs and take timely and accurate medical measures 6-8 hours before a patient's heart stops, which can greatly reduce the chance of death in the hospital The deterioration of the condition is a process that evolves over time, and its subtle changes are by no means without context Previous research reports show that about 60 to 70 of inpatients who experience unexpected in-hospital cardiac arrest had symptoms 6 to 8 hours before their cardiac arrest, but only a quarter of them were recognized by clinical staff Detection and discovery, therefore, there is a need for a risk warning tool or system that can be used earlier and continuously to monitor the condition, alert medical staff to pay attention to subtle changes in the patient's condition at any time, and take timely and accurate intervention measures before the condition progresses to effectively reduce adverse events or the risk of serious adverse events Unexpected deterioration cannot be detected early Acute and severe patients often undergo unpredictable changes, and timely detection or prediction of potential acute and severe patients is an important issue The currently commonly used clinical assessment method is Modified Early Warning Score MEWS, which uses simple physiological parameter assessment including heartbeat, respiratory rate, systolic blood pressure, body temperature, urine output and state of consciousness to screen out high-risk patients, and has been proven to be predictive Patient clinical prognosis MEWS is a scoring mechanism with a single time point and a standardized formula However, the AI crisis warning system developed by Boxin Medical Electronics - Hospital Emergency and Critical Care Early Warning Index System EWS is designed to predict patient status with immediate response , collect the physiological data of patients over time for deep learning, find the best prediction model, and improve the overall accuracy Boxin Medical Electronics uses a big data analysis model to build an early warning system EWS, IoT Internet of Things and 5G communication technology, allowing medical staff to remotely monitor the physiological status of patients through communication equipment, and monitor emergency and severe cases quickly The patient's condition changes and the golden rescue period of 6-8 hours before cardiac arrest can be grasped After Boxin Medical Electronics introduces AI visual interpretation, unmanned operation can greatly reduce medical manpower The AI technology developed by Boxin Medical Electronics is the Gradient Boosting Ensemble Learning System GBELS to build an early warning system It is a learning-based EWS prediction algorithm developed by the company, which is an integrated learning Ensemble Learning and is classified as supervised learning, providing the following three functions 1 Early warning risk notification is used to analyze representative data using GBELS to provide an early risk score so that medical staff can conduct immediate clinical assessment and provide appropriate medical treatment 2 Reduce medical manpower Collect continuous physiological monitoring data, such as heartbeat, respiration, blood pressure and blood oxygen concentration, etc, to reduce the time for medical staff to write cases 3 Combine IOT logistics network and 5G communication technology to quickly transmit medical data such as monitoring parameters and imaging data, and assist medical staff to monitor changes in patients' condition remotely through communication equipment AI critical illness system monitoring to master the golden treatment period Boxin Medical Electronics stated that assessing the severity of the disease in acute and severe patients is a complex task, and patients often experience unpredictable changes Clinical medical staff often judge the condition based on their own clinical experience or intuition, which lacks science and objectivity, resulting in the inability to correctly identify and timely detect potentially acute and severe patients, resulting in or misdiagnosis leading to increased in-hospital mortality of patients The introduction of an AI early critical illness warning system can assist emergency and critical care medical staff to correctly predict the patient's condition and allow patients to receive the care they need immediately This can reduce the manpower arrangement of the emergency and critical care ward at the same time and reduce labor costs In addition, the easy-to-carry design will help the system be introduced into ambulances, home care and other places in the future, so that emergency patients can receive appropriate care earlier Other departments within the hospital can also develop new applications around this system, which can effectively accelerate the development and promotion of smart medical technology With the COVID-19 epidemic still raging in many countries around the world, this system can also help hospitals in various places to operate more effectively Caring for and monitoring the condition of critically ill patients In addition to AI critical illness warning, Boxin Medical Electronics has also developed AI image interpretation - Medical Physiological Monitor Life Cycle Compliance Testing AVS, which uses AI image interpretation technology to develop automated quality inspection of life support medical equipment The instrument solves the time-consuming problem of medical instrument testing It can reduce testing time by 70, increase the number of tests by 3 times, and effectively reduce labor costs by 50 At the same time, it is 100 compliant with regulatory requirements, and gradually solves the shortage of manpower and medical resources in the medical field , medical work overload and other issues It has now taken root in mainland China and is actively preparing for its launch in Europe It will develop towards the Japanese and American markets in the future Boxin Medical Electronics develops AI image interpretation-medical physiological monitor life cycle compliance testing AVS to solve the time-consuming problem of medical instrument testing and can reduce testing by 70 time At this stage, Boxin Medical's smart medical technology has been introduced into medical hospitals including Hsinchu MacKay, Changkei, Dongyuan General Hospital, Kaohsiung University of Technology Affiliated Hospital, Zhenxin Hospital, Hsintai Hospital, Taipei Medical University Affiliated Hospital, etc GE HealthcareInc, an internationally renowned medical materials manufacturer, and Mindray Medical, China's largest medical materials manufacturer, are both representative customers of Boxin Medical Electronics 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」