:::

【2020 Application Example】 AOI fabric inspector lowers the false negative rate, and reduced the re-inspection volume by 70%

編輯群2020-07-22
22

Low detection rate, slow speed, difficult recruitment and high personnel costs

The textile industry has always been a labor-intensive industry. At present, almost all textile companies worldwide still inspect fabrics manually. There are three major pain points in manual fabric inspection: Low detection rate, slow speed, difficulty in recruiting workers, and high personnel costs On average, a fabric inspector can find up to 200 defects in one hour with a defect detection rate of about 70%.

However, inspectors are only able to maintain their concentration for 20 to 30 minutes at most, and their fabric inspection speed is generally limited to 20 to 30cm/s. Fabric inspectors become fatigued if they exceed this time and speed.

Domestic and foreign AOI fabric inspection machines purchased by textile manufacturers have not yet been officially integrated into the production line. At the beginning, 10,000 suspected defects could be detected in one roll of fabric. The detection rate was high but the accuracy [screening] was low. The number of suspected defects has been reduced to 7000, but is still not at the level of experienced inspectors.

High-speed cameras capture defects and record defect locations

▲High-speed cameras capture defects and record their locations

The rule-based defect identification method currently used by manufacturers requires a lot of adjustment time (about 1 to 3 months) before the manufacturers (site) actually uses it, and there is currently no solution to automatically correct the identification model after use. As a result, manufacturers need to spend extra time to adjust parameters. Therefore, it requires considerable cost for both manufacturers and clients (sites).

Current manufacturers' grey cloth inspection process

▲Current grew fabric inspection process of manufacturers

The specific method used by the guidance team and cooperating manufacturers to implement AI identification technology and learning framework (for model retraining) into the defect inspection process is described below

1. AI-based defect identification model:

Utilizes the large amount of image data collected (including fabrics with and without defects) to construct the defect detection model through machine learning, such as SVM, or deep learning object detection methods, such as SSD or YOLOv3. This model is used to determine the condition of the surface of grey fabric and determine if it is a normal product or a defective product, thereby achieving defect identification.

2. Identification model retraining framework:

If there is an error in the judgment of the visual inspector, the image will be marked and the data will be used in the dataset for re-training. After a certain number of misjudged data is accumulated, the system will automatically start the identification model retraining function, and the new model that is generated will automatically replace the old recognition model, thereby achieving the purpose of model update.

Post-project implementation grey cloth defect inspection process

▲Grey fabric defect inspection process after the implementation of this project

Low false negative rate and solves the challenges of labor shortage and higher quality requirements in the industry

This project uses a deep learning network architecture to reclassify defects that are detected, including real defects and false defects, and can further classify real defects and false defects to lower the false negative rate of traditional AOI solutions. This is expected to reduce re-inspection volume by 70% and above for fabric inspectors, eliminate concerns about implementation in the current production line, accelerate the application of AI-based AOI solutions by textile manufacturers, and solve the challenges of labor shortage and higher quality requirements in the industry.

Recommend Cases

【導入案例】海量數位工程AOI機器智能手臂檢測系統 大幅提高瑕疵檢測精準度
Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection Generally, the yield rate of products affects the costs for enterprises and the return rate for customers The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor Although there is AOI equipment to assist, these tools are mostly fixed detection machines Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5, and can be as high as 20 Three major pain points in manufacturing quality detection Robotic Arm AOI with dynamic multi-angle inspection helps to solve these issues According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry Pain point one, manual inspection of product quality is prone to errors Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production Pain point two, inability to quantify and record data from quality inspections Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet Pain point three, limitations of traditional AOI visual inspection systems Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations This method may handle flat or linear-shaped products like rectangular or square items at a single inspection point However, it is more challenging to implement for products with complex shapes eg, irregular automotive parts, requiring multi-point and multi-degree inspections Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular Selected the automotive industry as the real-world testing ground to quickly respond to customer needs The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates Automotive components are high in unit price and demand a stricter defect detection accuracy In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy Therefore, the automotive sector was chosen as the area for introduction By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs Helps to reduce communication costs and aims to become an industry standard In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis Data Analysis, based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain Supply Chain more swiftly Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application Self-driving vehicle developed by Massive Digital Engineering「Translated content is generated by ChatGPT and is for reference only Translation date：2024-05-19」

【解決方案】佐翼科技無人機導入高爾夫球場域 可節省一半人力
Droxo Tech Applies Drones in Golf Courses to Reduce Manpower by Half

For most golf courses, the operations and management is a headache "Golf courses are selling turf and need to be properly taken care of," a golf course manager bluntly pointed out Facing the market pain points of labor shortage, aging population and high cost, the use of AI drones for pesticide spraying and pest control will reduce labor costs by more than half and greatly improve the overall operational efficiency At noon in early summer, an AI drone is slowly taking off at the Taipei Golf Club in Taoyuan Its main task is to test AI drone fertilizing and pesticide spraying on the golf course In fact, drones of Droxo Tech, the company performing this task, are widely used for fertilization, pesticide spraying, and pest and disease control for rice, bananas, and tea trees For golf courses with turfs that often cover tens to hundreds of hectares, AI drones are needed to assist in turf maintenance Data collection, development of pesticide spraying AI models, and multispectral image analysis and testing will be carried out in the current stage In the future, large-scale technology implementation and verification will be carried out to set an example for applying drones to golf courses Using AI drones to fertilize and spray pesticides can reduce the manpower required by half The traditional way of maintaining the turf in golf courses is to carry spray buckets or drive spraying vehicles to spray areas one by one "Domestic golf courses began to plant ultra-dwarf Bermuda grass in 2001 This grass species prefers a cool climate and is not suitable for Taiwan's hot and humid weather" Droxo Techrsquos CEO further pointed out that to prevent turf from pests and diseases, pesticide spraying is necessary For an 18-hole golf course, it is equivalent to spraying pesticides once a week, and the T-ground and fairways are sprayed every two months For golf courses, spraying pesticides is time-consuming and labor-intensive It is important to note that large-scale spraying will increase the risk of personnel poisoning and increase the amount of pesticide used Benefits of applying agricultural drones to golf courses According to Droxo Techrsquos research, golf course pests include Spodoptera litura, which comes out at night to look for food, so pesticide spraying must be carried out in the evening According to the traditional method, pesticide spraying requires two vehicles and three personnel for a total of 45 hours If AI drones are used for fertilizing and pesticide spraying, it only takes one operator to spray 08 hectares of land in 20 minutes, saving about two-thirds of the manpower and reducing operating costs by about 30 Using AI drones to fertilize and spray pesticides on golf courses can reduce the manpower required by half In addition to the significant benefits of using agricultural drones for golf course turf maintenance, Droxo Tech also specially introduced AI multispectral image recognition for NDVI Normalized Difference Vegetation Index analysis "The so-called multispectral is to direct light with different wavelengths on the turf, and the reflected images are collected for analysis" Droxo Tech CEO Liu continued to explain that each plant absorbs light with different wavelengths, so multispectral imaging can determine the growth status of grass species At the same time, combined with AI image recognition, the distribution of pests and diseases can be accurately detected, and the amount of pesticide used is determined on this basis Cross-domain collaboration to build a multi-source turf image databasenbsp Using AI multispectral image recognition technology, Droxo Tech will collect visible light, multispectral, thermal images, and hyperspectral images to establish a multi-source turf image database to fully understand the growth cycle of Bermuda grass Droxo Tech has accumulated rich experience in agricultural AI drone pesticide spraying , but there are still many problems that need to be overcome to implement AI solutions in golf courses For example, it is necessary to establish a new pesticide spraying model and test flight methods, especially the application of multispectral image recognition PoC is not difficult, but actual implementation requires more test evidence, repeated inferences, and collaboration with plant experts This part must rely on the cross-domain integration of legal entities such as the Institute for Information Technology III, gathering more fields for verification, and creating a paradigm before it can be more widely adopted by golf courses There are not many international cases on the application of AI drones in golf courses During the verification process, it is not yet known whether it can be quickly copied to the next golf course However, Droxo Tech CEO Liu believes that through cross-domain collaboration, clearly defining the problems and listing them one by one, supply and demand parties can reach a consensus, propose solutions to each problem, and seek cooperation with internal and external resources Only then will we be able to gradually achieve the goal of making golf courses smarter and smoothly assist the industry with transformation Zuoyi Technology's CEO, Liu Junlin 「Translated content is generated by ChatGPT and is for reference only Translation date：2024-05-19」

【導入案例】維繫遊艇王國美譽 嘉信遊艇導入國內第一套FRP複材超音波智慧檢測
Maintaining the reputation of the “Kingdom of Yachts” - Kha Shing Enterprise introduces the first domestic FRP ultrasonic smart inspection of composite materials

The Kaohsiung-based Kha Shing Enterprise Co, Ltd was established over 40 years ago, and is Taiwan's largest customized yacht company with customers all over America, Europe, Asia, and Australia, earning Taiwan the reputation of the "Kingdom of Yachts" Current FRP hull inspection still relies on traditional methods, such as visual inspection and knocking sounds, which is time-consuming and labor-intensive Kha Shing has applied PAUT array ultrasonic inspection to hull FRP composite materials for the first time, and combined it with AI to interpret ultrasound images, develop complete intelligent solutions, and create emerging markets for inspection companies Kha Shing Enterprise Co, Ltd was formerly Kha Shing Wood Industry Co, Ltd, and was a factory specializing in wood import in Kaohsiung Linhai Industrial Park when it was first established It began to design, manufacture, and sell yachts in 1977 After the second-generation successor of the company, President Kung Chun-Hao entered the company, he made a breakthrough in the previous manufacturing model that relied mainly on the skills of master craftsmen, introduced digital manufacturing to accelerate shipbuilding, and began to make larger yachts, ranking in the top 20 manufacturers worldwide among manufacturers of large yachts over 24 feet It also set a record of delivering 94 yachts within one year, earning Taiwan the reputation of "Kingdom of Yachts" Defect detection ensures yacht quality, using AI to replace humans to achieve higher efficiency Defect detection is very important to ensuring yacht quality At present, the yacht industry still uses very traditional defect detection methods The hull structure is usually made by hand lay-up or the vacuum infusion process, using visual inspection or knocking and the frequency of the sound to determine defects It requires time-consuming manual inspection If there are any defects, they must be reworked and repaired, and a gel coat subsequently sprayed The hull must be constructed in sections to facilitate inspection For large yachts over 24 meters long, construction in sections is very time-consuming and labor-intensive To shorten the time of the yacht manufacturing process, Kha Shing Enterprise will first carry out the gel coating process for the hull, and then perform the hand lay-on process The hull manufacturing process has two types of composite material test specimen structures In terms of 54-foot yacht hulls, the hull contains gel coat, core material, fiber and resin, and the total thickness is about 32cmplusmn01cm, which is twice the total thickness of FRP hull without core material of about 16cmplusmn01cm Defects such as incomplete impregnation of glass fiber or residual air bubbles between glass fiber and resin occasionally occur during the manufacturing process The types of defects include insufficient resin, voids, and delamination Once defects occur, the supply of hull materials will be insufficient and yacht delivery will be delayed Schematic diagram of types of FRP hull In order to solve this problem, Kha Shing Enterprise has engaged in technical cooperated with the metal materials industry and the AI technology industry, combining the ultrasonic inspection expertise of the metal materials industry with AI technologies developed by the AI technology industry in recent years to help solve issues of Kha Shing Enterprise with defect detection The method uses PAUT on the composite material structure of yachts, conducts FRP ultrasonic evaluation to determine the thickness of the yacht hull and material properties, and evaluates the ultrasonic probe frequency applicable to the hull structure based on professional ultrasonic experience After testing, a frequency of 5MHz and a probe width of 45mm can successfully find the location and size of defects in the simulated defect test specimen The three parties jointly found defect detection solutions from array ultrasonic evaluation, AI technology model development, and actual application in yachts The image inspected is an ultrasound image The image displays different colors based on the ultrasonic feedback signal An AI model that automatically identifies defective parts is established through the YOLO algorithm If the amount of abnormal data collected is insufficient for training, the CNN-based Autoencoder algorithm is used to collect normal image data for training and construct an AI model for abnormality detection The object detection YOLO model is trained by inputting image data marked as having defects, while the abnormality detection model is trained by inputting image data without defects Simulated defective specimen corresponding to PAUT results Defect detection by and AI system can shorten the construction period by 15 months and speed up determination by 50 After the development of this AI system is completed, it will be validated on actual 54-foot yachts of Kha Shing Enterprise, and can effectively resolve issues with defects The application of AI technology in ultrasonic inspection for intelligent determination is expected to accelerate determination by approximately 50, and will also shortens the construction period by 15 months, effectively improving the speed and quality of the yacht manufacturing process As Taiwan develops larger and more refined yachts, it will create opportunities for industry optimization and transformation, as well as opportunities for the development of key technologies The application of an AI ultrasonic inspection solution for composite materials is the first of its kind in the yacht industry, and is expected to attract more yacht manufacturers with inspection needs The AI ultrasonic inspection solution for composite materials has three major competitive advantages 1 Professional inspection experience and digital database to facilitate process management and analysis 2 Automatic AI determination and identification quickly identifies defects and provides immediate feedback to process engineers 3 High-efficiency process inspection provides defect repair recommendations, reduces damage rate, and improves the strength and quality of composite materials The application of AI technology can optimize the yacht manufacturing process, reduce manual inspection, create added value through the application of AI in Taiwanrsquos yacht industry, increase international purchase orders, and allow Taiwan yachts to continue to enjoy a good reputation in the world Furthermore, this business model has also spread to fields of application related to composite materials, increasing cross-sector market usage It is estimated to contribute approximately NT14 to NT2 billion in economic benefits to Taiwan's equipment maintenance and non-destructive testing market

PopularTags