:::

【2020 Application Example】 AOI fabric inspector lowers the false negative rate, and reduced the re-inspection volume by 70%

Low detection rate, slow speed, difficult recruitment and high personnel costs

The textile industry has always been a labor-intensive industry. At present, almost all textile companies worldwide still inspect fabrics manually. There are three major pain points in manual fabric inspection: Low detection rate, slow speed, difficulty in recruiting workers, and high personnel costs On average, a fabric inspector can find up to 200 defects in one hour with a defect detection rate of about 70%.

However, inspectors are only able to maintain their concentration for 20 to 30 minutes at most, and their fabric inspection speed is generally limited to 20 to 30cm/s. Fabric inspectors become fatigued if they exceed this time and speed.

Domestic and foreign AOI fabric inspection machines purchased by textile manufacturers have not yet been officially integrated into the production line. At the beginning, 10,000 suspected defects could be detected in one roll of fabric. The detection rate was high but the accuracy [screening] was low. The number of suspected defects has been reduced to 7000, but is still not at the level of experienced inspectors.

High-speed cameras capture defects and record defect locations

▲High-speed cameras capture defects and record their locations

The rule-based defect identification method currently used by manufacturers requires a lot of adjustment time (about 1 to 3 months) before the manufacturers (site) actually uses it, and there is currently no solution to automatically correct the identification model after use. As a result, manufacturers need to spend extra time to adjust parameters. Therefore, it requires considerable cost for both manufacturers and clients (sites).

Current manufacturers' grey cloth inspection process

▲Current grew fabric inspection process of manufacturers

The specific method used by the guidance team and cooperating manufacturers to implement AI identification technology and learning framework (for model retraining) into the defect inspection process is described below

1. AI-based defect identification model:

Utilizes the large amount of image data collected (including fabrics with and without defects) to construct the defect detection model through machine learning, such as SVM, or deep learning object detection methods, such as SSD or YOLOv3. This model is used to determine the condition of the surface of grey fabric and determine if it is a normal product or a defective product, thereby achieving defect identification.

2. Identification model retraining framework:

If there is an error in the judgment of the visual inspector, the image will be marked and the data will be used in the dataset for re-training. After a certain number of misjudged data is accumulated, the system will automatically start the identification model retraining function, and the new model that is generated will automatically replace the old recognition model, thereby achieving the purpose of model update.

Post-project implementation grey cloth defect inspection process

▲Grey fabric defect inspection process after the implementation of this project

Low false negative rate and solves the challenges of labor shortage and higher quality requirements in the industry

This project uses a deep learning network architecture to reclassify defects that are detected, including real defects and false defects, and can further classify real defects and false defects to lower the false negative rate of traditional AOI solutions. This is expected to reduce re-inspection volume by 70% and above for fabric inspectors, eliminate concerns about implementation in the current production line, accelerate the application of AI-based AOI solutions by textile manufacturers, and solve the challenges of labor shortage and higher quality requirements in the industry.

Recommend Cases

【導入案例】赫銳特科技VCSEL封裝元件瑕疵導入AOI檢測 提升產能效率20
HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95 VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and ARVR VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics VCSEL technology has a wide range ofnbsp applications, including in drones Pictured Zoyi Technology's Agricultural Drone VCSEL technology has a wide range of applications, AI technology assists in defect detection HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness One of the key problems is the replacement of glass lens with epoxy resin lens The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized The release of stress caused by heat during the mounting process will directly cause the optical lens to break HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important Under the constraints of packaging space, the space for fitting the package and optical lens is limited Moreover, the optical lenses will be confined to a metal frame If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10 in the VCSEL package reliability verification, resulting in an increase in production costs In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality The problem of image collection needs to be solved first to successfully collect image data Therefore, HRT Technology first developed an Automated Optical Inspection AOI device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening Manual labeling is carried out according to the image classification above, including samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out Residual neural network ResNet or other related algorithms are used for deep learning to identify the quality of lenses Implementation of AOI inspection improves production efficiency by 20 and above Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance The lens is packaged on the VCSEL package that has completed die bonding After passing the general light up test, the final reliability test high temperature reflow is performed Failed samples go into the rework process However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95 and above in the reliability verification This is expected to help companies reduce production costs by 10 and increase production efficiency by 20 and above The difference before and after implementing AI image detection HRT Technology pointed out that this technology is an AI application developed based on tiny images It uses deep learning algorithms to identify defects in the images The trained network automatically classifies image data to predetermined categories Defect categories can be determined through reference images, so cumbersome programming is not required In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future

這是一張圖片。 This is a picture.
Using Plant Growth Chambers as an Example - Standardizing Electronic Device Procedures Based on Imaging

In recent years, global climate change and environmental issues have become increasingly severe, causing major impacts on agricultural production Traditional agriculture heavily relies on weather conditions, facing challenges such as unstable crop quality, plummeting yields, and difficult pest control Particularly in Taiwan, agricultural biotech companies and farmers have suffered continuous losses, creating an urgent need for innovative solutions Meanwhile, Taiwan's plant factory industry faces many challenges high equipment and labor costs, an incomplete industrial chain diminishing international competitiveness, and a lack of cooperation among enterprises, all of which limit industry development Additionally, COVID-19the pandemic has highlighted the importance of remote monitoring and management Traditional manual inspections and data collection methods no longer meet the needs of modern agricultural production These issues collectively underline the urgent need for smart agricultural solutions, driving companies like Taiwan's HaiBoTe to develop innovative projects integrating IoT, cloud computing, and artificial intelligence technologies HaiBoTe Cloud Data Integration and Analysis Platform Facing these challenges, the agricultural sector urgently needs a system that can precisely control growth environments, improve resource efficiency, enable remote monitoring, and facilitate intelligent management Existing plant factory equipment often requires complete replacement, with poor compatibility with older equipment, and sensors and camera systems may require different interfaces, making them inconvenient to use Therefore, there is a need for a flexible solution that can integrate various equipment and technologies, providing real-time monitoring and data analysis, and automatically adjusting environmental parameters based on plant growth conditions This demand exists not only in Taiwan but is also a global trend in the development of smart agriculture By incorporating artificial intelligence, more scientific evaluation standards can be established, optimizing production processes, improving yield and quality, while reducing energy consumption and environmental impact Additionally, such smart solutions can attract more young people to participate in agricultural production, promoting industry upgrading and sustainable development Overall, the demand for smart agricultural solutions stems from the urgent requirements to address climate change, enhance production efficiency, reduce costs, and achieve precise management, and this is exactly the problem companies like Taiwan's HaiBoTe are striving to solve Taiwan's plant factory operators are facing a series of severe challenges, which are gradually eroding their competitiveness and survival space Firstly, the high cost of equipment and operations is their biggest burden Each electricity bill feels like a heavy blow, forcing them to balance between ensuring product quality and controlling costs Secondly, the unpredictability brought by climate change has become their nightmare Sudden extreme weather events can destroy their carefully nurtured crops in a short time, causing massive economic losses What's worse, they find themselves increasingly at a disadvantage in international market competition In contrast, large overseas plant factories, with their advanced automation technology and well-organized supply chains, can produce stable-quality agricultural products at lower costs, putting unprecedented pressure on Taiwan's operators On the technical level, they also face numerous challenges Compatibility issues between new and old equipment often put them in a bind, encountering various technical obstacles when trying to integrate different systems Lack of precise data analysis and forecasting capabilities also makes it difficult for them to make production decisions and accurately determine the best growth conditions for each crop Existing monitoring systems provide data that is often disorganized, difficult to interpret and apply Human resource challenges are also severe, with young people generally lacking interest in agricultural work, making it difficult for them to recruit employees with modern agricultural skills Even existing employees often feel exhausted from tedious manual operations and monitoring tasks These problems are intertwined, creating a complex dilemma that leaves plant factory operators confused and anxious They urgently need a comprehensive solution that can enhance factory operational efficiency, reduce costs, and improve product competitiveness, helping them overcome difficulties and regain their footing in the fierce market competition In facing the various challenges of plant factory operators, Taiwan's HaiBoTe company has demonstrated exceptional technical innovation and a flexible customer-oriented development strategy They deeply understand that the solution must be able to seamlessly integrate existing equipment while providing highly intelligent management functions To this end, HaiBoTe's RampD team adopted a modular design approach to develop a system that can be flexibly configuredIoTIoT system The core of this system is a smart control hub that can communicate with various sensors and actuators During development, HaiBoTe worked closely with customers, deeply understanding their specific needs and operational environments They even dispatched engineers onsite to observe the daily operations of the plant factories, ensuring that the developed system actually solves practical problems This in-depth cooperation not only helped HaiBoTe optimize their product design but also established a close relationship with customers, laying the foundation for subsequent continuous improvements HaiBoTe's innovation is not just reflected in hardware design but also in their developed intelligent software system This system integrates advanced machine learning algorithms, capable of precise forecasts and optimal control of plant growth conditions based on large amounts of historical data and real-time monitoring information To help customers overcome technical barriers, HaiBoTe designed an intuitive and easy-to-use user interface, which even non-technical operators can master easily Additionally, they provide comprehensive training and tech support services, ensuring customers can fully utilize all functions of the system When facing challenges, HaiBoTe's technical team can quickly identify problems through remote diagnostics and provide solutions In one incident, during a serious equipment failure emergency faced by a customer, HaiBoTe's engineers guided the customer through system remote access, successfully instructing them on repairs and avoiding potential massive losses This full-range service not only solves customers' immediate difficulties but also strengthens their confidence in intelligent management, driving the entire industry toward more efficient and sustainable development HaiBoTe's developed smart agriculture solution not only brought revolutionary changes to plant factories but also painted an encouraging picture for the future of the entire agricultural industry The excellence of this system is evident in several aspects firstly, it achieves precise control of the plant growth environment, significantly improving crop yield and quality stability Through advanced artificial intelligence algorithms, the system can forecast and adjust optimum growth conditions based on historical data and real-time monitoring information, ensuring each plant grows in the ideal environment Secondly, it significantly reduces energy consumption and operational costs, improving resource efficiency The intelligent management system optimizes water, electricity, and nutrient supply, reducing waste and lowering manpower costs Additionally, the system's modular design and strong compatibility allow it to seamlessly integrate various new and old equipment, providing a flexible solution for gradual upgrades of plant factories Most importantly, the system injects a sense of technology and modernity into agricultural production, helping to attract the younger generation to the field and injecting new vitality into the industry Looking ahead, HaiBoTe's smart agriculture system has broad application prospects and expansion potential In addition to plant factories, this system can also be applied to traditional greenhouse cultivation, urban agriculture, and even home gardening In the field of aquaculture, similar technology can be used to monitor and optimize the breeding environments for fish or shrimp In the food processing industry, similar intelligent monitoring and forecasting systems can be used to optimize production processes and enhance food safety Even in the pharmaceutical industry, this type of precise environmental management system could be applied to drug research and production processes To further promote this system, HaiBoTe could adopt a multifaceted strategy Firstly, they could collaborate with agricultural colleges and research institutions to establish demonstration bases, allowing more people to experience the benefits of smart agriculture firsthand Secondly, they could develop customized solutions tailored to different scales and types of agricultural production, expanding the applicability of their products Furthermore, they could raise awareness and acceptance of smart agriculture within the industry by hosting forums, online seminars, and sharing success stories Lastly, they could explore collaborations with government departments to integrate this system into policies supporting the modernization and sustainable development of agriculture, thereby promoting the widespread adoption of smart agriculture on a larger scale Through these efforts, HaiBoTe not only can expand its market share but also make a significant contribution to the sustainable development of global agriculture, truly realizing the vision of technology empowering agriculture 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」

這是一張圖片。 This is a picture.
AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOIAIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us Our company's current development We are committed toIOTsmart manufacturing our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification After discussing with IT service providers, we defined it asAOIAIa feasible operational model Tzuhong Technology has invested inAOIAIan inspection plan to checkSMTtext on components, solder joints, polarity, missing partsand usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates Industry pain points Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections Previous consumer products with undetected anomalies were acceptable within a certain ratio However, in the automotive industry today, undetected defects could lead to fatalities hence, the automotive industry has extremely high quality demands To survive in the automotive supply chain, we must address the issue of undetectable anomalies Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry Application technology and explanation Initially,Figure 1,PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products At this point, the 'suspected defective' portion accounts for20manual review for these20parts, further classifying the 'suspected defective' portion into good and defective products With We aim to leverageAItechnology, to shift from manual re-inspection of these20technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3thus reducing the workload of Tzuhong's employees from20down to only3In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0IAIDetectionFigure 2。 The original AOI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI information on defective products, then manually re-inspect one by one to determine if they are defective AOIAI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after, then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward, then manually re-inspect one by one to determine if they are defective Process differences By introducing theAOIAIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees Difference between pre and post-introduction Promotion strategy 1 Similar field diffusion allSMTmanufacturers face bottlenecks in inspections leading to shipment delays introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs 2 Cross-industry expansion plans negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness Profit strategy 1 In collaboration withAOImanufacturers, collect licensing fees 2 Direct sales toSMTthe manufacturing industryAIsystems 3 ProvideSMTmanufacturing industryAOIAIsystem subscription model「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」