:::

【2020 Application Example】 AI Detection System Using Deep Learning, Detecting Irregular Polyhedral Defects in Just 0.5 Seconds!

Traditional manufacturing industries rely on manual visual inspection of products, lacking stability in quality yield

For products made by traditional manufacturing industries, 'quality yield performance' is a critical issue and a decisive factor for customer business requirements. Although many AOI vision inspection systems have been introduced in recent years, there are still numerous limitations that cannot be overcome when automating these inspection systems.

For example, the production of small quantities of diverse products, the inability to standardize irregular polygonal product dimensions, and the halo effect on glass or metal products from different lighting angles make it difficult to assist product yield filtering through AOI vision inspection, thus many traditional manufacturing industries still use manual visual inspection on their production lines.

Manual inspection is labor-intensive and time-consuming, with expensive solutions from abroad

A domestic model creation company often needs to manufacture products that are customized and diverse. Although it uses imported high-grade mold equipment, product appearance quality testing is still largely done by manual visual inspection. Testing standards vary by employee, and to adequately inspect the appearance of each product, the time each person spends cannot be easily controlled. Often the same product needs to be examined repeatedly to meet quality standards, which is very labor-intensive and time-consuming and also sensitive to external environmental influences.

Although the model company had evaluated adopting foreign AOI vision inspection equipment, a single set of equipment is expensive and only capable of inspecting certain types of product parameters, and lacks a learning feature to achieve diversified inspection goals, thus passive maintenance of the original plan is still necessary…

Customized solution significantly improves inspection efficiency and saves labor costs

To reduce the misjudgment rate of manual operations and operational costs, thus enhancing the competitiveness of the company's products, the model company sought assistance from 500HU Tech Ltd., hoping through customized service to leverage AI Deep Learning technology to improve the shortcomings of traditional AOI vision inspection systems, expanding the range of products that usable vision inspection systems can handle, and more accurately enhancing the accuracy of vision-inspected products.

With the support of the AI Innovation Research Center at National Central University, and based on the definition of five defect conditions provided by the model company, such as scratches, lint, white spots, damage cracks, and uneven baking paint, the initial step involved gathering a training dataset and manually replicating defect conditions on other parts and angles of the product, then using a program to generate defect images under different angles and lighting changes, followed by marking defects.

Then, using software methods for training sets required by different algorithms, such as VGG, RestNet, Inception, DenseNet, Xception, SqueezeNet, target migration learning, classification problem Faster_Rcnn, SSD, Yolo, Mask_Rcnn, and other object recognition algorithms, after comprehensive consideration of accuracy and speed, SSD was chosen as the main core testing and inspection algorithm.

Then, the format of the training set required by the selected algorithm was produced, used as the comparative model; then, using different AI frameworks, such as tensorflow, keras, practical verification tests were conducted, and verification test reports were produced. Ultimately, optimal application parameters were adjusted for each product inspection, ensuring an average inspection accuracy rate of 95%, with the inspection time reduced from 5 seconds to an average of 0.5 seconds.

Originally, the model company's production process involved manual inspection followed by stamping a QC stamp on batches or sorting out defective products. After introduction of this inspection system, the original process was maintained, but it sped up the manual judgment time, and during the process, recording for archival purposes took place, with defective items highlighted in red and recorded as photos, thus categorized into a 'defective-to-be-inspected' section. Manual inspection would then determine if the product was qualified to move to the next inspection, significantly enhancing inspection efficiency and saving labor costs!

Low-cost, high-efficiency new AI inspection option!

As the technology of visual inspection by machines replaces human labor, it plays an increasingly vital role in the production of small, diverse orders, urgent orders, and situations where there is a labor shortage. In contrast to expensive foreign inspection solutions, domestic providers can offer relatively cheap and customized solutions; whether in terms of purchase costs or inspection efficiency, they are attracting more businesses ready to try, effectively enhancing the quality yield of manufacturers and thereby increasing competitiveness.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【解決方案】佐翼科技無人機導入高爾夫球場域 可節省一半人力
Droxo Tech Applies Drones in Golf Courses to Reduce Manpower by Half

For most golf courses, the operations and management is a headache "Golf courses are selling turf and need to be properly taken care of," a golf course manager bluntly pointed out Facing the market pain points of labor shortage, aging population and high cost, the use of AI drones for pesticide spraying and pest control will reduce labor costs by more than half and greatly improve the overall operational efficiency At noon in early summer, an AI drone is slowly taking off at the Taipei Golf Club in Taoyuan Its main task is to test AI drone fertilizing and pesticide spraying on the golf course In fact, drones of Droxo Tech, the company performing this task, are widely used for fertilization, pesticide spraying, and pest and disease control for rice, bananas, and tea trees For golf courses with turfs that often cover tens to hundreds of hectares, AI drones are needed to assist in turf maintenance Data collection, development of pesticide spraying AI models, and multispectral image analysis and testing will be carried out in the current stage In the future, large-scale technology implementation and verification will be carried out to set an example for applying drones to golf courses Using AI drones to fertilize and spray pesticides can reduce the manpower required by half The traditional way of maintaining the turf in golf courses is to carry spray buckets or drive spraying vehicles to spray areas one by one "Domestic golf courses began to plant ultra-dwarf Bermuda grass in 2001 This grass species prefers a cool climate and is not suitable for Taiwan's hot and humid weather" Droxo Techrsquos CEO further pointed out that to prevent turf from pests and diseases, pesticide spraying is necessary For an 18-hole golf course, it is equivalent to spraying pesticides once a week, and the T-ground and fairways are sprayed every two months For golf courses, spraying pesticides is time-consuming and labor-intensive It is important to note that large-scale spraying will increase the risk of personnel poisoning and increase the amount of pesticide used Benefits of applying agricultural drones to golf courses According to Droxo Techrsquos research, golf course pests include Spodoptera litura, which comes out at night to look for food, so pesticide spraying must be carried out in the evening According to the traditional method, pesticide spraying requires two vehicles and three personnel for a total of 45 hours If AI drones are used for fertilizing and pesticide spraying, it only takes one operator to spray 08 hectares of land in 20 minutes, saving about two-thirds of the manpower and reducing operating costs by about 30 Using AI drones to fertilize and spray pesticides on golf courses can reduce the manpower required by half In addition to the significant benefits of using agricultural drones for golf course turf maintenance, Droxo Tech also specially introduced AI multispectral image recognition for NDVI Normalized Difference Vegetation Index analysis "The so-called multispectral is to direct light with different wavelengths on the turf, and the reflected images are collected for analysis" Droxo Tech CEO Liu continued to explain that each plant absorbs light with different wavelengths, so multispectral imaging can determine the growth status of grass species At the same time, combined with AI image recognition, the distribution of pests and diseases can be accurately detected, and the amount of pesticide used is determined on this basis Cross-domain collaboration to build a multi-source turf image databasenbsp Using AI multispectral image recognition technology, Droxo Tech will collect visible light, multispectral, thermal images, and hyperspectral images to establish a multi-source turf image database to fully understand the growth cycle of Bermuda grass Droxo Tech has accumulated rich experience in agricultural AI drone pesticide spraying , but there are still many problems that need to be overcome to implement AI solutions in golf courses For example, it is necessary to establish a new pesticide spraying model and test flight methods, especially the application of multispectral image recognition PoC is not difficult, but actual implementation requires more test evidence, repeated inferences, and collaboration with plant experts This part must rely on the cross-domain integration of legal entities such as the Institute for Information Technology III, gathering more fields for verification, and creating a paradigm before it can be more widely adopted by golf courses There are not many international cases on the application of AI drones in golf courses During the verification process, it is not yet known whether it can be quickly copied to the next golf course However, Droxo Tech CEO Liu believes that through cross-domain collaboration, clearly defining the problems and listing them one by one, supply and demand parties can reach a consensus, propose solutions to each problem, and seek cooperation with internal and external resources Only then will we be able to gradually achieve the goal of making golf courses smarter and smoothly assist the industry with transformation Zuoyi Technology's CEO, Liu Junlin 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

這是一張圖片。 This is a picture.
Testing Seat Contact Components AI Intelligent Flaw Detection

With rapid development in 5G, AIOT, automotive electronics, and other downstream sectors, the entire supply chain is expected to benefit from this consumer market As product demand momentum gradually increases, increasing production efficiency and reducing operational costs become the most important issues In order to meet the needs of customers for various packaging types, Yingwei Technology has been committed to developing highly customized test seats However, a resulting pain point is the inability to mass-produce and fully automate operations with machines some tasks still rely on manual execution In this project, the probe part of the test seat was outsourced in 2021, and under current and future large-scale demands, work hours, costs, supply, and quality are issues Yingwei faces The company achieves a defect detection rate of 9995, which seems high, but with an average inspector able to inspect 10,000 needles per day, there would still be 5 defective needles On a test seat that is only 3 cm wide with approximately 1,000 needles, just one defective needle could potentially lead to faulty testing at the customer end As the current operational mode relies on manual visual inspection, external factors such as fatigue or oversight of personnel, and subjective judgment by inspectors may lead to the outflow of defective products, which necessitates strict quality control of contact components We once sought to utilize optical inspections Rule-based for controlling the quality of appearances, but the metallic material of the contact components leads to light scattering, background noise interference, background scratches, and material issues that could result in misjudgments Therefore, we decided to look for AI technology service providers to solve our detection difficulties Developments of Dedicated AOI Line Scan Equipment To meet the needs for inspecting thousands to tens of thousands of probes within our company's IC test seats, traditional surface imaging and individual needle imaging would be too slow to achieve rapid inspection and labor-saving goals In response, the service provider proposed a trial with an AOI dedicated line scan module solution Utilizing a width of 63mm on the X-axis for reciprocal scanning of all probes on the test seat, the tests allowed for the simultaneous scanning of 8-9 probes, significantly enhancing the future detection efficiency of AOI machines This project will proceed with the aforementioned innovative Proof of Concept POC, focusing on the development of the line scanning equipment and performing imaging, learning, and training on both normal and abnormal probes provided by our company, with initial AI model training aimed at preliminary approval This project's customized line-scan imaging module Ideal future imaging result illustration A Single AI Technology Solution for MeasurementDetection Needs Unified use of AI DL CNN learning methods, instead of the current Rule-based system which necessitates defining each defect individually, to meet the needs for abrasion measurement and appearance defect detection of malfunctionsforeign objects When the same machine uses both measurement and detection technologies, not only does it increase costs, but it also affects the detection speed Hence, the service provider recommends the use of a line scan device for imaging Its resolution is sufficient for AI to simultaneously determine appearance defects and assess the condition of needle tip abrasion, as detailed below Line scan pixel imaging displaying needle tip abrasion conditions This AI detection technology meets both measurement and inspection needs for Yingwei, not only bringing more benefits to future probe testing but also introducing an innovative axis in AI technology Change the method of human inspection, enhance work efficiency and product quality After combining both hardware line scan and software AI model training approaches, we successfully ventured into new AOI detection applications Following the AI implementation POC, including the development and validation of a customized line scan module and an initial AI model, the plan is to officially develop the AOI machine next year and integrate it into the IC test seat production line Future Prospects Probe manufacturers upstream and downstream IC factory users both have needs for the AOI inspection machine upstream can ensure probe quality before leaving the factory, while downstream users can use this machine to regularly inspect the condition of numerous IC test seats in hand Given the future demands, the AOI machine is poised to have a significant positive impact on the IC testing industry in the foreseeable future 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【導入案例】挺進智慧物流50 新竹物流醫材配送班表超高效率
Advancing to Smart Logistics 5.0: Hsinchu Logistics Delivers Medical Materials with Ultra-High Efficiency

After incorporating AI technology, traditional logistics companies have seen significant improvements in transportation efficiency and reductions in transportation costs, especially in the transfer of medical materials which involves timely service and rights of hospitals and patients The implementation of intelligent logistics can save medical material businesses the cost of constructing GDP warehouses and other expenses up to millions A major domestic logistics leader, Hsinchu Transport HCT, owns a fleet of 3,500 vehicles and a storage area of 60,000 square meters, providing customized logistics solutions including logistics, commerce, finance, information, distribution, storage, and processing The company handles up to 580,000 parcels per day, with a maximum capacity reaching 900,000 parcels, making the enhancement of transshipment efficiency crucial for HCT Medical materials transportation at hospitals need optimization of current operational processes and enhancements in systematization and intelligence Especially the transportation of hospital medical materials, which encounters various challenges Medical materials suppliers need to cater to varying customer product demands, temperature requirements, and delivery times through multiple logistics providers This highly depends on the experience and careful control of operations staff Whether it is the product shipment or actual logistics process, each step must be interconnected Any human errors can impact the service timing and rights of the hospitals and patients Thus, all concerned businesses, along with the government and hospitals, are working to optimize current operational processes and elevate the level of systematization, automation, and intelligence to minimize service errors and cost losses HCT's distribution process prior to AI implementation Currently, with the government's push for standardized platform operations on the demand side of hospitals, supply-side businesses collaborate through data coordination to improve the accuracy and efficiency of product shipments, enhancing operational quality and management benefits at the demand side At the same time, some businesses are also investing in the standardization and systematization of internal operational processes, thus enhancing operational efficiency and quality In the freight logistics sector, logistics companies' warehouse staff need to expend labor to control different logistics shipment operations If they often receive emergency task notifications for shipments to medical facilities, they usually depend on small regional logistics providers to provide customized delivery services Although this improves delivery times, it does not allow for integrated informational services The new GDP regulations for medical materials require suppliers to undergo GDP compliance certification Therefore, Hsinchu Transport, assisted by the Ministry of Economic Affairs' AI coaching program, not only extends existing logistics services compliant with GDP regulations but will also use data integration and optimized AI technologies to help medical material businesses streamline and improve their logistics operations Complex logistics issues are solved using the Simulated Annealing SA algorithm To meet the 'Good Distribution Practices for Medical Devices,' Hsinchu Transport is not only actively introducing new logistics vehicles but will also implement artificial intelligence-based mathematical optimization technologies to assist in intelligent scheduling at nationwide business points and transshipment stations They aim to optimize the routing of medical materials between business points or regions thereby enhancing efficiency in the distribution process Currently, during the transshipment process of medical materials at Hsinchu Transport, detachable tractor heads and containers are used Each business point and transshipment station differ in location design and staffing, impacting the throughput per unit of time Furthermore, daily cargo conditions size, destination vary, and due to these fluctuating and distinct demands, the deployment of tractor heads and containers changes accordingly Under these circumstances, Hsinchu Transport relies on past experiences to schedule departures at each satellite depot and adjusts daily according to the cargo needs Due to the reliance on empirical scheduling, it is often difficult to consider all variables and considerations, leaving room for improvement in the current departure schedules The cargo delivery planning inherently constitutes an NP-Hard problem, difficult to solve with traditional analytical methods Hsinchu Transport, in collaboration with Singular Infinity, utilizes the Simulated Annealing SA algorithm to find solutions The new logistic service introduced by Hsinchu Transport is 'GDP Container Shift Planning' This planning involves estimating future volumes of medical materials between stations and scheduling container truck shifts accordingly, ensuring timely and quality delivery of medical materials while maximizing operational benefits and reducing travel distances Hsinchu Transport introduces AI-optimized shift planning, constructing the most efficient route from its origin to destination Hsinchu Transport introduces 'Optimized Shift Planning' service, reducing transportation costs by 5 The introduction method involves using cloud software services Hsinchu Transport regularly inputs 'Interchange Item Tables' from station to station into the 'Optimized Shift Planning' service After setting the algorithm parameters, a GDP container shift schedule is generated At the same time, developing a Hsinchu Transport medical material scheduling system allows Hsinchu Transport's medical transport units to compile suitable schedules through the Interchange Item Tables Under the same level of service, it's estimated that this can reduce transportation costs by 5, saving medical material businesses millions in construction costs for GDP warehouses and distribution Due to its requirements for sanitation, temperature, and its fragility, the transportation and transshipment of medical materials should be minimized to reduce exposure and risk However, logistics efficiency and costs must still be considered AI designs the most efficient route for each cargo from its origin to destination, effectively completing daily transportation tasks In response to the future high development demand of industrial logistics, distribution and transshipment AI optimization will be a key issue Through this project, a dedicated project promotion organization will be established, staffed with AI technology, IT, and process domain talents After accumulating implementation experience, the application of AI will gradually expand, comprehensively optimizing and transforming Hsinchu Transport's operational system, and partnering with AIOT and various AI domain partners to accelerate and expand the achievement of benefits「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」