:::

【2020 Application Example】 AI Detection System Using Deep Learning, Detecting Irregular Polyhedral Defects in Just 0.5 Seconds!

Traditional manufacturing industries rely on manual visual inspection of products, lacking stability in quality yield

For products made by traditional manufacturing industries, 'quality yield performance' is a critical issue and a decisive factor for customer business requirements. Although many AOI vision inspection systems have been introduced in recent years, there are still numerous limitations that cannot be overcome when automating these inspection systems.

For example, the production of small quantities of diverse products, the inability to standardize irregular polygonal product dimensions, and the halo effect on glass or metal products from different lighting angles make it difficult to assist product yield filtering through AOI vision inspection, thus many traditional manufacturing industries still use manual visual inspection on their production lines.

Manual inspection is labor-intensive and time-consuming, with expensive solutions from abroad

A domestic model creation company often needs to manufacture products that are customized and diverse. Although it uses imported high-grade mold equipment, product appearance quality testing is still largely done by manual visual inspection. Testing standards vary by employee, and to adequately inspect the appearance of each product, the time each person spends cannot be easily controlled. Often the same product needs to be examined repeatedly to meet quality standards, which is very labor-intensive and time-consuming and also sensitive to external environmental influences.

Although the model company had evaluated adopting foreign AOI vision inspection equipment, a single set of equipment is expensive and only capable of inspecting certain types of product parameters, and lacks a learning feature to achieve diversified inspection goals, thus passive maintenance of the original plan is still necessary…

Customized solution significantly improves inspection efficiency and saves labor costs

To reduce the misjudgment rate of manual operations and operational costs, thus enhancing the competitiveness of the company's products, the model company sought assistance from 500HU Tech Ltd., hoping through customized service to leverage AI Deep Learning technology to improve the shortcomings of traditional AOI vision inspection systems, expanding the range of products that usable vision inspection systems can handle, and more accurately enhancing the accuracy of vision-inspected products.

With the support of the AI Innovation Research Center at National Central University, and based on the definition of five defect conditions provided by the model company, such as scratches, lint, white spots, damage cracks, and uneven baking paint, the initial step involved gathering a training dataset and manually replicating defect conditions on other parts and angles of the product, then using a program to generate defect images under different angles and lighting changes, followed by marking defects.

Then, using software methods for training sets required by different algorithms, such as VGG, RestNet, Inception, DenseNet, Xception, SqueezeNet, target migration learning, classification problem Faster_Rcnn, SSD, Yolo, Mask_Rcnn, and other object recognition algorithms, after comprehensive consideration of accuracy and speed, SSD was chosen as the main core testing and inspection algorithm.

Then, the format of the training set required by the selected algorithm was produced, used as the comparative model; then, using different AI frameworks, such as tensorflow, keras, practical verification tests were conducted, and verification test reports were produced. Ultimately, optimal application parameters were adjusted for each product inspection, ensuring an average inspection accuracy rate of 95%, with the inspection time reduced from 5 seconds to an average of 0.5 seconds.

Originally, the model company's production process involved manual inspection followed by stamping a QC stamp on batches or sorting out defective products. After introduction of this inspection system, the original process was maintained, but it sped up the manual judgment time, and during the process, recording for archival purposes took place, with defective items highlighted in red and recorded as photos, thus categorized into a 'defective-to-be-inspected' section. Manual inspection would then determine if the product was qualified to move to the next inspection, significantly enhancing inspection efficiency and saving labor costs!

Low-cost, high-efficiency new AI inspection option!

As the technology of visual inspection by machines replaces human labor, it plays an increasingly vital role in the production of small, diverse orders, urgent orders, and situations where there is a labor shortage. In contrast to expensive foreign inspection solutions, domestic providers can offer relatively cheap and customized solutions; whether in terms of purchase costs or inspection efficiency, they are attracting more businesses ready to try, effectively enhancing the quality yield of manufacturers and thereby increasing competitiveness.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【解決方案】優式AI智能割草機器人 搶攻高爾夫藍海市場
USRROBOT's AI Lawn Mowing Robot Enters the Blue Ocean of Golf Market

An AI smart lawn mowing robot, resembling a vacuum robot, shuttles back and forth on the 30-hectare golf course lawn for weeding This robot, independently developed and designed by Taiwanese, is equipped with the world's first electronic fencing positioning technology which utilizes high-precision GPS integrated with cloud AI computation to determine the most efficient mowing paths, targeting the lucrative blue ocean market of golf courses This AI lawn mowing robot was developed by USRROBOT, a Taiwanese startup established in 2019 Chao-Cheng Chen, the president of USRROBOT, once served as the executive vice president of one of the top five ODM tech companies in Taiwan, and specializes in software and hardware integration When he served as the chairman of the Service Robot Alliance, he knew that the service robot industry was bound grow rapidly due to declining birth rates and the growingly severe labor shortage New demand - The horticulture market is large and the has rigid demand "To develop the core technology of service robots, we must find rigid demand Looking at European and American countries, there is a shortage of labor, but demand for horticulture has increased, and there has been a long-term shortage of 7-10 of horticultural workers" Under this strong "rigid demand," Chao-Cheng Chen established USRROBOT, and the company's first product is the AI lawn mowing robot In terms of overseas markets, the United States is the world's largest horticulture market, accounting for 30-40 of the global output value It is estimated that there are about 1 million horticulture workers, but they have been experiencing a labor shortage of 7-10 in recent years and have not been able to improve the situation The main reasons for labor shortage are Aging population and gardening is a labor-intensive job, so young people don't want to do it Unlike in Taiwan, European and American countries attach great importance to lawn maintenance and have expressly stipulated in the law that heavy fines will be imposed for failing to mow the lawn Therefore, the AI lawn mowing robot has considerable market development potential The introduction of AI multi-device collaborative mowing sensor technology is expected to reduce the burden of staff maintaining the golf course The AI lawn mowing robot developed by USRROBOT is currently in its second generation Domestic universities and well-known art museums are using the latest model M1, and it is also being used by some world-renowned high-tech companies and well-known universities in the United States The company is currently involved in negotiations for subsequent business cooperation USRROBOT stated that the professional RTK system currently used can reduce the original GPS positioning error from tens of meters to about 2 centimeters, allowing the robot to move accurately outdoors After setting the boundaries, it can be easily operated using the app New application - Implementation in golf courses solves the problem of labor aging and shortage Chao-Cheng Chen further explained that the National Land Surveying and Mapping Center is a RTK service provider RTK provides the error reference map of the positioning point USRROBOT can access the positioning error value of a specific position through 4G Internet access The AI algorithm of USRROBOT reduces the general 10-20 m error of GPS to 2 cm After positioning, USRROBOT then uses six-axis accelerator positioning, gyroscopes, and wheel differential sensing devices for software and hardware integration Only by matching the wheel's movement pattern and the terrain can accurate mowing path planning be achieved The AI lawn mowing robot, which is 62 cm wide, 84 cm long, 46 cm high, and weighs only 25 kg, can set the mowing boundaries in the cloud It can avoid pools and sand pits through settings, using AI algorithms to automatically calculate the optimal path It is able to mow approximately 150 ping of grass in one hour The battery can be used continuously for more than 6 hours The battery life is currently the highest in the world In addition to general gardening companies, with the assistance of the AI project team of the Industrial Development Bureau, Ministry of Economic Affairs, USRROBOT's AI lawn mowing robot has been applied to golf course lawn mowing A well-known golf course located in Taiping District, Taichung City currently has a staff of 5 people who are responsible for the lawn, planting maintenance, and other landscape maintenance of the entire 30-hectare course However, the average age of staff is as high as 55 years old, and the golf course has been unable to recruit new staff members for a long time In view of the aging staff and the shortage of manpower, the golf course hopes to mitigate the impact with AI technology, and is therefore using AI multi-device collaborative mowing sensor technology, in hopes of reducing the burden of staff maintaining the golf course New challenges - Expert systems are needed to overcome difficulties with different grass species "This AI lawn mowing robot has low noise, low pollution, low labor costs, and is waterproof and anti-theft In the lawn mowing process, it can identify and avoid obstacles through ultrasonic sensors while maintaining mowing quality, maintaining aesthetic and consistent grass length" Chao-Cheng Chen went on to say that the most important part about golf courses is that the grass pattern should be beautiful and free from diseases and pests Based on the site survey, golf courses are mainly divided into three major areas green, fairway and rough There is no problem using the current mowing robot to mow the rough area, and it can overcome slopes within 20 degreesThe short grass in the fairway area may only be two centimeters long, and the grass types are also different, so the cutterhead design needs to be modifiedAs for the grass in the green area, the grass must be mowed close to the ground and maintained in a consistent direction because it affects the putting speed Many factors will affect the green index, and this part requires more research and testing The AI lawn mowing robot can identify and avoid obstacles through ultrasonic sensors while maintaining mowing quality The AI smart lawn mowing robot has a built-in camera that can be used to detect the health condition of the lawn Chao-Cheng Chen said that in the future, an expert system will also be introduced for early determination of whether there are diseases, pests in the lawn or whether there is sufficient moisture, and provide lawn health data analysis to customers, so that they can take preventive and response measures sooner to reduce disaster losses Chao-Cheng Chen, who is also a good golfer himself, said that golf has developed well in Taiwan However, due to weather factors, such as rainy and humid climate and typhoons, Taiwan's golf courses have harder soil and more potholes compared with top tier golf courses overseas If AI lawn mowing robots are to be widely introduced into golf courses, there are still many difficulties that must be overcome However, Taiwan's difficult terrain creates a good testing ground Once Taiwan can overcome the many problems and successfully introduce the robot, it will be able to expand to overseas markets and seize new market opportunities in a blue ocean Chao-Cheng Chen, President of USRROBOT nbsp

【導入案例】哈瑪星科技建構AI模型管理平台 加速AI落地應用
Hamastar Technology Builds an AI Model Management Platform to Accelerate the Application of AI

Riding the AI hype train, financial service providers are using their solid foundation in the industry to not only transform themselves, but also assist their customers with transformation Hamastar Technology, which has been established for over two decades, has been developing AI technology and assisting industry customers with the implementation of AI in recent years Hamastar Technology believes that to implement a complete AI project, in addition to AI theoretical knowledge, data analysis, and model training capabilities, it is also necessary to develop APIs for data, establish databases, develop front-end RWD web pages, and even consider layout design and user experience based on customer needs These tasks create technical barriers for AI startups Even from the perspective of companies that have reached a certain scale, it is hard to accumulate technical experience and accelerate business growth due repeatedly investing manpower developing similar functions in each project Institutional customers still require high level of customization for AI Using the requirements of government Agency A implemented by Hamastar Technology as an example, users must control false information from specific channels The platform needs to provide data ingestion functions for training models and predictions, and can complete natural language processing NLP text classification model training and use When the model discovers false information, it needs to immediately notify responsible personnel through messaging software The need of Agency B is to use an AI model to automatically classify petitions and immediately provide information on past cases as reference for the petitioner or officer Although the project models are similar data ingestion, model prediction, warning notification, the required functions still need to be separately developed for individual projects, and existing programs and models cannot be reused to speed up the implementation of subsequent projects After in-depth discussion, Hamastar Technology found that pain points of enterprises implementing AI projects include high implementation costs and lengthy project schedules It is difficult for a single enterprise to simultaneously have data scientists, analysts, engineers, and designers Current projects are all focused on solving the needs of specific fields, and it is difficult to reuse the AI models in other fields of application At the same time, the tools are concentrated in AI projects and cannot provide customers with total solutions In other words, due to the "limited manpower," "restricted fields," and "insufficient tools" of AI service providers, the implementation of AI technology projects requires high costs or lengthy timelines These are common problems that companies urgently need to solve Therefore, if there is an AI model application service management platform, it will be able to solve the above difficulties and not only reduce costs, but also accelerate project implementation and provide customers with one-stop solutions AI model application service management platform assists in quickly completing projects Therefore, with the support of the AI project of the Industrial Development Bureau, Ministry of Economic Affairs, Hamastar Technology carried out the "AI Model Application Service Management Platform AISP RampD Project" and engaged in the RampD of AISP products The purpose is for AI service providers to complete the AI projects with twice the result using only half the effort The AISP provides one-stop AI solutions AI service providers can quickly assemble required functions, such as data API, model management, and model prediction result monitoring subscription through existing module functions of the AISP It also provides commonly used graphical tools to help companies quickly design interactive charts or dashboards required by users, effectively reducing the labor costs required to execute projects, shortening the solution POC or implementation time, and accelerating the implementation and diffusion of industry AI In terms of product business model, in the short term, the company will extensively invite IT service providers with expertise in the field of AI to work together, and use platform services to solve the AI implementation problems faced by requesting units in various field, gradually building trust in the platform brand In the mid-term, the company hopes to gradually expand the market based on its past success, and form strategic alliances with multiple IT service providers to solve more and wider problems in specialized fields and provide more solutions for units to choose from The platform combines field experts to jointly expand overseas markets In the long term, after establishing AI strategic alliances in various specialized fields, the platform will have a large number of AI solution experts for specialized fields After accumulating a large amount of successful project experience, Hamastar Technology hopes that the AISP will be able to work with experts companies to expand into the international market Harmastar Technology Co, Ltd was formed in 2000 by recruiting numerous senior professional managers and technical experts in related fields It is committed to software technology RampD and services, and aims to develop into an international software company, actively creating opportunities for international cooperation in the industry Under the excellent leadership of its first president, the company has rapidly grown into a major software company in Taiwan

這是一張圖片。 This is a picture.
CCTV Intelligent Video Search System

Search for a specific person, find someone with a suitcase entering the factory in Gao'an area Color features of the person and the object confirmed, person in blue and black top, suitcase in black color, throughCCTV the intelligent video search system, by setting object and color retrieval conditions, it can successfully locate three video clips containing the target subject This greatly aids operational staff in finding the target items, and through this system, search speed can far surpass manual effort6fold Pain Points The CSE-Kaohsiung Plant is densely equippedCCTVto monitor every corner of the plant area, but when an incidenthappens, it's impossible within a limited time throughCCTVvideo playback to find the incident, the implications and risks behind this are self-evident Many areas that are usually unmanned can easily become security blind spots Thus, how to monitor a vast plant area more intelligently and effectively is one of the crucial aspects of building a smart plant for the semiconductor industry The AES Plant in Kaohsiung covers a vast area, with many important sites requiring monitoring of personnel movements to ensure corporate secrets and employee safety 1 Automated production lines and warehouses In semiconductor enterprises’ automated production lines and warehouses, oftenAGV(Automated Guided VehicleAGVs automated guided vehicles travel at high speeds if plant personnel inadvertently enterAGVthe moving area and cannot issue a warning to the person, then the regrettable accidents that occur will be too late to reverse 2 Material and product storage areas Materials used in semiconductor-related processes are costly if areas storing materials or products are breached, there is a risk of loss of high-value materialsproducts 3 High-security areas Trade secrets relate to the core technological competitiveness of semiconductor-related enterprises if someone breaches the high-security areas, there is a risk of corporate secrets being leaked The safety of trade secrets has always been one of the most critical issues for semiconductor enterprises 4 Loading docks At AESLButthe dock area often has loading vehicles coming and going if someone intrudes into the dock area, there is a risk of vehicle collisions and accidents Additionally, goods awaiting shipment at the dock area could be stolen or potentially damaged from collisions, thus causing significant reputation and financial losses for the company, further leading to production and shipping inconvenience When an abnormal event occurs, how to quickly search for the relevant key footage from massive data Many important locations within the AES Kaohsiung Plant need to be equippedCCTVfor safety checks, butCCTVWith thousands to tens of thousands of cameras, manually searching through footage for an event requires laborious frame-by-frame review which is time-consuming and inefficient In light of advancements in computer vision, it's beneficial to utilizeAIto replace manual playback and searching Problem Scenario Object Detection The data source for object detection comprises two parts Open-source datasetsOIDv4and AES Kaohsiung PlantCCTVImage files For these files, search for usable data, specificallyOIDv4image files For these files, extract the defined nine major categories of objects for training data among them, two object categories, knives and gasoline barrels, were not found inOIDv4found usable data for knives and gasoline barrels, while the remaining seven categories of objects are available fromOIDv4useful training data found for the remaining seven categories of objects, all marked Regarding the Kaohsiung PlantCCTVimage files, select some frames Frame of the footage, and manually annotate the objects to be_detected for training and testing data Nine Major Objects Color Recognition The data source for color recognition is divided into two partsInternet image screenshots, and Kaohsiung PlantCCTVimage files Currently, no publicly available open-source datasets specifically for color recognition applications have been found, so images are collected from the web Search the web for images of the defined nine major object categories, save the images after separating the objects from the background, keeping only the object sections, and mark the images according to color Additionally, for the Kaohsiung PlantCCTVimage files, use the already-markedbounding boxextractCCTVimage files from variousFramesections of objects identified by color, and finally, visually identifiable images are marked according to color Each object category has its specific color definition, depending on the usual colors seen in these objects in real life Dynamic Ignore during Training FromOIDv4during the training of the object detection pilot model, since each image in this dataset is only marked for a single category, but the image may contain other desired detection categories unmarked For such cases, dynamic ignore techniques will be employed during training to avoid confusion Next, use the extracted training data from the Kaohsiung Plant toFine-Tuneenhance the detection rate of the object in specific designated areas Finally, select the model that computes the lowest loss value in the test set during the training process as the main object_detection model Dynamic Ignoring AIHelp You View CCTV The intelligent video search system primarily serves as an assistive system for searching surveillance footage, capable of speeding up the process of finding target events by setting search conditions for objects By simply defining the search conditions, you can quickly produce thumbnails of critical objects and playback for review, shortening the time required for manual case retrieval of the past The search time is quickly6doubled, allowing the front-end security unit to use this platform to strengthen the first line of risk management supervision and take timely preventive measures 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」