【2019 Application Example】 How can public restrooms rely on IoT and cloud technology to become cleaner, solve 70% of customer complaints, and increase efficiency by 120 times?

編輯群2019-11-21

IoT smart restroom: A revolution of clean, power-saving, and convenient new smart restrooms

Six sensors are used to detect toilet paper, hand soap level, water leakage, odor, people flow, and toilet usage conditions, and combined with NBIoT transmission, cloud system, and LINE robot. It greatly reduces customer complaints and improves the efficiency of replenishing consumables in restrooms. Coupled with real-time notifications, it can prevent illegal smoking in restrooms and improve safety. Users will no longer face the dilemma of wet, dirty, smelly restrooms, or toilet paper running out, greatly upgrading their experience.

What is your impression when you walk into a public restroom in a popular tourist area? No hand soap? No toilet paper? Or even a dirty, smelly, and leaking restroom? The IoT big data smart restroom solution of the Institute for Information Technology (III) solves all inconveniences of restrooms all at once.

According to statistics of the Environmental Protection Administration (EPA), Executive Yuan, there were more than 43,000 public restrooms registered and managed in Taiwan as of the end of September 2019, but the entire EPA only had over 34,000 people. Cleaning and managing such a large number of sites is obviously not an easy task. Coupled with the inevitable arrival of an aging society, the number and quality of personnel cleaning restrooms will inevitably encounter unprecedented bottlenecks. The introduction of effective service processes and assistance of technologies has become a major issue that must be faced sooner or later.

The IoT smart restroom service solution demonstrated by the III at over 20 restrooms around Taiwan may provide a good direction for us to solve this problem.

Overwhelming number of customer complaints, four major problems, and three solutions of the III

In 2016, when the MRT Songshan Station, which is connected to the train station, was officially opened, the public restrooms that were already at full capacity resulted in serious customer complaints due to the overwhelming use. Songshan Train Station, which originally had an average daily passenger volume of only 40,000, was already near a bottleneck in service capacity. After the connected MRT Songshan Station was opened, the number of passengers increased to 70,000. The restrooms that were already near full capacity were completely unable to cope with the additional passenger volume after the MRT station was opened.

Cao Xueqin once wrote a classic line that touched people's hearts in the novel "A Dream of Red Mansions": "When a wall is about to collapse, everybody gives it a shove" may be able to describe this phenomenon: The toilet paper and hand soap in each restroom was never replenished in time, the sinks were dirty, and the toilets could never be cleaned in time. There was an overwhelming number of customer complaints about the restrooms as a result. In addition, the public restrooms of Songshan Train Station are closer to the main passageways of passengers than the public toilets of MRT Songshan Station. At this point Songshan Train Station had to face and solve this problem.

Since Songshan Train Station has worked with the III for a long period of time, it commissioned the III to help solve this troublesome problem.

Edison has a famous saying: "If I find 10,000 ways something won't work, I haven't failed. I am not discouraged, because every wrong attempt discarded is another step forward." The first thing that the III needs to do is conduct pain point analysis and think about the underlying problem. After reviewing customer complaints and discussing and analyzing them with front-line cleaning service companies, the III found four problems and three solutions:

The four problems are: Toilet paper and hand soap are not promptly replenished, sinks are damp, and the space has a foul smell.

The three solutions correspond to these four problems respectively: 1. Delicacy management of consumables such as toilet paper and hand soap. 2. Digitize the key performance indicators (KPI) in the service process, such as the dampness of the sink, or the odor concentration in the space. 3. Use new Internet of Things (IoT) technology to implement the first two solutions, and assist big data and cloud technology in achieving efficient site cleaning management.

"Technology features and R&D process"

The combination of six key sensors with IoT cloud motherboard and big data, thoroughly resolving 70% of customer complaints and increasing efficiency by 120 times.

I. Delicacy management of consumables

To achieve delicacy management of toilet paper and hand soap, the first step is to develop sensors to detect these two consumables.

Starting in 2017, the III began to design the first infrared toilet paper detection module. The module mainly uses the physical characteristics of toilet paper usage habits for detection: Under normal use, toilet paper is placed on an iron drum holder, and its thickness slowly becomes thinner as it is used.

This module requires the combination of a position sensitive detector (PSD ), infrared emitting diode (IRED), and signal processing circuit (SPC) to effectively determine the length of toilet paper with accuracy reaching one decimal place.

When the detection module was first developed, there were no designs that could be referenced, so sensor selection, circuit board designing and planning, sensor programming, and even the light-cured 3D printed casing design were all completed in the III.

Public restroom field detector demonstration image

However, despite overcoming all the difficulties in designing and producing the toilet paper sensor, there was no way to foresee that fixing the sensor in place would be the most difficult problem.

The III team shared with us: “At first, we used hot melt adhesive to fix it in place, but cleaning personnel needed to open and close it every time they replenished toilet paper. The sensor fell due to too much vibration and not being firmly fixed in place.

The worst situation was in the women's restroom: When a female passenger was using the toilet, the sensor was not properly fixed in place and fell. Don’t you think this sensor looks like a pinhole camera? If something like this suddenly falls on the ground in the women's toilet, how bad do you think it will be? (laughs)

Fortunately, our superiors supported us, and we continued to develop the technology until we were able to successfully fix the sensor firmly in place. Otherwise, this project would have been aborted a long time ago."

Sensor with line interactivity demonstration

After the toilet paper detection module was launched, an inspection of toilet paper usage that once took cleaning personnel 15-20 minutes to complete now only takes 10 seconds by opening the app. This greatly improved efficiency by 120 times.

Now that the consumption of toilet paper has been solved, the next problem is detection when hand soap is at a low level.

Unlike toilet paper, the amount refilled each time for hand soap isn't always the same. Because the design philosophy was to use the lowest cost and most stable components to complete this function to facilitate future scaling, a common Hall sensor was chosen. It was mounted on the exterior of the soap dispenser to achieve the detection of low soap levels.

The principle is actually very simple. Once the liquid level is lower than a certain percentage, the Hall effect sensor can sense the change in voltage from electromagnetic induction of the liquid level. The sensor sends a signal to the back-end cloud server, and then the server then sends a message to cleaning personnel the same as the toilet paper sensor.

II. Digitization of key performance indicators (KPIs) in service processes

If the sink is wet, water will often seep onto the floor. In addition, the bottom of passengers’shoes will inevitably carry dust, so the floor will become dirty when they step on the wet floor. Visually, this will give people a sense that the “restroom is dirty." However, it is impossible to have cleaning personnel on duty in the restroom at all times, so a special sensor is needed to detect this situation.

The III uses the resistance characteristics of thin film resistors. When there is liquid on the surface of the thin film resistor, it will lower the overall resistance value and further change related values of the analog signal output. In this way, moisture can be detected by simply laying thin film resistors on surfaces that often become wet. For example, next to the windowsill or on the sink.

However, since sensors are relatively expensive and scratches will damage the performance of the sensors, this moisture detection sensor is only used in specific public restrooms.

Apart from looking dirty, if a foul smell comes from a public restroom, people will think it is dirty even if it looks bright and clean.

However, odor detection is not that easy to solve.

At first, we searched all kinds of sensors in Taiwan and overseas to find this "electronic nose." We eventually found a suitable MEMS chip in the product line of a major Japanese manufacturer that specializes in the production of gas sensors.

The III started from breadboard testing, circuit design drawings, to outsourced chip production, taking nearly six months to complete the design of the sensor.

Furthermore, in the process of developing smart restrooms, we also received requests to develop other modules, such as people flow detection and usage detection.

During the development process, we found that users may accidentally close the door of some accessible toilets after use and forget to turn off the lights, so it seems as if the toilet has been occupied all day long. However, people who really need to the toilets are blocked outside the door of accessible toilets that are actually vacant. This problem was relatively simple. The engineer found a ready-made people flow sensor module and installed it under the sink, and the problem was easily solved.

In addition, environmental protection and carbon reduction requirements are hard to meet for some remote public restrooms, such as Tri-Mountain (Lishan) National Scenic Area. Due to the remote location, responsible personnel must turn on the lights every day at work and turn off the lights when they get off work. Sometimes not many tourists use the public restroom all day long, but all the lights and equipment are still on all day long, which is a waste of electricity.

Generally, commercially available sensors are very dull and will turn off the power as soon as the set time of 30 seconds to 10 minutes is up. Such a sensor may be adequate at home when only one person uses the toilet. However, in a restroom that can easily reach 60 ping or above, several detectors will be needed to work together to ensure whether there are still users in the restroom. This is another problem without a commercially available solution. The III had no choice but to integrate multiple sensors and develop algorithms on the MCU to solve this problem.

III. The introduction of new IoT, cloud, big data, and 5G NBIoT technologies

On the path of innovation, there are always difficulties waiting for engineers to overcome. In the process of solving problems as they come, we also refined the solution step by step, making it cheaper, more reliable, and more convenient.

After the sensors described above were completed, the system gradually generated new problems for the III to solve. For example, the barrier of user habits, power consumption issues, cost issues, etc.

The app was changed to a LINE group robot to become more aligned with user habits

When the public restroom of about 60 ping at Songshan Train Station was completed for the first time in 2017, MCU and WIFI communication were used to monitor and transmit data to the server around the clock. After the system determines an abnormality, it uses the mobile app developed by the III to notify cleaning personnel.

This design seems to be impregnable at first glance. However, the average age of on-site cleaning personnel is over 50 years old, no one used the dedicated app, and front-line personnel often deleted the program within a few days of use. There is a whole set of sensors monitoring, but no cleaning personnel actually use it. User habits are often the biggest obstacle to the introduction of new technologies.

After conducting user interviews we found that the cleaning personnel of every public restroom have a LINE group.

The III team mentioned: "Knowing that they ( cleaning personnel ) have a LINE group makes things easier!

At first, we cautiously asked the cleaning personnel if they would invite a robot "new colleague" to help inspect toilet paper and determine abnormalities in the restrooms.

At the beginning, the cleaning ladies were a little skeptical. When they discovered that this robot "new colleague" was very useful, they fell in love with it."

Due to cost, environmental protection, and convenience issues, WIFI was upgraded to NBIoT communication protocol.

WIFI is fast and has wide bandwidth. A restroom has a men's room and women's room, which requires two separate systems for monitoring, and each system needs an independent 4G network to connect to the cloud system. Therefore, the construction and communication costs are relatively high, and the power consumption is also relatively high.

At this point, readers may have questions: Public restrooms are all set up in public spaces. Is there no public WIFI network available?

The III team gave us a very in-depth answer: "Actually, almost every public space has a WIFI network that can be used. However, sharing WIFI with other people is prone to interference, and IoT devices are simple and lack security control mechanisms. If you use public WIFI, there is a certain degree of security. risk.

Therefore, in our solution, we still designed a closed WIFI communication system to solve the communication problem.

In addition, since a WIFI base station can only support 20-30 nodes, a women's room with 18 toilets requires a separate systems. Coupled with the fact that it is separated by a concrete wall, the signal will be very weak and even affect the stability of the signal. Therefore, a public restroom installing two systems is mainly due to stability considerations rather than cost considerations."

In densely populated areas, using WIFI to transmit data to the server is not too troublesome. However, when smart restroom systems are beginning to be applied to restrooms in remote areas, such as Lishan, Guguan, Shitoushan and other public restrooms of national park visitor centers, maintaining network connection is indeed a difficult problem.

Fortunately, new generation mobile communication networks of 5G includes narrow-band Internet of Things (NBIoT) specially designed for the Internet of Things. The III is the first in Taiwan to develop Taiwan's first NBIoT MCU control system designed for smart restrooms using the NBIoT chipset of a domestic chip manufacturer.

In addition to the significant cost reduction, this system is also very energy efficient, requiring only 1/6 of the power of the original WIFI system. The most important thing is that compared to traditional WIFI, which requires a relatively stable 4G signal connection, this system has wider coverage and allows communication deep in the mountains and out in the wild. This allows wider coverage of smart restrooms in the future without being limited by network signals.

IV. "Effect Analysis and Future Outlook"

IoT smart toilet: A revolution of clean, power-saving, and convenient new smart toilets!

As the complete set of sensors, cloud system, NBIoT, and LINE robot are gradually launched, the benefits are clear.

In the case of public restrooms at Songshan Train Station, from being overwhelmed at first to greatly reducing the number of customer complaints by 70%, the time required to inspect toilet paper use was shortened from the original 15-20 minutes to only 10 seconds. Once an abnormal situation occurs, it has gone from being undetected to the prompt notifications today.

Interestingly and unexpectedly, this entire system also brings the added benefits of safety and thorough enforcement of tobacco hazards prevention laws. When a toilet is occupied for more than 40 minutes, a warning will be sent to the cleaning personnel group. Hence, when a user occupies a toilet for too long, cleaning personnel will knock on the door. This greatly improves safety.

In addition, odor detectors are also very sensitive to the smell of smoke. Since smoking is prohibited in national parks, tourists sometimes sneak into public restrooms in remote areas to smoke. In public restrooms of national parks, once the odor detector detects the smell of smoke, it will play a voice message about the Tobacco Hazard Prevention Act to let tourists clearly know that smoking in public restrooms will result in a fine of NT$2,000 to NT$10,000. Since the installation of odor detectors, the number of users smoking secretly in public restrooms has significantly decreased.

The "smart public restrooms" at Songshan Train Station won the "Golden Way Award" from the Ministry of Transportation and Communications for overcoming various difficulties, which made it famous. From a constant stream of customer complaints to model public restrooms that the public sector has enthusiastically visited, the additional workload on the case officer from handling group visits is actually a luxury to be worrying about.

Future Outlook

The system has proven its stability and cost effectiveness during the three years of R&D and field experiments, and has now been successfully transferred to domestic system integration companies. The III also hopes that this system can be expanded in the future, and the technology can even be transferred to Europe and the United States.

In addition, on the basis of stable and reliable data flow and communication connections, the introduction of big data for analysis may make the deployment of manpower more delicate, and the problem of uneven work distribution can be expected to be fundamentally corrected.

Facing the arrival of an aging society, NBIoT communication systems, combined with various IoT sensors, may be able to bring us a healthier and safer living environment. Some repetitive tasks that traditionally relied heavily on manpower can also use technology to greatly improve efficiency.

Recommend Cases

Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection Generally, the yield rate of products affects the costs for enterprises and the return rate for customers The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor Although there is AOI equipment to assist, these tools are mostly fixed detection machines Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5, and can be as high as 20 Three major pain points in manufacturing quality detection Robotic Arm AOI with dynamic multi-angle inspection helps to solve these issues According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry Pain point one, manual inspection of product quality is prone to errors Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production Pain point two, inability to quantify and record data from quality inspections Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet Pain point three, limitations of traditional AOI visual inspection systems Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations This method may handle flat or linear-shaped products like rectangular or square items at a single inspection point However, it is more challenging to implement for products with complex shapes eg, irregular automotive parts, requiring multi-point and multi-degree inspections Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular Selected the automotive industry as the real-world testing ground to quickly respond to customer needs The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates Automotive components are high in unit price and demand a stricter defect detection accuracy In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy Therefore, the automotive sector was chosen as the area for introduction By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs Helps to reduce communication costs and aims to become an industry standard In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis Data Analysis, based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain Supply Chain more swiftly Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application Self-driving vehicle developed by Massive Digital Engineering「Translated content is generated by ChatGPT and is for reference only Translation date：2024-05-19」

[2023 Case Study] AI Steps into Philanthropy: Stylish Tech at Food Banks

#Artificial Intelligence

#Food Bank

#Volunteer Involvement

Taiwan Food Bank AssociationHereinafter referred to as 'the Association'With the mission of providing food aid, poverty relief, reducing food waste, and building a hunger-free network, there are locations across Taiwan that gather donations from wholesalers, intermediaries, retailers, manufacturers, and even generous individuals These sites also rescue food that would otherwise be discarded, properly allocate and distribute it to needy households, thus aiding local vulnerable families55Food banks at various locations collect daily donations from wholesale stores, intermediaries, retailers, manufacturers, and even benevolent individuals from all over Taiwan These places also rescue about-to-be-discarded edible materials, properly sort them, and distribute to needy households, assisting local vulnerable populations However, each location requires significant human and volunteer resources to manage daily operations using traditional methods of communication with non-profit organizations and donors After receiving donations, these resources are then allocated to needy families or individuals There is a potential issue of uneven distribution of resources due to a lack of digitalization and integrated information management in these processes Warehouse and Transportation Centers and Mini Food Banks Distributing Resources to the Disadvantaged The location under validation by the Kaohsiung Charitable Organizations Association,Hereinafter referred to as 'Kaohsiung Charity' In109year6month24Officially inaugurated Taiwan's first 'Food Bank-Warehouse and Transportation Center' at a location measuring200square meters, enhancing the efficiency of food resource redistribution, proper storage, and management So far, nearly two hundred tons of vegetables and fruits have been saved, serving over a hundred organizations and benefiting over5thousand vulnerable households, and continues to serve19mini food banks, with planned completion across multiple districts in Kaohsiung, distributing food resources to over10ten thousand vulnerable families Kaohsiung Charity 'Food Bank-Warehouse and Transportation Center' in the Dasha Community Photo Source Kaohsiung Charitable Organizations Association Challenges in Labor and Food Resource Management Facing the needs of a large number of economically disadvantaged families, the management of the 'Food Bank-Warehouse and Transportation Center' is particularly critical During procurement, tasks such as sorting, purging, and bookkeeping must be performed, while during shipment, food resource needs suggested by social workers must be followed These activities rely on manual judgment and accumulated experience Many volunteers involved are elderly and have limited physical strength, making warehouse tasks physically demanding and recruitment challenging If a large batch of food resources arrives, space and manpower are consumed in sorting and inventory management, raising concerns about the effective use of resources and turnover rate This highlights the challenge of scaling up food bank services while lacking corresponding labor and material management systems At the same time, food bank resources come from various donations, thus they vary greatly in type, shelf life, standards, and quantity Volunteers at mini food banks, mostly also elderly, must handle multiple responsibilities such as case services, food resource management,resource allocation, and resource development Sometimes they must also explain and accept immediate, large quantities of specific resources, such as adults receiving baby formula 'Food Bank-Warehouse and Transportation Center' Resource Inventory Relies Entirely on Manual Labor Mini Food Bank Volunteers Handle Multiple Responsibilities Photo Source Taiwan Food Bank Association Reducing Scrap Resources60 Increasing Speed of Resource Transfer80 To enhance resource management and ensure effective use of materials, and to address personnel shortages, this field validation case has introduced 'Food Bank Warehouse Resource CollectionAITo advance resource management, ensure effective use of resources, and solve manpower shortages, this validation site has implemented an 'Automated Early Warning Needs Assessment System' for the food bank's warehouse resource gathering The first part involves building a classification model, setting up and collecting warehouse information at the site, andAItraining the model Past sitewarehouse information is collected and stored in a database, allowingAIfor preprocessing, classification, and other tasks At the same time, depending on the dependency conditions of the types of goods as features, algorithms are introduced for computation and modeling, and the data collected is used for retraining, ultimately validating the field and organizing data for the five most common types of goods into training and test datasets as required The second part involves constructing the classification model using AI techniques further use of reinforcement learning constructs the management mechanism for the food bank's warehouse, perfecting the classification of donated goodsRNNTechnical construction of classification models further use of reinforcement learning constructs food bank warehouse management mechanisms, making the classification of donated goods perfectlike white rice, instant drinks, noodles, instant noodles, and canned goodscan then be automatically assigned storage based on storage assignment principles AI Service System Process and Description Source Taiwan Food Bank Association AtAIUnder forecasts, it can optimize the speed of resource transfer and allocation, effectively and accurately match resource donations reducing the loss in the donation process, increase the accuracy of resource distribution, and improve the service rate—the successful donation rate—reducing the waste of resources due to incorrect items, and enabling instant monitoring of food resource stock, ensuring operators can respond quickly to needs, effectively providing resource assistance WithAIthe system's introduction and the establishment of data intelligence, it helps the operations of the warehouse and transportation center, allowing more time for the allocation of donated goods The introduction aims to accelerate the digital service rollout for social welfare organizations, thoroughly addressing the needs of the overall vulnerable segments of society Using the system for resource allocation and dispatching Photo Source Kaohsiung Charitable Organizations Association Following this field validation, it is possible to expand the system to other food bank service pointsAIThe system can also collaborate with more non-profit organizations, public welfare groups, and charitable organizations, expanding 'Food Bank Warehouse Resource CollectionAIAutomated Early Warning Demand Assessment System' application range such as medical supply distribution, helping more organizations manage and distribute more intelligently, reducing resource wastage, and enhancing social welfare 「Translated content is generated by ChatGPT and is for reference only Translation date：2024-12-12」

Testing Seat Contact Components AI Intelligent Flaw Detection

#Defect Detection AOI/Yield Optimization

With rapid development in 5G, AIOT, automotive electronics, and other downstream sectors, the entire supply chain is expected to benefit from this consumer market As product demand momentum gradually increases, increasing production efficiency and reducing operational costs become the most important issues In order to meet the needs of customers for various packaging types, Yingwei Technology has been committed to developing highly customized test seats However, a resulting pain point is the inability to mass-produce and fully automate operations with machines some tasks still rely on manual execution In this project, the probe part of the test seat was outsourced in 2021, and under current and future large-scale demands, work hours, costs, supply, and quality are issues Yingwei faces The company achieves a defect detection rate of 9995, which seems high, but with an average inspector able to inspect 10,000 needles per day, there would still be 5 defective needles On a test seat that is only 3 cm wide with approximately 1,000 needles, just one defective needle could potentially lead to faulty testing at the customer end As the current operational mode relies on manual visual inspection, external factors such as fatigue or oversight of personnel, and subjective judgment by inspectors may lead to the outflow of defective products, which necessitates strict quality control of contact components We once sought to utilize optical inspections Rule-based for controlling the quality of appearances, but the metallic material of the contact components leads to light scattering, background noise interference, background scratches, and material issues that could result in misjudgments Therefore, we decided to look for AI technology service providers to solve our detection difficulties Developments of Dedicated AOI Line Scan Equipment To meet the needs for inspecting thousands to tens of thousands of probes within our company's IC test seats, traditional surface imaging and individual needle imaging would be too slow to achieve rapid inspection and labor-saving goals In response, the service provider proposed a trial with an AOI dedicated line scan module solution Utilizing a width of 63mm on the X-axis for reciprocal scanning of all probes on the test seat, the tests allowed for the simultaneous scanning of 8-9 probes, significantly enhancing the future detection efficiency of AOI machines This project will proceed with the aforementioned innovative Proof of Concept POC, focusing on the development of the line scanning equipment and performing imaging, learning, and training on both normal and abnormal probes provided by our company, with initial AI model training aimed at preliminary approval This project's customized line-scan imaging module Ideal future imaging result illustration A Single AI Technology Solution for MeasurementDetection Needs Unified use of AI DL CNN learning methods, instead of the current Rule-based system which necessitates defining each defect individually, to meet the needs for abrasion measurement and appearance defect detection of malfunctionsforeign objects When the same machine uses both measurement and detection technologies, not only does it increase costs, but it also affects the detection speed Hence, the service provider recommends the use of a line scan device for imaging Its resolution is sufficient for AI to simultaneously determine appearance defects and assess the condition of needle tip abrasion, as detailed below Line scan pixel imaging displaying needle tip abrasion conditions This AI detection technology meets both measurement and inspection needs for Yingwei, not only bringing more benefits to future probe testing but also introducing an innovative axis in AI technology Change the method of human inspection, enhance work efficiency and product quality After combining both hardware line scan and software AI model training approaches, we successfully ventured into new AOI detection applications Following the AI implementation POC, including the development and validation of a customized line scan module and an initial AI model, the plan is to officially develop the AOI machine next year and integrate it into the IC test seat production line Future Prospects Probe manufacturers upstream and downstream IC factory users both have needs for the AOI inspection machine upstream can ensure probe quality before leaving the factory, while downstream users can use this machine to regularly inspect the condition of numerous IC test seats in hand Given the future demands, the AOI machine is poised to have a significant positive impact on the IC testing industry in the foreseeable future 「Translated content is generated by ChatGPT and is for reference only Translation date：2024-12-12」

Internet Explorer

Mozilla Firefox

Google Chrome

Apple Safari (5.0)

【2019 Application Example】 How can public restrooms rely on IoT and cloud technology to become cleaner, solve 70% of customer complaints, and increase efficiency by 120 times?

Recommend Cases

PopularTags