:::

【2020 Application Example】 AI Smart Toilet Quality Monitoring Platform, reducing customer complaints about dirty toilets and enhancing staff scheduling effectiveness

Best practices in AI+IoT implementation

As our country enters the first year of 5G commercialization this year, the integration of the Internet of Things with artificial intelligence to transmit data with zero delay will enable everyone to effectively manage all data. Toilet 'odor monitoring' has become the best platform. A certain chain supermarket in the country has 47 stores nationwide and in recent years, as competition in the supermarket industry intensifies, some stores plan seating areas and toilets for customer use.

Currently, the average number of customer complaints about toilet cleanliness in a certain store of the chain supermarket is about 10 times per month, which is notably higher than other stores, thus they hope to solve the problem of high complaint rates through artificial intelligence.

Customers frequently complain about dirty toilets

The toilets of a certain store of the chain supermarket are inspected at 12 PM and 6 PM daily, and cleaned during the night shift. Customer service staff often receive complaints about the dirty and smelly toilet environment, causing the need to constantly deploy manpower for toilet maintenance. To achieve a 100% odor-free toilet, it would be necessary to employ a cleaning staff member permanently present in the toilet, however, this solution is too costly and wastes manpower.

Through a collaboration between Guo Xing Information Co., Ltd. and the chain supermarket, the National Taichung University of Science and Technology AI team was commissioned to address this vexing issue using IoT and AI technologies.

IoT Monitoring x AI Manpower Dispatch

Guo Xing Information equipped the toilet door locks with IoT sensory devices, and installed 'odor sensors' and 'air temperature and humidity sensors' outside the cubicles. By monitoring the behavior, frequency, and timing of door usage, it predicts the cleanliness of the cubicle. If a person opens the toilet door and closes it quickly, and if more than three consecutive people exhibit the same behavior, it predicts that the cubicle is dirty enough to require cleaning.

In terms of manpower dispatch, the system predicts staffing needs based on user frequency, holidays, and festive events, dynamically adjusts manpower reserves, and calculates the minimum staffing needed to maintain toilet comfort.

Service architecture of the Smart Toilet Quality Monitoring Platform

▲Service architecture of the Smart Toilet Quality Monitoring Platform

This 'Smart Toilet Quality Monitoring Platform' is installed in the open-area toilets of business premises, collecting data such as usage frequency, time, odor intensity, air temperature, and humidity, and transmitting it to the platform for AI data analysis. This enables management to understand the real-time usage, frequency, and dirtiness of the toilets, providing alerts to dispatch cleaning staff and take responsive actions. It also assists managers in environmental quality monitoring and dirty conditions predictive dispatching. Through historical data analysis, it suggests dynamic manpower deployment during different time intervals for effective human resource management and utilization.

Smart toilet detection, reducing cleaning labor costs

After field tests of the Enhanced AI Smart Toilet Monitoring Platform, the retailer found the real-time monitoring and alert features extremely practical and is willing to continue using them. Regarding 'reducing the number of complaints', a one-month data validation showed a significant effect, while 'dynamic manpower dispatch' is still under evaluation and validation.

After a month of data evaluation, a noticeable improvement was found in 'monitoring toilet usage' and 'reducing complaints'. After trial use by the retailer, they are also willing to continue using the system. In the future, notifications will be made according to 'usage time' to prevent accidents within the cubicles. There will also be future deployments and promotions priced at low, mid, and high levels.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【解決方案】優式AI智能割草機器人 搶攻高爾夫藍海市場
USRROBOT's AI Lawn Mowing Robot Enters the Blue Ocean of Golf Market

An AI smart lawn mowing robot, resembling a vacuum robot, shuttles back and forth on the 30-hectare golf course lawn for weeding This robot, independently developed and designed by Taiwanese, is equipped with the world's first electronic fencing positioning technology which utilizes high-precision GPS integrated with cloud AI computation to determine the most efficient mowing paths, targeting the lucrative blue ocean market of golf courses This AI lawn mowing robot was developed by USRROBOT, a Taiwanese startup established in 2019 Chao-Cheng Chen, the president of USRROBOT, once served as the executive vice president of one of the top five ODM tech companies in Taiwan, and specializes in software and hardware integration When he served as the chairman of the Service Robot Alliance, he knew that the service robot industry was bound grow rapidly due to declining birth rates and the growingly severe labor shortage New demand - The horticulture market is large and the has rigid demand "To develop the core technology of service robots, we must find rigid demand Looking at European and American countries, there is a shortage of labor, but demand for horticulture has increased, and there has been a long-term shortage of 7-10 of horticultural workers" Under this strong "rigid demand," Chao-Cheng Chen established USRROBOT, and the company's first product is the AI lawn mowing robot In terms of overseas markets, the United States is the world's largest horticulture market, accounting for 30-40 of the global output value It is estimated that there are about 1 million horticulture workers, but they have been experiencing a labor shortage of 7-10 in recent years and have not been able to improve the situation The main reasons for labor shortage are Aging population and gardening is a labor-intensive job, so young people don't want to do it Unlike in Taiwan, European and American countries attach great importance to lawn maintenance and have expressly stipulated in the law that heavy fines will be imposed for failing to mow the lawn Therefore, the AI lawn mowing robot has considerable market development potential The introduction of AI multi-device collaborative mowing sensor technology is expected to reduce the burden of staff maintaining the golf course The AI lawn mowing robot developed by USRROBOT is currently in its second generation Domestic universities and well-known art museums are using the latest model M1, and it is also being used by some world-renowned high-tech companies and well-known universities in the United States The company is currently involved in negotiations for subsequent business cooperation USRROBOT stated that the professional RTK system currently used can reduce the original GPS positioning error from tens of meters to about 2 centimeters, allowing the robot to move accurately outdoors After setting the boundaries, it can be easily operated using the app New application - Implementation in golf courses solves the problem of labor aging and shortage Chao-Cheng Chen further explained that the National Land Surveying and Mapping Center is a RTK service provider RTK provides the error reference map of the positioning point USRROBOT can access the positioning error value of a specific position through 4G Internet access The AI algorithm of USRROBOT reduces the general 10-20 m error of GPS to 2 cm After positioning, USRROBOT then uses six-axis accelerator positioning, gyroscopes, and wheel differential sensing devices for software and hardware integration Only by matching the wheel's movement pattern and the terrain can accurate mowing path planning be achieved The AI lawn mowing robot, which is 62 cm wide, 84 cm long, 46 cm high, and weighs only 25 kg, can set the mowing boundaries in the cloud It can avoid pools and sand pits through settings, using AI algorithms to automatically calculate the optimal path It is able to mow approximately 150 ping of grass in one hour The battery can be used continuously for more than 6 hours The battery life is currently the highest in the world In addition to general gardening companies, with the assistance of the AI project team of the Industrial Development Bureau, Ministry of Economic Affairs, USRROBOT's AI lawn mowing robot has been applied to golf course lawn mowing A well-known golf course located in Taiping District, Taichung City currently has a staff of 5 people who are responsible for the lawn, planting maintenance, and other landscape maintenance of the entire 30-hectare course However, the average age of staff is as high as 55 years old, and the golf course has been unable to recruit new staff members for a long time In view of the aging staff and the shortage of manpower, the golf course hopes to mitigate the impact with AI technology, and is therefore using AI multi-device collaborative mowing sensor technology, in hopes of reducing the burden of staff maintaining the golf course New challenges - Expert systems are needed to overcome difficulties with different grass species "This AI lawn mowing robot has low noise, low pollution, low labor costs, and is waterproof and anti-theft In the lawn mowing process, it can identify and avoid obstacles through ultrasonic sensors while maintaining mowing quality, maintaining aesthetic and consistent grass length" Chao-Cheng Chen went on to say that the most important part about golf courses is that the grass pattern should be beautiful and free from diseases and pests Based on the site survey, golf courses are mainly divided into three major areas green, fairway and rough There is no problem using the current mowing robot to mow the rough area, and it can overcome slopes within 20 degreesThe short grass in the fairway area may only be two centimeters long, and the grass types are also different, so the cutterhead design needs to be modifiedAs for the grass in the green area, the grass must be mowed close to the ground and maintained in a consistent direction because it affects the putting speed Many factors will affect the green index, and this part requires more research and testing The AI lawn mowing robot can identify and avoid obstacles through ultrasonic sensors while maintaining mowing quality The AI smart lawn mowing robot has a built-in camera that can be used to detect the health condition of the lawn Chao-Cheng Chen said that in the future, an expert system will also be introduced for early determination of whether there are diseases, pests in the lawn or whether there is sufficient moisture, and provide lawn health data analysis to customers, so that they can take preventive and response measures sooner to reduce disaster losses Chao-Cheng Chen, who is also a good golfer himself, said that golf has developed well in Taiwan However, due to weather factors, such as rainy and humid climate and typhoons, Taiwan's golf courses have harder soil and more potholes compared with top tier golf courses overseas If AI lawn mowing robots are to be widely introduced into golf courses, there are still many difficulties that must be overcome However, Taiwan's difficult terrain creates a good testing ground Once Taiwan can overcome the many problems and successfully introduce the robot, it will be able to expand to overseas markets and seize new market opportunities in a blue ocean Chao-Cheng Chen, President of USRROBOT nbsp

【導入案例】赫銳特科技VCSEL封裝元件瑕疵導入AOI檢測 提升產能效率20
HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95 VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and ARVR VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics VCSEL technology has a wide range ofnbsp applications, including in drones Pictured Zoyi Technology's Agricultural Drone VCSEL technology has a wide range of applications, AI technology assists in defect detection HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness One of the key problems is the replacement of glass lens with epoxy resin lens The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized The release of stress caused by heat during the mounting process will directly cause the optical lens to break HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important Under the constraints of packaging space, the space for fitting the package and optical lens is limited Moreover, the optical lenses will be confined to a metal frame If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10 in the VCSEL package reliability verification, resulting in an increase in production costs In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality The problem of image collection needs to be solved first to successfully collect image data Therefore, HRT Technology first developed an Automated Optical Inspection AOI device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening Manual labeling is carried out according to the image classification above, including samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out Residual neural network ResNet or other related algorithms are used for deep learning to identify the quality of lenses Implementation of AOI inspection improves production efficiency by 20 and above Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance The lens is packaged on the VCSEL package that has completed die bonding After passing the general light up test, the final reliability test high temperature reflow is performed Failed samples go into the rework process However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95 and above in the reliability verification This is expected to help companies reduce production costs by 10 and increase production efficiency by 20 and above The difference before and after implementing AI image detection HRT Technology pointed out that this technology is an AI application developed based on tiny images It uses deep learning algorithms to identify defects in the images The trained network automatically classifies image data to predetermined categories Defect categories can be determined through reference images, so cumbersome programming is not required In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future

【導入案例】維繫遊艇王國美譽 嘉信遊艇導入國內第一套FRP複材超音波智慧檢測
Maintaining the reputation of the “Kingdom of Yachts” - Kha Shing Enterprise introduces the first domestic FRP ultrasonic smart inspection of composite materials

The Kaohsiung-based Kha Shing Enterprise Co, Ltd was established over 40 years ago, and is Taiwan's largest customized yacht company with customers all over America, Europe, Asia, and Australia, earning Taiwan the reputation of the "Kingdom of Yachts" Current FRP hull inspection still relies on traditional methods, such as visual inspection and knocking sounds, which is time-consuming and labor-intensive Kha Shing has applied PAUT array ultrasonic inspection to hull FRP composite materials for the first time, and combined it with AI to interpret ultrasound images, develop complete intelligent solutions, and create emerging markets for inspection companies Kha Shing Enterprise Co, Ltd was formerly Kha Shing Wood Industry Co, Ltd, and was a factory specializing in wood import in Kaohsiung Linhai Industrial Park when it was first established It began to design, manufacture, and sell yachts in 1977 After the second-generation successor of the company, President Kung Chun-Hao entered the company, he made a breakthrough in the previous manufacturing model that relied mainly on the skills of master craftsmen, introduced digital manufacturing to accelerate shipbuilding, and began to make larger yachts, ranking in the top 20 manufacturers worldwide among manufacturers of large yachts over 24 feet It also set a record of delivering 94 yachts within one year, earning Taiwan the reputation of "Kingdom of Yachts" Defect detection ensures yacht quality, using AI to replace humans to achieve higher efficiency Defect detection is very important to ensuring yacht quality At present, the yacht industry still uses very traditional defect detection methods The hull structure is usually made by hand lay-up or the vacuum infusion process, using visual inspection or knocking and the frequency of the sound to determine defects It requires time-consuming manual inspection If there are any defects, they must be reworked and repaired, and a gel coat subsequently sprayed The hull must be constructed in sections to facilitate inspection For large yachts over 24 meters long, construction in sections is very time-consuming and labor-intensive To shorten the time of the yacht manufacturing process, Kha Shing Enterprise will first carry out the gel coating process for the hull, and then perform the hand lay-on process The hull manufacturing process has two types of composite material test specimen structures In terms of 54-foot yacht hulls, the hull contains gel coat, core material, fiber and resin, and the total thickness is about 32cmplusmn01cm, which is twice the total thickness of FRP hull without core material of about 16cmplusmn01cm Defects such as incomplete impregnation of glass fiber or residual air bubbles between glass fiber and resin occasionally occur during the manufacturing process The types of defects include insufficient resin, voids, and delamination Once defects occur, the supply of hull materials will be insufficient and yacht delivery will be delayed Schematic diagram of types of FRP hull In order to solve this problem, Kha Shing Enterprise has engaged in technical cooperated with the metal materials industry and the AI technology industry, combining the ultrasonic inspection expertise of the metal materials industry with AI technologies developed by the AI technology industry in recent years to help solve issues of Kha Shing Enterprise with defect detection The method uses PAUT on the composite material structure of yachts, conducts FRP ultrasonic evaluation to determine the thickness of the yacht hull and material properties, and evaluates the ultrasonic probe frequency applicable to the hull structure based on professional ultrasonic experience After testing, a frequency of 5MHz and a probe width of 45mm can successfully find the location and size of defects in the simulated defect test specimen The three parties jointly found defect detection solutions from array ultrasonic evaluation, AI technology model development, and actual application in yachts The image inspected is an ultrasound image The image displays different colors based on the ultrasonic feedback signal An AI model that automatically identifies defective parts is established through the YOLO algorithm If the amount of abnormal data collected is insufficient for training, the CNN-based Autoencoder algorithm is used to collect normal image data for training and construct an AI model for abnormality detection The object detection YOLO model is trained by inputting image data marked as having defects, while the abnormality detection model is trained by inputting image data without defects Simulated defective specimen corresponding to PAUT results Defect detection by and AI system can shorten the construction period by 15 months and speed up determination by 50 After the development of this AI system is completed, it will be validated on actual 54-foot yachts of Kha Shing Enterprise, and can effectively resolve issues with defects The application of AI technology in ultrasonic inspection for intelligent determination is expected to accelerate determination by approximately 50, and will also shortens the construction period by 15 months, effectively improving the speed and quality of the yacht manufacturing process As Taiwan develops larger and more refined yachts, it will create opportunities for industry optimization and transformation, as well as opportunities for the development of key technologies The application of an AI ultrasonic inspection solution for composite materials is the first of its kind in the yacht industry, and is expected to attract more yacht manufacturers with inspection needs The AI ultrasonic inspection solution for composite materials has three major competitive advantages 1 Professional inspection experience and digital database to facilitate process management and analysis 2 Automatic AI determination and identification quickly identifies defects and provides immediate feedback to process engineers 3 High-efficiency process inspection provides defect repair recommendations, reduces damage rate, and improves the strength and quality of composite materials The application of AI technology can optimize the yacht manufacturing process, reduce manual inspection, create added value through the application of AI in Taiwanrsquos yacht industry, increase international purchase orders, and allow Taiwan yachts to continue to enjoy a good reputation in the world Furthermore, this business model has also spread to fields of application related to composite materials, increasing cross-sector market usage It is estimated to contribute approximately NT14 to NT2 billion in economic benefits to Taiwan's equipment maintenance and non-destructive testing market