:::

【2020 Application Example】 AI Bread Recognition System, machine scans, and the price is instantly calculated for you!

A brilliant idea transforming AI facial recognition technology

As artificial intelligence develops, more and more industries are embracing AI technology, even subtly entering into people's lives. As most bakeries sell freshly made bread and pastries, which typically do not have barcodes, they rely on cashiers to visually identify each item and enter the type and price of the bread. Thus, inspired by AI facial recognition technology, if such artificial intelligence could identify hundreds of types of bread, it could enhance checkout efficiency...

Diverse handmade breads delight customers but challenge clerks!

A local bakery has over 100 types of bread, regularly updating or adding new products, offering customers a variety of choices; this poses a challenge for cashiers.

It takes two months to train a cashier, but even after they start, there's still a 5 to 10% error rate due to bread recognition mistakes each month, especially during peak checkout times after work, causing bottlenecks and further errors due to the stress on cashiers. The difficulty in training cashiers and the lack of precision in the checkout process have long troubled businesses...

When baking meets artificial intelligence, it sparks a marvelous retail experience!

In typical bakeries, bread is sold 'naked' immediately after baking and then 'packaged' when it cools to room temperature. Both methods require cashiers to recognize and remember the prices and undergo two months of training before they can work the cash register. Even then, there is still a 5 to 10% error rate each month. My Dee Bakery, with its extensive range of over 100 bread types, poses a significant challenge for cashiers!

Due to Yun Kui Technology Co., Ltd.'s expertise in developing iPad POS systems, which are designed to be simple, convenient, and easy to use, they allow businesses to check out efficiently and accurately. Therefore, integrating the existing POS system with AI image recognition capabilities enables businesses to carry out transactions more efficiently and precisely.

AI bread recognition model operational schematic (Image provided by Yun Kui Technology)

▲AI bread recognition model operational schematic (Image provided by Yun Kui Technology)

The execution can be simplified into eight steps, which include:

1. Data collection: Take bread image data at bakeries.

2. Image annotation: The image data is handed over to Mu Kesi Co., Ltd. for manual annotation.

3. AI modeling and training: Managed by Mu Kesi, who adjusts AI models and training.

4. iPad POS adjustment: Simultaneous adjustments of the UI interface on the POS side and backend integration with the AI model.

5. Start testing: Once Mu Kesi reaches over 95% recognition accuracy with current data, formal integration testing begins.

6. Real scene testing: Move to the bakery to gather data and verify the correct recognition rates.

7. Planning real scene application accessories: When recognition accuracy exceeds 98%, design accessories for on-site checkout, such as remote cameras and projection light sources.

8. Official Application: Integration with electronic receipts goes live.

POS machine AI bread recognition checkout process: Start recognition - Recognition complete - Checkout - Confirm checkout, takes only 3 seconds (Image provided by Yun Kui Technology)

▲POS machine AI bread recognition checkout process: Start recognition - Recognition complete - Checkout - Confirm checkout, takes only 3 seconds (Image provided by Yun Kui Technology)

AI bread recognition system, making multitasking easy!

After adding AI capabilities, not only can it save upfront training time and costs for bakery cashiers and reduce costs from recognition errors, but it can also speed up the checkout process and efficiency, increasing customer satisfaction. This can later be promoted to various retail industries, expanding the new map of smart retail.

Comparison chart of bread checkout process before and after AI valuation (Image provided by Yun Kui Technology)

▲Before and after comparison chart of the bread checkout process with AI valuation (Image provided by Yun Kui Technology)

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

這是一張圖片。 This is a picture.
Testing Seat Contact Components AI Intelligent Flaw Detection

With rapid development in 5G, AIOT, automotive electronics, and other downstream sectors, the entire supply chain is expected to benefit from this consumer market As product demand momentum gradually increases, increasing production efficiency and reducing operational costs become the most important issues In order to meet the needs of customers for various packaging types, Yingwei Technology has been committed to developing highly customized test seats However, a resulting pain point is the inability to mass-produce and fully automate operations with machines some tasks still rely on manual execution In this project, the probe part of the test seat was outsourced in 2021, and under current and future large-scale demands, work hours, costs, supply, and quality are issues Yingwei faces The company achieves a defect detection rate of 9995, which seems high, but with an average inspector able to inspect 10,000 needles per day, there would still be 5 defective needles On a test seat that is only 3 cm wide with approximately 1,000 needles, just one defective needle could potentially lead to faulty testing at the customer end As the current operational mode relies on manual visual inspection, external factors such as fatigue or oversight of personnel, and subjective judgment by inspectors may lead to the outflow of defective products, which necessitates strict quality control of contact components We once sought to utilize optical inspections Rule-based for controlling the quality of appearances, but the metallic material of the contact components leads to light scattering, background noise interference, background scratches, and material issues that could result in misjudgments Therefore, we decided to look for AI technology service providers to solve our detection difficulties Developments of Dedicated AOI Line Scan Equipment To meet the needs for inspecting thousands to tens of thousands of probes within our company's IC test seats, traditional surface imaging and individual needle imaging would be too slow to achieve rapid inspection and labor-saving goals In response, the service provider proposed a trial with an AOI dedicated line scan module solution Utilizing a width of 63mm on the X-axis for reciprocal scanning of all probes on the test seat, the tests allowed for the simultaneous scanning of 8-9 probes, significantly enhancing the future detection efficiency of AOI machines This project will proceed with the aforementioned innovative Proof of Concept POC, focusing on the development of the line scanning equipment and performing imaging, learning, and training on both normal and abnormal probes provided by our company, with initial AI model training aimed at preliminary approval This project's customized line-scan imaging module Ideal future imaging result illustration A Single AI Technology Solution for MeasurementDetection Needs Unified use of AI DL CNN learning methods, instead of the current Rule-based system which necessitates defining each defect individually, to meet the needs for abrasion measurement and appearance defect detection of malfunctionsforeign objects When the same machine uses both measurement and detection technologies, not only does it increase costs, but it also affects the detection speed Hence, the service provider recommends the use of a line scan device for imaging Its resolution is sufficient for AI to simultaneously determine appearance defects and assess the condition of needle tip abrasion, as detailed below Line scan pixel imaging displaying needle tip abrasion conditions This AI detection technology meets both measurement and inspection needs for Yingwei, not only bringing more benefits to future probe testing but also introducing an innovative axis in AI technology Change the method of human inspection, enhance work efficiency and product quality After combining both hardware line scan and software AI model training approaches, we successfully ventured into new AOI detection applications Following the AI implementation POC, including the development and validation of a customized line scan module and an initial AI model, the plan is to officially develop the AOI machine next year and integrate it into the IC test seat production line Future Prospects Probe manufacturers upstream and downstream IC factory users both have needs for the AOI inspection machine upstream can ensure probe quality before leaving the factory, while downstream users can use this machine to regularly inspect the condition of numerous IC test seats in hand Given the future demands, the AOI machine is poised to have a significant positive impact on the IC testing industry in the foreseeable future 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【導入案例】海量數位工程AOI機器智能手臂檢測系統 大幅提高瑕疵檢測精準度
Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection Generally, the yield rate of products affects the costs for enterprises and the return rate for customers The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor Although there is AOI equipment to assist, these tools are mostly fixed detection machines Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5, and can be as high as 20 Three major pain points in manufacturing quality detection Robotic Arm AOI with dynamic multi-angle inspection helps to solve these issues According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry Pain point one, manual inspection of product quality is prone to errors Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production Pain point two, inability to quantify and record data from quality inspections Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet Pain point three, limitations of traditional AOI visual inspection systems Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations This method may handle flat or linear-shaped products like rectangular or square items at a single inspection point However, it is more challenging to implement for products with complex shapes eg, irregular automotive parts, requiring multi-point and multi-degree inspections Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular Selected the automotive industry as the real-world testing ground to quickly respond to customer needs The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates Automotive components are high in unit price and demand a stricter defect detection accuracy In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy Therefore, the automotive sector was chosen as the area for introduction By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs Helps to reduce communication costs and aims to become an industry standard In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis Data Analysis, based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain Supply Chain more swiftly Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application Self-driving vehicle developed by Massive Digital Engineering「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】防患於未然 麗臺科技研發心臟衰竭AI辨識技術可及早發現病徵
Preventing Problems Before They Arise: Leadtek Research Develops AI Technology for Early Detection of Heart Failure Symptoms

With the increase in the elderly population, the incidence of various chronic diseases is rising daily Among these, heart failure is not only a silent killer it has a very long disease course with a high recurrence rate, leading to increased burden on healthcare personnel However, by using medically certified electrocardiography acoustics devices, coupled with AI predictive assessment of heart failure risk and remote care systems, diagnosis can be aided significantly, helping doctors make accurate diagnoses for subsequent patient medical care or referrals Heart failure has a lengthy course and medical expenditure is five times that of diabetes If you find yourself short of breath even with minimal movement, or if you wake up from sleep needing to sit up to feel comfortable, or if you have symptoms such as swollen lower limbs, anxiety, restlessness, fatigue, or a loss of appetite, be cautious These could be signs of heart failure According to statistics, there are about 60 million people with heart failure worldwide, with 5 million new cases every year In China, nearly 290 million people suffer from cardiovascular diseases, accounting for the second leading cause of death among urban residents around 12 million of these are heart failure patients, accounting for over 59 of cardiac-related deaths The disease course of heart failure is exceptionally long, and both its recurrence and rehospitalization rates are exceedingly high, resulting in medical costs that are twice that of hypertension and five times those of diabetes According to US research statistics, the 30-day mortality rates for patients with myocardial infarction and heart failure are respectively 166 and 111, and the rehospitalization rates within 30 days are 199 and 244 The symptoms of heart failure, because they are similar to those of other diseases such as chronic obstructive pulmonary disease and asthma, have an 185 misdiagnosis rate, which poses a challenging problem for healthcare institutions Leadtek, a major graphics card manufacturer, has been investing in the medical and healthcare sector since 2000 Following two heart attacks in 2011 and 2015 experienced by Chairman Lu Kunshan, Leadtek has focused on health big data, independently developing AI technology for heart failure recognition This AI application reads patients' electrocardiograms and phonocardiograms to perform anomaly detection and model prediction of heart failure risk, enabling early detection of disease symptoms Leadtek independently developed heart failure AI recognition technology to predict medical history and risk Leadtek's independently developed heart failure AI recognition technology has the following three judgment functions 1 Prediction of heart failure history Classifies electrocardiogram and phonocardiogram data into 'with hospitalization history of heart failure' and 'no history of heart failure' 2 Risk prediction of heart failure Provides a predictive risk value of heart failure occurrence based on the electrocardiogram and phonocardiogram data 3 Prediction of heart failure recurrence risk For patients with heart failure, it reads their phonocardiogram and electrocardiogram data, assessing the risk prediction of heart failure recurrence Leadtek states that the application of heart failure AI recognition technology can assist doctors in making more efficient and accurate diagnoses, facilitating subsequent medical treatment or referrals for patients As an instance, in studies of heart failure patients discharged from Taipei Veterans General Hospital, using the EMAT Electromechanical Activation Time index and SDI Systolic Dysfunction Index calculated by the synchronized electrocardiography-acoustic device as treatment guidelines resulted in a higher survival rate compared to those treated based on traditional symptoms This research has also been published in the authoritative international cardiology journal JACC, receiving recognition in the international market System manufacturers can apply heart failure AI recognition technology for other value-added applications Leadtek states that cooperating system manufacturers can choose to build their own heart failure AI risk prediction engine, uploading their system's electrocardiogram and phonocardiogram data to Leadtek's heart failure AI risk prediction engine, which then returns risk prediction values for integration by system manufacturers cooperating manufacturers as a value-added application input Not just for clinical use, the heart failure AI risk prediction engine can also be extended for use at home or in the workplace Additionally, this system can be extended to other applications, including One, hospital outpatient screening Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to conduct a 10-second rapid test in outpatient and emergency departments to assess a patient's cardiac history and heart failure risk Two, discharge risk assessment Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to assess the heart failure risk during a patient's hospital stay The test data can serve as a pre-discharge risk assessment and prognostic indicator Three, continuous home care Patients can use the electrocardiogram and phonocardiogram recorder, wearable electrocardiogram recorder, and transmit through a home transmission box gateway to measure electrocardiogram and phonocardiogram signals at home and upload them to the amor health cloud platform for heart failure AI risk prediction analysis Patients can manage their health autonomously via an APP, reviewing historical physiological trends disease management nurses can manage member health through the health management backend Web Four, home rehabilitation training Patients can wear a health bracelet to monitor activity, fatigue, circulation, and sleep, autonomously managing their health through the mobile APP and observing the risk of heart failure, engaging in exercise and rehabilitation training to aid in swift recovery The heart failure AI recognition technology system can also be extended to employee home care applications Additionally, in factories or offices, this system can also achieve employee health management goals, with applications including One, workplace safety units Provide employees with wearable electrocardiogram recorders before they start work duties Two, physiological monitoring for business executors While executing business duties or training, employees wear wearable electrocardiogram recorders for fatigue warnings, signaling whether physiological conditions allow continued execution of tasks Task segments can use data transmission boxes or apps to upload physiological monitoring information to the health management platform, assessing the heart failure risk for operations staff, with test data serving as an indicator for enterprise resource human units and public safety Three, workplace physiological monitoring center care The workplace physiological monitoring center can inspect and record employees' historicalphysiological trends through the health cloud platform Four, workplace nursing units Nursing units receiving instructions from the physiological monitoring center can provide health management advice based on employees' physiological trends nursing centers can manage employee health through the health management backend Web Five, employees can wear health bracelets to monitor activity, fatigue, circulation, and sleep, autonomously managing their health and observing the risk of heart failure through the mobile APP, engaging in exercise and rehabilitation training to aid in rapid recovery Workplace application of heart failure cloud care and big data center diagram「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」