:::

【2020 Application Example】 AI Bread Recognition System, machine scans, and the price is instantly calculated for you!

A brilliant idea transforming AI facial recognition technology

As artificial intelligence develops, more and more industries are embracing AI technology, even subtly entering into people's lives. As most bakeries sell freshly made bread and pastries, which typically do not have barcodes, they rely on cashiers to visually identify each item and enter the type and price of the bread. Thus, inspired by AI facial recognition technology, if such artificial intelligence could identify hundreds of types of bread, it could enhance checkout efficiency...

Diverse handmade breads delight customers but challenge clerks!

A local bakery has over 100 types of bread, regularly updating or adding new products, offering customers a variety of choices; this poses a challenge for cashiers.

It takes two months to train a cashier, but even after they start, there's still a 5 to 10% error rate due to bread recognition mistakes each month, especially during peak checkout times after work, causing bottlenecks and further errors due to the stress on cashiers. The difficulty in training cashiers and the lack of precision in the checkout process have long troubled businesses...

When baking meets artificial intelligence, it sparks a marvelous retail experience!

In typical bakeries, bread is sold 'naked' immediately after baking and then 'packaged' when it cools to room temperature. Both methods require cashiers to recognize and remember the prices and undergo two months of training before they can work the cash register. Even then, there is still a 5 to 10% error rate each month. My Dee Bakery, with its extensive range of over 100 bread types, poses a significant challenge for cashiers!

Due to Yun Kui Technology Co., Ltd.'s expertise in developing iPad POS systems, which are designed to be simple, convenient, and easy to use, they allow businesses to check out efficiently and accurately. Therefore, integrating the existing POS system with AI image recognition capabilities enables businesses to carry out transactions more efficiently and precisely.

AI bread recognition model operational schematic (Image provided by Yun Kui Technology)

▲AI bread recognition model operational schematic (Image provided by Yun Kui Technology)

The execution can be simplified into eight steps, which include:

1. Data collection: Take bread image data at bakeries.

2. Image annotation: The image data is handed over to Mu Kesi Co., Ltd. for manual annotation.

3. AI modeling and training: Managed by Mu Kesi, who adjusts AI models and training.

4. iPad POS adjustment: Simultaneous adjustments of the UI interface on the POS side and backend integration with the AI model.

5. Start testing: Once Mu Kesi reaches over 95% recognition accuracy with current data, formal integration testing begins.

6. Real scene testing: Move to the bakery to gather data and verify the correct recognition rates.

7. Planning real scene application accessories: When recognition accuracy exceeds 98%, design accessories for on-site checkout, such as remote cameras and projection light sources.

8. Official Application: Integration with electronic receipts goes live.

POS machine AI bread recognition checkout process: Start recognition - Recognition complete - Checkout - Confirm checkout, takes only 3 seconds (Image provided by Yun Kui Technology)

▲POS machine AI bread recognition checkout process: Start recognition - Recognition complete - Checkout - Confirm checkout, takes only 3 seconds (Image provided by Yun Kui Technology)

AI bread recognition system, making multitasking easy!

After adding AI capabilities, not only can it save upfront training time and costs for bakery cashiers and reduce costs from recognition errors, but it can also speed up the checkout process and efficiency, increasing customer satisfaction. This can later be promoted to various retail industries, expanding the new map of smart retail.

Comparison chart of bread checkout process before and after AI valuation (Image provided by Yun Kui Technology)

▲Before and after comparison chart of the bread checkout process with AI valuation (Image provided by Yun Kui Technology)

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【導入案例】哈瑪星科技建構AI模型管理平台 加速AI落地應用
Hamastar Technology Builds an AI Model Management Platform to Accelerate the Application of AI

Riding the AI hype train, financial service providers are using their solid foundation in the industry to not only transform themselves, but also assist their customers with transformation Hamastar Technology, which has been established for over two decades, has been developing AI technology and assisting industry customers with the implementation of AI in recent years Hamastar Technology believes that to implement a complete AI project, in addition to AI theoretical knowledge, data analysis, and model training capabilities, it is also necessary to develop APIs for data, establish databases, develop front-end RWD web pages, and even consider layout design and user experience based on customer needs These tasks create technical barriers for AI startups Even from the perspective of companies that have reached a certain scale, it is hard to accumulate technical experience and accelerate business growth due repeatedly investing manpower developing similar functions in each project Institutional customers still require high level of customization for AI Using the requirements of government Agency A implemented by Hamastar Technology as an example, users must control false information from specific channels The platform needs to provide data ingestion functions for training models and predictions, and can complete natural language processing NLP text classification model training and use When the model discovers false information, it needs to immediately notify responsible personnel through messaging software The need of Agency B is to use an AI model to automatically classify petitions and immediately provide information on past cases as reference for the petitioner or officer Although the project models are similar data ingestion, model prediction, warning notification, the required functions still need to be separately developed for individual projects, and existing programs and models cannot be reused to speed up the implementation of subsequent projects After in-depth discussion, Hamastar Technology found that pain points of enterprises implementing AI projects include high implementation costs and lengthy project schedules It is difficult for a single enterprise to simultaneously have data scientists, analysts, engineers, and designers Current projects are all focused on solving the needs of specific fields, and it is difficult to reuse the AI models in other fields of application At the same time, the tools are concentrated in AI projects and cannot provide customers with total solutions In other words, due to the "limited manpower," "restricted fields," and "insufficient tools" of AI service providers, the implementation of AI technology projects requires high costs or lengthy timelines These are common problems that companies urgently need to solve Therefore, if there is an AI model application service management platform, it will be able to solve the above difficulties and not only reduce costs, but also accelerate project implementation and provide customers with one-stop solutions AI model application service management platform assists in quickly completing projects Therefore, with the support of the AI project of the Industrial Development Bureau, Ministry of Economic Affairs, Hamastar Technology carried out the "AI Model Application Service Management Platform AISP RampD Project" and engaged in the RampD of AISP products The purpose is for AI service providers to complete the AI projects with twice the result using only half the effort The AISP provides one-stop AI solutions AI service providers can quickly assemble required functions, such as data API, model management, and model prediction result monitoring subscription through existing module functions of the AISP It also provides commonly used graphical tools to help companies quickly design interactive charts or dashboards required by users, effectively reducing the labor costs required to execute projects, shortening the solution POC or implementation time, and accelerating the implementation and diffusion of industry AI In terms of product business model, in the short term, the company will extensively invite IT service providers with expertise in the field of AI to work together, and use platform services to solve the AI implementation problems faced by requesting units in various field, gradually building trust in the platform brand In the mid-term, the company hopes to gradually expand the market based on its past success, and form strategic alliances with multiple IT service providers to solve more and wider problems in specialized fields and provide more solutions for units to choose from The platform combines field experts to jointly expand overseas markets In the long term, after establishing AI strategic alliances in various specialized fields, the platform will have a large number of AI solution experts for specialized fields After accumulating a large amount of successful project experience, Hamastar Technology hopes that the AISP will be able to work with experts companies to expand into the international market Harmastar Technology Co, Ltd was formed in 2000 by recruiting numerous senior professional managers and technical experts in related fields It is committed to software technology RampD and services, and aims to develop into an international software company, actively creating opportunities for international cooperation in the industry Under the excellent leadership of its first president, the company has rapidly grown into a major software company in Taiwan

【導入案例】赫銳特科技VCSEL封裝元件瑕疵導入AOI檢測 提升產能效率20
HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95 VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and ARVR VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics VCSEL technology has a wide range ofnbsp applications, including in drones Pictured Zoyi Technology's Agricultural Drone VCSEL technology has a wide range of applications, AI technology assists in defect detection HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness One of the key problems is the replacement of glass lens with epoxy resin lens The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized The release of stress caused by heat during the mounting process will directly cause the optical lens to break HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important Under the constraints of packaging space, the space for fitting the package and optical lens is limited Moreover, the optical lenses will be confined to a metal frame If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10 in the VCSEL package reliability verification, resulting in an increase in production costs In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality The problem of image collection needs to be solved first to successfully collect image data Therefore, HRT Technology first developed an Automated Optical Inspection AOI device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening Manual labeling is carried out according to the image classification above, including samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out Residual neural network ResNet or other related algorithms are used for deep learning to identify the quality of lenses Implementation of AOI inspection improves production efficiency by 20 and above Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance The lens is packaged on the VCSEL package that has completed die bonding After passing the general light up test, the final reliability test high temperature reflow is performed Failed samples go into the rework process However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95 and above in the reliability verification This is expected to help companies reduce production costs by 10 and increase production efficiency by 20 and above The difference before and after implementing AI image detection HRT Technology pointed out that this technology is an AI application developed based on tiny images It uses deep learning algorithms to identify defects in the images The trained network automatically classifies image data to predetermined categories Defect categories can be determined through reference images, so cumbersome programming is not required In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future

這是一張圖片。 This is a picture.
AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOIAIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us Our company's current development We are committed toIOTsmart manufacturing our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification After discussing with IT service providers, we defined it asAOIAIa feasible operational model Tzuhong Technology has invested inAOIAIan inspection plan to checkSMTtext on components, solder joints, polarity, missing partsand usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates Industry pain points Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections Previous consumer products with undetected anomalies were acceptable within a certain ratio However, in the automotive industry today, undetected defects could lead to fatalities hence, the automotive industry has extremely high quality demands To survive in the automotive supply chain, we must address the issue of undetectable anomalies Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry Application technology and explanation Initially,Figure 1,PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products At this point, the 'suspected defective' portion accounts for20manual review for these20parts, further classifying the 'suspected defective' portion into good and defective products With We aim to leverageAItechnology, to shift from manual re-inspection of these20technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3thus reducing the workload of Tzuhong's employees from20down to only3In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0IAIDetectionFigure 2。 The original AOI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI information on defective products, then manually re-inspect one by one to determine if they are defective AOIAI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after, then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward, then manually re-inspect one by one to determine if they are defective Process differences By introducing theAOIAIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees Difference between pre and post-introduction Promotion strategy 1 Similar field diffusion allSMTmanufacturers face bottlenecks in inspections leading to shipment delays introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs 2 Cross-industry expansion plans negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness Profit strategy 1 In collaboration withAOImanufacturers, collect licensing fees 2 Direct sales toSMTthe manufacturing industryAIsystems 3 ProvideSMTmanufacturing industryAOIAIsystem subscription model「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」