:::

【2021 Solutions】 Conversational robots become smart medical helpers, effectively reducing the labor force of 70 people

"I've been eating, drinking, and urinating a lot recently. I'm worried about whether I have diabetes?" "You can go to the hospital to measure blood sugar. If fasting blood sugar is higher than 100 mg/dL, and postprandial blood sugar is higher than 140 mg/dL, glycated hemoglobin 5.7~6.4%, you may have signs of pre-diabetes.” The person talking to the patient may not be a real person, but an intelligent conversation robot. This is a smart medical robot developed by Asia Pacific Intelligent Machine Company, which specializes in Natural Language Understanding (NLU) technology. Through multiple rounds of dialogue, it can reduce about 70% of the manpower in medical clinics.

Founded in 2017, Asia Pacific Intelligent Machine Company, founder and CEO Jerry Wu is a well-known expert in the field of AI and one of the few Google Developers Experts in Asia. In the early days of its establishment, it used the interactive conversational robot Open Talk platform to enter smart manufacturing, insurance, media and other industrial fields.

AI applications grow from broad to refined, Asia-Pacific intelligent machines target the health care field to deeply explore the market

"AI technology is a very professional field. To achieve in-depth development, a huge amount of manpower and resources must be expended." From the beginning of its establishment, it has explored industrial-wide AI applications. After four years of exploration, Jerry understands that With limited manpower and resources, it is necessary to focus and deepen in one vertical field in order to create more revenue sources. Therefore, in the past two years, Asia-Pacific Intelligent Machines has decided to focus on the fields of smart health and smart care by using the health and medical corpus accumulated on the Open Talk platform. Based on Open Talk, it has developed more accurate auxiliary robots required by medical hospitals. as goal.

AMPIC Healthcare’s key advantages

▲AMPIC Healthcare’s Key Advantages

Asia-Pacific Intelligent Machinery started cooperation with Formosa Biomedical Engineering, and currently has accumulated more than 40 medical institutions, covering biotech medicine, medical cosmetology, rehabilitation, etc.

Affected by the novel coronavirus pneumonia (COVID-19) epidemic, during the level three alert period, people stayed at home and did not even dare to go to the hospital for medical treatment even if they were sick. At this time, Asia Pacific Smart Machine's video medical solution is dispatched It is used in non-contact cloud-based physiological measurements to provide doctors with a reference for long-term care and observation, helping to solve the problem of medical institutions using telemedicine for patient care.

The specific method is that after seeing the doctor, if the patient has questions about related medications, prescriptions, etc., he or she can directly contact the voice robot through the social communication line. Patients with chronic diseases do not need to upload blood pressure, blood oxygen, heartbeat and other data. They only need to upload an 8-second video of their own face close-up, and the calculation time is 30 seconds to analyze the patient's pulse index, heartbeat, muscle fatigue and other values. , if any abnormality is discovered, the patient can also seek medical treatment immediately.

Using labeling algorithm to mix physiological measurements (seeing) and conversational technology (listening), it can improve intention understanding by 80%

Why can physiological data be measured through close-up videos of faces? Jerry further explained that it mainly relies on the AI ​​algorithm label judgment in the background of the system, which means observing the flow of blood vessels based on the reflected light on the face in the video, performing identification actions, and judging the values ​​of heartbeat and blood pressure. The recognition rate is It can reach 80%-90%, which is equivalent to the data measured by the blood pressure machine.

The difference is that uploading data through a blood pressure machine requires purchasing a blood pressure machine and a self-measurement uploading platform. Generally, patients with chronic diseases are mostly middle-aged and elderly people who often forget to measure their blood pressure, which affects the continuous collection of physiological data. The action of video shooting and uploading can improve patient cooperation in hospitals and also help clinics continue to track the conditions of chronic patients. Because with physiological measurement data, combined with dialogue technology, we can understand the customer's care needs and intentions, reaching 90%. For example, if the customer has high blood pressure, abnormal lactic acid value, there may be some possible physical problems, if we match the customer For the content of robot interaction, OpenTalk can parse the two data sources to analyze the customer's intention and further feed it back to the doctor or caregiver, who will decide which care actions to take.

For example: in the field of medical beauty, medical beauty clinics care about what kind of beauty care customers want to do. Through robot dialogue and interactive behavior on the device, Asia Pacific Intelligence performs labeling actions, including extracting things of concern in the dialogue. , show the intention, such as wanting to do hyaluronic acid, small needle beauty, etc., collect voice and audio and video data, and integrate it into personalized tags, you can recommend skin care treatments, business shopping guides, or list tracking cases, etc., becoming a medical beauty The best assistant for the clinic to understand its clients.

The care platform recruits an AI technology team and will target the Japanese and Thai markets for international export in the future

The AI ​​technology of Asia-Pacific Intelligent Machines starts from natural language understanding and performs labeling actions from conversations. In addition to natural language processing, it also focuses on machine vision technology. Through images, including the recognition of customer age, gender, and facial emotions, it also masters visual tags and dialogue tags to deeply understand customer needs.

AMPIC Healthcare's system service architecture
▲AMPIC Healthcare’s system service architecture

Due to the huge number of disciplines in the medical field, Asia-Pacific smart machines have initially targeted the medical beauty and long-term care markets, and have adopted the concept of a care platform to recruit other AI technology teams. At this stage, it has included the detection of dementia and sarcopenia. It is expected to be included in the future, including blood sugar detection, gastroenterology, ophthalmology, etc., to explore potential markets and find powerful AI technology partners to jointly develop AI detection technology to make the health and medical services covered by the care platform more complete.

The Open Talk platform supports multiple languages ​​including Chinese, Taiwanese, English, Japanese and Thai, and has more than 130 automatic question and answer skills, which can automatically grasp customer emotions and customer needs. In the future, in addition to plans to introduce more than 100 automatic Q&A skills to medical institutions in 2022, In addition to the 200 companies, it will also target the Japanese and Thai markets, enter overseas markets, and export service solutions internationally.

Asia Pacific Intelligent Machine Company CEO Wu Bohan (third from left in the picture) and his team took a group photo after being interviewed by TVBS TV station
▲Asia Pacific Intelligent Machine Company CEO Wu Bohan (third from left in the picture) and his team took a group photo after being interviewed by TVBS TV station

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

這是一張圖片。 This is a picture.
Smart Construction Site Security Platform

In construction site operations, implementing safety protection measures and establishing related processes are essential for controlling workplace safety Every business owner strives to minimize industrial safety risks To reduce the probability of workplace accidents, it is particularly important to inspect personal protective equipment PPE and safety measures The Yongyi Smart Construction Site Security Platform utilizes an AI-embedded system, not only to detect whether workers are properly wearing helmets, but also to manage access control at construction site entrances and verify worker identity The Smart Construction Site Security Platform is also a part of the government's push for the Smart Construction Label Initiative 'Smart Site Management' is one of the three main items under the 'Maintenance Management' indicator, highlighting the importance of 'Smart Site Management' This solution includes access management, surveillance management, safety management, and environmental monitoring as aspects of its AIOT solution Feature Highlights 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-11-09」

【解決方案】7毫秒內分離人聲 洞見未來科技協助聽損者「聽說更簡單」
Voice Separation in 7 Milliseconds: RelaJet's Future Technology Makes 'Hearing and Speaking Easier' for the Hearing Impaired

One rainy Thursday afternoon near Taipei Arena, the Taipei Experience Center of RelaJet was fully booked with appointments from people with hearing loss eager to try hearing aids made with a voice separation engine For the hearing impaired, having affordable, lightweight, and effective noise-reducing hearing aids is truly a blessing 'We hope to help users in need to hear the world's wonders again' This empathetic expectation by RelaJet's founder and CEO Po-Ju Chen, who is also hearing impaired, illustrates his understanding of the needs of the hearing impaired He hopes that RelaJet's unique voice amplification hearing aid technology will benefit many more people Affordable hearing aids benefit many with hearing loss Founded in 2018 by Po-Ju Chen and his brother Yu-Ren Chen, RelaJet developed a multi-voice separation engine paired with Qualcomm's Bluetooth audio platform, drastically reducing the price of imported hearing aids, typically costing 80,000-100,000 NT dollars, to just under 10,000 NT dollars They aim to develop affordable goods with excellent noise-cancelling capabilities that wirelessly connect to smartphones In its first two years, the company primarily developed the multi-voice separation engine, which significantly improved the noise reduction quality Once equipped with Qualcomm Bluetooth earphone chips, the audio processing time is drastically short, at about 7 milliseconds to enhance main voice projection and reduce ambient noise, less than half the time required by traditional medical standard of 16 milliseconds for hearing aids, nearly 'zero-delay' 洞見未來科技推出平價助輔聽器,大大嘉惠聽損者 Yu-Ren Chen explains that the primary use of Qualcomm chips for edge computing, along with a streamlined algorithm, achieves extremely low latency and better noise reduction The hearing aids can cover 18 channels, whereas traditional hearing aids cover 4-48 channels In the future, RelaJet will progressively increase the number of channels According to statistics, there are 470 million people globally with hearing disabilities, with a 30 average device use rate in developed countries, with the highest in Western countries Taiwan has nearly 15 million people with disabling hearing loss, of which the middle-aged and elderly make up 30, yet the device use rate is only about 10, which is quite low Yu-Ren Chen further analyzes that the low device usage rate is due to two reasons firstly, the high average selling price of international big brands ranges from 80,000 to 200,000 NT dollars with a three-year usability period, which deters many due to the high cost and maintenance Secondly, in noisy environments, the noise is also amplified which does not necessarily ensure clarity for the users, and the sound parameters can't be adjusted in real-time, making it inconvenient to frequently visit stores for tuning Thirdly, most models cannot connect to smartphones, making it inconvenient for the hearing impaired to take phone calls Utilizing Qualcomm Bluetooth chips for rapid product development In light of this, Po-Ju Chen, formerly a semiconductor engineer at MediaTek, leads the technical development, while Yu-Ren Chen, with a legal background, manages the operations Their seamless collaboration, along with their team employing AI algorithms and chip integration, learns from thousands of hours of audio files in databases through neural networks and deep learning technologies to develop low-latency, high-noise-reduction voice amplification technologies for hearing aids In 2019, this sound processing technology was integrated into Qualcomm Bluetooth chips, winning first place in the Qualcomm Taiwan Startup Competition and becoming a partner in Qualcomm's Global Expansion Program, significantly boosting product development pace In 2021, they launched their own Otoadd series of hearingenhancement products in Taiwan, which received both market favor and positive reviews from many with hearing loss Based on different consumer needs, various product designs are available According to Yu-Ren Chen, the Otoadd wireless earphones with hearing enhancement functions, model N1, are entry-level neckband style priced at 9,500 NT per pair Users can wear the hearing aid while taking calls, and control noise reduction strength and volume through a mobile app They plan to develop accessories in the future tailored to the needs of older adults Besides being available for trials at experience centers in Taipei and Kaohsiung, this hearing aid is also sold through PChome, Taiwan Mobile's myfone, and Elder Age networks, among other channels Another model intended for individuals with mild to severe hearing loss is the Classic R hearing aid, which received the Japanese Good Design Award in 2021 Since its market debut last year, it has attracted those with congenital hearing loss, with users noting improved clarity in noisy environments and appreciating the convenience of Bluetooth connectivity for calls and watching videos This product is anticipated to be exported to international markets in the latter half of this year Additionally, a hearing aid product combining Bluetooth functionality, set to launch in June this year, is sized like typical Bluetooth earphones, targeting visually conscious consumers with hearing loss Its small size and attractive wireless earphone design allow for phone calls, and if approved by the Ministry of Health and Welfare, eligible users can apply for government subsidies RelaJet to expand into overseas markets, using the USA as a beachhead An interesting question arises due to the pandemic everyone must wear masks which impedes lip-reading How does this affect those with hearing loss Yu-Ren Chen indicates that this situation highlights RelaJet's advantages As each person with hearing loss has different levels of hearing ability, hearing aids can only augment to an appropriate volume, assisting users to hear about 60-70 content, with the remainder relying on lip reading and gestures During the pandemic, as everyone wears masks, masks also muffle sounds, but RelaJet's voice separation engine can correct and strengthen the separation, making it easier for those with hearing loss to recognize voices Besides the Taiwan market, RelaJet's next stage will be expanding into overseas markets, expecting to obtain ISO 13485 medical device quality management system certification and US medical device approval in 2022 They plan to enter the US market, either under their own brand or through OEM arrangements Apart from the Taiwan market, RelaJet will also enter the US market in the next phase for hearing aids「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【解決方案】2秒鐘完成結帳動作 Viscovery AI影像辨識助攻智慧零售
Complete checkout in 1 second, Viscovery AI image recognition assists smart retail

Artificial intelligence AI has gradually changed the way various industries operate in recent years However, most of the work is still done by humans, with AI playing a supporting role This has led to emergence of the term "AI Copilot," which stands for "AI-driven tools or assistants" that aim to assist users in completing various tasks and improve productivity and efficiency The concept of AI Copilot comes from the role of "co-pilot" During flight, the co-pilot assists the main pilot in completing various tasks to ensure flight safety and efficiency In fact, there have been signs of various "machines" beginning to play the role of "copilot" in different fields since the Industrial Revolution, assisting humans in completing heavy physical and repetitive tasks, greatly improving factory production efficiency, and driving rapid economic development Following the advancement of computing equipment and breakthroughs in machine learning, deep learning, and image recognition technologies, the concept of AI Copilot has gradually taken shape The development of AI Copilot marks the transition from "machine-assisted to AI-assisted" Early robots could only complete preset repetitive tasks, but today's AI copilot can learn and adapt to new environments and tasks, and continuously optimize its performance in practical applications This transformation not only changes human-machine interactions, but also has a profound impact on various industries The application scope of AI copilot covers various industries, including finance, healthcare, manufacturing, education, retail, etc, and are everywhere to be seen Application of AI copilot in the retail industry AI image recognition checkout In the retail industry, the application of AI copilot has begun to show concrete results Take Viscovery's AI image recognition checkout system as an example This system is a type of AI copilot model that helps store clerks speed up checkout or assists consumers in simplifying the self-service checkout process The store clerk needs to scan the product barcodes one by one in the regular checkout method If a product does not have a barcode, such as bread and meals, the clerk needs to first visually confirm the items, and then input them into the POS checkout system one by one Based on actual measurements at a chain bakery, it takes 22 seconds for an experienced clerk from "visual recognition" to "entering product information of a plate of 6 items into the checkout system" New clerks may need even more time In addition, according to a Japanese bakery operator, it takes 1 to 2 months to train employees to become familiar with products Now with AI image recognition technology, store clerks let AI handle the "product recognition" step, and AI will play the role of copilot, quickly identifying items within 1 second, speeding up checkout to save 50 of checkout time, and optimizing customers'shopping experience The time cost of training employees to identify bread can also be effectively shortened Even for products with barcodes, AI can quickly identify multiple items in one second, which is more efficient than scanning barcodes one by one The self-checkout system "assisted" by AI image recognition allows consumers to successfully complete shopping without the help of store clerks, eliminating the trouble of swiping barcodes or searching for items on the screen, which improves the shopping experience In a time when store clerks are hard to hire due to labor shortage, this also helps stores reduce operating costs AI quickly identifies multiple checkout items in just one second Source of image Viscovery Recently, startups dedicated to developing AI image recognition checkout solutions have emerged in various countries The most lightweight solution currently known is in Taiwan It can be immediately used by installing a Viscovery lens and a tablet installed with Viscovery AI image recognition software at the checkout counter to connect to the store's existing POS checkout system There are various integration methods, including plug-and-play and API solutions integrated with the store's POS system Viscovery AI image recognition system can be painlessly integrated with the store's existing POS system Source of image Viscovery Example of AI image recognition checkout Currently, the Viscovery AI image recognition system is being used in bakery chains in Taiwan, Chinese noodle shops in Singapore, micromarkets in department stores in Sendai, Japan, and Japanese bakeries and cake shops Over 7 million transactions were completed through this AI system, which identified more than 40 million items These use cases demonstrate the extensive application of the Viscovery AI image recognition system in the retail industry In the future, the company will continue to explore the various possibilities of using Vision AI in retail and catering nbsp The Viscovery AI image recognition system is already being used in bakeries, cake shops, restaurants, and convenience stores in Japan, Singapore, and Taiwan Source of image Viscovery