:::

【2021 Application Example】 Preventing Problems Before They Arise: Leadtek Research Develops AI Technology for Early Detection of Heart Failure Symptoms

With the increase in the elderly population, the incidence of various chronic diseases is rising daily. Among these, heart failure is not only a silent killer; it has a very long disease course with a high recurrence rate, leading to increased burden on healthcare personnel. However, by using medically certified electrocardiography acoustics devices, coupled with AI predictive assessment of heart failure risk and remote care systems, diagnosis can be aided significantly, helping doctors make accurate diagnoses for subsequent patient medical care or referrals.

Heart failure has a lengthy course and medical expenditure is five times that of diabetes

If you find yourself short of breath even with minimal movement, or if you wake up from sleep needing to sit up to feel comfortable, or if you have symptoms such as swollen lower limbs, anxiety, restlessness, fatigue, or a loss of appetite, be cautious! These could be signs of heart failure.

According to statistics, there are about 60 million people with heart failure worldwide, with 5 million new cases every year. In China, nearly 290 million people suffer from cardiovascular diseases, accounting for the second leading cause of death among urban residents; around 12 million of these are heart failure patients, accounting for over 59% of cardiac-related deaths. The disease course of heart failure is exceptionally long, and both its recurrence and rehospitalization rates are exceedingly high, resulting in medical costs that are twice that of hypertension and five times those of diabetes.

According to U.S. research statistics, the 30-day mortality rates for patients with myocardial infarction and heart failure are respectively 16.6% and 11.1%, and the rehospitalization rates within 30 days are 19.9% and 24.4%. The symptoms of heart failure, because they are similar to those of other diseases such as chronic obstructive pulmonary disease and asthma, have an 18.5% misdiagnosis rate, which poses a challenging problem for healthcare institutions.

Leadtek, a major graphics card manufacturer, has been investing in the medical and healthcare sector since 2000. Following two heart attacks in 2011 and 2015 experienced by Chairman Lu Kunshan, Leadtek has focused on health big data, independently developing AI technology for heart failure recognition. This AI application reads patients' electrocardiograms and phonocardiograms to perform anomaly detection and model prediction of heart failure risk, enabling early detection of disease symptoms.

Leadtek independently developed heart failure AI recognition technology to predict medical history and risk

Leadtek's independently developed heart failure AI recognition technology has the following three judgment functions:

1. Prediction of heart failure history: Classifies electrocardiogram and phonocardiogram data into 'with hospitalization history of heart failure' and 'no history of heart failure'.

2. Risk prediction of heart failure: Provides a predictive risk value of heart failure occurrence based on the electrocardiogram and phonocardiogram data.

3. Prediction of heart failure recurrence risk: For patients with heart failure, it reads their phonocardiogram and electrocardiogram data, assessing the risk prediction of heart failure recurrence.

Leadtek states that the application of heart failure AI recognition technology can assist doctors in making more efficient and accurate diagnoses, facilitating subsequent medical treatment or referrals for patients. As an instance, in studies of heart failure patients discharged from Taipei Veterans General Hospital, using the EMAT (Electromechanical Activation Time index) and SDI (Systolic Dysfunction Index) calculated by the synchronized electrocardiography-acoustic device as treatment guidelines resulted in a higher survival rate compared to those treated based on traditional symptoms. This research has also been published in the authoritative international cardiology journal JACC, receiving recognition in the international market.

System manufacturers can apply heart failure AI recognition technology for other value-added applications.

▲System manufacturers can apply heart failure AI recognition technology for other value-added applications

Leadtek states that cooperating system manufacturers can choose to build their own heart failure AI risk prediction engine, uploading their system's electrocardiogram and phonocardiogram data to Leadtek's heart failure AI risk prediction engine, which then returns risk prediction values for integration by system manufacturers / cooperating manufacturers as a value-added application input.

Not just for clinical use, the heart failure AI risk prediction engine can also be extended for use at home or in the workplace

Additionally, this system can be extended to other applications, including:

One, hospital outpatient screening: Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to conduct a 10-second rapid test in outpatient and emergency departments to assess a patient's cardiac history and heart failure risk. Two, discharge risk assessment: Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to assess the heart failure risk during a patient's hospital stay. The test data can serve as a pre-discharge risk assessment and prognostic indicator.

Three, continuous home care: Patients can use the electrocardiogram and phonocardiogram recorder, wearable electrocardiogram recorder, and transmit through a home transmission box (gateway) to measure electrocardiogram and phonocardiogram signals at home and upload them to the amor health cloud platform for heart failure AI risk prediction analysis. Patients can manage their health autonomously via an APP, reviewing historical physiological trends; disease management nurses can manage member health through the health management backend Web.

Four, home rehabilitation training: Patients can wear a health bracelet to monitor activity, fatigue, circulation, and sleep, autonomously managing their health through the mobile APP and observing the risk of heart failure, engaging in exercise and rehabilitation training to aid in swift recovery.

The heart failure AI recognition technology system can also be extended to employee home care applications.

▲The heart failure AI recognition technology system can also be extended to employee home care applications.

Additionally, in factories or offices, this system can also achieve employee health management goals, with applications including:

One, workplace safety units: Provide employees with wearable electrocardiogram recorders before they start work duties.

Two, physiological monitoring for business executors: While executing business duties or training, employees wear wearable electrocardiogram recorders for fatigue warnings, signaling whether physiological conditions allow continued execution of tasks. Task segments can use data transmission boxes or apps to upload physiological monitoring information to the health management platform, assessing the heart failure risk for operations staff, with test data serving as an indicator for enterprise resource human units and public safety.

Three, workplace physiological monitoring center care: The workplace physiological monitoring center can inspect and record employees' historicalphysiological trends through the health cloud platform.

Four, workplace nursing units: Nursing units receiving instructions from the physiological monitoring center can provide health management advice based on employees' physiological trends; nursing centers can manage employee health through the health management backend Web. Five, employees can wear health bracelets to monitor activity, fatigue, circulation, and sleep, autonomously managing their health and observing the risk of heart failure through the mobile APP, engaging in exercise and rehabilitation training to aid in rapid recovery.

Workplace application of heart failure cloud care and big data center diagram.

▲Workplace application of heart failure cloud care and big data center diagram

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【導入案例】哈瑪星科技建構AI模型管理平台 加速AI落地應用
Hamastar Technology Builds an AI Model Management Platform to Accelerate the Application of AI

Riding the AI hype train, financial service providers are using their solid foundation in the industry to not only transform themselves, but also assist their customers with transformation Hamastar Technology, which has been established for over two decades, has been developing AI technology and assisting industry customers with the implementation of AI in recent years Hamastar Technology believes that to implement a complete AI project, in addition to AI theoretical knowledge, data analysis, and model training capabilities, it is also necessary to develop APIs for data, establish databases, develop front-end RWD web pages, and even consider layout design and user experience based on customer needs These tasks create technical barriers for AI startups Even from the perspective of companies that have reached a certain scale, it is hard to accumulate technical experience and accelerate business growth due repeatedly investing manpower developing similar functions in each project Institutional customers still require high level of customization for AI Using the requirements of government Agency A implemented by Hamastar Technology as an example, users must control false information from specific channels The platform needs to provide data ingestion functions for training models and predictions, and can complete natural language processing NLP text classification model training and use When the model discovers false information, it needs to immediately notify responsible personnel through messaging software The need of Agency B is to use an AI model to automatically classify petitions and immediately provide information on past cases as reference for the petitioner or officer Although the project models are similar data ingestion, model prediction, warning notification, the required functions still need to be separately developed for individual projects, and existing programs and models cannot be reused to speed up the implementation of subsequent projects After in-depth discussion, Hamastar Technology found that pain points of enterprises implementing AI projects include high implementation costs and lengthy project schedules It is difficult for a single enterprise to simultaneously have data scientists, analysts, engineers, and designers Current projects are all focused on solving the needs of specific fields, and it is difficult to reuse the AI models in other fields of application At the same time, the tools are concentrated in AI projects and cannot provide customers with total solutions In other words, due to the "limited manpower," "restricted fields," and "insufficient tools" of AI service providers, the implementation of AI technology projects requires high costs or lengthy timelines These are common problems that companies urgently need to solve Therefore, if there is an AI model application service management platform, it will be able to solve the above difficulties and not only reduce costs, but also accelerate project implementation and provide customers with one-stop solutions AI model application service management platform assists in quickly completing projects Therefore, with the support of the AI project of the Industrial Development Bureau, Ministry of Economic Affairs, Hamastar Technology carried out the "AI Model Application Service Management Platform AISP RampD Project" and engaged in the RampD of AISP products The purpose is for AI service providers to complete the AI projects with twice the result using only half the effort The AISP provides one-stop AI solutions AI service providers can quickly assemble required functions, such as data API, model management, and model prediction result monitoring subscription through existing module functions of the AISP It also provides commonly used graphical tools to help companies quickly design interactive charts or dashboards required by users, effectively reducing the labor costs required to execute projects, shortening the solution POC or implementation time, and accelerating the implementation and diffusion of industry AI In terms of product business model, in the short term, the company will extensively invite IT service providers with expertise in the field of AI to work together, and use platform services to solve the AI implementation problems faced by requesting units in various field, gradually building trust in the platform brand In the mid-term, the company hopes to gradually expand the market based on its past success, and form strategic alliances with multiple IT service providers to solve more and wider problems in specialized fields and provide more solutions for units to choose from The platform combines field experts to jointly expand overseas markets In the long term, after establishing AI strategic alliances in various specialized fields, the platform will have a large number of AI solution experts for specialized fields After accumulating a large amount of successful project experience, Hamastar Technology hopes that the AISP will be able to work with experts companies to expand into the international market Harmastar Technology Co, Ltd was formed in 2000 by recruiting numerous senior professional managers and technical experts in related fields It is committed to software technology RampD and services, and aims to develop into an international software company, actively creating opportunities for international cooperation in the industry Under the excellent leadership of its first president, the company has rapidly grown into a major software company in Taiwan

這是一張圖片。 This is a picture.
Testing Seat Contact Components AI Intelligent Flaw Detection

With rapid development in 5G, AIOT, automotive electronics, and other downstream sectors, the entire supply chain is expected to benefit from this consumer market As product demand momentum gradually increases, increasing production efficiency and reducing operational costs become the most important issues In order to meet the needs of customers for various packaging types, Yingwei Technology has been committed to developing highly customized test seats However, a resulting pain point is the inability to mass-produce and fully automate operations with machines some tasks still rely on manual execution In this project, the probe part of the test seat was outsourced in 2021, and under current and future large-scale demands, work hours, costs, supply, and quality are issues Yingwei faces The company achieves a defect detection rate of 9995, which seems high, but with an average inspector able to inspect 10,000 needles per day, there would still be 5 defective needles On a test seat that is only 3 cm wide with approximately 1,000 needles, just one defective needle could potentially lead to faulty testing at the customer end As the current operational mode relies on manual visual inspection, external factors such as fatigue or oversight of personnel, and subjective judgment by inspectors may lead to the outflow of defective products, which necessitates strict quality control of contact components We once sought to utilize optical inspections Rule-based for controlling the quality of appearances, but the metallic material of the contact components leads to light scattering, background noise interference, background scratches, and material issues that could result in misjudgments Therefore, we decided to look for AI technology service providers to solve our detection difficulties Developments of Dedicated AOI Line Scan Equipment To meet the needs for inspecting thousands to tens of thousands of probes within our company's IC test seats, traditional surface imaging and individual needle imaging would be too slow to achieve rapid inspection and labor-saving goals In response, the service provider proposed a trial with an AOI dedicated line scan module solution Utilizing a width of 63mm on the X-axis for reciprocal scanning of all probes on the test seat, the tests allowed for the simultaneous scanning of 8-9 probes, significantly enhancing the future detection efficiency of AOI machines This project will proceed with the aforementioned innovative Proof of Concept POC, focusing on the development of the line scanning equipment and performing imaging, learning, and training on both normal and abnormal probes provided by our company, with initial AI model training aimed at preliminary approval This project's customized line-scan imaging module Ideal future imaging result illustration A Single AI Technology Solution for MeasurementDetection Needs Unified use of AI DL CNN learning methods, instead of the current Rule-based system which necessitates defining each defect individually, to meet the needs for abrasion measurement and appearance defect detection of malfunctionsforeign objects When the same machine uses both measurement and detection technologies, not only does it increase costs, but it also affects the detection speed Hence, the service provider recommends the use of a line scan device for imaging Its resolution is sufficient for AI to simultaneously determine appearance defects and assess the condition of needle tip abrasion, as detailed below Line scan pixel imaging displaying needle tip abrasion conditions This AI detection technology meets both measurement and inspection needs for Yingwei, not only bringing more benefits to future probe testing but also introducing an innovative axis in AI technology Change the method of human inspection, enhance work efficiency and product quality After combining both hardware line scan and software AI model training approaches, we successfully ventured into new AOI detection applications Following the AI implementation POC, including the development and validation of a customized line scan module and an initial AI model, the plan is to officially develop the AOI machine next year and integrate it into the IC test seat production line Future Prospects Probe manufacturers upstream and downstream IC factory users both have needs for the AOI inspection machine upstream can ensure probe quality before leaving the factory, while downstream users can use this machine to regularly inspect the condition of numerous IC test seats in hand Given the future demands, the AOI machine is poised to have a significant positive impact on the IC testing industry in the foreseeable future 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」

【導入案例】赫銳特科技VCSEL封裝元件瑕疵導入AOI檢測 提升產能效率20
HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95 VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and ARVR VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics VCSEL technology has a wide range ofnbsp applications, including in drones Pictured Zoyi Technology's Agricultural Drone VCSEL technology has a wide range of applications, AI technology assists in defect detection HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness One of the key problems is the replacement of glass lens with epoxy resin lens The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized The release of stress caused by heat during the mounting process will directly cause the optical lens to break HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important Under the constraints of packaging space, the space for fitting the package and optical lens is limited Moreover, the optical lenses will be confined to a metal frame If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10 in the VCSEL package reliability verification, resulting in an increase in production costs In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality The problem of image collection needs to be solved first to successfully collect image data Therefore, HRT Technology first developed an Automated Optical Inspection AOI device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening Manual labeling is carried out according to the image classification above, including samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out Residual neural network ResNet or other related algorithms are used for deep learning to identify the quality of lenses Implementation of AOI inspection improves production efficiency by 20 and above Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance The lens is packaged on the VCSEL package that has completed die bonding After passing the general light up test, the final reliability test high temperature reflow is performed Failed samples go into the rework process However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95 and above in the reliability verification This is expected to help companies reduce production costs by 10 and increase production efficiency by 20 and above The difference before and after implementing AI image detection HRT Technology pointed out that this technology is an AI application developed based on tiny images It uses deep learning algorithms to identify defects in the images The trained network automatically classifies image data to predetermined categories Defect categories can be determined through reference images, so cumbersome programming is not required In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future