:::

【2021 Solutions】 InfuseAI focuses on building the PrimeHub MLOps software platform to lower the threshold for enterprises to introduce AI technology

In light of the rapid development of Artificial Intelligence (AI), InfuseAI has created PrimeHub, a one-stop AI deployment platform software, with the aim of lowering the barriers for AI adoption and assisting enterprises in a successful transformation. InfuseAI Inc., founded in 2018 by senior developers from the Taiwanese open-source community, g0v's Chia-liang Kao, and KKTIX founder Liang-Bin Hsueh, specializes in PrimeHub, the AI deployment platform software.

InfuseAI's COO Liang-Bin Hsueh shares insights on MLOps implementation and application

▲InfuseAI's COO Liang-Bin Hsueh shares insights on MLOps implementation and application

InfuseAI's COO, Liang-Bin Hsueh mentioned that AI project development is an iterative process. During the AI product lifecycle from data collection, development, model deployment to monitoring etc., it contains many technical debts that prolong the project cycle, increase costs, and significantly reduce the benefits. Furthermore, according to statistics, data scientists spend 65% of their work hours on tasks other than model development. The realization of AI not only involves development but also includes maintenance and cross-team collaboration issues. All these factors significantly slow down the speed of AI development to match the company's needs.

Liang-Bin Hsueh points out that the issues arising from the inability of AI development speed to keep up with enterprise needs can be specifically illustrated in the following two aspects:

• Speed of AI model development: In the past, it took 1 to 2 years to complete an AI project. However, as enterprises adopt AI, the project and AI model numbers multiply.

• Operational issues after AI model deployment: The lifecycle of an AI model begins after deployment. As data accumulates, AI models can be retrained to enhance performance. However, as the number of models grows, operational issues and computational resource bottlenecks emerge.

Hence, the MLOps platform—PrimeHub, developed by InfuseAI, encompasses the processes from AI model development, training management, to operational deployment and monitoring, offering a one-stop platform service through a smooth automated AI workflow that enables true enterprise AI implementation.

MLOps ecosystem

In other words, the InfuseAI team continuously adds to PrimeHub Apps by integrating third-party application services, actively collaborating with more manufacturers to seamlessly integrate AI models into PrimeHub, and eagerly anticipates cooperation with more businesses focused on AI technology and SI partners to inspire more applications on the MLOps platform and further promote large-scale AI implementation. Since its formation over three years ago, InfuseAI's clients include Taiwan AI Academy, E.SUN Financial Holdings, Sinopac Financial Holdings, National Taiwan University Hospital, and Chi Mei Hospital. Among these, InfuseAI works closely with Taiwan AI Academy to address various academic needs. Teaching assistants at each branch only need to operate simply in the PrimeHub platform, where all management tasks are automatically completed. Students in PrimeHub’s self-service platform establish a uniform pre-configured environment, allowing multiple deep learning calculations simultaneously, isolated by containers without interference. Additionally, assistants can decide on the data to load based on the course progress, automatically loading course files and datasets when students launch the environment.

Yushan Financial Holdings began intensive integration into AI development in 2018, acquiring GPU computing resources. They discovered the need for robust infrastructure to speed up operations amidst numerous individuals and projects concurrently. They sought a management platform to assist with computing resource management and data authorization.

Liang-Bin Hsueh states that the PrimeHub platform aims to help enterprises scale AI development, reducing model deployment time from days to hours, further facilitated by APIs and APPs to automate and optimize workflows. PrimeHub operates on a yearly subscription basis, promising ongoing optimization of the platform environment and the flexibility to offer customized services to different customers. Currently, it offers three solutions: PrimeHub Enterprise Edition, PrimeHub Deploy—a lightweight model deployment management plan, and PrimeHub Community Edition, allowing users to choose according to their needs.

(This article is a curated selection from the "AI Engineering Online Meetup")

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

這是一張圖片。 This is a picture.
AI Smart Health Prevention Plan

Herji Ltd held an interactive teaching session with AI storybooks at the 'Taiwan Early Childhood Development and Remedial Association Taitung Office', allowing children, teachers, and parents to engage in immersive educational experiences AI-generated children's educational storybook materials AI Learning Platform In recent years, changes in the social structure of Taiwan, combined with experiences in hospital emergency departments, have often led us to overlook the depressive symptoms exhibited by adolescents, resulting in tragic incidents of self-harm or even suicide among children A significant part of children's depression stems from their academic performance, with parents worrying about their children's future competitiveness, thus placing a lot of pressure on children who perform poorly academically In a family with two children with the same genetic background and provided with the same resources for growth, we often find that the second child's academic performance is not up to par, with poor grades, an inability to concentrate in class, and even lacking the patience and perseverance to finish reading a comic book or playing a video game We have been exploring why these differences occur and discovered that these issues often arise from undiagnosed learning disabilities during early childhood Due to environmental factors, children with delayed learning abilities are often not acknowledged by over 80 of parents who are reluctant to seek treatment for their children, primarily fearing that their child will be labeled as delayed As a result, the child's learning ability is hindered from an early age, with their academic struggles increasing as they enter primary and secondary school, leading to greater academic lag, frustration from parents, struggles from the child, and increased family disputes If tutoring does not yield effective results, expenditure without achieving positive outcomes often leads to further family conflicts, creating a vicious cycle that accumulates a lot of negative emotions in children during their developmental process, which in turn affects various factors impacting their health In reality, the main reasons behind a child's poor academic performance, inability to learn, lack of interest in learning new things, or even developing health-impacting psychological conditions, actually stem from accumulated learning delays during early childhood The period before the age of six is considered the golden window for treating learning delays If these can be identified and addressed during this time, there is a chance that the child's learning abilities can be greatly improved10The industry's current pain points are as follows 1Lack of methodologies for assessing learning abilitiesLack of databases for sample comparisons in the market 2Traditional parental misconceptionsFear of labeling and treatment delays for mild to moderate cases 3Lack of therapeutic materials and toolsShortage of therapeutic storybooks and series courses This project will develop a national talent development support system, utilizing AI Technological development of a system for assessing children's learning abilities that supports parents in safeguarding their children's health from the start of learning ability testing, offering early detection and treatment In the future, all Taiwanese children, regardless of background, will be able to establish a healthy foundation in early childhood, growing up to become valuable assets for national development 2、 As proposed in this planAIApplications and explanations 'Child Language Ability'AI'Analysis Model' This model quantitatively analyzes 'the condition of children's use of Mandarin' when 'expressing an event' Scenario Preschool teachers guide children in narrating storybook contentAITools analyze the sentences used by children to describe storybook content, applying statistical algorithms for quantitative analysis Analysis indicators include 'sentence type' and 'lexical items' Analysis aspects include correctness of sentence structures, diversity of vocabulary, quantity of vocabulary used, and accuracy of vocabulary usage Application Comparative analysis between an individual child and peers' language abilities can offer more detailed language skills teaching by preschool teachers Techniques used Chinese word segmentation, Chinese POS tagging, Chinese syntactic rules analysis algorithm, and quantitative analysis algorithms Tools usedChinese word segmentation tools, POS tagging toolsChinese POS Tagging Tool 3、 Expected Industrial Value Establish a learning ability assessment and support system, through therapeutic storybooks and courses Collaborate with kindergartens to develop learning ability bases, preventing children from being stuck at the starting point Alongside parents, protect children's health starting with learning ability testing, backed by a robust database, allowing parents to identify early any delays in learning, helping children regain their learning abilities 4、 Expected Industrial Benefits Economic Benefit and Future Spread and Impetus By supporting children with delayed learning abilities, enhancing their learning prowess through this project, these children serve as the future of our nation and can thus significantly contribute to national talent development Furthermore, the purpose of establishing a learning ability development base is to help reunite children with their parents, increasing their interaction time, allowing the children to move beyond mere one-dimensional interactions 3C This facilitates two-way interactions between the child and parents, potentially impacting children who may have been otherwise delayed in developing their capabilities due to environmental factors 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-11-15」

【解決方案】聲麥無線推出殺手級5G即時AI語音翻譯 降低5成口譯成本
VM-Fi launches killer 5G real-time AI voice translator that reduces interpretation costs by 50%

With "Voice as a Service VaaS", VM-Fi Inc launched the world's leading 5G real-time AI voice translation service "VM-Fi," providing AI real-time translation subtitles TranSpeech and AI multi-lingual smart counter TransDisplay The service is applied to real-time translation services in diverse fields, such as international exhibitions, tourism industry, and retail stores The translation service can be quickly set up in 15 minutes, which can significantly reduce the customer's interpretation service cost by 50, creating benefits in terms of time and labor costs This killer application is a product launched by VM-Fi, which has been established for three years It can significantly reduce the cost of interpretation by half It successfully entered the Japanese market and is highly popular among consumers TranSpeech real-time subtitles for speeches and TransDisplay smart counter AI service solution For organizers of international forums and exhibitions, paying high interpretation fees has always been a common pain point hard to put into words According to statistics, to hold an all-English forum in Taiwan, including two interpreters, setting up an interpretation booth, on-site radio station, control panel, and audio, the total cost will be at least NT100,000 to meet the on-site interpretation needs Established in September 2020, VM-Fi launched the "VM-Fi 5G real-time AI voice translation service" In just 2 years, and successively won the Mobileheroes of the Ministry of Economic Affairs Industrial Development Bureau, Start-up competition in the Smart City Project, Qualcomm Innovate in Taiwan Challenge QITC, Japan's JR Kyushu Innovative Business Competition Excellence Award, and the CES 2022 Innovation Award It has not only received praises in the market, but also attracted great attention from Taiwanese investors and was adopted by large Japanese trading companies It hopes to help people around the world avoid communication barriers through smart city solutions, and enjoy a convenient life in smart cities 5G real-time AI voice translation does not require expensive interpreters and equipment and reduces the interpretation cost by 50 The VM-Fi team, which has a solid technical foundation in language translation, digital content, and UX development, has learned that only 20 of high-end consumers in the market can afford the high cost of interpretation To meet the remaining 80 of market demand, VM-Fi combines 5G high-speed transmission and AI voice recognition technology help customers reduce labor and costs Its business solutions can be applied in international exhibitions, tourism services, shopping malls, and online and offline business meetings 5G high-speed AI speech translation service process "Unlike traditional interpreters' sentence-by-sentence interpretation, which is a time-consuming and inefficient process that prevents the audience from smoothly listening to a speech," VM-Fi further stated that the real-time AI speech translation service uses AI algorithms to analyze the speakers speech The AI determines the parts of speech and subject of the speaker, and then immediately translates it The lecturer does not need to wait for the interpreter, and only needs to connect the microphone cable to the VM-Fi 5G real-time AI voice translation service to speak freely The audience can immediately read the translated subtitles 5G real-time AI voice translation was used in the Kyoto Smart City Summit amp Expo for two consecutive years in 2022-2023 The "VM-Fi 5G real-time AI voice translation service" currently supports Chinese, English, Japanese, Korean, Spanish, French, and German, providing translation services between these seven languages During the pandemic, when the demand for online activities increased significantly, VM-Fi introduced the world's first real-time subtitle service solution The contents spoken by the foreign speaker is translated in real-time and displayed on the live broadcast screen, allowing the audience to understand contents shared by the speaker in real time The operation method is also very simple Audiences do not need to download the APP All they need to do is open the Youtube or Facebook live broadcast platforms provided by the organizer The real-time subtitle solution not only saves customers the trouble of translation work, but also allows online listeners to enjoy seamless real-time translation services without any worries Real-time subtitles provide audiences with seamless real-time translation service In addition, the smart counter solution TransDisplay launched by VM-Fi in Japan is also very popular among consumers VM-Fi stated that Japan has a large elderly population and a large number of tourists Especially during the pandemic, most consumers wore masks and there was often a gap in communication The smart counter directly converts the communication between two parties from voice to text and displays on the transparent partition, providing the most considerate service that the public can clearly see at a glance In the future, VM-Fi will work with Taiwanese panel manufacturers, integrating software and hardware to provide voice-to-real-time subtitle translation services in Japanrsquos shopping malls, stations, airports, and government agencies Smart counters provided people with friendly communication services during the pandemic User experience is the key to VM-Fi taking root in the Japanese market Facing the explosive growth of cross-border tourism business opportunities after the pandemic, VM-Fi is confident in business expansion VM-Fi stated that the VM-Fi 5G real-time AI voice translation service has demonstrated excellent product and service resilience during the pandemic, and can flexibly meet customer needs for various physical or online services VM-Fi plans to establish a headquarters in Japan before April 2025, and actively cooperates with Kansai and Kyoto prefectural and municipal governments to expand its operations After establishing a solid foundation in the Japanese market, the EU market will be the next important target VM-Fi participated in fundraising activities of the AI Founders Alliance of the AI Program of the Industrial Development Bureau, Ministry of Economic Affairs The company relied on the assistance of the Institute for Information Technology III, Taiwan-Japan Industrial Collaboration Promotion Office TJPO, and the Japan External Trade Organization JETRO to actively seize Japan's market "Japan's market not only values digital transformation, but also user experience UX" Therefore, after the successful launch in Japan, everything will fall into place when it expands to other markets around the world VM-Fi app in Japan's shopping malls, stations, airports, and government agencies VM-Fi is a startup with passion and innovative spirit nbspfounded in 2020 We focus on AI speech recognition and real-time translation technologies, and are committed to allowing people around the world to enjoy high-speed speech translation during international speeches, at service counters, and during communication, completely removing the language barrier and allowing everyone to enjoy equal rights to information VM-Fi's AI service is not only a technological innovation, but also a commitment to global sustainable development A Digital solutions We are committed to reducing paper use Every sheet of A4 paper saved reduces carbon emissions by 78 grams, using practical digital solutions to promote environmental protection B Renewable energy decisions We choose cloud services that use renewable energy and plan to achieve the goal of using cloud services that use 100 renewable energy by 2025, in order to create a greener technology foundation for the future C Water saving decisions We are committed to using cloud services that achieve positive water benefits before 2030, ensuring that the replenishment of water resources exceeds consumption, and contributing to the future of the Earth D Net zero emission decisions When using new data centers, we will choose net-zero deforestation to protect the natural environment E Sustainable development goals Through the decisions above, we are making active efforts to achieve the United Nations Sustainable Development Goals SDGs 4, 7, 9, 10, 11, and 13, exerting every effort to create a better world VM-Fi's vision is to create a world without communication barriers, allowing everyone to communicate freely and jointly move toward a better future Let us work together to contribute to global communication equality and sustainable development, and create a greener and better future nbsp

【解決案例】神經元科技 動鑑觀顫 以眼為始 最佳智慧醫療輔助者
Neuron Technology, moving and observing, starting with the eyes, the best smart medical assistant

Looking around the world and in Taiwan, the number of patients suffering from vertigo is increasing year by year When faced with vertigo testing, most people will choose to have it diagnosed by a doctor or hospitalized with neuromedical imaging tools such as MRI or CT for interpretation However, this may lead to misdiagnosis of vertigo, overdiagnosis of patients, waste of medical resources, etc, and cannot be effectively traced back The actual condition of the patient's dizziness In order to solve the long-term clinical pain point of vertigo, Neurobit has developed a smart wearable medical device - NeuroSpeed smart glasses and an AI assistance system It provides an AI smart solution for rapid screening of vertigo, assisting doctors in quickly screening more than 80 of brain diseases Efficient detection power with accuracy and sensitivity of over 90 Neuron Technology was founded in 2016 The co-founders include Yang Juncheng, Chen Weicheng, Huang Jinxun and Wang Jingfu The four of them were studying at the National Taiwan University Medical Engineering Institute and the Creative Entrepreneurship Program to jointly offer the "Biomedical Innovation and Commercialization" course Next, let’s embark on the entrepreneurial journey together The core team members of Neuron Technology are mainly composed of cross-field experts in medical engineering, information technology, neurology, patents, business, etc The common entrepreneurial concept is to continuously explore and explore unsolved pain points in medical clinical practice Seeing that patients were suffering from vertigo, Neuron Technology invented and independently developed an efficient and practical wearable smart medical device, NeuroSpeed Smart Glasses, which combines hardware AI-assisted decision-making system software to provide an AI smart solution for rapid dizziness screening Neuron Technology CEO Yang Juncheng said that the proportion of people in Taiwan and the world who suffer from vertigo is very high In Taiwan, as many as 3 of the people about 700,000 suffer from vertigo, while in the United States, about 1,000 people suffer from vertigo Tens of thousands of people go to see a doctor due to vertigo From the data, it can be seen that the vertigo medical care market is quite huge Regarding rapid screening for vertigo diagnosis in the clinic, current rapid screening tools in hospitals mainly use neurological examinations, and most of them are processed through questionnaire-type scales The diagnosis will rely too much on the patient's chief complaint and the doctor's experience judgment, and lacks quantitative indicators, resulting in Misdiagnosis of vertigo and loss of golden treatment time For patients with vertigo who are admitted to the emergency department, medical diagnosis in the past relied heavily on neuromedical imaging tools such as computed tomography CT or magnetic resonance imaging MRI After observation, it was found that the equipment was insufficient In the United States, the number of patients admitted to the emergency department Less than 3 of the population can receive immediate MRI diagnosis, and less than 50 can receive CT diagnosis However, excessive use of CT or MRI diagnosis may lead to overdiagnosis and treatment of patients, and even waste of medical resources In order to help vertigo patients accurately and efficiently screen and triage and reduce over-diagnosis in clinics and emergency rooms, NeuroSpeed Smart Glasses, a wearable smart medical device developed by Neuron Technology, is believed to have a great impact on the overall application of medical resources and patient diagnosis and treatment It is very helpful Yang Juncheng said that if it is not necessary to use MRI to track the diagnosis, this device can be used as a rapid screening test before the existing MRI neuroimaging tools and after the patient is admitted to the hospital, reducing over-diagnosis of patients NeuroSpeed's examination method is to quickly screen for nystagmus to identify patients with potential brain diseases The examination method of this technology is to observe the trembling state of the eyes and a series of eye movements when the subject is staring at a stationary object, so as to judge Brain risks for appropriate diagnosis and treatment NeuroSPeed smart glasses can crack brain and eye diseases, clinical trial sensitivity reaches 90 With the active research and development of Neuron Technology, two generations of NeuroSpeed smart glasses have been successfully launched The first generation NeuroSpeed mainly provides doctors with real-time observation of high-quality eye images and eye movement response-related examination data reference, and does not provide auxiliary diagnosis services The second generation of NeuroSpeed allows physicians to record, track, store and view relevant eye movement analysis and pupil area identification, thereby effectively diagnosing diseases of the central, meridian and peripheral nervous systems Because the second-generation NeuroSpeed product has the function of assisting doctors in analysis and diagnosis, it has been classified as a Class II medical device in the United States and must be certified by the US FDA before it can be sold externally At this stage, this product has completed pre-submission and will be submitted for review after the biocompatibility test is completed It is expected that the second generation NeuroSpeed will successfully obtain US FDA certification next year In terms of actual verification fields, NeuroSpeed has currently cooperated with New Taipei Shuanghe Hospital and Taichung Tzu Chi Hospital for clinical verification Its clinical results have confirmed the classification judgment of central nervous system diseases such as stroke and other vestibular system diseases With the addition of NeuroSpeed Smart glasses are designed to be lightweight and easy to carry, detect quickly and easily, and have the functional characteristics of automatic interpretation They can effectively assist doctors in quickly screening for potential brain disease risks in patients with vertigo Field verification with foreign medical centers mainly involves vertigo patients admitted to the emergency department Physicians can use NeuroSpeed smart devices to interpret the phenomenon of stroke diagnosis Currently, the accuracy of clinical trials in the above-mentioned cooperative hospitals reaches 80 and the sensitivity reaches 90 Neuron Technology develops smart wearable medical device NeuroSpeed smart glasses In addition to becoming the best smart medical assistant for doctors to quickly screen brain disease risks in the clinic and emergency department, NeuroSpeed smart glasses also assist doctors in the detection and assessment of strabismus risk They are jointly developed with the Tri-Service General Hospital through neuron technology The "Portable Strabismus and Abnormal Eye Movement Diagnosis System" is implemented in the Tri-Service General Hospital, providing doctors with a complete preoperative assessment of strabismus and postoperative tracking basis This excellent RD technology achievement was recognized by the 17th National Innovation Award-Clinical Innovation Award in 2020 We know that many diseases can cause congenital or acquired eye movement abnormalities, and even cause symptoms of strabismus or nystagmus Among them, as for strabismus, according to expert physician consultation surveys, the global prevalence of strabismus among school-age children is 2 5, while the prevalence of strabismus among school-age children in Taiwan is about 1 to 4 Yang Juncheng said that clinical diagnosis of the symptoms of these diseases is mainly divided into two categories deviation measurement of eye position and eye movement test It has been observed that there is currently a lack of objective quantitative methods for diagnosing eyeball position deviation, and eyeball deviation measuring instruments are used to check subjectively For Neuron Technology, the current NeuroSpeed instrument and strabismus and abnormal eye movement diagnosis system software can integrate objective and clear eyeball images, eye muscle function and eye deviation angle data as a rapid test that meets clinical diagnostic criteria Service, the data of these tests can be used as the basis for doctors’ complete preoperative assessment and postoperative tracking of strabismus Therefore, this system can provide objective and effective quantitative analysis, which can greatly reduce the medical risks of patients during surgery In terms of business model, Neuron Technology mainly cooperates with hospitals to sell research-based products It is believed that the company expects to have significant revenue performance after passing the FDA next year At present, Neuron Technology will use the country's first wearable smart medical device NeuroSpeed smart glasses and AI assistance system to provide software and hardware integrated solutions to assist doctors in quickly screening brain diseases and eye diseases, extending patients' golden treatment time and reducing social risks health care costs to create a triple win NeuroSpeed smart glasses assist doctors in quickly screening brain and eye diseases Looking at the world, the pioneer of smart medical equipment, a new paradigm of biomedical software and hardware system integration In the early days of Neuron Technology’s entrepreneurship, technology research and development and business expansion faced many challenges Yang Juncheng expressed his sentiments that since the NeuroSpeed product is the first medical smart glasses developed in China, both in terms of obtaining hardware raw materials and developing technical specifications, The challenges associated with building and integrating related systems are higher than those for consumer electronics Additionally, bringing together cross-disciplinary talent and integrating it into a core team is also an entrepreneurial challenge In terms of business development, although the company has accumulated clinical verification results and published related outputs, the establishment of market channels still requires continuous efforts to expand It is hoped that it can continue to rely on the assistance of legal persons such as the Capital Strategy Council to actively create more diversified market channels and connect potential Cooperating manufacturers In order to accelerate international expansion and market operation exchanges, the company will conduct a new round of fundraising planning at this stage to meet development Since its establishment, Neuron Technology has taken long-term development and stable profits as its operating goals Yang Juncheng said that in addition to focusing on existing professional fields, we also develop and apply value-added products through the company's software development and software development The accumulated RD energy of hard integration is expanded to other medical disciplines and fields Yang Juncheng hopes that Neuron Technology can become a pioneer in smart medical equipment, with research and development oriented to meet the needs of users and patients, and also hopes to become a model for the integration of biomedical software and hardware systems For the medium and long-term layout, the company will promote industry-university exchanges and cultivate biomedical talents integrate upstream and downstream industry resources to create smart medical solutions and platforms and actively explore foreign sales markets such as the United States and Europe as a basis for sustainable development of the company Vision 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」