The intelligence of machines and the branch of computer science which aims to create it

Artificial Intelligence Journal

Subscribe to Artificial Intelligence Journal: eMailAlertsEmail Alerts newslettersWeekly Newsletters
Get Artificial Intelligence Journal: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Artificial Intelligence Authors: Elizabeth White, Liz McMillan, Shelly Palmer, Pat Romanski, Yeshim Deniz

Related Topics: Cloud Computing, Artificial Intelligence Journal

Blog Post

Handwriting Recognition in Healthcare | @CloudExpo #API #CognitiveComputing

A use case handwriting recognition application is not only applicable for healthcare but for manufacturing, hospitality & retail

While some existing apps allow the doctors to write using their stylus pen, what is needed is an integrated solution that includes handwriting recognition, voice, face recognition and other cognitive intelligence as part of health care applications.

 

The Need for Handwriting Recognition in Healthcare

  • Studies point to the fact that more than 70% of people spend more than one hour a day using pen
  • Today, 80 percent of physicians still rely on traditional pen and paper to capture patient information, as well as for treatment-related information
  • Hand Written notes that are not electronically captured pose a great challenge to HIPAA compliance
  • There are not very many integrated Healthcare Enterprise Application that integrates handwritten notes with Health care back end systems
  • Implementing text recognition with your EHR software may be one of the most beneficial methods to save your staff time and effort.
  • While some existing apps allow doctors to write using their stylus pen, what is needed is an integrated solution that includes handwriting recognition, voice , face recognition and other cognitive intelligence as part of health care applications.

Introduction To Windows 10 Ink
Recently Windows 10 platform has released an anniversary update, and one of the key components of that is the introduction of Windows ink. While the concept of using a stylus pen to written to your tablet device is not really new, but what is unique about Windows ink is the kind of developer support and the ability to create new set of transformational applications using Universal Windows Platform Apps (UWP).

  • The Windows Ink platform, together with a pen device, provides a natural way to create digital handwritten notes, drawings, and annotations.
  • As part of Windows UWP, A XAML UI platform control that, by default, receives and displays all input from a pen as either an ink stroke or an erase stroke.
  • Handwriting Recognition can, convert ink strokes to text using handwriting recognition, or to shapes using custom recognition
  • UWP apps that support Windows Ink can serialize and deserialize ink strokes to an Ink Serialized Format (ISF) file. The ISF file is a GIF image with additional metadata for all ink stroke properties and behaviors.
  • By integrating Windows 10 ink with existing UWP applications, next generation user experience can be created.

Extending the Solution with Azure Cognitive Services
As the patient centric applications naturally have to deal with humans, they can be highly extended by adding cognitive services on top of them. Cognitive Services enable natural and contextual interaction with tools that augment users' experiences using the power of machine-based intelligence. Tap into an ever-growing collection of powerful artificial intelligence algorithms for vision, speech, language, and knowledge.

  • For example, Face API can help with Face Recognition, such that patient identification can be found by the application, even when the patient is not in a position to talk or express.
  • Also most of the times, Doctors would like to get the true emotion of patients based on certain medical procedures, these kind of tests are also possible with Emotion API .
  • OCR solution that is available as part of Computer Vision API may also be useful in recognizing certain medication related receipts and other paper documents related to treatment.
  • It is very clear that by integration with Cognitive Services a patient centric handwriting recognition application can be extended to very many use cases.

A blue print of a healthcare application that can utilize the power of Windows 10 ink, Azure Cognitive Services with integration with back end enterprise health care application is mentioned below.

Summary

  • Windows 10 packs with many features that goes beyond the personal computing and will play an active role in Enterprise End User Access
  • Platform Services provided by Azure Cloud Platform like Azure App Service, Cognitive Services will extend the use cases with advanced user experience.
  • Windows 10 Universal app development provides a consistent user experience across devices like PC, Surface Tablets, HD TVs and gaming consoles.
  • The mentioned use case handwriting recognition application is not just applicable for healthcare alone but in many situations of manufacturing, hospitality, retail and other domains too.

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).