US20110004071A1 - Medical Information Visualization Assistant System and Method - Google Patents

Medical Information Visualization Assistant System and Method Download PDF

Info

Publication number
US20110004071A1
US20110004071A1 US12/789,267 US78926710A US2011004071A1 US 20110004071 A1 US20110004071 A1 US 20110004071A1 US 78926710 A US78926710 A US 78926710A US 2011004071 A1 US2011004071 A1 US 2011004071A1
Authority
US
United States
Prior art keywords
medical information
medical
time
historical
visualization tool
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/789,267
Other versions
US8645164B2 (en
Inventor
Anthony Faiola
Simon C. Hillier
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Indiana University Research and Technology Corp
Original Assignee
Indiana University Research and Technology Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Indiana University Research and Technology Corp filed Critical Indiana University Research and Technology Corp
Priority to US12/789,267 priority Critical patent/US8645164B2/en
Publication of US20110004071A1 publication Critical patent/US20110004071A1/en
Assigned to INDIANA UNIVERSITY RESEARCH AND TECHNOLOGY CORPORATION reassignment INDIANA UNIVERSITY RESEARCH AND TECHNOLOGY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FAIOLA, ANTHONY
Application granted granted Critical
Publication of US8645164B2 publication Critical patent/US8645164B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/7475User input or interface means, e.g. keyboard, pointing device, joystick
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/743Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/7445Display arrangements, e.g. multiple display units
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records

Definitions

  • the intensive care unit (ICU) of a medical facility may be a data rich environment.
  • ICU patients usually have significant organ system derangement and may have very little physiologic reserve.
  • Effective medical care may require intensive monitoring of organ function, frequent multimodal diagnostic testing, and many consultations from subspecialty physicians and other health care providers.
  • Sources of patient-generated data may include continuous automatic physiologic monitoring and intermittently determined data that is gathered by bedside care providers and/or from various diagnostic testing sources.
  • FIG. 1 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 2 is a flow diagram depicting another exemplary embodiment of the present invention.
  • FIG. 3 is a flow diagram depicting yet another exemplary embodiment of the present invention.
  • FIG. 4 is a diagram depicting another exemplary embodiment of the present invention.
  • FIG. 5 is a diagram depicting even another exemplary embodiment of the present invention.
  • FIG. 6 is a diagram depicting yet another exemplary embodiment of the present invention.
  • FIG. 7 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 8 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 9 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 10 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 11 is a flow diagram depicting yet another exemplary embodiment of the present invention.
  • This disclosure is drawn to methods and systems related to displaying and visualizing medical information for facilitating effective analysis by medical professionals. While an exemplary embodiment may be utilized in an intensive care unit of a medical facility, any aspect of medical care (such as a psychiatric facility, general practice environments and home-based medical care, for example) may utilize the methods and systems described herein. Further, although the methods and systems are generally described herein in relation to medical care, other industries (such as the automotive and manufacturing industries, for example) may utilize the methods and systems.
  • MDV Medical data visualization
  • CCPs critical care physicians
  • the medical field has provided excellent opportunities for the application of data visualization technology with the potential to help improve healthcare that can improve health-related outcomes.
  • the clinical decision making process should always be supported by relevant and reliable clinical data.
  • the use of MDV may be considered a data analysis method in which physicians are able to select the relevant variables to model and decide on representation or encoding of factors to better obtain the analysis results and draw conclusions.
  • a system for displaying medical information related to a human subject may include a computer system 10 , server system(s) 12 , data monitoring device(s) 14 , electronic medical record (EMR) storage/interoperability tool 15 , medical information database(s) 16 and a medical information visualization tool including an interface 18 , software 20 and management database(s) 22 .
  • the computer system 10 , server system(s) 12 , the data monitoring devices 14 , the EMR storage/interoperability tool 15 , and the medical information database(s) 16 may be in communication with each other directly, indirectly and/or via a network connection 24 (such as the Internet, an intranet or other network).
  • a network connection 24 such as the Internet, an intranet or other network.
  • the data monitoring devices 14 may monitor the human subject to measure, record and/or transmit medical information associated with the human subject.
  • the medical information may be transmitted to the EMR storage/interoperability tool 15 and/or medical information database(s) 16 for storage.
  • Each EMR 15 and/or medical information database 16 may be configured to store medical information associated with the human subject.
  • the medical information visualization tool may be stored on the server system(s) 12 and may be accessible by the computer system 10 and/or the data monitoring device(s) 14 . Further, the medical information visualization tool may be configured to display the medical information (including medical parameters related to clinical data and/or human subject-generated data).
  • the medical information visualization tool may be configured to simultaneously display near real-time medical information from the data monitoring devices 14 and historical medical information from the medical information databases 16 . In some embodiments, the historical medical information may be displayed on a graph having a dynamically adjustable time period.
  • the EMR 15 may be utilized with an interoperability tool 15 .
  • the interoperability tool 15 may allow medical information to be received and/or shared in a compatible format with computer system 10 , server system(s) 12 , data monitoring device(s) 14 , electronic medical record (EMR) storage/interoperability tool 15 , medical information database(s) 16 and the medical information visualization tool.
  • EMR electronic medical record
  • Example interoperability tools 15 may include open source tools such as those available from Mirth Corporation, among others.
  • Data monitoring devices 14 may include any type of device configured to monitor and/or measure medical information. Examples of such data monitoring devices 14 may include devices that monitor pulse oximetry, mixed venous oximetry, intracranial pressure, neuro-physiologic data, spontaneous potential, evoked potential, aortic echocardiography, laser Doppler perfusion, Bair Hugger temperature and venous compression devices, among others. Data monitoring devices 14 may monitor, measure and or record medical information in the form of parameters and/or settings used by the data monitoring devices 14 and/or in the form of parameters measured in response to the data monitoring devices 14 .
  • a drug dispensing device may monitor the dispensing rate of a drug being provided to a patient as one parameter, and also monitor the patient's blood pressure in response to the drug being administered as another parameter.
  • both parameters may be displayed by the medical information visualization tool.
  • the medical information visualization tool may include an information visualization timeline (IVT) 28 .
  • the IVT 28 may provide historical data to the health care clinician in the form of a plurality of horizontal graphs 30 of the data (where the time parameter 32 is the horizontal axis and the medical data parameter range 34 is the vertical axis) in controllable time resolutions.
  • Clinicians may be able to select a range of physiological parameters of the patient, viewing them side-by-side in clinical context (in the present embodiment, the plurality of graphs 30 are organized in a vertical side-by-side, or stacked, relationship). In one embodiment, this may include up to five or six parameter histories or timeline graphs 30 . Some embodiments may include limitless parameter histories or timeline graphs 30 .
  • These parameter histories or timeline graphs 30 may be stacked (or customized) on a touch-screen display any way the clinician prefers (e.g. using a drag-and-drop system). In some embodiments, the parameter histories or timeline graphs 30 may be displayed horizontally, vertically, diagonally and in other similar orientations.
  • data points 36 may identify the data reading extracted from a patient monitoring system. Data points 36 may be located in varying increments on the scale of each physiological parameter reading, depending on the time resolution. Colored (or grayed) areas may indicate a safe zone 38 for the parameter (or may alternatively indicate a danger or warning zone), if applicable.
  • Each timeline graph 30 may have its own dedicated scale, (as shown on the left side in FIGS. 4 and 5 , for example). At the bottom of the IVT 28 , a timeline 32 may indicate the hours and minutes within each day.
  • the medical information visualization tool may be configured to display the historical medical information on a timeline graph 30 (as shown in FIG. 4 generally and FIG. 5 in more detail).
  • the graph 30 may represent a particular medical parameter during the dynamically adjustable time period.
  • the medical information visualization tool may be configured to be dynamically adjustable such that the medical parameters may be displayed in a customizable order.
  • medical parameters including heart rate, blood oxygen level and blood pressure may be arranged (stacked) in many ways (e.g. heart rate, blood pressure, then blood oxygen level, etc.).
  • the medical parameters may be displayed in a vertical orientation.
  • the medical information visualization tool may include a scrubber tool 40 configured to select a particular time on a timeline 32 and to display the historical medical information associated with the particular time on a graph 30 .
  • the graph 30 may represent predetermined medical parameter(s).
  • these parameters may include ABP, PAP, SvO, iNO and RR.
  • the medical information visualization tool may display numeric values 42 associated with the historical medical information associated with the particular time.
  • the scrubber tool 40 may be further configured to be moved along the timeline 32 using the touch-screen (by touching the scrubber handle 44 and sliding it to the desired position on the timeline 32 ).
  • the medical information visualization tool may display numeric values 42 associated with the historical medical information associated with the scrubber tool's 40 location on the timeline.
  • clinicians may want to know all the exact parameter readings at a particular point on the timeline 32 relative to the current (real-time) reading (which may be indicated to the far right in FIG. 4 , for example).
  • the scrubber tool 40 may be moved, using the touch-screen display, by a touch-and-slide action on the scrubber handle 44 near the top of the scrubber tool 40 .
  • the scrubber tool 40 may be flagged on the top of the graphs 30 , with the current time readings, that indicate the specific information for that location on the timeline graph 30 (e.g., day in the ICU, time in minutes and seconds, and date).
  • the scrubber tool 40 may also include a data point scrubber (DPS) 46 .
  • DPS data point scrubber
  • the DPS 46 may allow the clinician to scrub or move the tool 40 back and forth along the timeline 32 to any data point 36 (corresponding to a particular time), helping the clinician see the specific parameter values at that point in time.
  • Data balloons 42 (as shown in FIGS. 4 and 5 ) may be transparent so as not to hide any data points 36 . Further, the data balloons 42 may disappear after a predetermined amount of time (e.g. 10 seconds).
  • the medical information visualization tool may be configured to display the recent medical information on a graph 52 .
  • the graph 52 may represent a particular medical parameter during a predetermined recent time period 48 .
  • this predetermined time period 48 includes the most recent 15 minutes.
  • any other time period deemed to be “recent” by a medical operator may suffice.
  • the medical information visualization tool may be further configured to simultaneously display real-time medical information as a numeric value 50 .
  • the medical information visualization tool may include a current data status section (CDS) 54 .
  • the CDS 54 may display the to-the-minute (real-time or near real-time) data stream.
  • the CDS 54 may include a large numeric display 50 that may provide the current numeric reading from a patient's monitoring device (e.g., 44 mmHG), physiological reading initials (e.g., ABP) and/or a graph 52 having compressed data points (e.g. the most recent 15 minute readings).
  • the medical information visualization tool may include a time resolution controller 56 configured to select a time period 58 in which the medical information is to be displayed.
  • the time period 58 is approximately 8 A.M. through 4 P.M. on June 12.
  • This time period 58 may be adjusted by selecting a start time 60 and an end time 62 to define, redefine and/or adjust the time period 58 .
  • the arrows 60 , 62 shown in FIG. 7 may be moved left and right on the timeline 32 (using a touch-and-slide action on the touch screen, for example) to increase, decrease or merely shift the time period 58 .
  • the medical information visualization tool may include a time resolution control section (TRC) 56 .
  • the TRC 56 may allow the clinician to scroll left and right throughout the entire timeline 32 (including the duration of the patient's history in the medical facility), as well as to focus on specified earlier time periods 58 .
  • the TRC may include a day indicator 64 that indicates the specific day and date on the timeline 32 , and a day controller slider 66 that may allow the clinician to scroll left and right throughout the entire history of the patient's stay. In this manner, if a patient is in the medical facility for several weeks, the clinician may easily scroll to find a past day and time necessary to compare with their current reading.
  • the TRC 56 may also include a timeline 32 having a time indication area that may display each day broken down in 30 minute intervals.
  • Clinicians may specify smaller time intervals if necessary (e.g., 15, 10, or 5 minutes). Further, the clinician may want to focus on a specific time range of four to six hours, for example, to compare to the current readings. The clinician may control the breadth of time to observe (e.g., three hours or six hours) using the beginning 60 and ending 62 time resolution control handles. These may be adjusted for the desired length of time. The clinician may also identify and compare the length of time and the location of an earlier time (within the patient's history) with the current reading, indicated at the CDS 54 .
  • the clinician may also identify and compare the length of time and the location of an earlier time (within the patient's history) with the current reading, indicated at the CDS 54 .
  • the medical information visualization tool may include an icon tool controller 100 configured to display icons on or near the displayed historical medical information. These icons may be associated with a medical treatment, a medical procedure, a medical test and/or other similar event. Examples of such icons may include icons associated with operating room procedures 102 , lab work 104 , x-rays 106 , ventilation settings changes 108 , GAS lab work 110 , clinician notes 112 , cardio EKG 114 , cardio echo 116 , medication administration 118 and blood administration 120 , among others. The icons may be displayed at an approximate time when the medical treatment, medical procedure, medical test and/or other similar event occurred. For example, FIG.
  • icons 106 placed near the time that x-rays of the patient were taken.
  • icons may be placed on an individual parameter graph 30 (as opposed to one icon for the all parameter graphs 30 ).
  • icons may be graphical or textual (such as the phrase “X-Rays Taken”) in nature.
  • a textual icon may be displayed to identify an abnormal condition such as a heart monitoring probe being disconnected from a patient. In that case, the textual icon may state “Heart monitoring device disconnected—patient did not flatline.”
  • the medical information visualization tool may include a clinical icon tray section (CIT) 100 .
  • the CIT 100 may provide the clinician a broad array of information about the patient's history since the time admitted into the medical facility.
  • an icon When an icon is placed on the timeline by a clinician, it may represent a clinical note 112 or intervention administered to the patient. Each icon may be placed within the timeline at or near the exact location (in time) where the note 112 or intervention was given.
  • Historical data about the patient may be represented by icons in various categories. For example, one category may be represented by Note Icons 112 that may be placed on the top bar of the CIT 100 . These may be separated from the bottom of CIT 100 , as there may be many notes left by clinicians throughout the stay of the patient in the medical facility. Another category may be represented by several other types of icons (as discussed above, for example) that may be placed on the bottom bar of the CIT 100 . These icons may identify an array of interventions that have been administered to the patient. In one embodiment, the icons may be generated using an icon generator 122 . A clinician may use a “drag and drop” movement to place icons from the icon generator 122 onto the timeline. Clinicians may also place new icons on the timeline by clicking on the icon generator 122 . The respective icon may appear automatically in the timeline based on the current date and time. In such an embodiment, the clinician does not have to worry about placing the icon in the correct location on the timeline.
  • clinician notes 112 icons may be placed on the timeline. As a clinician roll their cursor and/or finger over the clinical note 112 icon, information about the date, time, and clinician author of the note may appear in a details box 124 . In another embodiment, as clinician note 112 icons are generated throughout a patient's stay, the clinician note 112 icons may be numbered consecutively. Clinicians may find the details of the clinician note 112 icon (and all other icons) by clicking on the icon, which may open a details box 124 with all the details related to date, time, clinical note or other intervention information. After creating the original note, clinicians may “save & close” the details box 124 . Clinicians may also print the note using a printer. If other clinicians desire to read a note, they may activate the icon.
  • the medical information visualization tool may include a private messaging system configured to provide inter-clinician textual communications.
  • a private messaging system may include an inbox for received messages, an outbox for sent messages.
  • the private messaging system may provide for messages to be directed to a specific clinician.
  • the messages may be directed to any clinician who reviews the patient's medical information.
  • a message may also be identified by a flashing icon and/or read/unread message icons upon a clinician logging into or initializing the medical information visualization tool.
  • the medical information visualization tool may include a profile interface 130 configured to select, display and/or identify user accounts, patient accounts, clinician accounts, and/or medical parameter specialty sets.
  • a clinician may log in to the medical information visualization tool.
  • the clinician may have easy access to any patients associated with that clinician.
  • each clinician may have a profile associated therewith.
  • a clinician or patient profile may display medical parameters and/or medical specialty areas associated with that clinician or patient, respectively. For example, if the clinician is a cardiologist, the profile interface 130 may display cardiovascular medical parameters by default.
  • the profile interface 130 may display cardiovascular medical parameters by default.
  • a clinician may enter information associated with a new patient. Such information may be used to create an electronic medical record.
  • the profile interface 130 may also be configured to display information associated with a patient in the patient information section 136 and/or information associated with a clinician/physician in the clinician information section 138 .
  • the profile interface 130 may also include medical parameter sets associated with the clinician and/or patient.
  • a drop down menu may be displayed.
  • the drop down menu may display medical specialty areas (or subsets of medical specialty areas) such as Cardiovascular, Pulmonary, Infectious Disease, Medications, Auto Differential, Blood Gas Profile, Coagulation, Hemogram, Liver Function, Metabolic Profile, Metabolic Special and the like.
  • These medical specialty areas may be associated with specific medical parameters. For example, as is shown in FIG. 9 , under the Cardiovascular set, several medical parameters may be selected, such as Heart Rate, ABP invasive, EKG cont-rythm, Echocardiogram, EKG 12 lead and Cardio Catheter. In this example, the grayed out medical parameters are already being displayed on the information visualization timeline 28 .
  • the clinician may return to the medical specialty area associated with the patient or clinician.
  • a method of displaying medical information (including medical parameters) related to a human subject may include steps of: gathering 70 medical information associated with the human subject from data monitoring devices 14 , storing 72 the medical information (or at least a sub-set of the medical information) in electronic medical record(s), simultaneously displaying 74 both real time and historical medical parameters using a medical information visualization tool, modifying 76 the time period 58 that the historical medical information is to be displayed to define another time period 58 , and simultaneously displaying 78 the real time and historical medical parameters using the medical information visualization tool.
  • the medical information visualization tool may be configured to simultaneously display near real-time medical information and historical medical information from the electronic medical record(s).
  • the gathering step 70 and storing steps 72 may be performed at a predetermined time interval.
  • the method may also include adjusting the display order of the medical parameters using the medical information visualization tool, and simultaneously displaying the medical parameters in the adjusted display order using the medical information visualization tool.
  • a computer-readable medium having instructions configured to perform steps. These instructions may include: receiving 80 medical information from data monitoring devices 14 , storing 82 the medical information in electronic medical record(s), simultaneously outputting 84 at least two medical parameters to a display device over a first time period using a medical information visualization tool, modifying 86 the first time period that the historical medical information is to be displayed to define a second time period, and simultaneously outputting 88 the medical parameters to the display device over the second time period using the medical information visualization tool.
  • the medical information visualization tool may be configured to simultaneously display near real-time medical information and historical medical information from the electronic medical record(s).
  • One benefit of the medical information visualization tool may be to allow healthcare clinicians the ability to select and view several physiological data parameters in context (side-by-side, for example) while controlling the time resolution.
  • Clinicians may be able to select and view the medical information from several perspectives.
  • these perspectives may include a clinician specific perspective (e.g. is the clinician a surgeon, anesthesiologist, etc.), a patient specific perspective (e.g. is the patient an adult or child, etc.) and/or a problem specific perspective (e.g. is the patient being treated for a heart attack or lung collapse, etc.).
  • the medical information visualization tool may further include a report generation tool configured to generate one or more reports to be displayed, printed and/or transmitted.
  • reports may include a complete report of all medical information or a customized report including a subset of all monitored medical information, where the subset may include only medical information chosen by a clinician.
  • Example reports may be generated as a one-time report, a change-of-shift summary report, a daily report, an hourly report and/or other similar report.
  • the medical information visualization tool may include one or more of the features described herein.
  • the medical information visualization tool may include the IVT 28 , icon tool controller 100 , CDS 54 , TRC 56 and profile interface 130 , among other features.
  • a clinician may log in 90 to the medical information visualization tool using a predetermined user name and/or password.
  • a medical information visualization tool menu may be provided 92 where the clinician may select the desired medical parameters to be displayed on the touch-screen display.
  • the clinician may select 94 other display options (such as a timeline 32 for a scrubber tool 40 or other similar options).
  • the customized medical information visualization tool display may then be initiated 96 .
  • the medical information visualization tool display settings may then be stored 98 for each clinician so that the clinician may quickly recall and reuse the display settings. Further, the medical information visualization tool display settings may also be stored 98 for each individual patient so that the clinician may quickly recall and reuse the display settings for subsequent visits by that particular patient.
  • FIG. 1 One exemplary computing environment is depicted in FIG. 1 . While one embodiment of the invention relates to the general context of computer-executable instructions that may run on one or more computers, those skilled in the art will recognize that the invention also may be implemented in combination with other program modules and/or as a combination of hardware and software.
  • program modules include routines, programs, components, data structures, etc., that perform particular tasks or implement particular abstract data types.
  • inventive methods may be practiced with other computer system configurations, including single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, hand-held wireless computing devices, microprocessor-based or programmable consumer electronics, and the like, each of which can be operatively coupled to one or more associated devices.
  • aspects of the invention may also be practiced in distributed computing environments where certain tasks are performed by remote processing devices that are linked through a communications network.
  • program modules may be located in both local and remote memory storage devices.
  • a computer may include a variety of computer readable media.
  • Computer readable media may be any available media that can be accessed by the computer and includes both volatile and nonvolatile media, removable and non-removable media.
  • Computer readable media may comprise computer storage media and communication media.
  • Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD ROM, digital video disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store the desired information and which may be accessed by the computer.
  • An exemplary environment for implementing various aspects of the invention may include a computer that includes a processing unit, a system memory and a system bus.
  • the system bus couples system components including, but not limited to, the system memory to the processing unit.
  • the processing unit may be any of various commercially available processors. Dual microprocessors and other multi processor architectures may also be employed as the processing unit.
  • the system bus may be any of several types of bus structure that may further interconnect to a memory bus (with or without a memory controller), a peripheral bus, and a local bus using any of a variety of commercially available bus architectures.
  • the system memory may include read only memory (ROM) and/or random access memory (RAM).
  • ROM read only memory
  • RAM random access memory
  • a basic input/output system (BIOS) is stored in a non-volatile memory such as ROM, EPROM, EEPROM, which BIOS contains the basic routines that help to transfer information between elements within the computer, such as during start-up.
  • the RAM may also include a high-speed RAM such as static RAM for caching data.
  • the computer may further include an internal hard disk drive (HDD) (e.g., EIDE, SATA), which internal hard disk drive may also be configured for external use in a suitable chassis, a magnetic floppy disk drive (FDD), (e.g., to read from or write to a removable diskette) and an optical disk drive, (e.g., reading a CD-ROM disk or, to read from or write to other high capacity optical media such as the DVD).
  • the hard disk drive, magnetic disk drive and optical disk drive may be connected to the system bus by a hard disk drive interface, a magnetic disk drive interface and an optical drive interface, respectively.
  • the interface for external drive implementations includes at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.
  • the drives and their associated computer-readable media provide nonvolatile storage of data, data structures, computer-executable instructions, and so forth.
  • the drives and media accommodate the storage of any data in a suitable digital format.
  • computer-readable media refers to a HDD, a removable magnetic diskette, and a removable optical media such as a CD or DVD, it should be appreciated by those skilled in the art that other types of media which are readable by a computer, such as zip drives, magnetic cassettes, flash memory cards, cartridges, and the like, may also be used in the exemplary operating environment, and further, that any such media may contain computer-executable instructions for performing the methods of the invention.
  • a number of program modules may be stored in the drives and RAM, including an operating system, one or more application programs, other program modules and program data. All or portions of the operating system, applications, modules, and/or data may also be cached in the RAM. It is appreciated that the invention may be implemented with various commercially available operating systems or combinations of operating systems.
  • a user may enter commands and information into the computer through one or more wired/wireless input devices, for example, a keyboard and a pointing device, such as a mouse.
  • Other input devices may include a microphone (functioning in association with appropriate language processing/recognition software as know to those of ordinary skill in the technology), an IR remote control, a joystick, a game pad, a stylus pen, or the like.
  • input devices are often connected to the processing unit through an input device interface that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, an IEEE 1394 serial port, a game port, a USB port, an IR interface, etc.
  • a display monitor or other type of display device may also be connected to the system bus via an interface, such as a video adapter.
  • a computer may include other peripheral output devices, such as speakers, printers, etc.
  • the computer may operate in a networked environment using logical connections via wired and/or wireless communications to one or more remote computers.
  • the remote computer(s) may be a workstation, a server computer, a router, a personal computer, a portable computer, a personal digital assistant, a cellular device, a microprocessor-based entertainment appliance, a peer device or other common network node, and may include many or all of the elements described relative to the computer.
  • the logical connections depicted include wired/wireless connectivity to a local area network (LAN) and/or larger networks, for example, a wide area network (WAN).
  • LAN and WAN networking environments are commonplace in offices, and companies, and facilitate enterprise-wide computer networks, such as intranets, all of which may connect to a global communications network such as the Internet.
  • the computer may be operable to communicate with any wireless devices or entities operatively disposed in wireless communication, e.g., a printer, scanner, desktop and/or portable computer, portable data assistant, communications satellite, any piece of equipment or location associated with a wirelessly detectable tag (e.g., a kiosk, news stand, restroom), and telephone.
  • any wireless devices or entities operatively disposed in wireless communication e.g., a printer, scanner, desktop and/or portable computer, portable data assistant, communications satellite, any piece of equipment or location associated with a wirelessly detectable tag (e.g., a kiosk, news stand, restroom), and telephone.
  • Wi-Fi such as IEEE 802.11x (a, b, g, n, etc.)
  • BluetoothTM wireless technologies such as IEEE 802.11x (a, b, g, n, etc.)
  • the communication may
  • the system may also include one or more server(s).
  • the server(s) may also be hardware and/or software (e.g., threads, processes, computing devices).
  • the servers may house threads to perform transformations by employing aspects of the invention, for example.
  • One possible communication between a client and a server may be in the form of a data packet adapted to be transmitted between two or more computer processes.
  • the data packet may include a cookie and/or associated contextual information, for example.
  • the system may include a communication framework (e.g., a global communication network such as the Internet) that may be employed to facilitate communications between the client(s) and the server(s).

Abstract

Methods, systems, devices and/or apparatus related to displaying and visualizing medical information for facilitating effective analysis by medical professionals. Example systems for displaying medical information related to a human subject may include a computer system, server system(s), data monitoring device(s), electronic medical record/interoperability tool, medical information database(s) and a medical information visualization tool having an interface, software and management database(s). Such system may simultaneously output at least two medical parameters (relating to near real-time medical information and historical medical information) to a display device using the medical information visualization tool.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of U.S. Provisional Patent Application Ser. No. 61/217,200, entitled “Medical Information Visualization Assistant System and Method,” filed on May 28, 2009, the disclosure of which is incorporated herein by reference.
  • BACKGROUND
  • The intensive care unit (ICU) of a medical facility may be a data rich environment. ICU patients usually have significant organ system derangement and may have very little physiologic reserve. Effective medical care may require intensive monitoring of organ function, frequent multimodal diagnostic testing, and many consultations from subspecialty physicians and other health care providers. In this kind of a critical care environment, it is often difficult to make rapid evaluations of a patient's condition due to the overwhelming volume of data that is continuously generated. Sources of patient-generated data may include continuous automatic physiologic monitoring and intermittently determined data that is gathered by bedside care providers and/or from various diagnostic testing sources. In addition to patient-generated data, there may be vast arrays of clinical data generated that document the treatment received by the patient. This data may include drug therapy, respiratory therapy, physical therapy and/or all other clinical interventions.
  • Effective clinical decisions pertaining to the care of these patients may be made when physicians can easily organize and understand the vast flood of data from these various sources. Unfortunately, physicians and other health care staff typically have to retrieve this critical data from multiple locations and organize it into a cohesive profile of the patient's current condition. Furthermore, the data retrieved from these diverse sources is usually presented in a form that does not allow trends and relationships between co-variables to be immediately recognized. Further, critical care physicians (CCP) work in a highly stressful environment and are usually pressed for time, frequently looking after several critically ill patients. As a result, the process of monitoring, evaluating and treating complex medical problems is labor intensive and time-consuming; it demands that physicians analyze data in text and numeric form.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The foregoing and other features of the present disclosure will become more fully apparent from the following description and appended claims, taken in conjunction with the accompanying drawings. Understanding that these drawings depict only several embodiments in accordance with the disclosure and are, therefore, not to be considered limiting of its scope, the disclosure will be described with additional specificity and detail through use of the accompanying drawings.
  • In the drawings:
  • FIG. 1 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 2 is a flow diagram depicting another exemplary embodiment of the present invention.
  • FIG. 3 is a flow diagram depicting yet another exemplary embodiment of the present invention.
  • FIG. 4 is a diagram depicting another exemplary embodiment of the present invention.
  • FIG. 5 is a diagram depicting even another exemplary embodiment of the present invention.
  • FIG. 6 is a diagram depicting yet another exemplary embodiment of the present invention.
  • FIG. 7 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 8 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 9 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 10 is a diagram depicting an exemplary embodiment of the present invention.
  • FIG. 11 is a flow diagram depicting yet another exemplary embodiment of the present invention.
  • DETAILED DESCRIPTION
  • In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the Figures, may be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are explicitly contemplated and make part of this disclosure.
  • This disclosure is drawn to methods and systems related to displaying and visualizing medical information for facilitating effective analysis by medical professionals. While an exemplary embodiment may be utilized in an intensive care unit of a medical facility, any aspect of medical care (such as a psychiatric facility, general practice environments and home-based medical care, for example) may utilize the methods and systems described herein. Further, although the methods and systems are generally described herein in relation to medical care, other industries (such as the automotive and manufacturing industries, for example) may utilize the methods and systems.
  • Medical data visualization (MDV) may provide valuable assistance for data analysis and decision making for critical care physicians (CCPs). How CCPs perceive and interact with patient data may affect their ability to arrive at the best critical care solution. The medical field has provided excellent opportunities for the application of data visualization technology with the potential to help improve healthcare that can improve health-related outcomes. In a real-life critical care context, the clinical decision making process should always be supported by relevant and reliable clinical data. In this case, the use of MDV may be considered a data analysis method in which physicians are able to select the relevant variables to model and decide on representation or encoding of factors to better obtain the analysis results and draw conclusions.
  • In an exemplary embodiment (as shown in FIG. 1), a system for displaying medical information related to a human subject is provided. This system may include a computer system 10, server system(s) 12, data monitoring device(s) 14, electronic medical record (EMR) storage/interoperability tool 15, medical information database(s) 16 and a medical information visualization tool including an interface 18, software 20 and management database(s) 22. The computer system 10, server system(s) 12, the data monitoring devices 14, the EMR storage/interoperability tool 15, and the medical information database(s) 16 may be in communication with each other directly, indirectly and/or via a network connection 24 (such as the Internet, an intranet or other network). The data monitoring devices 14 may monitor the human subject to measure, record and/or transmit medical information associated with the human subject. The medical information may be transmitted to the EMR storage/interoperability tool 15 and/or medical information database(s) 16 for storage. Each EMR 15 and/or medical information database 16 may be configured to store medical information associated with the human subject. The medical information visualization tool may be stored on the server system(s) 12 and may be accessible by the computer system 10 and/or the data monitoring device(s) 14. Further, the medical information visualization tool may be configured to display the medical information (including medical parameters related to clinical data and/or human subject-generated data). The medical information visualization tool may be configured to simultaneously display near real-time medical information from the data monitoring devices 14 and historical medical information from the medical information databases 16. In some embodiments, the historical medical information may be displayed on a graph having a dynamically adjustable time period.
  • In some embodiments, the EMR 15 may be utilized with an interoperability tool 15. The interoperability tool 15 may allow medical information to be received and/or shared in a compatible format with computer system 10, server system(s) 12, data monitoring device(s) 14, electronic medical record (EMR) storage/interoperability tool 15, medical information database(s) 16 and the medical information visualization tool. Example interoperability tools 15 may include open source tools such as those available from Mirth Corporation, among others.
  • Data monitoring devices 14 may include any type of device configured to monitor and/or measure medical information. Examples of such data monitoring devices 14 may include devices that monitor pulse oximetry, mixed venous oximetry, intracranial pressure, neuro-physiologic data, spontaneous potential, evoked potential, aortic echocardiography, laser Doppler perfusion, Bair Hugger temperature and venous compression devices, among others. Data monitoring devices 14 may monitor, measure and or record medical information in the form of parameters and/or settings used by the data monitoring devices 14 and/or in the form of parameters measured in response to the data monitoring devices 14. For example, a drug dispensing device may monitor the dispensing rate of a drug being provided to a patient as one parameter, and also monitor the patient's blood pressure in response to the drug being administered as another parameter. In such an example, both parameters may be displayed by the medical information visualization tool.
  • In one embodiment, the medical information visualization tool may include an information visualization timeline (IVT) 28. The IVT 28 may provide historical data to the health care clinician in the form of a plurality of horizontal graphs 30 of the data (where the time parameter 32 is the horizontal axis and the medical data parameter range 34 is the vertical axis) in controllable time resolutions. Clinicians may be able to select a range of physiological parameters of the patient, viewing them side-by-side in clinical context (in the present embodiment, the plurality of graphs 30 are organized in a vertical side-by-side, or stacked, relationship). In one embodiment, this may include up to five or six parameter histories or timeline graphs 30. Some embodiments may include limitless parameter histories or timeline graphs 30. These parameter histories or timeline graphs 30 may be stacked (or customized) on a touch-screen display any way the clinician prefers (e.g. using a drag-and-drop system). In some embodiments, the parameter histories or timeline graphs 30 may be displayed horizontally, vertically, diagonally and in other similar orientations. Within each timeline graph 30, data points 36 may identify the data reading extracted from a patient monitoring system. Data points 36 may be located in varying increments on the scale of each physiological parameter reading, depending on the time resolution. Colored (or grayed) areas may indicate a safe zone 38 for the parameter (or may alternatively indicate a danger or warning zone), if applicable. Each timeline graph 30 may have its own dedicated scale, (as shown on the left side in FIGS. 4 and 5, for example). At the bottom of the IVT 28, a timeline 32 may indicate the hours and minutes within each day.
  • In one embodiment, the medical information visualization tool may be configured to display the historical medical information on a timeline graph 30 (as shown in FIG. 4 generally and FIG. 5 in more detail). The graph 30 may represent a particular medical parameter during the dynamically adjustable time period. In another embodiment, the medical information visualization tool may be configured to be dynamically adjustable such that the medical parameters may be displayed in a customizable order. For example, medical parameters including heart rate, blood oxygen level and blood pressure may be arranged (stacked) in many ways (e.g. heart rate, blood pressure, then blood oxygen level, etc.). In yet another embodiment, the medical parameters may be displayed in a vertical orientation.
  • In another embodiment (as shown in FIG. 4 generally and FIG. 5 in more detail), the medical information visualization tool may include a scrubber tool 40 configured to select a particular time on a timeline 32 and to display the historical medical information associated with the particular time on a graph 30. The graph 30 may represent predetermined medical parameter(s). In FIG. 5, for example, these parameters may include ABP, PAP, SvO, iNO and RR. Further, the medical information visualization tool may display numeric values 42 associated with the historical medical information associated with the particular time. In FIG. 5, for example, these numeric values 42 include ABP=49 mmHg, PAP=50 mmHg, SvO=65%, iNO=20 ppm and RR=22 breaths/min. In one embodiment, the scrubber tool 40 may be further configured to be moved along the timeline 32 using the touch-screen (by touching the scrubber handle 44 and sliding it to the desired position on the timeline 32). In such an embodiment, the medical information visualization tool may display numeric values 42 associated with the historical medical information associated with the scrubber tool's 40 location on the timeline.
  • In some cases, clinicians may want to know all the exact parameter readings at a particular point on the timeline 32 relative to the current (real-time) reading (which may be indicated to the far right in FIG. 4, for example). The scrubber tool 40 may be moved, using the touch-screen display, by a touch-and-slide action on the scrubber handle 44 near the top of the scrubber tool 40. The scrubber tool 40 may be flagged on the top of the graphs 30, with the current time readings, that indicate the specific information for that location on the timeline graph 30 (e.g., day in the ICU, time in minutes and seconds, and date). The scrubber tool 40 may also include a data point scrubber (DPS) 46. The DPS 46 may allow the clinician to scrub or move the tool 40 back and forth along the timeline 32 to any data point 36 (corresponding to a particular time), helping the clinician see the specific parameter values at that point in time. Data balloons 42 (as shown in FIGS. 4 and 5) may be transparent so as not to hide any data points 36. Further, the data balloons 42 may disappear after a predetermined amount of time (e.g. 10 seconds).
  • In another embodiment (as shown in FIG. 4 generally and FIG. 6 in more detail), the medical information visualization tool may be configured to display the recent medical information on a graph 52. The graph 52 may represent a particular medical parameter during a predetermined recent time period 48. For example, in FIG. 6, this predetermined time period 48 includes the most recent 15 minutes. However, any other time period deemed to be “recent” by a medical operator may suffice. The medical information visualization tool may be further configured to simultaneously display real-time medical information as a numeric value 50. In FIG. 6, for example, these numeric values 50 include ABP=44 mmHg, PAP=53 mmHg, SvO=44%, iNO=0 ppm and RR=22 breaths/min.
  • In one embodiment, the medical information visualization tool may include a current data status section (CDS) 54. The CDS 54 may display the to-the-minute (real-time or near real-time) data stream. As can be seen in FIG. 6, the CDS 54 may include a large numeric display 50 that may provide the current numeric reading from a patient's monitoring device (e.g., 44 mmHG), physiological reading initials (e.g., ABP) and/or a graph 52 having compressed data points (e.g. the most recent 15 minute readings).
  • In yet another embodiment (as shown in FIG. 4 generally and FIG. 7 in more detail), the medical information visualization tool may include a time resolution controller 56 configured to select a time period 58 in which the medical information is to be displayed. In FIG. 7, for example, the time period 58 is approximately 8 A.M. through 4 P.M. on June 12. This time period 58 may be adjusted by selecting a start time 60 and an end time 62 to define, redefine and/or adjust the time period 58. For example, the arrows 60, 62 shown in FIG. 7 may be moved left and right on the timeline 32 (using a touch-and-slide action on the touch screen, for example) to increase, decrease or merely shift the time period 58.
  • In one embodiment, the medical information visualization tool may include a time resolution control section (TRC) 56. The TRC 56 may allow the clinician to scroll left and right throughout the entire timeline 32 (including the duration of the patient's history in the medical facility), as well as to focus on specified earlier time periods 58. The TRC may include a day indicator 64 that indicates the specific day and date on the timeline 32, and a day controller slider 66 that may allow the clinician to scroll left and right throughout the entire history of the patient's stay. In this manner, if a patient is in the medical facility for several weeks, the clinician may easily scroll to find a past day and time necessary to compare with their current reading. The TRC 56 may also include a timeline 32 having a time indication area that may display each day broken down in 30 minute intervals. Clinicians may specify smaller time intervals if necessary (e.g., 15, 10, or 5 minutes). Further, the clinician may want to focus on a specific time range of four to six hours, for example, to compare to the current readings. The clinician may control the breadth of time to observe (e.g., three hours or six hours) using the beginning 60 and ending 62 time resolution control handles. These may be adjusted for the desired length of time. The clinician may also identify and compare the length of time and the location of an earlier time (within the patient's history) with the current reading, indicated at the CDS 54.
  • In another embodiment, the medical information visualization tool (as depicted in FIG. 8) may include an icon tool controller 100 configured to display icons on or near the displayed historical medical information. These icons may be associated with a medical treatment, a medical procedure, a medical test and/or other similar event. Examples of such icons may include icons associated with operating room procedures 102, lab work 104, x-rays 106, ventilation settings changes 108, GAS lab work 110, clinician notes 112, cardio EKG 114, cardio echo 116, medication administration 118 and blood administration 120, among others. The icons may be displayed at an approximate time when the medical treatment, medical procedure, medical test and/or other similar event occurred. For example, FIG. 8 includes an icon 106 placed near the time that x-rays of the patient were taken. Alternatively, or additionally, icons may be placed on an individual parameter graph 30 (as opposed to one icon for the all parameter graphs 30). Further, icons may be graphical or textual (such as the phrase “X-Rays Taken”) in nature. In one embodiment, a textual icon may be displayed to identify an abnormal condition such as a heart monitoring probe being disconnected from a patient. In that case, the textual icon may state “Heart monitoring device disconnected—patient did not flatline.”
  • In one embodiment, the medical information visualization tool may include a clinical icon tray section (CIT) 100. The CIT 100 may provide the clinician a broad array of information about the patient's history since the time admitted into the medical facility. When an icon is placed on the timeline by a clinician, it may represent a clinical note 112 or intervention administered to the patient. Each icon may be placed within the timeline at or near the exact location (in time) where the note 112 or intervention was given.
  • Historical data about the patient may be represented by icons in various categories. For example, one category may be represented by Note Icons 112 that may be placed on the top bar of the CIT 100. These may be separated from the bottom of CIT 100, as there may be many notes left by clinicians throughout the stay of the patient in the medical facility. Another category may be represented by several other types of icons (as discussed above, for example) that may be placed on the bottom bar of the CIT 100. These icons may identify an array of interventions that have been administered to the patient. In one embodiment, the icons may be generated using an icon generator 122. A clinician may use a “drag and drop” movement to place icons from the icon generator 122 onto the timeline. Clinicians may also place new icons on the timeline by clicking on the icon generator 122. The respective icon may appear automatically in the timeline based on the current date and time. In such an embodiment, the clinician does not have to worry about placing the icon in the correct location on the timeline.
  • In one embodiment, clinician notes 112 icons may be placed on the timeline. As a clinician roll their cursor and/or finger over the clinical note 112 icon, information about the date, time, and clinician author of the note may appear in a details box 124. In another embodiment, as clinician note 112 icons are generated throughout a patient's stay, the clinician note 112 icons may be numbered consecutively. Clinicians may find the details of the clinician note 112 icon (and all other icons) by clicking on the icon, which may open a details box 124 with all the details related to date, time, clinical note or other intervention information. After creating the original note, clinicians may “save & close” the details box 124. Clinicians may also print the note using a printer. If other clinicians desire to read a note, they may activate the icon.
  • In another embodiment, the medical information visualization tool may include a private messaging system configured to provide inter-clinician textual communications. In one embodiment, such a private messaging system may include an inbox for received messages, an outbox for sent messages. In another embodiment, the private messaging system may provide for messages to be directed to a specific clinician. In other embodiments, the messages may be directed to any clinician who reviews the patient's medical information. A message may also be identified by a flashing icon and/or read/unread message icons upon a clinician logging into or initializing the medical information visualization tool.
  • In some embodiments (as depicted in FIG. 9), the medical information visualization tool may include a profile interface 130 configured to select, display and/or identify user accounts, patient accounts, clinician accounts, and/or medical parameter specialty sets. By actuating the “Log-in” button 132 (via a mouse click, finger touch or other actuation means), a clinician may log in to the medical information visualization tool. By logging in to the medical information visualization tool, the clinician may have easy access to any patients associated with that clinician. Further, each clinician may have a profile associated therewith. A clinician or patient profile may display medical parameters and/or medical specialty areas associated with that clinician or patient, respectively. For example, if the clinician is a cardiologist, the profile interface 130 may display cardiovascular medical parameters by default. Similarly, if the patient has cardiovascular problems, the profile interface 130 may display cardiovascular medical parameters by default. By actuating the “New Patient” button 134, a clinician may enter information associated with a new patient. Such information may be used to create an electronic medical record. The profile interface 130 may also be configured to display information associated with a patient in the patient information section 136 and/or information associated with a clinician/physician in the clinician information section 138.
  • The profile interface 130 may also include medical parameter sets associated with the clinician and/or patient. By actuating the “Display Sets” button 140, a drop down menu may be displayed. The drop down menu may display medical specialty areas (or subsets of medical specialty areas) such as Cardiovascular, Pulmonary, Infectious Disease, Medications, Auto Differential, Blood Gas Profile, Coagulation, Hemogram, Liver Function, Metabolic Profile, Metabolic Special and the like. These medical specialty areas (or subsets thereof) may be associated with specific medical parameters. For example, as is shown in FIG. 9, under the Cardiovascular set, several medical parameters may be selected, such as Heart Rate, ABP invasive, EKG cont-rythm, Echocardiogram, EKG 12 lead and Cardio Catheter. In this example, the grayed out medical parameters are already being displayed on the information visualization timeline 28. By clicking the “Default Set” button 142, the clinician may return to the medical specialty area associated with the patient or clinician.
  • In an exemplary embodiment (as shown in FIG. 2), a method of displaying medical information (including medical parameters) related to a human subject is provided. This method may include steps of: gathering 70 medical information associated with the human subject from data monitoring devices 14, storing 72 the medical information (or at least a sub-set of the medical information) in electronic medical record(s), simultaneously displaying 74 both real time and historical medical parameters using a medical information visualization tool, modifying 76 the time period 58 that the historical medical information is to be displayed to define another time period 58, and simultaneously displaying 78 the real time and historical medical parameters using the medical information visualization tool. In this embodiment, the medical information visualization tool may be configured to simultaneously display near real-time medical information and historical medical information from the electronic medical record(s). In another embodiment, the gathering step 70 and storing steps 72 may be performed at a predetermined time interval. In yet another embodiment, the method may also include adjusting the display order of the medical parameters using the medical information visualization tool, and simultaneously displaying the medical parameters in the adjusted display order using the medical information visualization tool.
  • In an exemplary embodiment (as shown in FIG. 3), a computer-readable medium having instructions configured to perform steps is provided. These instructions may include: receiving 80 medical information from data monitoring devices 14, storing 82 the medical information in electronic medical record(s), simultaneously outputting 84 at least two medical parameters to a display device over a first time period using a medical information visualization tool, modifying 86 the first time period that the historical medical information is to be displayed to define a second time period, and simultaneously outputting 88 the medical parameters to the display device over the second time period using the medical information visualization tool. In this embodiment, the medical information visualization tool may be configured to simultaneously display near real-time medical information and historical medical information from the electronic medical record(s).
  • One benefit of the medical information visualization tool may be to allow healthcare clinicians the ability to select and view several physiological data parameters in context (side-by-side, for example) while controlling the time resolution. Clinicians may be able to select and view the medical information from several perspectives. For example, these perspectives may include a clinician specific perspective (e.g. is the clinician a surgeon, anesthesiologist, etc.), a patient specific perspective (e.g. is the patient an adult or child, etc.) and/or a problem specific perspective (e.g. is the patient being treated for a heart attack or lung collapse, etc.).
  • In yet another embodiment, the medical information visualization tool may further include a report generation tool configured to generate one or more reports to be displayed, printed and/or transmitted. Such reports may include a complete report of all medical information or a customized report including a subset of all monitored medical information, where the subset may include only medical information chosen by a clinician. Example reports may be generated as a one-time report, a change-of-shift summary report, a daily report, an hourly report and/or other similar report.
  • In one embodiment, (as shown in FIG. 10), the medical information visualization tool may include one or more of the features described herein. For example, the medical information visualization tool may include the IVT 28, icon tool controller 100, CDS 54, TRC 56 and profile interface 130, among other features.
  • In one exemplary embodiment (as shown in FIG. 11), a clinician (such as a doctor or nurse, for example) may log in 90 to the medical information visualization tool using a predetermined user name and/or password. A medical information visualization tool menu may be provided 92 where the clinician may select the desired medical parameters to be displayed on the touch-screen display. Using the medical information visualization tool menu, the clinician may select 94 other display options (such as a timeline 32 for a scrubber tool 40 or other similar options). Based, at least in part, on the medical parameters and/or display options selected, the customized medical information visualization tool display may then be initiated 96. The medical information visualization tool display settings may then be stored 98 for each clinician so that the clinician may quickly recall and reuse the display settings. Further, the medical information visualization tool display settings may also be stored 98 for each individual patient so that the clinician may quickly recall and reuse the display settings for subsequent visits by that particular patient.
  • To provide additional context for various aspects of the present invention, the following discussion is intended to provide a brief, general description of a suitable computing environment in which the various aspects of the invention may be implemented. One exemplary computing environment is depicted in FIG. 1. While one embodiment of the invention relates to the general context of computer-executable instructions that may run on one or more computers, those skilled in the art will recognize that the invention also may be implemented in combination with other program modules and/or as a combination of hardware and software.
  • Generally, program modules include routines, programs, components, data structures, etc., that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that aspects of the inventive methods may be practiced with other computer system configurations, including single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, hand-held wireless computing devices, microprocessor-based or programmable consumer electronics, and the like, each of which can be operatively coupled to one or more associated devices. Aspects of the invention may also be practiced in distributed computing environments where certain tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
  • A computer may include a variety of computer readable media. Computer readable media may be any available media that can be accessed by the computer and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD ROM, digital video disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store the desired information and which may be accessed by the computer.
  • An exemplary environment for implementing various aspects of the invention may include a computer that includes a processing unit, a system memory and a system bus. The system bus couples system components including, but not limited to, the system memory to the processing unit. The processing unit may be any of various commercially available processors. Dual microprocessors and other multi processor architectures may also be employed as the processing unit.
  • The system bus may be any of several types of bus structure that may further interconnect to a memory bus (with or without a memory controller), a peripheral bus, and a local bus using any of a variety of commercially available bus architectures. The system memory may include read only memory (ROM) and/or random access memory (RAM). A basic input/output system (BIOS) is stored in a non-volatile memory such as ROM, EPROM, EEPROM, which BIOS contains the basic routines that help to transfer information between elements within the computer, such as during start-up. The RAM may also include a high-speed RAM such as static RAM for caching data.
  • The computer may further include an internal hard disk drive (HDD) (e.g., EIDE, SATA), which internal hard disk drive may also be configured for external use in a suitable chassis, a magnetic floppy disk drive (FDD), (e.g., to read from or write to a removable diskette) and an optical disk drive, (e.g., reading a CD-ROM disk or, to read from or write to other high capacity optical media such as the DVD). The hard disk drive, magnetic disk drive and optical disk drive may be connected to the system bus by a hard disk drive interface, a magnetic disk drive interface and an optical drive interface, respectively. The interface for external drive implementations includes at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.
  • The drives and their associated computer-readable media provide nonvolatile storage of data, data structures, computer-executable instructions, and so forth. For the computer, the drives and media accommodate the storage of any data in a suitable digital format. Although the description of computer-readable media above refers to a HDD, a removable magnetic diskette, and a removable optical media such as a CD or DVD, it should be appreciated by those skilled in the art that other types of media which are readable by a computer, such as zip drives, magnetic cassettes, flash memory cards, cartridges, and the like, may also be used in the exemplary operating environment, and further, that any such media may contain computer-executable instructions for performing the methods of the invention.
  • A number of program modules may be stored in the drives and RAM, including an operating system, one or more application programs, other program modules and program data. All or portions of the operating system, applications, modules, and/or data may also be cached in the RAM. It is appreciated that the invention may be implemented with various commercially available operating systems or combinations of operating systems.
  • While a touch-screen display is envisioned for at least some of the embodiments described herein, it is also within the scope of the disclosure that a user may enter commands and information into the computer through one or more wired/wireless input devices, for example, a keyboard and a pointing device, such as a mouse. Other input devices may include a microphone (functioning in association with appropriate language processing/recognition software as know to those of ordinary skill in the technology), an IR remote control, a joystick, a game pad, a stylus pen, or the like. These and other input devices are often connected to the processing unit through an input device interface that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, an IEEE 1394 serial port, a game port, a USB port, an IR interface, etc.
  • A display monitor or other type of display device may also be connected to the system bus via an interface, such as a video adapter. In addition to the monitor, a computer may include other peripheral output devices, such as speakers, printers, etc.
  • The computer may operate in a networked environment using logical connections via wired and/or wireless communications to one or more remote computers. The remote computer(s) may be a workstation, a server computer, a router, a personal computer, a portable computer, a personal digital assistant, a cellular device, a microprocessor-based entertainment appliance, a peer device or other common network node, and may include many or all of the elements described relative to the computer. The logical connections depicted include wired/wireless connectivity to a local area network (LAN) and/or larger networks, for example, a wide area network (WAN). Such LAN and WAN networking environments are commonplace in offices, and companies, and facilitate enterprise-wide computer networks, such as intranets, all of which may connect to a global communications network such as the Internet.
  • The computer may be operable to communicate with any wireless devices or entities operatively disposed in wireless communication, e.g., a printer, scanner, desktop and/or portable computer, portable data assistant, communications satellite, any piece of equipment or location associated with a wirelessly detectable tag (e.g., a kiosk, news stand, restroom), and telephone. This includes at least Wi-Fi (such as IEEE 802.11x (a, b, g, n, etc.)) and Bluetooth™ wireless technologies. Thus, the communication may be a predefined structure as with a conventional network or simply an ad hoc communication between at least two devices.
  • The system may also include one or more server(s). The server(s) may also be hardware and/or software (e.g., threads, processes, computing devices). The servers may house threads to perform transformations by employing aspects of the invention, for example. One possible communication between a client and a server may be in the form of a data packet adapted to be transmitted between two or more computer processes. The data packet may include a cookie and/or associated contextual information, for example. The system may include a communication framework (e.g., a global communication network such as the Internet) that may be employed to facilitate communications between the client(s) and the server(s).
  • Following from the above description and invention summaries, it should be apparent to those of ordinary skill in the art that, while the methods and apparatuses herein described constitute exemplary embodiments of the present invention, it is to be understood that the inventions contained herein are not limited to the above precise embodiment and that changes may be made without departing from the scope of the invention. Likewise, it is to be understood that it is not necessary to meet any or all of the identified advantages or objects of the invention disclosed herein in order to fall within the scope of the invention, since inherent and/or unforeseen advantages of the present invention may exist even though they may not have been explicitly discussed herein.

Claims (20)

1. A system for displaying medical information related to a human subject, comprising:
a computer system;
one or more server systems in communication with the computer system;
one or more data monitoring devices providing at least near real-time medical information to the computer system and/or the one or more server systems;
one or more electronic medical records in communication with the one or more server systems, each electronic medical record being configured to store historical medical information associated with the human subject;
a medical information interoperability tool in communication with the one or more electronic medical records, the medical information interoperability tool configured to translate and transmit real-time and/or historical medical information among the one or more data monitoring devices, one or more electronic medical records and the one or more server systems;
a medical information visualization tool stored on the one or more server systems and accessible by the computer system, the medical information visualization tool being configured to display at least near real-time medical information from the data monitoring devices and historical medical information from at least one of the electronic medical records and/or the medical information interoperability tool, the at least near real-time and historical medical information including medical parameters related to at least one of clinical data and human subject-generated data;
wherein the medical information visualization tool is configured to simultaneously display at least two parameters of the historical medical information and the at least near real-time medical information, the historical medical information being displayed on a graph having a dynamically adjustable time period.
2. The system of claim 1, wherein the medical information visualization tool is configured to be dynamically adjustable such that the at least two parameters of historical and at least near real-time medical information may be displayed in a customizable order.
3. The system of claim 1, wherein the medical information visualization tool is configured to display the historical medical information on a graph, wherein the graph represents a particular medical parameter during the dynamically adjustable time period.
4. The system of claim 1, wherein at least two parameters of historical medical information and at least near real-time medical information are displayed in a vertical orientation.
5. The system of claim 1, wherein one or more data monitoring devices includes one or more health monitoring devices temporarily affixed to the human subject, the one or more health monitoring devices adapted to continuously and/or intermittently monitor the medical parameters.
6. The system of claim 1,
wherein the medical information visualization tool includes a scrubber tool configured to select a particular time on a timeline and display the historical medical information associated with the particular time on the graph; and
wherein the medical information visualization tool displays numeric values associated with the historical medical information associated with the particular time.
7. The system of claim 6,
wherein the scrubber tool is further configured to be moved along the timeline; and
wherein the medical information visualization tool displays numeric values associated with the historical medical information associated with the scrubber tool's location on the timeline.
8. The system of claim 1,
wherein the medical information visualization tool is configured to display the near real-time medical information on a graph, wherein the graph represents a particular medical parameter during a predetermined recent time period; and
wherein the medical information visualization tool is further configured to simultaneously display real-time medical information as a numeric value.
9. The system of claim 1, wherein the medical information visualization tool includes a time resolution controller configured to select a time period in which the medical information is to be displayed.
10. The system of claim 9, wherein the time resolution controller is further configured to select a start time and an end time that defines the time period.
11. The system of claim 1,
wherein the medical information visualization tool includes an icon tool controller configured to display at least one icon near the historical medical information being displayed, the at least one icon being associated with at least one of a medical treatment, a medical procedure and a medical test; and
wherein the at least one icon is displayed at an approximate time that the medical treatment, medical procedure and/or medical test was performed.
12. The system of claim 1, further comprising:
a messaging system in communication with the one or more electronic medical records, the messaging system configured to provide at least one of inter-clinician textual communications and clinician note taking.
13. The system of claim 1, further comprising:
a report generation tool configured to generate one or more reports to be displayed, printed and/or transmitted, wherein the one or more reports include at least two parameters of the historical medical information and the at least near real-time medical information, the historical medical information being displayed on a graph having a dynamically adjustable time period.
14. A method of displaying medical information related to a human subject, the method comprising:
gathering medical information associated with the human subject from one or more data monitoring devices, the medical information including at least two medical parameters related to at least one of clinical data and human subject-generated data;
storing the medical information in one or more electronic medical records;
simultaneously displaying the at least two medical parameters using a medical information visualization tool, the medical information visualization tool being configured to simultaneously display at least near real-time medical information and historical medical information from the one or more electronic medical records, the historical medical information being displayed based, at least in part, on a first time period;
modifying the first time period that the historical medical information is to be displayed to define a second time period; and
simultaneously displaying the at least two medical parameters using the medical information visualization tool, the historical medical information being displayed based, at least in part, on the second time period.
15. The method of claim 14, wherein the gathering step and storing steps are performed at a predetermined time interval.
16. The method of claim 14, further comprising:
adjusting the display order of the at least two medical parameters to be displayed using the medical information visualization tool; and
simultaneously displaying the at least two medical parameters in the adjusted display order using the medical information visualization tool.
17. A computer-readable medium having instructions thereon, the instructions configured to perform the steps of:
receiving medical information associated with the human subject from one or more data monitoring devices, the medical information including at least two medical parameters related to at least one of clinical data and human subject-generated data;
storing the medical information in one or more electronic medical records;
simultaneously outputting the at least two medical parameters to a display device using a medical information visualization tool, the medical information visualization tool being configured to simultaneously display at least near real-time medical information and historical medical information from the one or more electronic medical records, the historical medical information being displayed based, at least in part, on a first time period;
modifying the first time period that the historical medical information is to be displayed to define a second time period; and
simultaneously outputting the at least two medical parameters to the display device using the medical information visualization tool, the historical medical information being displayed based, at least in part, on the second time period.
18. The computer-readable medium of claim 17, wherein the gathering step and storing steps are performed at a predetermined time interval.
19. The computer-readable medium of claim 17, wherein the display device includes a touch-screen display device.
20. The method of claim 17, further comprising:
adjusting the display order of the at least two medical parameters to be outputted using the medical information visualization tool; and
simultaneously outputting the at least two medical parameters in the adjusted display order to the display device using the medical information visualization tool.
US12/789,267 2009-05-28 2010-05-27 Medical information visualization assistant system and method Expired - Fee Related US8645164B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/789,267 US8645164B2 (en) 2009-05-28 2010-05-27 Medical information visualization assistant system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US21720009P 2009-05-28 2009-05-28
US12/789,267 US8645164B2 (en) 2009-05-28 2010-05-27 Medical information visualization assistant system and method

Publications (2)

Publication Number Publication Date
US20110004071A1 true US20110004071A1 (en) 2011-01-06
US8645164B2 US8645164B2 (en) 2014-02-04

Family

ID=43413033

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/789,267 Expired - Fee Related US8645164B2 (en) 2009-05-28 2010-05-27 Medical information visualization assistant system and method

Country Status (1)

Country Link
US (1) US8645164B2 (en)

Cited By (188)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100313151A1 (en) * 2009-06-04 2010-12-09 Microsoft Corporation Representing data on configurable timeline with filter
US20120144250A1 (en) * 2010-12-07 2012-06-07 Brian Lee Visual Outage Management Tool
US20120173985A1 (en) * 2010-12-29 2012-07-05 Tyler Peppel Multi-dimensional visualization of temporal information
US20120215122A1 (en) * 2011-02-18 2012-08-23 University Of Utah Research Foundation Arrhythmia information management
WO2012158720A1 (en) * 2011-05-15 2012-11-22 Spacelabs Healthcare, Llc User configurable central monitoring station
WO2012177546A2 (en) * 2011-06-22 2012-12-27 Honeywell International Inc. Methods for touch screen control of paperless recorders
US20130041679A1 (en) * 2011-08-12 2013-02-14 Fujitsu Limited Order display apparatus, computer readable storage medium, and order display method
WO2013125606A1 (en) * 2012-02-23 2013-08-29 Nihon Kohden Corporation Monitoring apparatus
EP2660743A1 (en) * 2012-05-03 2013-11-06 B. Braun Avitum AG Method for customization of user interface of a medical apparatus for extracorporal blood treatment; medical apparatus for extracorporal blood treatment
US20140013265A1 (en) * 2011-03-30 2014-01-09 Medhi Goranka Time frame based data analysis
US20140019901A1 (en) * 2011-01-18 2014-01-16 Airstrip Ip Holdings, Llc Systems and methods for viewing patient data
US20140022256A1 (en) * 2012-07-17 2014-01-23 Covidien Lp Time alignment display technique for a medical device
WO2014047171A1 (en) * 2012-09-18 2014-03-27 Draeger Medical Systems, Inc. System and method of generating a user interface display of patient parameter data
WO2014078859A1 (en) * 2012-11-19 2014-05-22 Etiometry Llc User interface for patient risk analysis systems
US20140142970A1 (en) * 2011-12-16 2014-05-22 Etiometry Llc User Interface for Patient Risk Analysis System
US8775972B2 (en) * 2012-11-08 2014-07-08 Snapchat, Inc. Apparatus and method for single action control of social network profile access
EP2777488A1 (en) * 2013-03-14 2014-09-17 Depuy Synthes Products, Inc. Methods and systems for displaying medical parameters of a patient
US20140310584A1 (en) * 2013-04-12 2014-10-16 Fujifilm Corporation Medical care information display control apparatus, medical care information display control method, and medical care information display control program
EP2869228A1 (en) * 2013-10-29 2015-05-06 Nihon Kohden Corporation Biological information monitor apparatus and central monitor
US9083770B1 (en) 2013-11-26 2015-07-14 Snapchat, Inc. Method and system for integrating real time communication features in applications
US9094137B1 (en) 2014-06-13 2015-07-28 Snapchat, Inc. Priority based placement of messages in a geo-location based event gallery
US9152765B2 (en) 2010-03-21 2015-10-06 Spacelabs Healthcare Llc Multi-display bedside monitoring system
US20150339447A1 (en) * 2014-05-22 2015-11-26 Fujifilm Corporation Medical assistance device, operation method of medical assistance device, non-transitory computer-readable recording medium, and medical assistance system
US9225897B1 (en) 2014-07-07 2015-12-29 Snapchat, Inc. Apparatus and method for supplying content aware photo filters
US9237202B1 (en) 2014-03-07 2016-01-12 Snapchat, Inc. Content delivery network for ephemeral objects
US9276886B1 (en) 2014-05-09 2016-03-01 Snapchat, Inc. Apparatus and method for dynamically configuring application component tiles
US9298889B2 (en) 2007-03-09 2016-03-29 Spacelabs Healthcare Llc Health data collection tool
US9384652B2 (en) 2010-11-19 2016-07-05 Spacelabs Healthcare, Llc System and method for transfer of primary alarm notification on patient monitoring systems
US9385983B1 (en) 2014-12-19 2016-07-05 Snapchat, Inc. Gallery of messages from individuals with a shared interest
CN105726131A (en) * 2016-01-26 2016-07-06 深圳市科曼医疗设备有限公司 Multi-bed monitoring interface waveform display method and system
US9396354B1 (en) 2014-05-28 2016-07-19 Snapchat, Inc. Apparatus and method for automated privacy protection in distributed images
US9537811B2 (en) 2014-10-02 2017-01-03 Snap Inc. Ephemeral gallery of ephemeral messages
US20170027455A1 (en) * 2015-07-27 2017-02-02 Nihon Kohden Corporation Vital signs information measuring apparatus and vital signs information measuring method
US9604020B2 (en) 2009-10-16 2017-03-28 Spacelabs Healthcare Llc Integrated, extendable anesthesia system
US20170172492A1 (en) * 2015-12-21 2017-06-22 Nihon Kohden Corporation Muscular relaxation monitoring device, muscular relaxation monitoring method and muscular relaxation monitoring program
US9705831B2 (en) 2013-05-30 2017-07-11 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US9721394B2 (en) 2012-08-22 2017-08-01 Snaps Media, Inc. Augmented reality virtual content platform apparatuses, methods and systems
US9742713B2 (en) 2013-05-30 2017-08-22 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US9797764B2 (en) 2009-10-16 2017-10-24 Spacelabs Healthcare, Llc Light enhanced flow tube
US9843720B1 (en) 2014-11-12 2017-12-12 Snap Inc. User interface for accessing media at a geographic location
US9854219B2 (en) 2014-12-19 2017-12-26 Snap Inc. Gallery of videos set to an audio time line
JP2017228099A (en) * 2016-06-23 2017-12-28 コニカミノルタ株式会社 Patient information display system and patient information display method
US9866999B1 (en) 2014-01-12 2018-01-09 Investment Asset Holdings Llc Location-based messaging
US9936030B2 (en) 2014-01-03 2018-04-03 Investel Capital Corporation User content sharing system and method with location-based external content integration
JP2018521714A (en) * 2015-05-26 2018-08-09 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Device, system and method for visualization of patient related data
US10055717B1 (en) 2014-08-22 2018-08-21 Snap Inc. Message processor with application prompts
US20180267700A1 (en) * 2017-03-16 2018-09-20 Q Bio, Inc User interface for medical information
US10082926B1 (en) 2014-02-21 2018-09-25 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US20180286500A1 (en) * 2015-12-31 2018-10-04 Alberto SOLE GUERRA System for acquisition, processing and visualization of clinical data of patients
US10123166B2 (en) 2015-01-26 2018-11-06 Snap Inc. Content request by location
US10135949B1 (en) 2015-05-05 2018-11-20 Snap Inc. Systems and methods for story and sub-story navigation
US10133705B1 (en) 2015-01-19 2018-11-20 Snap Inc. Multichannel system
US10157449B1 (en) 2015-01-09 2018-12-18 Snap Inc. Geo-location-based image filters
US10165402B1 (en) 2016-06-28 2018-12-25 Snap Inc. System to track engagement of media items
US10203855B2 (en) 2016-12-09 2019-02-12 Snap Inc. Customized user-controlled media overlays
US10219111B1 (en) 2018-04-18 2019-02-26 Snap Inc. Visitation tracking system
US10223397B1 (en) 2015-03-13 2019-03-05 Snap Inc. Social graph based co-location of network users
US10284508B1 (en) 2014-10-02 2019-05-07 Snap Inc. Ephemeral gallery of ephemeral messages with opt-in permanence
US10311916B2 (en) 2014-12-19 2019-06-04 Snap Inc. Gallery of videos set to an audio time line
US10319149B1 (en) 2017-02-17 2019-06-11 Snap Inc. Augmented reality anamorphosis system
US10327096B1 (en) 2018-03-06 2019-06-18 Snap Inc. Geo-fence selection system
US10334307B2 (en) 2011-07-12 2019-06-25 Snap Inc. Methods and systems of providing visual content editing functions
US10348662B2 (en) 2016-07-19 2019-07-09 Snap Inc. Generating customized electronic messaging graphics
US10354425B2 (en) 2015-12-18 2019-07-16 Snap Inc. Method and system for providing context relevant media augmentation
US10366543B1 (en) 2015-10-30 2019-07-30 Snap Inc. Image based tracking in augmented reality systems
US10387514B1 (en) 2016-06-30 2019-08-20 Snap Inc. Automated content curation and communication
US10387730B1 (en) 2017-04-20 2019-08-20 Snap Inc. Augmented reality typography personalization system
US10416865B2 (en) * 2016-05-19 2019-09-17 Welch Allyn, Inc. Medical device with enhanced user interface controls
US10423983B2 (en) 2014-09-16 2019-09-24 Snap Inc. Determining targeting information based on a predictive targeting model
US10430838B1 (en) 2016-06-28 2019-10-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections with automated advertising
US10439972B1 (en) 2013-05-30 2019-10-08 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US10474321B2 (en) 2015-11-30 2019-11-12 Snap Inc. Network resource location linking and visual content sharing
US10499191B1 (en) 2017-10-09 2019-12-03 Snap Inc. Context sensitive presentation of content
US10523625B1 (en) 2017-03-09 2019-12-31 Snap Inc. Restricted group content collection
US10582277B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US10581782B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US10592574B2 (en) 2015-05-05 2020-03-17 Snap Inc. Systems and methods for automated local story generation and curation
US10616239B2 (en) 2015-03-18 2020-04-07 Snap Inc. Geo-fence authorization provisioning
US10623666B2 (en) 2016-11-07 2020-04-14 Snap Inc. Selective identification and order of image modifiers
US10638256B1 (en) 2016-06-20 2020-04-28 Pipbin, Inc. System for distribution and display of mobile targeted augmented reality content
US20200170582A1 (en) * 2018-11-30 2020-06-04 Covidien Lp Contextual patient data representation and display
US10679393B2 (en) 2018-07-24 2020-06-09 Snap Inc. Conditional modification of augmented reality object
US10679389B2 (en) 2016-02-26 2020-06-09 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US10678818B2 (en) 2018-01-03 2020-06-09 Snap Inc. Tag distribution visualization system
US10682460B2 (en) 2013-01-28 2020-06-16 Smiths Medical Asd, Inc. Medication safety devices and methods
US10699811B2 (en) 2011-03-11 2020-06-30 Spacelabs Healthcare L.L.C. Methods and systems to determine multi-parameter managed alarm hierarchy during patient monitoring
US10740974B1 (en) 2017-09-15 2020-08-11 Snap Inc. Augmented reality system
US10805696B1 (en) 2016-06-20 2020-10-13 Pipbin, Inc. System for recording and targeting tagged content of user interest
US10817898B2 (en) 2015-08-13 2020-10-27 Placed, Llc Determining exposures to content presented by physical objects
US10824654B2 (en) 2014-09-18 2020-11-03 Snap Inc. Geolocation-based pictographs
US10834525B2 (en) 2016-02-26 2020-11-10 Snap Inc. Generation, curation, and presentation of media collections
US10839219B1 (en) 2016-06-20 2020-11-17 Pipbin, Inc. System for curation, distribution and display of location-dependent augmented reality content
US10862951B1 (en) 2007-01-05 2020-12-08 Snap Inc. Real-time display of multiple images
US10885136B1 (en) 2018-02-28 2021-01-05 Snap Inc. Audience filtering system
US10915911B2 (en) 2017-02-03 2021-02-09 Snap Inc. System to determine a price-schedule to distribute media content
US10933311B2 (en) 2018-03-14 2021-03-02 Snap Inc. Generating collectible items based on location information
US10952013B1 (en) 2017-04-27 2021-03-16 Snap Inc. Selective location-based identity communication
US10948717B1 (en) 2015-03-23 2021-03-16 Snap Inc. Reducing boot time and power consumption in wearable display systems
US10963529B1 (en) 2017-04-27 2021-03-30 Snap Inc. Location-based search mechanism in a graphical user interface
US10979752B1 (en) 2018-02-28 2021-04-13 Snap Inc. Generating media content items based on location information
US10987026B2 (en) 2013-05-30 2021-04-27 Spacelabs Healthcare Llc Capnography module with automatic switching between mainstream and sidestream monitoring
US10993069B2 (en) 2015-07-16 2021-04-27 Snap Inc. Dynamically adaptive media content delivery
US10997760B2 (en) 2018-08-31 2021-05-04 Snap Inc. Augmented reality anthropomorphization system
CN112753076A (en) * 2018-09-24 2021-05-04 皇家飞利浦有限公司 Medical monitoring system
US10997783B2 (en) 2015-11-30 2021-05-04 Snap Inc. Image and point cloud based tracking and in augmented reality systems
US11017173B1 (en) 2017-12-22 2021-05-25 Snap Inc. Named entity recognition visual context and caption data
US11023514B2 (en) 2016-02-26 2021-06-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US11030787B2 (en) 2017-10-30 2021-06-08 Snap Inc. Mobile-based cartographic control of display content
US11037372B2 (en) 2017-03-06 2021-06-15 Snap Inc. Virtual vision system
US11044393B1 (en) 2016-06-20 2021-06-22 Pipbin, Inc. System for curation and display of location-dependent augmented reality content in an augmented estate system
US11085984B2 (en) 2016-04-03 2021-08-10 Q Bio, Inc. Tensor field mapping
US11128715B1 (en) 2019-12-30 2021-09-21 Snap Inc. Physical friend proximity in chat
US11131735B2 (en) 2019-09-27 2021-09-28 Q Bio, Inc. Maxwell parallel imaging
CN113597643A (en) * 2018-12-24 2021-11-02 中国医学科学院北京协和医院 Medical advice tool display method for medical equipment and medical equipment
US11163941B1 (en) 2018-03-30 2021-11-02 Snap Inc. Annotating a collection of media content items
US11170393B1 (en) 2017-04-11 2021-11-09 Snap Inc. System to calculate an engagement score of location based media content
US11182383B1 (en) 2012-02-24 2021-11-23 Placed, Llc System and method for data collection to validate location data
US11189299B1 (en) 2017-02-20 2021-11-30 Snap Inc. Augmented reality speech balloon system
US11199957B1 (en) 2018-11-30 2021-12-14 Snap Inc. Generating customized avatars based on location information
US11201981B1 (en) 2016-06-20 2021-12-14 Pipbin, Inc. System for notification of user accessibility of curated location-dependent content in an augmented estate
US11206615B2 (en) 2019-05-30 2021-12-21 Snap Inc. Wearable device location systems
US11216869B2 (en) 2014-09-23 2022-01-04 Snap Inc. User interface to augment an image using geolocation
US11218838B2 (en) 2019-10-31 2022-01-04 Snap Inc. Focused map-based context information surfacing
US11228551B1 (en) 2020-02-12 2022-01-18 Snap Inc. Multiple gateway message exchange
US11232040B1 (en) 2017-04-28 2022-01-25 Snap Inc. Precaching unlockable data elements
US11250075B1 (en) 2017-02-17 2022-02-15 Snap Inc. Searching social media content
US11249614B2 (en) 2019-03-28 2022-02-15 Snap Inc. Generating personalized map interface with enhanced icons
US11265273B1 (en) 2017-12-01 2022-03-01 Snap, Inc. Dynamic media overlay with smart widget
US11290851B2 (en) 2020-06-15 2022-03-29 Snap Inc. Location sharing using offline and online objects
US11294936B1 (en) 2019-01-30 2022-04-05 Snap Inc. Adaptive spatial density based clustering
US11301117B2 (en) 2019-03-08 2022-04-12 Snap Inc. Contextual information in chat
US11314776B2 (en) 2020-06-15 2022-04-26 Snap Inc. Location sharing using friend list versions
US11343323B2 (en) 2019-12-31 2022-05-24 Snap Inc. Augmented reality objects registry
US11361493B2 (en) 2019-04-01 2022-06-14 Snap Inc. Semantic texture mapping system
US11388226B1 (en) 2015-01-13 2022-07-12 Snap Inc. Guided personal identity based actions
US11424025B2 (en) * 2019-08-30 2022-08-23 GE Precision Healthcare LLC Systems and methods for medical device monitoring
US11429618B2 (en) 2019-12-30 2022-08-30 Snap Inc. Surfacing augmented reality objects
US11430091B2 (en) 2020-03-27 2022-08-30 Snap Inc. Location mapping for large scale augmented-reality
US11455082B2 (en) 2018-09-28 2022-09-27 Snap Inc. Collaborative achievement interface
US11475254B1 (en) 2017-09-08 2022-10-18 Snap Inc. Multimodal entity identification
US11483267B2 (en) 2020-06-15 2022-10-25 Snap Inc. Location sharing using different rate-limited links
US11503432B2 (en) 2020-06-15 2022-11-15 Snap Inc. Scalable real-time location sharing framework
US11500525B2 (en) 2019-02-25 2022-11-15 Snap Inc. Custom media overlay system
US11507614B1 (en) 2018-02-13 2022-11-22 Snap Inc. Icon based tagging
US11516167B2 (en) 2020-03-05 2022-11-29 Snap Inc. Storing data based on device location
USD973072S1 (en) * 2020-09-30 2022-12-20 Masimo Corporation Display screen or portion thereof with graphical user interface
US11558709B2 (en) 2018-11-30 2023-01-17 Snap Inc. Position service to determine relative position to map features
US11574431B2 (en) 2019-02-26 2023-02-07 Snap Inc. Avatar based on weather
US11601783B2 (en) 2019-06-07 2023-03-07 Snap Inc. Detection of a physical collision between two client devices in a location sharing system
US11601888B2 (en) 2021-03-29 2023-03-07 Snap Inc. Determining location using multi-source geolocation data
US20230070694A1 (en) * 2019-04-10 2023-03-09 Imam Abdulrahman Bin Faisal University Method to restore loss of feeling in a foot of a person
US11606755B2 (en) 2019-05-30 2023-03-14 Snap Inc. Wearable device location systems architecture
US11614508B1 (en) 2021-10-25 2023-03-28 Q Bio, Inc. Sparse representation of measurements
US11616745B2 (en) 2017-01-09 2023-03-28 Snap Inc. Contextual generation and selection of customized media content
US11614509B2 (en) 2019-09-27 2023-03-28 Q Bio, Inc. Maxwell parallel imaging
US11619501B2 (en) 2020-03-11 2023-04-04 Snap Inc. Avatar based on trip
US11625443B2 (en) 2014-06-05 2023-04-11 Snap Inc. Web document enhancement
US11631276B2 (en) 2016-03-31 2023-04-18 Snap Inc. Automated avatar generation
US11645324B2 (en) 2021-03-31 2023-05-09 Snap Inc. Location-based timeline media content system
US11675831B2 (en) 2017-05-31 2023-06-13 Snap Inc. Geolocation based playlists
US11676730B2 (en) 2011-12-16 2023-06-13 Etiometry Inc. System and methods for transitioning patient care from signal based monitoring to risk based monitoring
US11676378B2 (en) 2020-06-29 2023-06-13 Snap Inc. Providing travel-based augmented reality content with a captured image
US11714535B2 (en) 2019-07-11 2023-08-01 Snap Inc. Edge gesture interface with smart interactions
US11729343B2 (en) 2019-12-30 2023-08-15 Snap Inc. Including video feed in message thread
US11734712B2 (en) 2012-02-24 2023-08-22 Foursquare Labs, Inc. Attributing in-store visits to media consumption based on data collected from user devices
US11751015B2 (en) 2019-01-16 2023-09-05 Snap Inc. Location-based context information sharing in a messaging system
US11748642B2 (en) 2019-02-15 2023-09-05 Q Bio, Inc. Model parameter determination using a predictive model
US11776256B2 (en) 2020-03-27 2023-10-03 Snap Inc. Shared augmented reality system
US11785161B1 (en) 2016-06-20 2023-10-10 Pipbin, Inc. System for user accessibility of tagged curated augmented reality content
US11799811B2 (en) 2018-10-31 2023-10-24 Snap Inc. Messaging and gaming applications communication platform
US11809624B2 (en) 2019-02-13 2023-11-07 Snap Inc. Sleep detection in a location sharing system
WO2023170442A3 (en) * 2022-03-01 2023-11-09 Mofaip, Llc Targeted isolation of anatomic sites for form generation and medical record generation and retrieval
US11816853B2 (en) 2016-08-30 2023-11-14 Snap Inc. Systems and methods for simultaneous localization and mapping
US11821742B2 (en) 2019-09-26 2023-11-21 Snap Inc. Travel based notifications
US11829834B2 (en) 2021-10-29 2023-11-28 Snap Inc. Extended QR code
US11843456B2 (en) 2016-10-24 2023-12-12 Snap Inc. Generating and displaying customized avatars in media overlays
US11842411B2 (en) 2017-04-27 2023-12-12 Snap Inc. Location-based virtual avatars
US11852554B1 (en) 2019-03-21 2023-12-26 Snap Inc. Barometer calibration in a location sharing system
US11860888B2 (en) 2018-05-22 2024-01-02 Snap Inc. Event detection system
US11868414B1 (en) 2019-03-14 2024-01-09 Snap Inc. Graph-based prediction for contact suggestion in a location sharing system
US11870743B1 (en) 2017-01-23 2024-01-09 Snap Inc. Customized digital avatar accessories
US11877211B2 (en) 2019-01-14 2024-01-16 Snap Inc. Destination sharing in location sharing system
US11876941B1 (en) 2016-06-20 2024-01-16 Pipbin, Inc. Clickable augmented reality content manager, system, and network
US11893208B2 (en) 2019-12-31 2024-02-06 Snap Inc. Combined map icon with action indicator
US11900418B2 (en) 2016-04-04 2024-02-13 Snap Inc. Mutable geo-fencing system
US11925869B2 (en) 2012-05-08 2024-03-12 Snap Inc. System and method for generating and displaying avatars
US11943192B2 (en) 2020-08-31 2024-03-26 Snap Inc. Co-location connection service
US11962645B2 (en) 2022-06-02 2024-04-16 Snap Inc. Guided personal identity based actions

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9158888B1 (en) * 2010-03-26 2015-10-13 Open Invention Network, Llc System and method for analysing data records utilizing a touch screen interface
JP5879308B2 (en) * 2013-07-11 2016-03-08 富士フイルム株式会社 Medical information display control apparatus and method, and program
US11145395B1 (en) 2019-07-16 2021-10-12 Laura A. Mitchell Health history access

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060265249A1 (en) * 2005-05-18 2006-11-23 Howard Follis Method, system, and computer-readable medium for providing a patient electronic medical record with an improved timeline
US20080281831A1 (en) * 1997-01-31 2008-11-13 Making Everlasting Memories, L.L.C. System and Method for Archiving Records
US20090055735A1 (en) * 2005-07-15 2009-02-26 Siemens Medical Solutions Health Services Corporation Systems user interfaces and methods for processing medical data
US20090287103A1 (en) * 2008-05-14 2009-11-19 Pacesetter, Inc. Systems and methods for monitoring patient activity and/or exercise and displaying information about the same
US20100185871A1 (en) * 2009-01-15 2010-07-22 Authentiverse, Inc. System and method to provide secure access to personal information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080281831A1 (en) * 1997-01-31 2008-11-13 Making Everlasting Memories, L.L.C. System and Method for Archiving Records
US20060265249A1 (en) * 2005-05-18 2006-11-23 Howard Follis Method, system, and computer-readable medium for providing a patient electronic medical record with an improved timeline
US20090055735A1 (en) * 2005-07-15 2009-02-26 Siemens Medical Solutions Health Services Corporation Systems user interfaces and methods for processing medical data
US20090287103A1 (en) * 2008-05-14 2009-11-19 Pacesetter, Inc. Systems and methods for monitoring patient activity and/or exercise and displaying information about the same
US20100185871A1 (en) * 2009-01-15 2010-07-22 Authentiverse, Inc. System and method to provide secure access to personal information

Cited By (398)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10862951B1 (en) 2007-01-05 2020-12-08 Snap Inc. Real-time display of multiple images
US11588770B2 (en) 2007-01-05 2023-02-21 Snap Inc. Real-time display of multiple images
US9298889B2 (en) 2007-03-09 2016-03-29 Spacelabs Healthcare Llc Health data collection tool
US20100313151A1 (en) * 2009-06-04 2010-12-09 Microsoft Corporation Representing data on configurable timeline with filter
US9797764B2 (en) 2009-10-16 2017-10-24 Spacelabs Healthcare, Llc Light enhanced flow tube
US9604020B2 (en) 2009-10-16 2017-03-28 Spacelabs Healthcare Llc Integrated, extendable anesthesia system
US9152765B2 (en) 2010-03-21 2015-10-06 Spacelabs Healthcare Llc Multi-display bedside monitoring system
US9384652B2 (en) 2010-11-19 2016-07-05 Spacelabs Healthcare, Llc System and method for transfer of primary alarm notification on patient monitoring systems
US20120144250A1 (en) * 2010-12-07 2012-06-07 Brian Lee Visual Outage Management Tool
US8726103B2 (en) * 2010-12-07 2014-05-13 At & T Intellectual Property I, Lp Visual outage management tool
US9881257B2 (en) * 2010-12-29 2018-01-30 Tickr, Inc. Multi-dimensional visualization of temporal information
US20120173985A1 (en) * 2010-12-29 2012-07-05 Tyler Peppel Multi-dimensional visualization of temporal information
US20140019901A1 (en) * 2011-01-18 2014-01-16 Airstrip Ip Holdings, Llc Systems and methods for viewing patient data
US10282518B2 (en) * 2011-01-18 2019-05-07 Airstrip Ip Holdings, Llc Systems and methods for viewing electrocardiograms
US20120215122A1 (en) * 2011-02-18 2012-08-23 University Of Utah Research Foundation Arrhythmia information management
US11139077B2 (en) 2011-03-11 2021-10-05 Spacelabs Healthcare L.L.C. Methods and systems to determine multi-parameter managed alarm hierarchy during patient monitoring
US10699811B2 (en) 2011-03-11 2020-06-30 Spacelabs Healthcare L.L.C. Methods and systems to determine multi-parameter managed alarm hierarchy during patient monitoring
US11562825B2 (en) 2011-03-11 2023-01-24 Spacelabs Healthcare L.L.C. Methods and systems to determine multi-parameter managed alarm hierarchy during patient monitoring
US20140013265A1 (en) * 2011-03-30 2014-01-09 Medhi Goranka Time frame based data analysis
WO2012158720A1 (en) * 2011-05-15 2012-11-22 Spacelabs Healthcare, Llc User configurable central monitoring station
GB2505133A (en) * 2011-05-15 2014-02-19 Spacelabs Healthcare Llc User configurable central monitoring station
GB2505133B (en) * 2011-05-15 2017-07-19 Spacelabs Healthcare Llc User configurable central monitoring station
WO2012177546A2 (en) * 2011-06-22 2012-12-27 Honeywell International Inc. Methods for touch screen control of paperless recorders
WO2012177546A3 (en) * 2011-06-22 2013-02-28 Honeywell International Inc. Methods for touch screen control of paperless recorders
US11750875B2 (en) 2011-07-12 2023-09-05 Snap Inc. Providing visual content editing functions
US10999623B2 (en) 2011-07-12 2021-05-04 Snap Inc. Providing visual content editing functions
US11451856B2 (en) 2011-07-12 2022-09-20 Snap Inc. Providing visual content editing functions
US10334307B2 (en) 2011-07-12 2019-06-25 Snap Inc. Methods and systems of providing visual content editing functions
US20130041679A1 (en) * 2011-08-12 2013-02-14 Fujitsu Limited Order display apparatus, computer readable storage medium, and order display method
US11676730B2 (en) 2011-12-16 2023-06-13 Etiometry Inc. System and methods for transitioning patient care from signal based monitoring to risk based monitoring
US10062456B2 (en) 2011-12-16 2018-08-28 Etiometry Inc. Systems and methods for transitioning patient care from signal based monitoring to risk based monitoring
US20140142970A1 (en) * 2011-12-16 2014-05-22 Etiometry Llc User Interface for Patient Risk Analysis System
WO2013125606A1 (en) * 2012-02-23 2013-08-29 Nihon Kohden Corporation Monitoring apparatus
US9760683B2 (en) 2012-02-23 2017-09-12 Nihon Kohden Corporation Monitoring apparatus
US11734712B2 (en) 2012-02-24 2023-08-22 Foursquare Labs, Inc. Attributing in-store visits to media consumption based on data collected from user devices
US11182383B1 (en) 2012-02-24 2021-11-23 Placed, Llc System and method for data collection to validate location data
EP2660743A1 (en) * 2012-05-03 2013-11-06 B. Braun Avitum AG Method for customization of user interface of a medical apparatus for extracorporal blood treatment; medical apparatus for extracorporal blood treatment
US9703926B2 (en) 2012-05-03 2017-07-11 B. Braun Avitum Ag Method for customization of user interface of a medical apparatus for extracorporal blood treatment; medical apparatus for extracorporal blood treatment
US11925869B2 (en) 2012-05-08 2024-03-12 Snap Inc. System and method for generating and displaying avatars
US20140022256A1 (en) * 2012-07-17 2014-01-23 Covidien Lp Time alignment display technique for a medical device
US9218671B2 (en) * 2012-07-17 2015-12-22 Covidien Lp Time alignment display technique for a medical device
US10169924B2 (en) 2012-08-22 2019-01-01 Snaps Media Inc. Augmented reality virtual content platform apparatuses, methods and systems
US9792733B2 (en) 2012-08-22 2017-10-17 Snaps Media, Inc. Augmented reality virtual content platform apparatuses, methods and systems
US9721394B2 (en) 2012-08-22 2017-08-01 Snaps Media, Inc. Augmented reality virtual content platform apparatuses, methods and systems
WO2014047171A1 (en) * 2012-09-18 2014-03-27 Draeger Medical Systems, Inc. System and method of generating a user interface display of patient parameter data
CN104798074A (en) * 2012-09-18 2015-07-22 德尔格医疗系统有限公司 System and method of generating a user interface display of patient parameter data
US10887308B1 (en) 2012-11-08 2021-01-05 Snap Inc. Interactive user-interface to adjust access privileges
US9882907B1 (en) 2012-11-08 2018-01-30 Snap Inc. Apparatus and method for single action control of social network profile access
US11252158B2 (en) 2012-11-08 2022-02-15 Snap Inc. Interactive user-interface to adjust access privileges
US8775972B2 (en) * 2012-11-08 2014-07-08 Snapchat, Inc. Apparatus and method for single action control of social network profile access
WO2014078859A1 (en) * 2012-11-19 2014-05-22 Etiometry Llc User interface for patient risk analysis systems
EP2919644A4 (en) * 2012-11-19 2016-09-14 Etiometry Inc User interface for patient risk analysis systems
EP3767636A1 (en) * 2012-11-19 2021-01-20 Etiometry Inc. User interface for patient risk analysis system
US10881784B2 (en) 2013-01-28 2021-01-05 Smiths Medical Asd, Inc. Medication safety devices and methods
US10682460B2 (en) 2013-01-28 2020-06-16 Smiths Medical Asd, Inc. Medication safety devices and methods
JP2014179091A (en) * 2013-03-14 2014-09-25 Depuy Synthes Products Llc Methods, systems, and devices for monitoring and displaying medical parameters for patient
EP2777488A1 (en) * 2013-03-14 2014-09-17 Depuy Synthes Products, Inc. Methods and systems for displaying medical parameters of a patient
AU2014201281B2 (en) * 2013-03-14 2018-03-15 Integra Lifesciences Corporation Methods, systems, and devices for monitoring and displaying medical parameters for a patient
US20140310584A1 (en) * 2013-04-12 2014-10-16 Fujifilm Corporation Medical care information display control apparatus, medical care information display control method, and medical care information display control program
US9742713B2 (en) 2013-05-30 2017-08-22 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US11134046B2 (en) 2013-05-30 2021-09-28 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US10987026B2 (en) 2013-05-30 2021-04-27 Spacelabs Healthcare Llc Capnography module with automatic switching between mainstream and sidestream monitoring
US11115361B2 (en) 2013-05-30 2021-09-07 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US10439972B1 (en) 2013-05-30 2019-10-08 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US11509618B2 (en) 2013-05-30 2022-11-22 Snap Inc. Maintaining a message thread with opt-in permanence for entries
US10587552B1 (en) 2013-05-30 2020-03-10 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US9705831B2 (en) 2013-05-30 2017-07-11 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
EP2869228A1 (en) * 2013-10-29 2015-05-06 Nihon Kohden Corporation Biological information monitor apparatus and central monitor
US9083770B1 (en) 2013-11-26 2015-07-14 Snapchat, Inc. Method and system for integrating real time communication features in applications
US9794303B1 (en) 2013-11-26 2017-10-17 Snap Inc. Method and system for integrating real time communication features in applications
US11102253B2 (en) 2013-11-26 2021-08-24 Snap Inc. Method and system for integrating real time communication features in applications
US10069876B1 (en) 2013-11-26 2018-09-04 Snap Inc. Method and system for integrating real time communication features in applications
US10681092B1 (en) 2013-11-26 2020-06-09 Snap Inc. Method and system for integrating real time communication features in applications
US11546388B2 (en) 2013-11-26 2023-01-03 Snap Inc. Method and system for integrating real time communication features in applications
US9936030B2 (en) 2014-01-03 2018-04-03 Investel Capital Corporation User content sharing system and method with location-based external content integration
US9866999B1 (en) 2014-01-12 2018-01-09 Investment Asset Holdings Llc Location-based messaging
US10080102B1 (en) 2014-01-12 2018-09-18 Investment Asset Holdings Llc Location-based messaging
US10349209B1 (en) 2014-01-12 2019-07-09 Investment Asset Holdings Llc Location-based messaging
US11463393B2 (en) 2014-02-21 2022-10-04 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US10949049B1 (en) 2014-02-21 2021-03-16 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US10958605B1 (en) 2014-02-21 2021-03-23 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US11463394B2 (en) 2014-02-21 2022-10-04 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US10082926B1 (en) 2014-02-21 2018-09-25 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US11902235B2 (en) 2014-02-21 2024-02-13 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US10084735B1 (en) 2014-02-21 2018-09-25 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US9237202B1 (en) 2014-03-07 2016-01-12 Snapchat, Inc. Content delivery network for ephemeral objects
US9407712B1 (en) 2014-03-07 2016-08-02 Snapchat, Inc. Content delivery network for ephemeral objects
US11743219B2 (en) 2014-05-09 2023-08-29 Snap Inc. Dynamic configuration of application component tiles
US10817156B1 (en) 2014-05-09 2020-10-27 Snap Inc. Dynamic configuration of application component tiles
US11310183B2 (en) 2014-05-09 2022-04-19 Snap Inc. Dynamic configuration of application component tiles
US9276886B1 (en) 2014-05-09 2016-03-01 Snapchat, Inc. Apparatus and method for dynamically configuring application component tiles
US20150339447A1 (en) * 2014-05-22 2015-11-26 Fujifilm Corporation Medical assistance device, operation method of medical assistance device, non-transitory computer-readable recording medium, and medical assistance system
US9396354B1 (en) 2014-05-28 2016-07-19 Snapchat, Inc. Apparatus and method for automated privacy protection in distributed images
US10572681B1 (en) 2014-05-28 2020-02-25 Snap Inc. Apparatus and method for automated privacy protection in distributed images
US9785796B1 (en) 2014-05-28 2017-10-10 Snap Inc. Apparatus and method for automated privacy protection in distributed images
US10990697B2 (en) 2014-05-28 2021-04-27 Snap Inc. Apparatus and method for automated privacy protection in distributed images
US11625443B2 (en) 2014-06-05 2023-04-11 Snap Inc. Web document enhancement
US11921805B2 (en) 2014-06-05 2024-03-05 Snap Inc. Web document enhancement
US10659914B1 (en) 2014-06-13 2020-05-19 Snap Inc. Geo-location based event gallery
US9532171B2 (en) 2014-06-13 2016-12-27 Snap Inc. Geo-location based event gallery
US10623891B2 (en) 2014-06-13 2020-04-14 Snap Inc. Prioritization of messages within a message collection
US10182311B2 (en) 2014-06-13 2019-01-15 Snap Inc. Prioritization of messages within a message collection
US10779113B2 (en) 2014-06-13 2020-09-15 Snap Inc. Prioritization of messages within a message collection
US11317240B2 (en) 2014-06-13 2022-04-26 Snap Inc. Geo-location based event gallery
US9094137B1 (en) 2014-06-13 2015-07-28 Snapchat, Inc. Priority based placement of messages in a geo-location based event gallery
US10524087B1 (en) 2014-06-13 2019-12-31 Snap Inc. Message destination list mechanism
US9825898B2 (en) 2014-06-13 2017-11-21 Snap Inc. Prioritization of messages within a message collection
US9430783B1 (en) 2014-06-13 2016-08-30 Snapchat, Inc. Prioritization of messages within gallery
US9693191B2 (en) 2014-06-13 2017-06-27 Snap Inc. Prioritization of messages within gallery
US11166121B2 (en) 2014-06-13 2021-11-02 Snap Inc. Prioritization of messages within a message collection
US9113301B1 (en) 2014-06-13 2015-08-18 Snapchat, Inc. Geo-location based event gallery
US10200813B1 (en) 2014-06-13 2019-02-05 Snap Inc. Geo-location based event gallery
US10448201B1 (en) 2014-06-13 2019-10-15 Snap Inc. Prioritization of messages within a message collection
US11122200B2 (en) 2014-07-07 2021-09-14 Snap Inc. Supplying content aware photo filters
US11595569B2 (en) 2014-07-07 2023-02-28 Snap Inc. Supplying content aware photo filters
US10432850B1 (en) 2014-07-07 2019-10-01 Snap Inc. Apparatus and method for supplying content aware photo filters
US11849214B2 (en) 2014-07-07 2023-12-19 Snap Inc. Apparatus and method for supplying content aware photo filters
US11496673B1 (en) 2014-07-07 2022-11-08 Snap Inc. Apparatus and method for supplying content aware photo filters
US9225897B1 (en) 2014-07-07 2015-12-29 Snapchat, Inc. Apparatus and method for supplying content aware photo filters
US10602057B1 (en) 2014-07-07 2020-03-24 Snap Inc. Supplying content aware photo filters
US10701262B1 (en) 2014-07-07 2020-06-30 Snap Inc. Apparatus and method for supplying content aware photo filters
US9407816B1 (en) 2014-07-07 2016-08-02 Snapchat, Inc. Apparatus and method for supplying content aware photo filters
US10348960B1 (en) 2014-07-07 2019-07-09 Snap Inc. Apparatus and method for supplying content aware photo filters
US10154192B1 (en) 2014-07-07 2018-12-11 Snap Inc. Apparatus and method for supplying content aware photo filters
US10055717B1 (en) 2014-08-22 2018-08-21 Snap Inc. Message processor with application prompts
US11017363B1 (en) 2014-08-22 2021-05-25 Snap Inc. Message processor with application prompts
US10423983B2 (en) 2014-09-16 2019-09-24 Snap Inc. Determining targeting information based on a predictive targeting model
US11625755B1 (en) 2014-09-16 2023-04-11 Foursquare Labs, Inc. Determining targeting information based on a predictive targeting model
US11281701B2 (en) 2014-09-18 2022-03-22 Snap Inc. Geolocation-based pictographs
US10824654B2 (en) 2014-09-18 2020-11-03 Snap Inc. Geolocation-based pictographs
US11741136B2 (en) 2014-09-18 2023-08-29 Snap Inc. Geolocation-based pictographs
US11216869B2 (en) 2014-09-23 2022-01-04 Snap Inc. User interface to augment an image using geolocation
US11012398B1 (en) 2014-10-02 2021-05-18 Snap Inc. Ephemeral message gallery user interface with screenshot messages
US20170374003A1 (en) 2014-10-02 2017-12-28 Snapchat, Inc. Ephemeral gallery of ephemeral messages
US9537811B2 (en) 2014-10-02 2017-01-03 Snap Inc. Ephemeral gallery of ephemeral messages
US11855947B1 (en) 2014-10-02 2023-12-26 Snap Inc. Gallery of ephemeral messages
US10284508B1 (en) 2014-10-02 2019-05-07 Snap Inc. Ephemeral gallery of ephemeral messages with opt-in permanence
US11038829B1 (en) 2014-10-02 2021-06-15 Snap Inc. Ephemeral gallery of ephemeral messages with opt-in permanence
US11522822B1 (en) 2014-10-02 2022-12-06 Snap Inc. Ephemeral gallery elimination based on gallery and message timers
US10708210B1 (en) 2014-10-02 2020-07-07 Snap Inc. Multi-user ephemeral message gallery
US10944710B1 (en) 2014-10-02 2021-03-09 Snap Inc. Ephemeral gallery user interface with remaining gallery time indication
US11411908B1 (en) 2014-10-02 2022-08-09 Snap Inc. Ephemeral message gallery user interface with online viewing history indicia
US10958608B1 (en) 2014-10-02 2021-03-23 Snap Inc. Ephemeral gallery of visual media messages
US10476830B2 (en) 2014-10-02 2019-11-12 Snap Inc. Ephemeral gallery of ephemeral messages
US11190679B2 (en) 2014-11-12 2021-11-30 Snap Inc. Accessing media at a geographic location
US9843720B1 (en) 2014-11-12 2017-12-12 Snap Inc. User interface for accessing media at a geographic location
US10616476B1 (en) 2014-11-12 2020-04-07 Snap Inc. User interface for accessing media at a geographic location
US11956533B2 (en) 2014-11-12 2024-04-09 Snap Inc. Accessing media at a geographic location
US10311916B2 (en) 2014-12-19 2019-06-04 Snap Inc. Gallery of videos set to an audio time line
US9854219B2 (en) 2014-12-19 2017-12-26 Snap Inc. Gallery of videos set to an audio time line
US11783862B2 (en) 2014-12-19 2023-10-10 Snap Inc. Routing messages by message parameter
US11803345B2 (en) 2014-12-19 2023-10-31 Snap Inc. Gallery of messages from individuals with a shared interest
US10514876B2 (en) 2014-12-19 2019-12-24 Snap Inc. Gallery of messages from individuals with a shared interest
US11372608B2 (en) 2014-12-19 2022-06-28 Snap Inc. Gallery of messages from individuals with a shared interest
US9385983B1 (en) 2014-12-19 2016-07-05 Snapchat, Inc. Gallery of messages from individuals with a shared interest
US11250887B2 (en) 2014-12-19 2022-02-15 Snap Inc. Routing messages by message parameter
US10811053B2 (en) 2014-12-19 2020-10-20 Snap Inc. Routing messages by message parameter
US10580458B2 (en) 2014-12-19 2020-03-03 Snap Inc. Gallery of videos set to an audio time line
US10380720B1 (en) 2015-01-09 2019-08-13 Snap Inc. Location-based image filters
US11301960B2 (en) 2015-01-09 2022-04-12 Snap Inc. Object recognition based image filters
US11734342B2 (en) 2015-01-09 2023-08-22 Snap Inc. Object recognition based image overlays
US10157449B1 (en) 2015-01-09 2018-12-18 Snap Inc. Geo-location-based image filters
US11388226B1 (en) 2015-01-13 2022-07-12 Snap Inc. Guided personal identity based actions
US10133705B1 (en) 2015-01-19 2018-11-20 Snap Inc. Multichannel system
US10416845B1 (en) 2015-01-19 2019-09-17 Snap Inc. Multichannel system
US11249617B1 (en) 2015-01-19 2022-02-15 Snap Inc. Multichannel system
US10536800B1 (en) 2015-01-26 2020-01-14 Snap Inc. Content request by location
US11910267B2 (en) 2015-01-26 2024-02-20 Snap Inc. Content request by location
US10123166B2 (en) 2015-01-26 2018-11-06 Snap Inc. Content request by location
US10932085B1 (en) 2015-01-26 2021-02-23 Snap Inc. Content request by location
US11528579B2 (en) 2015-01-26 2022-12-13 Snap Inc. Content request by location
US10223397B1 (en) 2015-03-13 2019-03-05 Snap Inc. Social graph based co-location of network users
US10616239B2 (en) 2015-03-18 2020-04-07 Snap Inc. Geo-fence authorization provisioning
US10893055B2 (en) 2015-03-18 2021-01-12 Snap Inc. Geo-fence authorization provisioning
US11902287B2 (en) 2015-03-18 2024-02-13 Snap Inc. Geo-fence authorization provisioning
US11662576B2 (en) 2015-03-23 2023-05-30 Snap Inc. Reducing boot time and power consumption in displaying data content
US10948717B1 (en) 2015-03-23 2021-03-16 Snap Inc. Reducing boot time and power consumption in wearable display systems
US11320651B2 (en) 2015-03-23 2022-05-03 Snap Inc. Reducing boot time and power consumption in displaying data content
US10135949B1 (en) 2015-05-05 2018-11-20 Snap Inc. Systems and methods for story and sub-story navigation
US11392633B2 (en) 2015-05-05 2022-07-19 Snap Inc. Systems and methods for automated local story generation and curation
US11496544B2 (en) 2015-05-05 2022-11-08 Snap Inc. Story and sub-story navigation
US10592574B2 (en) 2015-05-05 2020-03-17 Snap Inc. Systems and methods for automated local story generation and curation
US11449539B2 (en) 2015-05-05 2022-09-20 Snap Inc. Automated local story generation and curation
US10911575B1 (en) 2015-05-05 2021-02-02 Snap Inc. Systems and methods for story and sub-story navigation
JP2018521714A (en) * 2015-05-26 2018-08-09 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Device, system and method for visualization of patient related data
US10993069B2 (en) 2015-07-16 2021-04-27 Snap Inc. Dynamically adaptive media content delivery
US20170027455A1 (en) * 2015-07-27 2017-02-02 Nihon Kohden Corporation Vital signs information measuring apparatus and vital signs information measuring method
US10817898B2 (en) 2015-08-13 2020-10-27 Placed, Llc Determining exposures to content presented by physical objects
US11315331B2 (en) 2015-10-30 2022-04-26 Snap Inc. Image based tracking in augmented reality systems
US10366543B1 (en) 2015-10-30 2019-07-30 Snap Inc. Image based tracking in augmented reality systems
US11769307B2 (en) 2015-10-30 2023-09-26 Snap Inc. Image based tracking in augmented reality systems
US10733802B2 (en) 2015-10-30 2020-08-04 Snap Inc. Image based tracking in augmented reality systems
US10474321B2 (en) 2015-11-30 2019-11-12 Snap Inc. Network resource location linking and visual content sharing
US10997783B2 (en) 2015-11-30 2021-05-04 Snap Inc. Image and point cloud based tracking and in augmented reality systems
US11380051B2 (en) 2015-11-30 2022-07-05 Snap Inc. Image and point cloud based tracking and in augmented reality systems
US11599241B2 (en) 2015-11-30 2023-03-07 Snap Inc. Network resource location linking and visual content sharing
US10997758B1 (en) 2015-12-18 2021-05-04 Snap Inc. Media overlay publication system
US11468615B2 (en) 2015-12-18 2022-10-11 Snap Inc. Media overlay publication system
US11830117B2 (en) 2015-12-18 2023-11-28 Snap Inc Media overlay publication system
US10354425B2 (en) 2015-12-18 2019-07-16 Snap Inc. Method and system for providing context relevant media augmentation
US20170172492A1 (en) * 2015-12-21 2017-06-22 Nihon Kohden Corporation Muscular relaxation monitoring device, muscular relaxation monitoring method and muscular relaxation monitoring program
EP3398157A4 (en) * 2015-12-31 2019-11-27 Saiph Technology, LLC. System for acquisition, processing and visualization of clinical data of patients
US20180286500A1 (en) * 2015-12-31 2018-10-04 Alberto SOLE GUERRA System for acquisition, processing and visualization of clinical data of patients
WO2017128620A1 (en) * 2016-01-26 2017-08-03 深圳市科曼医疗设备有限公司 Multi-bed monitoring interface waveform display method and system
CN105726131A (en) * 2016-01-26 2016-07-06 深圳市科曼医疗设备有限公司 Multi-bed monitoring interface waveform display method and system
US11889381B2 (en) 2016-02-26 2024-01-30 Snap Inc. Generation, curation, and presentation of media collections
US11197123B2 (en) 2016-02-26 2021-12-07 Snap Inc. Generation, curation, and presentation of media collections
US10679389B2 (en) 2016-02-26 2020-06-09 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US11611846B2 (en) 2016-02-26 2023-03-21 Snap Inc. Generation, curation, and presentation of media collections
US11023514B2 (en) 2016-02-26 2021-06-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US10834525B2 (en) 2016-02-26 2020-11-10 Snap Inc. Generation, curation, and presentation of media collections
US11631276B2 (en) 2016-03-31 2023-04-18 Snap Inc. Automated avatar generation
US11085984B2 (en) 2016-04-03 2021-08-10 Q Bio, Inc. Tensor field mapping
US11900418B2 (en) 2016-04-04 2024-02-13 Snap Inc. Mutable geo-fencing system
US10416865B2 (en) * 2016-05-19 2019-09-17 Welch Allyn, Inc. Medical device with enhanced user interface controls
US10839219B1 (en) 2016-06-20 2020-11-17 Pipbin, Inc. System for curation, distribution and display of location-dependent augmented reality content
US11785161B1 (en) 2016-06-20 2023-10-10 Pipbin, Inc. System for user accessibility of tagged curated augmented reality content
US10992836B2 (en) 2016-06-20 2021-04-27 Pipbin, Inc. Augmented property system of curated augmented reality media elements
US11876941B1 (en) 2016-06-20 2024-01-16 Pipbin, Inc. Clickable augmented reality content manager, system, and network
US10805696B1 (en) 2016-06-20 2020-10-13 Pipbin, Inc. System for recording and targeting tagged content of user interest
US11044393B1 (en) 2016-06-20 2021-06-22 Pipbin, Inc. System for curation and display of location-dependent augmented reality content in an augmented estate system
US10638256B1 (en) 2016-06-20 2020-04-28 Pipbin, Inc. System for distribution and display of mobile targeted augmented reality content
US11201981B1 (en) 2016-06-20 2021-12-14 Pipbin, Inc. System for notification of user accessibility of curated location-dependent content in an augmented estate
JP2017228099A (en) * 2016-06-23 2017-12-28 コニカミノルタ株式会社 Patient information display system and patient information display method
US10885559B1 (en) 2016-06-28 2021-01-05 Snap Inc. Generation, curation, and presentation of media collections with automated advertising
US10735892B2 (en) 2016-06-28 2020-08-04 Snap Inc. System to track engagement of media items
US10785597B2 (en) 2016-06-28 2020-09-22 Snap Inc. System to track engagement of media items
US10430838B1 (en) 2016-06-28 2019-10-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections with automated advertising
US11445326B2 (en) 2016-06-28 2022-09-13 Snap Inc. Track engagement of media items
US11640625B2 (en) 2016-06-28 2023-05-02 Snap Inc. Generation, curation, and presentation of media collections with automated advertising
US10506371B2 (en) 2016-06-28 2019-12-10 Snap Inc. System to track engagement of media items
US10219110B2 (en) 2016-06-28 2019-02-26 Snap Inc. System to track engagement of media items
US10327100B1 (en) 2016-06-28 2019-06-18 Snap Inc. System to track engagement of media items
US10165402B1 (en) 2016-06-28 2018-12-25 Snap Inc. System to track engagement of media items
US11895068B2 (en) 2016-06-30 2024-02-06 Snap Inc. Automated content curation and communication
US10387514B1 (en) 2016-06-30 2019-08-20 Snap Inc. Automated content curation and communication
US11080351B1 (en) 2016-06-30 2021-08-03 Snap Inc. Automated content curation and communication
US10348662B2 (en) 2016-07-19 2019-07-09 Snap Inc. Generating customized electronic messaging graphics
US11509615B2 (en) 2016-07-19 2022-11-22 Snap Inc. Generating customized electronic messaging graphics
US11816853B2 (en) 2016-08-30 2023-11-14 Snap Inc. Systems and methods for simultaneous localization and mapping
US11876762B1 (en) 2016-10-24 2024-01-16 Snap Inc. Generating and displaying customized avatars in media overlays
US11843456B2 (en) 2016-10-24 2023-12-12 Snap Inc. Generating and displaying customized avatars in media overlays
US10623666B2 (en) 2016-11-07 2020-04-14 Snap Inc. Selective identification and order of image modifiers
US11750767B2 (en) 2016-11-07 2023-09-05 Snap Inc. Selective identification and order of image modifiers
US11233952B2 (en) 2016-11-07 2022-01-25 Snap Inc. Selective identification and order of image modifiers
US11397517B2 (en) 2016-12-09 2022-07-26 Snap Inc. Customized media overlays
US10754525B1 (en) 2016-12-09 2020-08-25 Snap Inc. Customized media overlays
US10203855B2 (en) 2016-12-09 2019-02-12 Snap Inc. Customized user-controlled media overlays
US11616745B2 (en) 2017-01-09 2023-03-28 Snap Inc. Contextual generation and selection of customized media content
US11870743B1 (en) 2017-01-23 2024-01-09 Snap Inc. Customized digital avatar accessories
US10915911B2 (en) 2017-02-03 2021-02-09 Snap Inc. System to determine a price-schedule to distribute media content
US11720640B2 (en) 2017-02-17 2023-08-08 Snap Inc. Searching social media content
US10319149B1 (en) 2017-02-17 2019-06-11 Snap Inc. Augmented reality anamorphosis system
US11250075B1 (en) 2017-02-17 2022-02-15 Snap Inc. Searching social media content
US11861795B1 (en) 2017-02-17 2024-01-02 Snap Inc. Augmented reality anamorphosis system
US11748579B2 (en) 2017-02-20 2023-09-05 Snap Inc. Augmented reality speech balloon system
US11189299B1 (en) 2017-02-20 2021-11-30 Snap Inc. Augmented reality speech balloon system
US11037372B2 (en) 2017-03-06 2021-06-15 Snap Inc. Virtual vision system
US11670057B2 (en) 2017-03-06 2023-06-06 Snap Inc. Virtual vision system
US11258749B2 (en) 2017-03-09 2022-02-22 Snap Inc. Restricted group content collection
US10523625B1 (en) 2017-03-09 2019-12-31 Snap Inc. Restricted group content collection
US10887269B1 (en) 2017-03-09 2021-01-05 Snap Inc. Restricted group content collection
US10936180B2 (en) * 2017-03-16 2021-03-02 Q Bio, Inc. User interface for medical information
US20180267700A1 (en) * 2017-03-16 2018-09-20 Q Bio, Inc User interface for medical information
US10581782B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US10582277B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US11558678B2 (en) 2017-03-27 2023-01-17 Snap Inc. Generating a stitched data stream
US11349796B2 (en) 2017-03-27 2022-05-31 Snap Inc. Generating a stitched data stream
US11297399B1 (en) 2017-03-27 2022-04-05 Snap Inc. Generating a stitched data stream
US11170393B1 (en) 2017-04-11 2021-11-09 Snap Inc. System to calculate an engagement score of location based media content
US11195018B1 (en) 2017-04-20 2021-12-07 Snap Inc. Augmented reality typography personalization system
US10387730B1 (en) 2017-04-20 2019-08-20 Snap Inc. Augmented reality typography personalization system
US11556221B2 (en) 2017-04-27 2023-01-17 Snap Inc. Friend location sharing mechanism for social media platforms
US11451956B1 (en) 2017-04-27 2022-09-20 Snap Inc. Location privacy management on map-based social media platforms
US11842411B2 (en) 2017-04-27 2023-12-12 Snap Inc. Location-based virtual avatars
US11474663B2 (en) 2017-04-27 2022-10-18 Snap Inc. Location-based search mechanism in a graphical user interface
US11418906B2 (en) 2017-04-27 2022-08-16 Snap Inc. Selective location-based identity communication
US10952013B1 (en) 2017-04-27 2021-03-16 Snap Inc. Selective location-based identity communication
US10963529B1 (en) 2017-04-27 2021-03-30 Snap Inc. Location-based search mechanism in a graphical user interface
US11392264B1 (en) 2017-04-27 2022-07-19 Snap Inc. Map-based graphical user interface for multi-type social media galleries
US11409407B2 (en) 2017-04-27 2022-08-09 Snap Inc. Map-based graphical user interface indicating geospatial activity metrics
US11782574B2 (en) 2017-04-27 2023-10-10 Snap Inc. Map-based graphical user interface indicating geospatial activity metrics
US11385763B2 (en) 2017-04-27 2022-07-12 Snap Inc. Map-based graphical user interface indicating geospatial activity metrics
US11232040B1 (en) 2017-04-28 2022-01-25 Snap Inc. Precaching unlockable data elements
US11675831B2 (en) 2017-05-31 2023-06-13 Snap Inc. Geolocation based playlists
US11475254B1 (en) 2017-09-08 2022-10-18 Snap Inc. Multimodal entity identification
US10740974B1 (en) 2017-09-15 2020-08-11 Snap Inc. Augmented reality system
US11335067B2 (en) 2017-09-15 2022-05-17 Snap Inc. Augmented reality system
US11721080B2 (en) 2017-09-15 2023-08-08 Snap Inc. Augmented reality system
US11006242B1 (en) 2017-10-09 2021-05-11 Snap Inc. Context sensitive presentation of content
US11617056B2 (en) 2017-10-09 2023-03-28 Snap Inc. Context sensitive presentation of content
US10499191B1 (en) 2017-10-09 2019-12-03 Snap Inc. Context sensitive presentation of content
US11670025B2 (en) 2017-10-30 2023-06-06 Snap Inc. Mobile-based cartographic control of display content
US11030787B2 (en) 2017-10-30 2021-06-08 Snap Inc. Mobile-based cartographic control of display content
US11943185B2 (en) 2017-12-01 2024-03-26 Snap Inc. Dynamic media overlay with smart widget
US11558327B2 (en) 2017-12-01 2023-01-17 Snap Inc. Dynamic media overlay with smart widget
US11265273B1 (en) 2017-12-01 2022-03-01 Snap, Inc. Dynamic media overlay with smart widget
US11017173B1 (en) 2017-12-22 2021-05-25 Snap Inc. Named entity recognition visual context and caption data
US11687720B2 (en) 2017-12-22 2023-06-27 Snap Inc. Named entity recognition visual context and caption data
US11487794B2 (en) 2018-01-03 2022-11-01 Snap Inc. Tag distribution visualization system
US10678818B2 (en) 2018-01-03 2020-06-09 Snap Inc. Tag distribution visualization system
US11507614B1 (en) 2018-02-13 2022-11-22 Snap Inc. Icon based tagging
US11841896B2 (en) 2018-02-13 2023-12-12 Snap Inc. Icon based tagging
US11523159B2 (en) 2018-02-28 2022-12-06 Snap Inc. Generating media content items based on location information
US10885136B1 (en) 2018-02-28 2021-01-05 Snap Inc. Audience filtering system
US10979752B1 (en) 2018-02-28 2021-04-13 Snap Inc. Generating media content items based on location information
US10524088B2 (en) 2018-03-06 2019-12-31 Snap Inc. Geo-fence selection system
US11722837B2 (en) 2018-03-06 2023-08-08 Snap Inc. Geo-fence selection system
US11044574B2 (en) 2018-03-06 2021-06-22 Snap Inc. Geo-fence selection system
US10327096B1 (en) 2018-03-06 2019-06-18 Snap Inc. Geo-fence selection system
US11570572B2 (en) 2018-03-06 2023-01-31 Snap Inc. Geo-fence selection system
US10933311B2 (en) 2018-03-14 2021-03-02 Snap Inc. Generating collectible items based on location information
US11163941B1 (en) 2018-03-30 2021-11-02 Snap Inc. Annotating a collection of media content items
US10219111B1 (en) 2018-04-18 2019-02-26 Snap Inc. Visitation tracking system
US11297463B2 (en) 2018-04-18 2022-04-05 Snap Inc. Visitation tracking system
US10779114B2 (en) 2018-04-18 2020-09-15 Snap Inc. Visitation tracking system
US10924886B2 (en) 2018-04-18 2021-02-16 Snap Inc. Visitation tracking system
US11683657B2 (en) 2018-04-18 2023-06-20 Snap Inc. Visitation tracking system
US10448199B1 (en) 2018-04-18 2019-10-15 Snap Inc. Visitation tracking system
US10681491B1 (en) 2018-04-18 2020-06-09 Snap Inc. Visitation tracking system
US11860888B2 (en) 2018-05-22 2024-01-02 Snap Inc. Event detection system
US10679393B2 (en) 2018-07-24 2020-06-09 Snap Inc. Conditional modification of augmented reality object
US11670026B2 (en) 2018-07-24 2023-06-06 Snap Inc. Conditional modification of augmented reality object
US11367234B2 (en) 2018-07-24 2022-06-21 Snap Inc. Conditional modification of augmented reality object
US10943381B2 (en) 2018-07-24 2021-03-09 Snap Inc. Conditional modification of augmented reality object
US10789749B2 (en) 2018-07-24 2020-09-29 Snap Inc. Conditional modification of augmented reality object
US11676319B2 (en) 2018-08-31 2023-06-13 Snap Inc. Augmented reality anthropomorphtzation system
US10997760B2 (en) 2018-08-31 2021-05-04 Snap Inc. Augmented reality anthropomorphization system
US11450050B2 (en) 2018-08-31 2022-09-20 Snap Inc. Augmented reality anthropomorphization system
CN112753076A (en) * 2018-09-24 2021-05-04 皇家飞利浦有限公司 Medical monitoring system
US11704005B2 (en) 2018-09-28 2023-07-18 Snap Inc. Collaborative achievement interface
US11455082B2 (en) 2018-09-28 2022-09-27 Snap Inc. Collaborative achievement interface
US11799811B2 (en) 2018-10-31 2023-10-24 Snap Inc. Messaging and gaming applications communication platform
US11199957B1 (en) 2018-11-30 2021-12-14 Snap Inc. Generating customized avatars based on location information
US11698722B2 (en) 2018-11-30 2023-07-11 Snap Inc. Generating customized avatars based on location information
US11812335B2 (en) 2018-11-30 2023-11-07 Snap Inc. Position service to determine relative position to map features
US11558709B2 (en) 2018-11-30 2023-01-17 Snap Inc. Position service to determine relative position to map features
US20200170582A1 (en) * 2018-11-30 2020-06-04 Covidien Lp Contextual patient data representation and display
CN113597643A (en) * 2018-12-24 2021-11-02 中国医学科学院北京协和医院 Medical advice tool display method for medical equipment and medical equipment
US11877211B2 (en) 2019-01-14 2024-01-16 Snap Inc. Destination sharing in location sharing system
US11751015B2 (en) 2019-01-16 2023-09-05 Snap Inc. Location-based context information sharing in a messaging system
US11294936B1 (en) 2019-01-30 2022-04-05 Snap Inc. Adaptive spatial density based clustering
US11693887B2 (en) 2019-01-30 2023-07-04 Snap Inc. Adaptive spatial density based clustering
US11809624B2 (en) 2019-02-13 2023-11-07 Snap Inc. Sleep detection in a location sharing system
US11748642B2 (en) 2019-02-15 2023-09-05 Q Bio, Inc. Model parameter determination using a predictive model
US11500525B2 (en) 2019-02-25 2022-11-15 Snap Inc. Custom media overlay system
US11954314B2 (en) 2019-02-25 2024-04-09 Snap Inc. Custom media overlay system
US11574431B2 (en) 2019-02-26 2023-02-07 Snap Inc. Avatar based on weather
US11301117B2 (en) 2019-03-08 2022-04-12 Snap Inc. Contextual information in chat
US11868414B1 (en) 2019-03-14 2024-01-09 Snap Inc. Graph-based prediction for contact suggestion in a location sharing system
US11852554B1 (en) 2019-03-21 2023-12-26 Snap Inc. Barometer calibration in a location sharing system
US11249614B2 (en) 2019-03-28 2022-02-15 Snap Inc. Generating personalized map interface with enhanced icons
US11740760B2 (en) 2019-03-28 2023-08-29 Snap Inc. Generating personalized map interface with enhanced icons
US11361493B2 (en) 2019-04-01 2022-06-14 Snap Inc. Semantic texture mapping system
US20230070694A1 (en) * 2019-04-10 2023-03-09 Imam Abdulrahman Bin Faisal University Method to restore loss of feeling in a foot of a person
US11785549B2 (en) 2019-05-30 2023-10-10 Snap Inc. Wearable device location systems
US11206615B2 (en) 2019-05-30 2021-12-21 Snap Inc. Wearable device location systems
US11606755B2 (en) 2019-05-30 2023-03-14 Snap Inc. Wearable device location systems architecture
US11601783B2 (en) 2019-06-07 2023-03-07 Snap Inc. Detection of a physical collision between two client devices in a location sharing system
US11917495B2 (en) 2019-06-07 2024-02-27 Snap Inc. Detection of a physical collision between two client devices in a location sharing system
US11714535B2 (en) 2019-07-11 2023-08-01 Snap Inc. Edge gesture interface with smart interactions
US11424025B2 (en) * 2019-08-30 2022-08-23 GE Precision Healthcare LLC Systems and methods for medical device monitoring
US11821742B2 (en) 2019-09-26 2023-11-21 Snap Inc. Travel based notifications
US11614509B2 (en) 2019-09-27 2023-03-28 Q Bio, Inc. Maxwell parallel imaging
US11131735B2 (en) 2019-09-27 2021-09-28 Q Bio, Inc. Maxwell parallel imaging
US11218838B2 (en) 2019-10-31 2022-01-04 Snap Inc. Focused map-based context information surfacing
US11429618B2 (en) 2019-12-30 2022-08-30 Snap Inc. Surfacing augmented reality objects
US11128715B1 (en) 2019-12-30 2021-09-21 Snap Inc. Physical friend proximity in chat
US11729343B2 (en) 2019-12-30 2023-08-15 Snap Inc. Including video feed in message thread
US11943303B2 (en) 2019-12-31 2024-03-26 Snap Inc. Augmented reality objects registry
US11893208B2 (en) 2019-12-31 2024-02-06 Snap Inc. Combined map icon with action indicator
US11343323B2 (en) 2019-12-31 2022-05-24 Snap Inc. Augmented reality objects registry
US11228551B1 (en) 2020-02-12 2022-01-18 Snap Inc. Multiple gateway message exchange
US11888803B2 (en) 2020-02-12 2024-01-30 Snap Inc. Multiple gateway message exchange
US11765117B2 (en) 2020-03-05 2023-09-19 Snap Inc. Storing data based on device location
US11516167B2 (en) 2020-03-05 2022-11-29 Snap Inc. Storing data based on device location
US11619501B2 (en) 2020-03-11 2023-04-04 Snap Inc. Avatar based on trip
US11430091B2 (en) 2020-03-27 2022-08-30 Snap Inc. Location mapping for large scale augmented-reality
US11776256B2 (en) 2020-03-27 2023-10-03 Snap Inc. Shared augmented reality system
US11915400B2 (en) 2020-03-27 2024-02-27 Snap Inc. Location mapping for large scale augmented-reality
US11290851B2 (en) 2020-06-15 2022-03-29 Snap Inc. Location sharing using offline and online objects
US11314776B2 (en) 2020-06-15 2022-04-26 Snap Inc. Location sharing using friend list versions
US11483267B2 (en) 2020-06-15 2022-10-25 Snap Inc. Location sharing using different rate-limited links
US11503432B2 (en) 2020-06-15 2022-11-15 Snap Inc. Scalable real-time location sharing framework
US11676378B2 (en) 2020-06-29 2023-06-13 Snap Inc. Providing travel-based augmented reality content with a captured image
US11943192B2 (en) 2020-08-31 2024-03-26 Snap Inc. Co-location connection service
USD973072S1 (en) * 2020-09-30 2022-12-20 Masimo Corporation Display screen or portion thereof with graphical user interface
US11961116B2 (en) 2020-10-26 2024-04-16 Foursquare Labs, Inc. Determining exposures to content presented by physical objects
US11601888B2 (en) 2021-03-29 2023-03-07 Snap Inc. Determining location using multi-source geolocation data
US11902902B2 (en) 2021-03-29 2024-02-13 Snap Inc. Scheduling requests for location data
US11606756B2 (en) 2021-03-29 2023-03-14 Snap Inc. Scheduling requests for location data
US11645324B2 (en) 2021-03-31 2023-05-09 Snap Inc. Location-based timeline media content system
US11614508B1 (en) 2021-10-25 2023-03-28 Q Bio, Inc. Sparse representation of measurements
US11829834B2 (en) 2021-10-29 2023-11-28 Snap Inc. Extended QR code
WO2023170442A3 (en) * 2022-03-01 2023-11-09 Mofaip, Llc Targeted isolation of anatomic sites for form generation and medical record generation and retrieval
US11962645B2 (en) 2022-06-02 2024-04-16 Snap Inc. Guided personal identity based actions
US11963105B2 (en) 2023-02-10 2024-04-16 Snap Inc. Wearable device location systems architecture
US11961196B2 (en) 2023-03-17 2024-04-16 Snap Inc. Virtual vision system

Also Published As

Publication number Publication date
US8645164B2 (en) 2014-02-04

Similar Documents

Publication Publication Date Title
US8645164B2 (en) Medical information visualization assistant system and method
US20200357493A1 (en) Monitoring, capturing, measuring and annotating physiological waveform data
US10541048B2 (en) System for monitoring and visualizing a patient treatment process
US11031139B2 (en) Systems and methods for conversational flexible data presentation
CA3030643C (en) User interface for configurably displaying real-time data for multiple patients
EP2441015B1 (en) Systems and methods for viewing patient data
US8310336B2 (en) Systems and methods for storing, analyzing, retrieving and displaying streaming medical data
US8956292B2 (en) Trending display of patient wellness
JP2019071084A (en) Infusion planning system
EP4022642A1 (en) Systems and methods for medical device monitoring
US20130030836A1 (en) Third-party site connections for online health care communication
CN114342000A (en) System and method for supervising graphical user interface of application
US20210407633A1 (en) System and method for tracking informal observations about a care recipient by caregivers
JP7232240B2 (en) Contextualized Patient-Specific Representations of Predictive Score Information
US20140033103A1 (en) System, method, and software for patient monitoring
Kruger et al. Advanced integrated real-time clinical displays
JP6741576B2 (en) Electrocardiogram (ECG) device including type-ahead editing function and method of operating the same
CN114341999A (en) System and method for graphical user interface for medical device trending
US8818823B2 (en) Online patient and health care provider communication
US20200176114A1 (en) System and method for providing a layer-based presentation of a model-generated patient-related prediction
CN115485004A (en) System and method for remote control of life-critical medical devices
US8930221B2 (en) Health care biometric surveillance and online provider communication
EP4184518A1 (en) Graphic user interface systems and methods for determining and displaying indicators of anesthesia adequacy
US11600397B2 (en) Systems and methods for conversational flexible data presentation
Chen et al. SEPRES: Sepsis prediction via the clinical data integration system in the ICU

Legal Events

Date Code Title Description
AS Assignment

Owner name: INDIANA UNIVERSITY RESEARCH AND TECHNOLOGY CORPORA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FAIOLA, ANTHONY;REEL/FRAME:031839/0843

Effective date: 20100909

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20220204