United Sciences In-Ear PC Patent App US 2015168996a1

111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111
us 20150168996Al
United States
(12) Patent Application Publication
(19)
SHARPE et al.
(43)
(54)
IN-EAR WEARABLE COMPUTER
(71)
Applicant: UNITED SCIENCES, LLC,

ATLANTA, GA (US)
(72)
Inventors: WESS ERIC SHARPE, VININGS, GA

(US); KAROL HATZILIAS,
ATLANTA, GA (US)
Filed:
A wearable computer including an earpiece body manufactured from an image of a user's ear, the image created from a
three dimensional ('3D') optical scan of a user's ear; one or
more sensors configured to sense information regarding the
user when the wearable computer is worn in the ear; a computer processor and memory operatively coupled to the computer processor; and a wearable computing module stored in
memory, the wearable computing module comprising a module of automated computing machinery configured to receive
the sensed information and invoke a wearable computing
action in dependence upon the sensed information.
Publication Classification
Wearable
Computer
100
ABSTRACT
(57)
Dec. 17, 2013
(51 ) Int. CI.

G06F 1116
H04R 1110
G05B 15102
G06F 21/31
G06F 3116
Pub. No.: US 2015/0168996 Al

Pub. Date:
Jun. 18,2015
G06F 3101
(2006.01)
H04R 1108
(2006.01)
(52) U.S. CI.
CPC ................ G06F 11163 (2013.01); G06F 31011
(2013.01); H04R 1110 (2013.01); H04R 1108
(2013.01); G06F 21/31 (2013.01); G06F 31165
(2013.01); G05B 15102 (2013.01); H04R
2420/07 (2013.01)
(21) App!. No.: 141109,796

(22)
(10)
(2006.01)
(2006.01)
(2006.01)
(2006.01)
(2006.01)
I
I
I
1/1
I / I
t/ I
I
I
I
I
I
I
I
104
________________ JI
Device
108
Patent Application Publication
Jun. 18,2015 Sheet 1 of 10
US 2015/0168996 A1
- - - - - - - - - - - - - - - -I
Wearable
Computer
100
I
I
I
1//
I / I
~/ I
I
I
I
I
I
I
104
________________
JI
FIG. 1
Device
108
Jun. 18,2015 Sheet 2 of 10
US 2015/0168996 A1
-,
Memory
258
Sensed /
Information
216
Authentication Module
2M
Mobile
Wireless
Adapter
Biometric
Values
1.a
Music And Entertainment

Applications
274
Speech Recognition And

Text To Speech Module
Business Transaction
Module
266
2IQ
Health And Fitness

Module
Mobile Communications
Module
268
278
256
/1
I
I Bus
I 254 -....--..
I
Processor
I
252
I
I
I
I
Situational Awareness
Module
270
Biometric Interface
Module
272
I~~ ____ - - - - - - - - - - - - - - - - - - - Memory
214
Wireless
Adapter
212
Sensed Information
216
Biometric Values
218
Wearable Computing
Module 220
Bus
_. --I- .. --- -1-----
Sensors
II
II
II
II TransducefilMicrophonell
: II 2(\2
III
204 II
~
I
II
Speaker I
I
104
206 II
I
'-
.! .. ____ .1'- ____ -IlL ___
.!
I
Sensors
104
FIG.2
Jun. 18,2015 Sheet 3 of 10
US 2015/0168996 A1
Sensors
104
Sense information Regarding The User When A Wearable Computer Is Worn in The Ear
302
Information
216
invoke A Wearable Computing Action in Dependence Upon The Sensed Information

304
Action
306
FIG.3
Jun. 18,2015 Sheet 4 of 10
US 2015/0168996 A1
Wearable
Computer
...:':::'.:~ .;~:::::~,\
1Q.Q
Sense Information Regarding The User When A Wearable Computer Is Worn In The Ear
302
Invoke A Wearable Computing Action In Dependence Upon The Sensed Information

~
Transmit The Sensed Information Wirelessly To A Mobile

Computing Device
402
Mobile
Device
108
Information
216
Action
306
FIG.4
Jun. 18,2015 Sheet 5 of 10
US 2015/0168996 A1
Wearable
Computer
100
Sense Information Regarding The User When AWearable Computer Is Worn In The Ear
302
Invoke AWearable Computing Action In Dependence Upon The Sensed Information
304
Transmit The Sensed
Information Wirelessly To A
Mobile Computing Device
502
Receive Authentication
Information Regarding The User
504
Action
306
Authentication
506
Mobile
Device
108
FIG. 5
Jun. 18,2015 Sheet 6 of 10
US 2015/0168996 A1
Wearable
Computer
100
3.Q2

~
Transmitting Sensed Audio

From The User To A Speech
Recognition Module On A
(602)
Receive An
Audio Response
606
Play The Audio Response

Through A Speaker
610
Audio 604
Action
306
Audio
Response
Mobile
Device
608
108
FIG.6
Jun. 18,2015 Sheet 7 of 10
US 2015/0168996 A1
Wearable
Computer
100
---,;:-~".'~ ~,,:;;,~\
302

~
Transmitting The Sensed

Information Wirelessly To A
Receiving Health And Fitness Information Regarding

The User Created In Dependence Upon Biometric
Values Derived From The Sensed Information
702
704
Action
306
Instruction 706
Mobile
Device
108
FIG.7
Jun. 18,2015 Sheet 8 of 10
US 2015/0168996 A1
Wearable
Computer
100
302

304
Transmit Sensed Audio
From An External
Microphone Of The
Wearable Computer To A
Situational Awareness
Module On A Mobile
Computing Device 802
Receive An Instruction To
Invoke An Internal Speaker
In The Wearable Computer;
aoo
Play Audio
Received Through
The External
Microphone
Through The
Internal Speaker
808
Audio 604
Action
306
Instruction
Mobile
Device
804
1Q.a
FIG.8
Jun. 18,2015 Sheet 9 of 10
Z"'.,:>-
US 2015/0168996 A1
Wearable
Computer
100
~;~::;~.J.,.
Sense Infurmation Regarding The User When A Wearable Computer Is Worn In The Ear
302

304
Transmit The Sensed
Information To A Biometric
Interface Module On A Mobile
Computing Device
902
Receive An Instruction To Invoke A Biometric Interface

Action In Response To A User Instruction Determined
From Biometric Values Derived From The Sense
Information 904
Action
306
Instruction 906
Mobile
Device
108
FIG.9
Jun. 18,2015 Sheet 10 of 10
US 2015/0168996 A1
Wearable
Computer
~~~;;;;;':"- ~:-:.'~~'\
100
302
Invoke AWearable Computing Action In Dependence Upon The Sensed Information
304
Receive Audio Information From An
Entertainment Application Installed
On A Mobile Computing Device
Play Audio Through The Internal

Speaker In Response To The
Received Audio Information
1002
1006
Action
Audio
Information
306
1004
Mobile
Device
108
FIG. 10
Jun. 18,2015
US 2015/0168996 Al
1
IN-EAR WEARABLE COMPUTER
BACKGROUND
[0001] Wearable computers, also known as body-borne
computers are electronic devices that are worn by a user. This
class of wearable technology has been developed for general
or special purpose information technologies and media development. Wearable computers are especially useful for applications that require more complex computational support
than just hardware coded logics.
[0002] One ofthe main features of a wearable computer is
consistency. There is a constant interaction between the computer and user and often there is no need to turn the device on
or ofT. Another feature of wearable computers is the ability to
multi-task. It is not necessary for a user to stop what she is
doing to use the wearable computer. Often wearable computers are augmented into many user actions. Such wearable
computers can be incorporated by the user to act like a prosthetic. It can therefore be an extension of the user's mind and
body.
SUMMARY
[0003] A wearable computer including an earpiece body
manufactured from an image of a user's ear, the image created
from a three dimensional ('3D') optical scan of a user's ear;
one or more sensors configured to sense information regarding the user when the wearable computer is worn in the ear; a
computer processor and memory operatively coupled to the
computer processor; and a wearable eomputing module
stored in memory, the wearable computing module comprising a module of automated computing machinery configured
to receive the sensed infonnation and invoke a wearable computing action in dependence upon the sensed infornlation.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] FIG. 1 sets forth a network diagram of a system
according to embodiments of the present invention.
[0005] FIG. 2 sets forth a system diagram according to
embodiments of the present invention.
[0006] FIG. 3 sets forth a flow chart illustrating an example
method of in-ear wearable computing.
[0007] FIG. 4 sets forth a flow chart illustrating another
example method of in-ear wearable computing.
DETAILED DESCRIPTION OF EXAMPLE
EMBODIMENTS
[0014] Example methods, wearable computers, apparatuses, and products for wearable computing in accordance
with the present invention are described with reference to the
accompanying drawings, begimling with FIG. 1. FIG. 1 sets
forth a network diagram of a system according to embodi-
ments of the present invention. The system of FIG. 1 includes

a wearable computer (100) worn in a user's ear (110) and
wirelessly comlected to a mobile device (110). The example
wearable computer (100) of FIG. 1 includes an earpiece body
(102) manufactured from an image of a user's ear (110).
Typically. such an image includes a three dimensional image
('3D') ofthe interior of the user's ear such as the ear canal. In
some embodiments, portions of the exterior of the user's ear
are also imaged. Such an image may be created from a three
dimensional ('3D') optical scan of a user's ear (110). Creating a 3D image derived from a 3D optical scan ofthe interior
of the patient's ear canal can be carried out using methods and
systems described in U.S. patent application Ser. Nos.
13/417,649; 13/417,767, 13/586,471; 13/586,411; 13/586,
459; 13/546,448; 13/586,448; 13/586,474; 14/040,973,
14/041,943; 14/049,666; 14/049,530; 14/049,687, all incorporated by reference herein in their entirety.
[0015] The wearable computer (100) of FIG. 1 also
includes one or more sensors (104) configured to sense information regarding the user (11 0) when the wearable computer
is worn in the ear. Such exemplary sensors are capable of
sensing information including electroencephalography, electromyography, electrooculography, electrocardiography,
accelerometry, reflective pulse oximetry, audio, temperature,
and other sensed information about a user that may be gathered through the ear as will occur to those of skill in the art.
Such sensed information is often used to derive biometric
values for the user useful in wearable computing according to
embodiments of the present invention such as pulse rate, body
temperature, blood oxygen level, rapid eye movement sleep,
non-rapid eye movement sleep, snoring, blood pressure,
muscle tension, eye position, brain wave activity, and other
values derived from sensed information as may occur to those
of skill in the art.
[0016] The example wearable computer (100) of FIG. 1
also includes a computer processor and memory operatively
coupled to the computer processor. The example wearable
computer also includes a wearable computing module stored
in memory, the wearable computing module comprising a
module of automated computing machinery configured to
receive the sensed information and invoke a wearable computing action in dependence upon the sensed information.
Wearable computing actions include actions carried out for
the benefit of the user wearing the wearable computer (100).
In the example of FIG. 1, such actions may be carried out with
the aid of wireless connnunications with and additional
resources provided by the mobile computing device (108).
Exanlples of wearable computing actions include authentication of the user, speech recognition, playing audio, playing
the rendering of a text-to-speech engine, transmitting or
recording biometric information for health and fitness, providing situational awareness to the user, allowing biometric
interface actions such as invoking a speech interface or using
eye movement or brain activity to control an application,
playing music and entertainment, and many other wearable
computing actions that will occur to those of skill in the art.
[0017] The mobile device (108) in the example oHIG.1 is
wirelessly coupled for data connnunications with the wearable computer (100). The mobile device (108) is itself also a
computer capable of wirelessly providing additional
resources for the wearable computing actions of the wearable
computer (100). Such additional resources allow the user to
Jun. 18,2015
US 2015/0168996 Al
2
experience the benefit of the additional computing power of
the mobile device while still wearing a comfortable custom
in-ear wearable computer.
[OOlS] For further explanation, FIG. 2 sets forth a system
diagram according to embodiments of the present invention.
The system of FIG. 2 is similar to the system of FIG. 1 in that
the system of FIG. 2 includes a wearable computer (100)
wirelessly coupled for data communications with a mobile
computing device (lOS).
includes an earpiece body (102) manufactured from an image
of a user's ear. In the example of FIG. 2, the image created
from a three dimensional ('3D') optical scan of a user's ear.
The custom fit ofthe wearable computer of FIG. 1 provides a
comfortable wearable computer that allows for hands and
eyes free action by the user.
also includes one or more sensors (104) configured to sense
information regarding the user when the wearable computer
is worn in the ear. The sensors of the example wearable
computcr (100) sense information including clectrocnccphalography, electromyography, electrooculography, electrocardiography, acccleromctry, rcflectivc pulse oximctry, audio,
temperature, and other information that will occur to those of
skill in the art. Such sensed information is often used to derive
biometric values for the user useful in wearable computing
according to embodiments of the present invention such as
pulse rate, body temperature, blood oxygen level, rapid eye
movement sleep, non-rapid eye movement sleep, snoring,
blood prcssure, muscle tension, eyc position, brain wave
activity, and other values derived from sensed information as
may occur to those of skill in the art.
also includes one or more microphones (204). The example
microphones (204) of FIG. 2 may include internal microphones for detccting audio from within the ear or external
microphones for detecting audio from without the ear. Internal microphones may include microphones for detecting
audio from speech from the user through either direct speech
or through a bone conduction microphone or any other internalmicrophones that may occur to those of skill in the art.
External microphones may be any microphone that useiblly
detccts audio from without thc ear such as ambient noise,
external music, warning signals, or any other external audio
that may occur to those of skill in the art. In various embodiments both internal and external microphones may be implemented as bone conducting microphones.
also includes one or more speakers (206). The example speakers of FIG. 2 may include traditional ear bud or earphone
audio speakers, bone conduction, speakers or any other
speakers that will occur to those of skill in the art. In some
embodiments of the present invention, the speakers (206) the
wearable computer (100) of FIG .2 are implemented as one or
more internal speaker oriented toward the tympanic membrane of the user in dependence upon the image created from
the 3D scan. Such an image of the internal portion ofthe ear
created from the 3D scan may provide the location and orientation of the tympanic membrane. Orienting speakers in
dependence of such location or orientation provides
improved quality and efficiency in audio presentation.
also includes a computer processor (210) and memory (214)
and wireless adapter (212) operatively coupled to the com-
puter processor (210) through bus (20S). The example wearable computer (100) of FIG. 2 includes a wearable computing
module (220) stored in memory (214), the wearable computing module (220) comprising a module of automated computing machinery configured to receive the sensed information (216) and invoke a wearable computing action in
dependence upon the sensed infornmtion.
[0024] The wearable computer (100) of FIG. 2 includes one
or more transducers (202). Such transducers may provide
additional interaction with the user through various physical
means such as vibration, pulsation, and other interaction provided by transducers that will occur to those of skill in the art.
[0025] In the example of FIG. 2, the wearable computer's
(100) wearable computing module (220) includes a wireless
c0111111unications module and is configured to transmit the
sensed information wirelessly to a mobile computing device
(lOS). In some embodiments, the sensed information is used
to derive biometric values (21S) in the wearable computer.
Alternatively, the sensed information (216) is transmitted to
the mobile device (lOS) and the sensed infonnation is used to
derive biometric values (21S) by the mobile computing
device. Such biometric values are useful in providing wearable computing actions as will occurto those of skill in the art.
[0026] In the exanlple of FIG. 2, the wearable computer
(100) also includes a wearable computing module (220) that
includes a wireless COlllll1unications module and is configured to transmit the sensed information (216) wirelessly to a
mobile computing device (lOS) and receiving, from an
authentication module (264) installed on the mobile computing device (lOS), authentication infornlation regarding the
user. The authentication module, in the example of FIG. 2,
receives the sensed information either in its original fornl
trom the sensors and derives biometric values (21S) or
receives the sensed information as biometric values. The
authentication module then authenticates the user based on
the sensed information and returns to the wearable computer
authentication infornlation identifying whether the current
wearer of the wearable computer is an authorized user of the
wearable computer. A user may be authenticated by the quality of the fit of the wearable computer in the ear canal as
detected by pressure, force or other sensors, the user may be
authenticated by the way and shape the ear canal changes as
the user's jaw moves, the user may be authenticated with
voice recognition, through a speech password or any other
manner of authentication that will occurto those of skill in the
art.
[0027] In the exanlple of FIG. 2, the wearable computer
(100) includes a microphone (204) and a speaker (206), and
the wearable computing module (220). In the example of FIG.
2, the wireless connl1Unications module is also configured to
transmit sensed audio from the user to a speech recognition
module (266) installed on a mobile computing device (lOS);
receive, in response to the transmitted audio, an audio
response; and play the audio response through the speaker
(206). Through the use of speech rccognition a uscr is allowcd
to remain hands-free and eyes-free and still cOlllll1unicate
with applications available to that user through the in-ear
wearable computer.
[002S] In the example of FIG. 2, the wearable computing
module (220) is also configured to transmit the sensed information wirelessly to a mobile computing device (lOS);
receive, from a health and fitness module (26S) installed on
the mobile computing device (lOS), health and fitness information regarding the user created in dependence upon bio-
Jun. 18,2015
US 2015/0168996 Al
3
metric values (218) derived from the sensed infonnation
(216). Example health and fitness infornlation may include
heart rate, target heart rate, blood pressure, general infornlation about the user's wellbeing, current body temperature of
the user, brain wave activity of the user, or any other health
and fitness information that will occur to those of skill in the
art.
[0029] In the example of FIG. 2, the wearable computer
(100) includes a microphone (204) and a plurality of speakers
(206). In the example of FIG. 2, the speakers (206) include an
internal speaker and the microphone (204) includes an externalmicrophone. In the example of FIG. 2, the wearable computing module (220) includes a wireless communications
module and is configured to transmit sensed audio from the
external microphone to a situational awareness module (270)
installed on a mobile computing device (108); receive, in
response to the transmitted audio from the external microphone (204), an instruction to invoke the internal speaker
(206); and play audio received through the external microphone (204) through the internal speaker (206). The situational awareness module (270) of FIG. 2 determines whether
external sound should be passed through to the user. Such a
situational awareness module may compare the external
sound to a profile, a threshold, or other information to determine whether external sound should be played to the user.
[0030] In the example of FIG. 2, the wearable computing
module (220) includes a wireless communications module
and is configured to transmit the sensed information (216) to
a biometric interface module (272) installed on a mobile
computing device (108); and receive, in response to the
sensed infornlation, an instruction to invoke an biometric
interface action in response to a user instruction determined
from biometric values (218) derived from the sense infonnation (216). The biometric interface module (272) allows a
user to control applications through the use of biometrics
derived from sensed infonnation in the ear such as line of
sight or eye movement, brainwave activity, or other biometrics that will occur to those of skill in the art.
(100) includes an internal speaker and the wearable computing module (220) includes a wireless communications module and is configured to receive audio information from an
entertainment application (274) installed OIl a mobile computing device (108) and playing audio through the internal
speaker (206) in response to the received audio infonnation.
(100) includes a business transaction module (276) that provides business transaction applications such as applications
for banking, connnerce, and so on. In the example of FIG. 2,
the wearable computer (100) includes a mobile connnunications module (278) that provides mobile cOllllllunications
with other mobile connnunications devices.
[0033] For further explanation, FIG. 3 sets forth a flow
chart illustrating an example method of in-ear wearable computing. The method of FIG. 3 includes sensing (302), through
sensors (104) integrated in an earpiece body (102) ofa wearable computer (100), information (216) regarding the user
when the wearable computer (100) is worn in the ear, the
wearable computer (100) comprising the earpiece body (102)
manufactured from an image of a user's ear, the image created
from a three dimensional ('3D') optical scan of a user's ear.
Sensing information according to the method of FIG. 3 may
be carried out by electroencephalography, electromyography,
electrooculography, electrocardiography, accelerometry,
reflective pulse oximetry, sensing audio, sensing temperature,

and sensing other infonnation that will occur to those of skill
in the art. Such sensed information is often used to derive
biometric values for the user useful in wearable computing
according to embodiments of the present invention such as
pulse rate, body temperature, blood oxygen level, rapid eye
movement sleep, non-rapid eye movement sleep, snoring,
blood pressure, muscle tension, eye position, brain wave
activity, and other values derived from sensed infonnation as
may occur to those of skill in the art.
[0034] The method of FIG. 3 also includes invoking (304)
a wearable computing action (306) in dependence upon the
sensed information. Wearable computing actions include
actions carried out for the benefit of the user wearing the
wearable computer (100). In the example of FIG. 1, such
actions may be carried out with the aid of wireless connnunications with and additional resources provided by the
mobile computing device (108). Examples of wearable computing actions include authentication of the user, speech recognition, playing audio, playing the rendering of a text-tospeech engine, transmitting or recording biometric
information for health and fitness, providing situational
awareness to the user, allowing biometric interface actions
such as invoking a speech interface or using eye movement or
brain activity to control an application, playing music and
entertailnnent, and many other wearable computing actions
that will occur to those of skill in the art.
chart illustrating another example method of in-ear wearable
computing. The method of FIG. 4 is similar to the method of
FIG. 3 in that it includes sensing (302), through sensors (104)
integrated in an earpiece body (102) of a wearable computer
(100), infornlation (216) regarding the user when the wearable computer (100) is worn in the ear and invoking (304) a
wearable computing action (306) in dependence upon the
sensed information.
[0036] In the method of FIG. 4, however, invoking (304) a
wearable computing action (306) also includes transmitting
(402) the sensed infonnation (216) wirelessly to a mobile
computing device (108). Transmitting (402) the sensed information (216) wirelessly to a mobile computing device (108)
may be carried out in some embodiments using Bluetooth.
Bluetooth is a wireless technology standard for exchanging
data over short distances (using short-wavelength microwave
transmissions in the ISM band from 2400-2480 MHz) from
fixed and mobile devices. Transmitting (402) the sensed
information (216) wirelessly to a mobile computing device
(108) may be carried out using other protocols and teclmologies such as TCP (Transmission Control Protocol), IP (Internet Protocol), HTTP (HyperText Transfer Protocol), WAP
(Wireless Access Protocol), HDTP (Handheld Device Transport Protocol), and others as will occur to those of skill in the
art.
(100), infonnation (216) regarding the user when the wearable computer (100) is worn in the ear and invoking (304) a
sensed information. In the method of FIG. 5, however, invoking (304) a wearable computing action (308) also includes
transmitting (502) the sensed information wirelessly to a
Jun. 18,2015
US 2015/0168996 Al
4
mobile computing device (108) and receiving (504), from an
authentication module installed on the mobile computing
device (108), authentication information (506) regarding the
user.
(100), information (216) regarding the user when the wearable computer (100) is worn in the ear and invoking (304) a
sensed information. In the method of FIG. 6, however, invoking (304) a wearable computing action (306) includes transmitting (602) sensed audio (604) from the user to a speech
recognition module on a mobile computing device (108).
Speech recognition (SR) is the translation of spoken words
into text. It is also known as "automatic speech recognition",
"ASR", "computer speech recognition", "speech to text", or
just "SIT".
[0039] Some SR systems use "speaker independent speech
recognition" while others use "training" where an individual
speaker reads sections of text into the SR system. These
systems analyze the person's specific voice and use it to fine
tune the recognition of that person's speech, resulting in more
accurate transcription. Systems that do not use training are
called "speaker independent" systems. Systems that use
training are called "speaker dependent" systems.
[0040] Speech recognition applications include voice user
interfaces such as voice dialing (e.g. "Call home"), call routing (e.g. "I would like to make a collect call"), domestic
appliance control, search (e.g. find a podcast where particular
words were spoken), simple data entry (e.g., entering a credit
card number), preparation of structured documents (e.g. a
radiology report), speech-to-text processing (e.g., word processors or emails). and aircraft (usually termed Direct Voice
Input).
[0041] The method of FIG. 6 also includes receiving (606),
in response to the transmitted audio (604), an audio response
(608) and playing (610) the audio response through a speaker
in the wearable computer (100). Such an audio response may
be streamed from the mobile device to the wearable computer.
sensed information. In the method of FIG. 7, however, invoking (304) a wearable computing action (306) includes transmitting (702) the sensed information (216) wirelessly to a
mobile computing device (108) and receiving (704), from a
health and fitness module installed on the mobile computing
device (108), health and fitness information regarding the
user created in dependence upon biometric values derived
from the sensed information (216). Example health and fitness information may include heart rate, target heart rate,
blood pressure, general information about the user's wellbeing, current body temperature of the user, brain wave activity
of the user, or any other health and fitness information that
will occur to those of skill in the art.

(100), infonnation (216) regarding the user when the wearable computer (100) is worn in the ear and invoking (304) a
sensed information. In the method of FIG. 8, however, invoking (304) a wearable computing action (306) includes transmitting (802) sensed audio (604) from an external microphone of the wearable computer (100) to a situational
awareness module on a mobile computing device (108) and
receiving (806), in response to the transmitted audio (604)
from the external microphone, an instruction (804) to invoke
an internal speaker in the wearable computer (100). The situational awareness module deternlines whether external sound
should be passed through to the user. Such a situational
awareness module may compare the external sound to a profile, a threshold, or other information to determine whether
external sound should be played to the user.
[0044] The method of FIG. 8 also includes playing (808)
audio received through the external microphone through the
internal speaker. Playing (808) audio received through the
external microphone through the internal speaker may be
carried out by passing sound detected by the external microphone to the internal speaker.
sensed information. In the method ofFIG. 9, however, invoking (304) a wearable computing action (306) includes transmitting (902) the sensed information (216) to a biometric
interface module on a mobile computing device (108) and
receiving (904), in response to the sensed information (216)
an instruction (906) to invoke a biometric interface action in
response to a user instruction determined from biometric
values derived from the sense information. The biometric
interface module allows a user to control applications through
the use of biometrics derived from sensed information in the
ear such as line of sight or eye movement, brainwave activity,
or other biometrics that will occur to those of skill in the art.
FIG. 3 in that it includes sensing (302). through sensors (104)
(100), infornlation (216) regarding the user when the wearable computer (100) is worn in the ear and invoking (304) a
sensed information. In the method of FIG. 10. however.
invoking (304) a wearable computing action (306) includes
receiving (1002) audio infonnation from an entertainment
application installed on a mobile computing device (108) and
playing (1006) audio through the internal speaker in response
to the received audio information (1004). Audio information
from an entertainment application installed on a mobile com-
Jun. 18,2015
US 2015/0168996 Al
5
puting device (108) may be music, speech-from-text, or any
other audio infornlation that will occur to those of skill in the
art.
[0047] It will be understood from the foregoing description
that modifications and changes may be made in various
embodiments of the present invention without departing from
its true spirit. The descriptions in tIlls specification are for
purposes of illustration only and are not to be construed in a
limiting sense. The scope of the present invention is limited
only by the language of the following claims.
What is claimed is:
1. A wearable computer, comprising:
an earpiece body manufactured from an image of a user's
ear, the image created from a three dimensional (3D')
optical scan of the user's ear:
one or more sensors configured to sense information
regarding the user when the wearable computer is worn
in the ear;
a computer processor and memory operatively coupled to
the computer processor; and
a wearable computing module stored in memory, the wearable computing module comprising a module of automated computing machinery configured to receive the
sensed infonnation and invoke a wearable computing
action in dependence upon the sensed infonnation.
2. The wearable computer of claim 1 wherein the wearable
computing module further comprises a wireless communications module and the wearable computing action further comprises transmitting the sensed information wirelessly to a
mobile computing device.
computing module further comprises a wireless cOllllllunications module and the wearable computing action further comprises transmitting the sensed information wirelessly to a
mobile computing device and receiving, from an authentication module installed on the mobile computing device,
authentication information regarding the user.
computer further comprises a microphone and a speaker, and
the wearable computing module further comprises a wireless
communications module and the wearable computing action
further comprises:
transmitting sensed audio from the user to a speech recognition module installed on a mobile computing device;
receiving, in response to the transmitted audio, an audio
response; and
playing the audio response through the speaker.
computing module fhrther comprises a wireless communications module and the wearable computing action further comprises:
transmitting the sensed information wirelessly to a mobile
computing device;
receiving, from a health and fitness module installed on the
mobile computing device, health and fitness information
regarding the user created in dependence upon biometric
values derived from the sensed infonnation.
computer further comprises a microphone, an internal
speaker, and an external microphone; and the wearable computing module further comprises a wireless cOllllllUnications
module and the wearable computing action further comprises:
transmitting sensed audio from the external microphone to

a situational awareness module on a mobile computing
device;
receiving, in response to the transmitted audio from the
external microphone, an instruction to invoke the internal speaker; and
playing audio received through the external microphone
through the internal speaker.
computing module further comprises a wireless communications module and the wearable computing action further comprises:
transmitting the sensed infonnation to a biometric interface module installed on a mobile computing device;
receiving, in response to the sensed information, an
instruction to invoke an biometric interface action in
response to a user instruction determined from biometric
values derived from the sense information.
computer includes an internal speaker, the wearable computing module further comprises a wireless communications
module, and the wearable computing action further comprises receiving audio information from an entertailIDlent
application installed on a mobile computing device and playing audio through the internal speaker in response to the
received audio information.
9. A method of in-ear wearable computing, the method
comprising:
sensing, through sensors integrated in an earpiece body of
a wearable computer, information regarding the user
when a wearable computer is worn in the ear, the wearable computer comprising the earpiece body manufactured from an image of a user's ear, the image created
from a three dimensional (3D') optical scan ofthe user's
ear;
and invoking a wearable computing action in dependence
upon the sensed information.
10. The method of claim 9 wherein invoking a wearable
computing action further comprises transmitting the sensed
information wirelessly to a mobile computing device.
computing action further comprises:
computing device; and
receiving, from an authentication module installed on the
mobile computing device, authentication information
regarding the user.
transmitting sensed audio from the user to a speech recognitionmodule on a mobile computing device;
receiving, in response to the transmitted audio, an audio
response; and
playing the audio response through a speaker in the wearable computer.
computing device: and
receiving, from a health and fitness module installed on the
mobile computing device, health and fitness infornlation
regarding the user created in dependence upon biometric
values derived from the sensed information.
Jun. 18,2015
US 2015/0168996 Al
6
transmitting sensed audio from an external microphone of
the wearable computer to a situational awareness module on a mobile computing device;
receiving, in response to the transmitted audio from the
external microphone, an instruction to invoke an internal
speaker in the wearable computer; and
playing audio received through the external microphone
through the internal speaker.
computing action:
transmitting the sensed infonnation to a biometric interface module on a mobile computing device; and
receiving, in response to the sensed infonnation, an
instruction to invoke a biometric interface action in
response to a user instruction detennined from biometric
values derived from the sense infonnation.
receiving audio infonnation from an entertainment application installed on a mobile computing device; and
playing audio through the internal speaker in response to
the received audio information.
17. A wearable computer, comprising:
an earpiece body manufactured from an image of a user's
ear, the image created irom a three dimensional (3D')
optical scan of the user's ear;
one or more sensors configured to sense infonnation

regarding the user when the wearable computer is worn
in the ear;
one or more microphones;
one or more speakers
a computer processor and memory operatively coupled to
the computer processor; and
a wearable computing module stored in memory, the wearable computing module comprising a module of automated computing machinery configured to receive the
sensed information and invoke a wearable computing
action in dependence upon the sensed infonnation.
18. The wearable computer of claim 17 wherein the one or
more microphones comprise an internal microphone and an
external microphone.
more microphones comprise an internal bone conducting
microphone.
more speakers comprise an internal speaker oriented toward
the tympanic membrane of the user in dependence upon the
image created from the 3D scan.
21. The wearable computer of claim 17 wherein the
speaker comprises an internal bone conducting speaker.
22. The wearable computer of claim 17 wherein one or
more sensors are to sense infonnation including electroencephalography, electromyography, electrooculography, electrocardiography, accelerometry, reflective pulse oximetry,
audio, or temperature.
* * * * *

United Sciences In-Ear PC Patent App US 2015168996a1

Caricato da

Informazioni sul documento

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

United Sciences In-Ear PC Patent App US 2015168996a1

Caricato da

Copyright:

Formati disponibili

111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111

IN-EAR WEARABLE COMPUTER

Applicant: UNITED SCIENCES, LLC,

Inventors: WESS ERIC SHARPE, VININGS, GA

Dec. 17, 2013

(51 ) Int. CI.

Pub. No.: US 2015/0168996 Al

(21) App!. No.: 141109,796

Patent Application Publication

Jun. 18,2015 Sheet 1 of 10

Patent Application Publication

Jun. 18,2015 Sheet 2 of 10

Music And Entertainment

Speech Recognition And

Health And Fitness

I~~ ____ - - - - - - - - - - - - - - - - - - - Memory

_. --I- .. --- -1-----

Patent Application Publication

Jun. 18,2015 Sheet 3 of 10

invoke A Wearable Computing Action in Dependence Upon The Sensed Information

Patent Application Publication

Jun. 18,2015 Sheet 4 of 10

Invoke A Wearable Computing Action In Dependence Upon The Sensed Information

Transmit The Sensed Information Wirelessly To A Mobile

Patent Application Publication

Jun. 18,2015 Sheet 5 of 10

Invoke AWearable Computing Action In Dependence Upon The Sensed Information

Patent Application Publication

Jun. 18,2015 Sheet 6 of 10

Invoke A Wearable Computing Action In Dependence Upon The Sensed Information

Transmitting Sensed Audio

Play The Audio Response

Patent Application Publication

Jun. 18,2015 Sheet 7 of 10

Invoke A Wearable Computing Action In Dependence Upon The Sensed Information

Transmitting The Sensed

Receiving Health And Fitness Information Regarding

Patent Application Publication

Jun. 18,2015 Sheet 8 of 10

Invoke A Wearable Computing Action In Dependence Upon The Sensed Information

Patent Application Publication

Jun. 18,2015 Sheet 9 of 10

Invoke A Wearable Computing Action In Dependence Upon The Sensed Information

Receive An Instruction To Invoke A Biometric Interface

Patent Application Publication

Jun. 18,2015 Sheet 10 of 10

Invoke AWearable Computing Action In Dependence Upon The Sensed Information

Play Audio Through The Internal

ments of the present invention. The system of FIG. 1 includes

reflective pulse oximetry, sensing audio, sensing temperature,

[0043] For further explanation, FIG. 8 sets forth a flow

transmitting sensed audio from the external microphone to

one or more sensors configured to sense infonnation

Potrebbero piacerti anche