Docstoc

Interface between Headset and Co

Document Sample
Interface between Headset and Co Powered By Docstoc
					     Group # 6
 TAJ’S House

    Tatiana Torres
  Aysenur Basagalar
    Jessica Clifton
Mohammad   ’Sameer Khan
                   Introduction
• TAJ’S is a wireless voice
  control system. “You say it,
  and it will do it.”
• It provides more comfort
  for elderly and
  handicapped people.
• Main idea is to control a
  thermostat and a light
  switch using human voice
  wirelessly.
               Project Goals
•   Controlling Light Switch
•   Controlling Thermostat
•   Wireless
•   Voice Controlled
•   Price Efficient
Overall Block Diagram
 Bluetooth
  Headset




Blue Soleil
                  Microsoft
Software/
                   Speech     Computer
Bluetooth
                  Software
  Dongle




                              Blue Soleil
                              Software/
                              Bluetooth
                                Dongle




               Light           Arduino
              Switch          Bluetooth     Thermostat
          Software Block Diagram
                                                                                Turn On                               Red Fan
                                                                                 Heater                               Turns On
                                                                  Compare
                                                                  Command
                                                   Thermostat
                                                                     and        No Action
                                                   Command
                                                                 Surrounding                      Microcontroller
                                                                 Temperature                         Arduino
                                                                                 Current             Program
                                                                               Temperature

                                                                                Turn On
                                                                                                                      Blue Fan
                                                                                  Air
                                                                                                                      Turns On
                                                Analyze                        Conditioner
          Microsoft   Translates
 Verbal                            Data Base   Command
          Software     Voice to
Command                  Text                    Text




                                                                 Turn on                                  Activate    Light turns
                                                                  Light                                   Switch          on

                                                                                Microcontroller
                                                  Light Switch
                                                                 No Action
                                                                                   Arduino
                                                   Command                         Program

                                                                 Turn off                                Deactivate   Light turns
                                                                  Light                                   Switch          off
          Personal Computer
• We considered each group members’ laptops
• Decided on using Toshiba Satellite A200-
  ST2041 Series which uses the 75 W 100-240 V
  AC Adapter, and it has a 4000 mAh Lithium Ion
  battery pack
• Reasons: there was no problem installing all the
  necessary software, and it has a better
  performance than the other group members’
  laptops
                      Fan
• In order to demonstrate the on or
  off state of the thermostat, two
  fans are used
• Each acquired fan is a Crystal
  Clear UV JT8025H12S
• It is an 80 mm case with quad LEDs
• This fan has a three wire connection, but only
  two connections are necessary for our design
• It works with a maximum of 12V, and minimum
  of 3.2 V
• It operates with a minimum current of 240 mA
Fan Decision Matrix Operation
                                 Command




                   Increase                 Decrease
                     Temp                    Temp



           OFF                                             OFF
    Turn         Heating Fan’s             Cooling Fan’s         Turn
    ON              Status                    Status             ON


                         ON                        ON


                   Remain                    Remain
                    ON                        ON
                   LCD
The SerLCD v2.5 is selected
• Serial connection
   between the micro
   controller and the LCD
• Low power consumption (works with 5 V)
• It displays yellow on blue contrast with a
   backlight feature
             Battery Pack
• The battery pack is a normal battery
  holder with DC to DC step up converter
• The converter generates a regulated 5.0 V
  supply from two AA size batteries with a
  current of 200 mA
• The battery pack is used to power up the
  Arduino BT
       Microcontroller / Possibilities
Name         Clock    I/O    Price    Wireless
             Speed    Pins   (Dev.Bd) Communications
                                      Method
PIC          20 MHz   33      $65    RF modules to be
16F877                               added
ATMEL        16 MHz   35      $85    RF modules to be
AVR AT162                            added
Stellaris    25 MHz   24      $89    RF modules to be
LM2965                               added
Arduino BT   20 MHz   14     $141    WT11 Bluetooth
                                     module included
Wireless Communications modules

• $25 RF:Nordic



• $44 RF:Nordic

• $70 Bluetooth Module
Permission to use image by www.arduino.cc
                       Arduino BT

• ATMega 168 Microcontroller
• Serial Bluetooth transmission
  rate of 115200 bits/second
• 1024 bytes of RAM
• Power needed: 5V
• 14 Digital I/O pins
• 9 Analog I/O pins
• Arduino API(C language
  based)


                                  Permission to use image by
                                         www.arduino.cc
                     Arduino NG

• ATMega 168 Microcontroller
• Serial transmission rate of
  9600 bits/second
• 1024 bytes of RAM
• Power needed: 5V
• 14 Digital I/O pins
• 9 Analog I/O pins
• Arduino API(C language
  based)
Implementing the Arduino BT
              Light Switch
• Controlled directly by a digital pin of the
  microcontroller.
• A combination of a 5V(MCU) pin – 1 Amp
  relay controls the on/off operation of the
  light bulb.
• The load cannot overpass 1 Amp with this
  relay.
         Light bulbs Rating
Source   Power   Current   Resistance

120V     120 W   1.00 A    120 Ohms

120V     60 W    0.50 A    240 Ohms

120V     40 W    0.33 A    360 Ohms

120V     30 W    0.25 A    480 Ohms

120V     13 W    0.11 A    1108 Ohms
Circuit Design
          DS18S20-PAR Digital
             Thermometer
• This thermometer is selected
  since it requires only one port
  pin for communication
• It converts temperature in 750
   ms (max)
• It can measure temperatures
  from –55°C to +100°C
• For the testing purpose, we have to change the
  surrounding temperature of the sensor
  For cooling, we use ice pack and place it near the sensor
  For warming, we use a hair dryer and blow it in the direction of the
  sensor
              Thermostat
The design of the thermostat includes
• The cooling fan & heating fan
• LCD
• Two SPDT relays
• Two 9 V batteries
• The Arduino Bluetooth
• DS18S20-PAR digital thermometer
The Heating Fan Design
The Cooling Fan Design
   Interface between Headset and
              Computer
• We wanted to have
  interface between
  headset and
  computer
• It should be wireless
• Easy to transfer data
        Bluetooth Connection
• The PC itself does not contain a Bluetooth radio
  therefore it is necessary to add additional
  software and hardware.
• In order to establish a connection, BlueSoleil
  software is installed and a compatible BT dongle
  is inserted into the PC’s USB port.
• Once the BlueSoleil software is installed, the BT
  headset and Arduino BT can be setup.
   Requirements and Specifications
• Wireless interface connection between user and voice processing
  device (PC) is max 10 meters range
• Wireless interface connection between voice processing device and
  microcontroller is max 100 meters range
• Max data transfer rate is 1 Mbps between all used Bluetooth devices
  which are dongle, BT module (microcontroller), and headset

    Device          Class    Transfer    Maximum    Maximum      Maximum     Bluetooth
                            Data Rate    Distance   Permitted    Permitted   Versions
                                                     Power      Power(dbm)

    Headset          2       1 Mbps       10 m      2.5 mW          4           1.2


    Dongle           1       1 Mbps       100 m     100 mW         20           2.0


  BT module          1      2 ~ 3 Mbps    100 m     100 mW         20           2.0
(microcontroller)
          Bluetooth Headset
• Motorola H700
• H700 has a battery life of talk
• time of up to 6 hours and a
• standby time of up to 130 hours
• Uses Bluetooth v.1.2 for quicker
   pairing and reduced interference
• Can connect with compatible devices up to 10
  meters away
• Advantage of this headset: It uses the Rapid
  Charge technology meaning that it takes less
  than an hour to charge
         Bluetooth Dongle Options
Requirements       Cyber-Blue Bluetooth USB Bluetooth Dongle
                   v2.0 EDR USB Dongle Adapter ES-388
Range              up to 100m              0-100m

Transfer rate or   2.1 Mbps                1 Mbps
speed
Size               2 x 0.5 x 0.25-inches   2 x 0.5 x 0.25-inches
                   (H x W x D,             (H x W x D,
                   approximate)            approximate)
Price              $29.99                  $6.99
        Bluetooth USB Dongle
• The Bluetooth USB Dongle ES 388
  has data transfer rate of 1Mbps
• Our dongle is class 1 which gives an
  approximate range of 100 meters
• However, the smaller range of the
  headset limits the range of the dongle
  to 10 meters
• It consumes 10mA with 0dbm of output power
• It possesses a very good transmission with very low
  losses in the transmitted signal
                                BlueSoleil
•   BlueSoleil is a set of Bluetooth
    Application Profiles implementation on
    Windows operating system and fully
    compliant to Bluetooth SIG latest
    specifications

•   It enables PCs to form networks and
    exchange information wirelessly

•   The host device is expressed as a
    golden globe in the center, with the
    remote devices within range displayed
    as planets orbiting the Sun (Soleil)

•   It also provides PCs a fast and reliable
    solution for effortless wireless
    connection to mobile phones,
    headsets, PDAs, Access Points,
    Printers, Digital Cameras, PC
    peripherals, and so on
       Headset Bluetooth Setup
• Open BlueSoleil software
• Place the BT headset in
  Pairing mode
• Under My Bluetooth, select
  Bluetooth Device Discovery
• Right click on the headset
  icon, select Pair device here
  make sure that headset switch
  is on it should be displaying
  purple light
• Enter the pass code: 0000
• Right click on the icon again,
  select Connect with that it is
  noticeable headset would start
  blinking with blue color
   Headset Computer Settings
• After pairing headset with BlueSoleil, these
  settings should be applied to the PC
• Under Control Panel, select Sounds and Audio
  Devices
• Select the Audio tab and change the sound
  default devices to Bluetooth AV/HS Audio
• Select the Voice tab and change the voice
  default devices to Bluetooth AV/HS Audio
• Once these changes have been applied, then all
  audio input and output will be handled through
  the BT headset
         Arduino BT Setup
• Assuming BlueSoleil software is already
  on, Under My Bluetooth, select Bluetooth
  Device Discovery
• Right click on the BT icon, select Pair
  device
• Enter the following pass code: 12345
• Right click on the icon again, select
  Connect
                Pairing and Repairing
•   After the BT connections have been
    established, the GUI will have the
    capability of using voice to control the
    operation of these devices

•   Every time user closes BlueSoleil, user
    has to repair the devices

•   However that does not mean that user
    has to follow all these steps, BlueSoleil
    recognizes the devices once the
    network address has been inputted.
    Then, user can right click on the
    device and pair device tab
     Graphical User Interface
             Provides a user-friendly design

• Recognizes spoken phrases
          “Light      Command      Computer Response Action
           on”        Fan +On          “Fan is on”    Turn fan on
                      Fan +Off         “Fan is off”  Turn fan off
                      Light +On       “Light is on”  Turn light on
                      Light +Off     “Light is off”  Turn light off




            • Computer responds to user with a customized spoken
              responses

• Allows programmatic responses                             “Light is
                                                              on”
Speech Recognition Options
  Dragon Naturally $80   Win32 SDK available
  Speaking                     (at a cost)


  IBM ViaVoice    $20    Win32 SDK no longer
                               supported


  Microsoft       Free   Win32 SDK available
  Speech                       (Free)
         Microsoft Speech
  Software Development Kit (SDK)
• Includes Microsoft Speech API (SAPI)
   – Speech Recognition (SR) engine
      • SAPI takes audio as input and uses the SR engine to output
        that as text
   – Text-To-Speech (TTS) engine
      • SAPI takes text as input and uses the TTS engine to output that
        text as spoken audio

                                      TTS
                                     Speech            AUDIO
                            SAPI     Engine
        TEXT
                   Database Tables
   Activity Log




Command_Response
               Database Forms
                Input_Output                  Test Command




Command List
                               Activity Log
                      Input_Output Form
• Speech Applications
    TTS & SR
• COM Port Communication
    Control Devices




                                • Graphical User Interface Responses
                                    • Buttons
                                    • Textboxes
          Text to Speech Integration
• The Microsoft Speech Object Library
  must be selected in the References      Private Sub
  menu of the VBA module so that all      RC_FalseRecognition(ByVal
  applicable methods and objects are      StreamNumber As Long, ByVal
  recognized                              StreamPosition As Variant, ByVal
                                          Result As
                                          SpeechLib.ISpeechRecoResult)
• The script to use TTS begins with the
  declaration of “appSpeech” as an        If TTSPreference = -1 Then
  object.                                    Dim appSpeech As Object
                                             Set appSpeech =
• It then defines “appSpeech” as SAPI     CreateObject("SAPI.SpVoice")
                                             appSpeech.Speak "Command not
                                          recognized"
• The text strings are converted into
  audio by using the appSpeech.Speak
  command
                                  Creating Grammar
                                      Tells SR engine what words it can recognize


          XML File                             GrammarBuilder                       Class Inherits from SR System


<grammar xml:lang="en-US"                 //Build Choice List                       class SrgsGrammar : SrgsDocument
version="1.0" xmlns="http://              Choices grammarChoices = new Choices();   {
www.w3.org/2001/06/grammar" tag-                                                        private static string[] _colors = new string[] {"turn", "light", "on"};
format="semantics-ms/1.0">                grammarChoices.Add("Turn");                   public SrgsGrammar(): base(GrammarRule()){
   <rule id="Color" scope="public">       grammarChoices.Add("Light");                  }
      <one-of>                            grammarChoices.Add("On");                     private static SrgsRule GrammarRule()
         <item> turn </item>                                                            {
         <item> light </item>             //Add to Grammar Builder                           //Create new rule
         <item> on </item>                GrammarBuilder gb = new                           SrgsRule rule = new SrgsRule("LightOn");
      </one-of>                           GrammarBuilder(grammarChoices);                   //Create a oneof list
      <tag> $ = $$ </tag>                                                                  SrgsOneOf choices = new SrgsOneOf();
   </rule>                                //Add Grammar Builder to Grammar                  //Get items to add to oneof list
<grammar>                                 grammar = new Grammar(gb);                       foreach (string color in _colors)
                                                                                           {
                                                                                               SrgsItem grammarItem = new SrgsItem(lighton);
                                                                                               choices.Add(grammarItem);
                                                                                           }
                                                                                            //Add list to rule
                                                                                           rule.Add(choices);
                                                                                           //Return Rule
                                                                                          return rule;
                                                                                        }
                                                                                    }
                   Creating XML File
•   Deletes any old XML file
                                                  XML File


•   Creates a new Word document
     – Invisible open of MS Word


•   Pulls all commands from Command_Response table




•   Each command formatted into a string readable to SR software
                                                  <grammar xml:lang="en-US"
•   Saves this string as a .txt file and stores   version="1.0" xmlns="http://
                                                  www.w3.org/2001/06/grammar" tag-
    onto C: drive                                 format="semantics-ms/1.0">
                                                     <rule id="Color" scope="public">
                                                        <one-of>
                                                           <item> turn </item>

•
                                                           <item> light </item>
    Renames file as .XML                                   <item> on </item>
                                                        </one-of>
                                                        <tag> $ = $$ </tag>
                                                     </rule>
                                                  <grammar>
    SR Engine Integration
                         RC_StartStream

                             Listens
                               For
                            Command


        RC_Recognition                    RC_FalseRecognition


           Recognized                              Not
                                                Recognized



       Initializes SAPI                         TTS Engine
      Updates the GUI
  Accesses Command Table
                                                             Command not
Looks up appropriate response                                 Recognized

       Do_Something
         Controlling Hardware
• DoSomething subroutine is called whenever a phrase is
  recognized
   – Series of If-Then statements

   – Control Thermostat and Light Switch by sending
     ASCII Decimal values to microcontroller

   – MSComm object library used for COM port control
       Voice Recognition Integrity
• User Commands
   – Distinct and easily recognizable by the SR engine
   – Noticeable recognition issues with some words
   – Limited Commands to two word phrases


• Voice Training
   –   Takes approximately 5 minutes
   –   Improves efficiency by 85%
   –   Necessary for this project
   –   Multiple user speech profiles
      System Design
 Verbal
Command                                               Respond to
                                                        User
            SR              Lookup          TTS
           Engine            Table         Engine



                            Action
      Thermostat                              Light




                Bluetooth            Connection




  ON/OFF         Get                         ON/OFF
   State        Temp                          State
                         Work Distribution

100%
90%
80%
70%                                                                      Sameer
60%                                                                      Jessica
                                                                         Aysenur
50%
                                                                         Tatiana
40%
30%
20%

10%
 0%
                                t      on         e      re   re
     ear ch sign   itc
                      h      sta gniti          as ftwa ftwa       PC
                                                                     B
   es      De ht Sw erm eco
                            o                tab o          o
  R                    h       R          Da no S iel S
              Lig     T ce                      i     ol
                         Voi               Ardu lueS
                                                  B
                       Budget
Bluetooth USB Dongle      1     $7.99
Motorola H700 Bluetooth   1     $0.00
Headset
Case Fan                  2     $6.54
BlueSoleil Software       1     $0.00
MS Speech Software        1     $0.00
DS18S20 Thermometer       2     $10.85
Ser LCD v2.5              1     $29.3
Arduino Bluetooth         1     $141.14
Development Board
Arduino NG USB            1     $35.17
Development Board
PC Board                  1     $1.99
SPDT Relay                3     $4.49
Project Box               1     $4.99
Lamp Base                 1     $1.69
Light Bulb                1     $1.00
Header Pins               1     $3.00
Batteries                 3     $5.00
Battery Pack              1     $10.00
Personal Computer         1     $0.00
TOTAL                           $299.52
           Existing Systems
  System      Characteristics                  Price
   Name
             -One word command
HAL 2000     -Wired system                    $ 1500
             -Only two speech voices
             recognition

             -No voice recognition
ELAN         -Wired system                    $ 3500
             -Touch Screen based

             -No voice recognition features
X10          -Wired connections               $ 900
             -Remote control/Camera
             controlled

TAJ’S        -Voice recognition
             -Multiple user speech voices     $ 299
             -Wireless System
   Thank You

Question and Answers

				
DOCUMENT INFO