FREE ELECTRONIC LIBRARY - Dissertations, online materials

Pages:     | 1 |   ...   | 4 | 5 || 7 | 8 |   ...   | 21 |


-- [ Page 6 ] --

What is especially interesting is that a theory similar to the EAC model has emerged fairly recently from an academic field unrelated to NLP (Ehrlichman et al., 2007); it is based on a buffer model which is used to hold representations. Eye-movements are associated with retrieval and fixations are associated with maintenance of the information in the buffer.

It is proposed that the EAC model is worthy of further research with an experimental methodology that incorporates the assumptions and requirements presented here. A significant part of this future direction is the use of eye-tracking technology to detect, track and classify eyemovements. As current state-of-the-art eye-trackers are still limited in the range of eyemovements they can track because they are designed in with the working assumption of the subject looking at a screen or an object in the environment, a novel eye-tracker that is able to successfully track non-visual eye-movements is required. The design and implementation of such an eye-tracker has been the main objective of this thesis. Thus, Chapter 3 reviews current eyetracking systems with respect to the requirements of such research and sets the background for the implementation of the Robust Eye-Accessing Cues Tracker (REACT), introduced in Chapter 4.


In Chapter 2, the benefit of using an eye-tracking system for research relevant to the EAC model was established. In fact, the lack of a computerised eye-movement rating system has been a major flaw in previous studies. Direct viewing methods, even when performed by trained individuals, are error-prone and make objectivity seem impossible to achieve.

While there are several eye-tracking systems with good performance (both commercial and in academia), they are fundamentally designed for applications where the subject is looking at an object or a screen in the external world. Briefly mentioned in earlier chapters and reiterated here, such visual eye-movements are restricted by a relatively narrow field of view; Hansen and Ji (2010) report that fixations normally occur within two to five (2-5) degrees of central vision.

Further, as it was found empirically, people prefer to turn their heads in the general direction of the object or screen and then shift their eyes a small amount to put the visual target in focus. A trivial example of this behaviour is television; if you were sitting in front of your computer reading this thesis and there was a television screen several degrees up and to one side, you would most likely turn your head towards the screen every time it gathered your interest and then shift your eyes to focus on any objects displayed on the television screen.

In contrast, non-visual eye-movements are usually characterized by a shift to an extreme location within the eye socket and the fundamental assumptions that current eye-tracking systems have been designed with render them incapable of tracking these eye-movements. For example, the vast majority of eye-trackers use infrared light and a glint-centred coordinate system (e.g. Ohno et al., 2002; Li et al., 2005); the glint is the reflection of the cornea and appears as a very bright spot. When the glint falls onto the sclera, which is also white, it can be very difficult to find its position. Thus, such eye-trackers operate on the implicit or explicit assumption that the glint will always fall within the iris or pupil, which would not hold true for extreme eye-movements.

Before going any further it is important to define what “extreme” means in the context of eyemovements and further explicitly list the requirements of a non-visual eye-tracker compared to a visual one.

Hansen and Ji (2010), cite the work of Tweed and Vilis (1990) when stating that “eye positions are restricted to a subset of anatomically possible positions described by Listing’s and Donder’s 37 laws”. Indeed, in their study which is not specific to the oculomotor range but concerns the geometric relations of eye position and velocity vectors during saccades with respect to Listing’s law, Tweed and Vilis (1990) briefly mention that the oculomotor range of their measurements is ±40° both horizontally and vertically. Other researchers (Guitton and Volle, 1987) however report that the human oculomotor range is ±55°, a considerably larger range. It is not uncommon to come across eye-movement studies which were performed over a range as large as ±70° (Collewijn et al., 1988) and ±80° (Guitton and Volle, 1987) though such research also aims to test objectives that require eye-movements beyond the maximum human oculomotor range. In this research work, ±55° of angular range will be considered the maximum possible range. Further, the label of “extreme eye-movements” is given to those eye-movements that extend beyond the operational tracking range of existing eye-trackers, which is equal to or less than ±30° (e.g. SR Research, 2009).

Thus, the requirement that separates visual eye-movement trackers from non-visual eyemovement trackers is its ability to maintain similar accuracy across the complete range of eyemovements as defined by the aforementioned oculomotor range of ±55°.

This chapter will walk through the eye-tracking literature from the past decade or so in order to give an overview of currently available systems and their suitability for this application. In doing so, it will also form the basis for several fundamental decisions that have informed the design of the Robust Eye-Accessing Cues Tracker (REACT).

A recent review by Hansen and Ji (2010) is a comprehensive and fairly detailed source of technical information on video-based eye-tracking systems. It categorizes research work based

on the particular area of focus:

a) Eye localization in the image that is concerned with:

i. detecting the existence of eyes ii. interpreting eye positions in the image iii. tracking the detected eyes from frame to frame

b) Gaze estimation which is concerned with estimating where the person is looking in 2D or 3D or determining the 3D line of sight.

38 While this categorization is appropriate for the latter review, this review will categorise eyetrackers in a different fashion, one that facilitates the discussion of several design choices made

with the applications requirements in mind:

 Remote versus head-mounted. Remote eye-trackers where one or more cameras are placed in a remote location and head-mounted eye-trackers which are directly mounted on the subject’s head usually through a glasses-like frame or a helmet.

 Light source(s). The light source used in each eye-tracker dictates the image properties and to a large degree formulates the computer vision problem that is required to be solved. As such, the eye-trackers will be classed based on whether they use natural illumination (passive) or (near-) infrared illumination (active). In the case of active illumination several light sources may be used, each one of which will result in corresponding glint, which is the reflection of the light source on the cornea. The glint is a “nickname” for the first Purkinje image, as shown in Figure 4.

 Number of cameras. As this review focused on video-based eye-trackers only, it is important to include the number of cameras each system uses as more than one camera is often used.

 Gaze estimation method. There are two main methods of gaze estimation, the primary objective of eye-trackers, namely 2D and 3D gaze estimation. 2D gaze estimation is concerned with estimating where exactly the subject is looking on a surface such as a screen. On the other hand, 3D gaze estimation may estimate the gaze direction or point of regard in 3D space.

 Calibration requirements. As it will be briefly explained below, most eye-trackers require a calibration to be executed either once for each system, once for each subject, or both. This serves as another useful element for categorisation.

Further, eye localization schemes will not be discussed as they are only relevant to full-face images such as those taken by remote eye-trackers, unless relevant in terms of another technical aspect.

Before further discussing the requirements of an eye-tracker that is suitable for non-visual eyemovement application, it is useful to give a brief overview of existing designs based on the categories laid out above.

39 It seems that remote eye-trackers are by far the most common design, perhaps because it is considered to be less invasive than a head-mounted tracker, though this conception will be revisited later in this chapter. Thus, while there is a limited number of head-mounted designs (Ebisawa et al., 2002; Takegami et al., 2002; Li et al., 2005; Clarke et al., 2002; Hansen and Pece,

2005) there are at seven to eight times more remote trackers found in the literature (Collet et al., 1997; Heinzmann and Zelinsky, 1998; Kim and Ramakrishna, 1999; Matsumoto and Zelinsky, 2000; Ohno et al., 2002; Sirohey et al., 2002; Benoit et al., 2005; Sun et al., 2006; Wallhoff et al., 2006; Liang and Houi, 2007; Chen and Ji, 2008; Valenti et al., 2008; Yamazoe et al., 2008; White et al., 1993; Morimoto et al., 2000; Morimoto et al., 2002; Coutinho and Morimoto, 2006; Hennessey et al., 2006; Meyer et al., 2006; Li et al., 2007; Ramdane-Cherif and Nait-ali, 2008; Newman et al., 2000; Shih et al., 2000; Andiel et al., 2002; Ji and Yang, 2002; Beymer and Flickner, 2003; Ishima and Ebisawa, 2003; Noureddin et al., 2004; Ohno and Mukawa, 2004; Shih and Liu, 2004; Park and Kim, 2005; Yoo and Chung, 2005; Merad et al., 2006; Tsuji and Aoyagi, 2006; Park, 2007;

Chen et al., 2008; Guestrin and Eizenman, 2008; Kohlbecher and Poitschke, 2008; Hennessey and Lawrence, 2009; Nagamatsu, 2009; Wang et al., 2005).


–  –  –

Equally limited is the number of eye-trackers (regardless of whether they are head-mounted or remote) that use passive illumination (Hansen and Pece, 2005; Li et al., 2005; Colombo et al., 2007; Newman et al., 2000; Wang et al., 2005; Heinzmann and Zelinsky, 1998; Yamazoe et al., 2008; Matsumoto et al., 2000). Eye-trackers that use infrared light illumination offer several

advantages over passive illumination:

 Depending on the exact configuration, the pupil appears as very dark or very bright (called dark- and bright-pupil effect respectively), which allows the pupil to be detected easily and with accuracy. Because of the different reflection properties of the iris and the pupil, this is possible even if the iris appears as dark as the pupil in natural light. The bright-pupil effect is produced when the light source is coaxial to the camera and the dark-pupil effect otherwise (Ebisawa, 1998).

 If a filter is put on top of the camera lens to block non-infrared light, brightness and contrast are kept constant and barely, if at all, affected by other light sources from the external environment. Similarly, shadows may only be formed by the diffusion properties of the infrared source which is within the control of the eye-tracker designer. Last but not least, reflections from objects in the environment do not appear in images captured with active illumination.

 Infrared light is invisible to the human eye and therefore does not distract the subject or cause the pupil to contract.

As can be seen from the list above, active illumination provides several important advantages over passive illumination. In addition, it costs very little to add infrared illumination to any hardware design and there has to be a very compelling reason to use passive illumination. There

only two disadvantages to active illumination:

 Active illumination does not perform quite as well in the outdoors and eye-trackers designed to work outdoors (Hansen and Pece, 2005) avoid the use of infrared illumination.

 There is additional light emitted to the eye which will soon be regulated by international safety standards (Hansen and Ji, 2010). However, in all probability, this will only be a

–  –  –


In order to determine the gaze, which is primary objective of eye-trackers, a feature-based approach is by far the most commonly used (e.g. Ebisawa et al., 2002; Li et al., 2005; Ohno et al., 2002; Benoit et al., 2005). A feature-based approach means that the eye-tracker identifies a set of feature points in the image such as the pupil and the glint (for active illumination eye-trackers) in order to determine the gaze. In this category, two schemes are possible: (a) 2D regression-based gaze estimation and (b) 3D model-based gaze estimation (Hansen and Ji, 2010). One of the main challenges faced by eye-trackers which use the glint as their reference point is that with movement of the eyes and depending on the where the light source is placed, the glint may fall onto the sclera which makes it very hard to detect as they are both very bright regions. The eyecorners are also used as reference points in some natural-light trackers where the glint is not available (Zhu and Yang, 2002; Valenti et al., 2008).

2D regression-based gaze estimation is performed simply by asking the subject to look at several different calibration points whose geometry on a surface (usually the screen) is known. At the same time, the pupil or iris locations are recorded and the calibration points and feature point locations are used to calculate a function such that. Using this function, consequent pupil positions in the image can be mapped to screen coordinates. In schemes that use the corneal reflection, the vector between the glint and the pupil or iris location is used.


On the other hand, 3D model-based gaze estimation, as the name suggests, uses the set of detected feature points in combination with a model of the eye and in some cases the scene to estimate the gaze direction or point of regard in 3D space.

All gaze estimation methods require that a set of parameters are determined through a calibration process; such processes can be categorised into the following categories (Hansen and

Ji, 2010):

42  Camera calibration, which refers to determining the intrinsic camera parameters (focal length, image sensor size and principal point). As long as the parameters do not change value (e.g. by changing the camera focus setting), they only need to be calculated once.

Pages:     | 1 |   ...   | 4 | 5 || 7 | 8 |   ...   | 21 |

Similar works:

«January 2010 Wartime Rescue of Jews by the Polish Catholic Clergy The Testimony of Survivors Edited and compiled by Mark Paul Polish Educational Foundation in North America Toronto 2009 Rescue activities on behalf of Jews were carried out by priests, nuns and monks in more than one thousand Roman Catholic Church institutions throughout Poland during World War II. The number of priests and religious involved in these activities was many times higher. This effort is all the more remarkable since...»

«Chinese Military Modernization and Asian Security Michael Swaine August 1998 1 2 Chinese Military Modernization and Asian Security* Michael Swaine I’ll speak on the question of Chinese military defense modernization and its implications for the Asian security environment. I’ll try to keep my remarks at a level where we can talk about broader issues and concepts, and the implications of all this for regional evolution in the security environment, U.S. security interests, U.S.-Japan...»

«THE SIGNIFIER POINTING AT THE MOON THE SIGNIFIER POINTING AT THE MOON Psychoanalysis and Zen Buddhism Raul Moncayo Masao Abe, Zen and Western Thought, 1999, University of Hawaii Press, reproduced with permission of Palgrave Macmillan. Ekaku Hakuin (1685–1788). Daruma, 18th century. Hanging scroll, ink on paper © 2012 Museum Associates/LACMA. Licensed by Art Resource, NY. First published in 2012 by Karnac Books Ltd 118 Finchley Road London NW3 5HT Copyright © 2012 by Raul Moncayo The right...»

«References Allerton, D.J. (1982). Valency and the English verb. London: Academic Press. American Psychiatric Association (1994). Diagnostic and statistic manual of mental disorders, 4th Edition (DSM-IV). Washington, DC: American Psychiatric Association. Anderson, S. (1971). On the role of deep structure in semantic interpretation. Foundations of Language, 7, 387-396. Baddeley, A.D. & Hitch, G.J. (1974). Working memory. In: G. Bower (Ed.), The psychology of learning and motivation. New York:...»

«FIXING STUDENTS’ FIXED MINDSETS: PAVING THE WAY FOR MEANINGFUL ASSESSMENT Carrie Sperling and Susan Shapcott* I. INTRODUCTION Picture a first-semester legal writing classroom. Students receive their first important graded assignment in law school. They anxiously flip through the pages of their office memo and see more markings on their papers than they have ever seen on anything they have written in the past. Their professor commented on their organization, their analysis, their use of...»

«Intentional Binding and the Sense of Agency: A review James W. Moore1,2 & Sukhvinder S. Obhi3,4 1. Department of Psychology, Goldsmiths, University of London, London, UK 2. Brain Mapping Unit, Department of Psychiatry, University of Cambridge, Cambridge, UK 3. Centre for Cognitive Neuroscience & Department of Psychology, Wilfrid Laurier University, Waterloo, Ontario, Canada 4. Institute of Cognitive Neuroscience, University College London, London, U.K. Correspondence: sobhi@wlu.ca PrePrint...»

«355 366. YTTERVALLA, FRUSTUNA SN, DAGA HD.366. Yttervalla, Frustuna sn, Daga hd. I en källare S om boningshuset i den östra gården i Yttervalla by finnas två mindre stycken av en runsten inmurade i källartaket. Källaren är enligt uppgift av gårdens ägare (herr Alb. Andersson) byggd år 1877. Stenmaterialet var delvis fört från en gammal grund i Långlid, delvis hopsamlat i backarna N om byn. Möjligen finnas i v'ággoch takmurarna flera rester av den sönderslagna runstenen, ehuru nu...»

«DISSERTATION Titel der Dissertation Ethics in Mind Ethiopian Journalism and Ethics Verfasser: Worke Hailemarkos Ayalew Angestrebter akademischer Titel Doktor der Philosophie (Dr. phil) Wien, im 2011 Studienkennzahl lt. Studienblatt: A 092 301 Matrikelnummer: a0749672 Dissertationsgebiet lt. Studienblatt: Publizistikund Kommunikationswissenschaften Betreuer; Univ.-Prof. Dr. Thomas A. Bauer II To Fiori (Eminet Hailemarkos Ayalew), my cute Daughter For all the joy with which you fill my life. III...»

«*** Free EBOOK*** Your Journey of Personal Transformation Begins HERE: An Introduction to Understanding Your Human Design Chart by Evelyn Levenson, MBA Certified Human Design Specialist Your Success By Design Coach Your Journey Begins HERE www.HumanDesignforSuccess.com This Report is for your personal use. You MAY SHARE it, in its entirety with all author and contact information. However, You May NOT Trade, Sell or Resell This Intellectual Property in Any Way. You may not reprint any part of it...»

«The Five Organ Sonatas of Sir Charles Villiers Stanford (1852-1924) Stephanie Burgoyne ARCCO Although much has been written about Sir Charles Villiers Stanford, it is still difficult to understand why, (apart from his Anglican Cathedral church music) so little of his large output of over 200 compositions has remained to be performed. Since it is a well-known fact that none of us experience musical selections quite the same, I ask the reader to keep in mind that the intention of this submission...»

«What Indoor Cats Need To enrich the lives of indoor cats, we have developed this resource checklist; and some suggestions for making changes. Informed Owners As an owner, one of the most important things you can do for you cat is to educate yourself about feline idiosyncrasies. These resources will help you do just that. Books From the Cat's Point of View answers nearly every question the new cat owner could have and gives the experienced cat owner a look at life from the other side of the...»

«Fools Die Mario Puzo Book I Chapter 1 “Listen to me. I will tell you the truth about a man’s life. I will tell you the truth about his love for women. That he never hates them. Already you think I’m on the wrong track. Stay with me. Really—I’m a master of magic. “Do you believe a man can truly love a woman and constantly betray her? Never mind physically, but betray her in his mind, in the very ‘poetry of his soul.’ Well, it’s not easy, but men do it all the time. “Do you...»

<<  HOME   |    CONTACTS
2016 www.dissertation.xlibx.info - Dissertations, online materials

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.