current ophthalmic simulators demonstrate the equipment setup and 3-dimensional ( 3d ) image perception in a 2d environment .
however they do not simulate the 3d nature of the eye so that the trainee does not appreciate the structures within the eye in true 3d , and therefore depth perception and spatial awareness are a problem .
depth perception and spatial awareness are very important in that manipulation of instruments within the eye by the examiner involves distances that are microscopic . it is critical that ophthalmologists learn in three dimensions for procedures . in ocular ultrasound
it is important to know where the resultant ultrasound beam is being placed according to probe position and hence the structures being examined .
the most challenging aspect of ocular b - scan ultrasound is the conversion , by the operator , of 2d slice of image into 3d interpretations .
this also needs to be realized in real time in order to formulate an echographic diagnostic interpretation . in photocoagulation of the retina and yag laser capsulotomy
it is important to know exactly where and at what depth to aim the laser so as not to damage adjacent structures that can potentially have blinding consequences in real patient situations .
hence patients will not need to have procedures done by less experienced clinicians until they are deemed competent by way of learning from these models .
there is no current technology that can simulate the procedure in true 3d to give the ophthalmologist even more insight into the complexity of the procedure they are simulating .
we have studied extensively 3d computer technology and its use in teaching medical procedures.16 the proposed solution is real 3d and the team has developed an eye model that can be manipulated in 3 dimensions to give a user - defined perspective of the model eye that is an ideal teaching tool ( see figure 1 ) .
this technology can be integrated into simulators of medical equipment , such as ophthalmoscopes , ultrasound probes , and lasers , to give real time 3d feedback on ophthalmologists aiming and operation of the equipment and simulate the consequences of their actions , such as measuring distances in ultrasound .
the system can evaluate their technique and compare their performance against a gold standard performed by a competent operator .
the system can give them feedback and illustrate the gold standard performance for educational purposes .
we have developed a novel approach to teach ocular ultrasound by using a novel 3d ocular model .
a 3d virtual model is built using widely available , open source , software ( see figure 2 ) .
the model is then used to generate movie clips simulating different orientations of the scanner head . using blender ,
quicktime motion clips are choreographed and collated into interactive quizzes and other pertinent pedagogical media .
the process involves scripting motion vectors , rotation , and tracking , of both the virtual stereo camera and the model .
the resulting sequence is then rendered for twinned right- and left - eye views . finally , the twinned views are synchronized and combined in a format compatible with the stereo projection apparatus .
the process of making models and the various simulations are detailed further on our website ( http://www.abdn.ac.uk/~com168/ophth/development_process.shtml ) to illustrate further the potential of our models .
the eye models are currently being used to teach ocular ultrasound and they have been made to simulate ultrasound positions and lesion localization ( see figure 3 ) .
these models will help the student with spatial awareness and allow for assimilation of this awareness into clinical practice .
it will also help with grasping the nomenclature used in ocular ultrasound as well as helping with localization of lesions and obtaining the best possible images for echographic diagnosis , accurate measurements , and reporting .
a further model has been developed from our experience and work on eye modeling in blender .
this model is interactive and can be manipulated in any direction and plane using a graphics interface pad .
this model has much potential to teach where both trainer and trainee can interact with it .
it will be used to teach not only ultrasound , but also ophthalmic anatomy , and surgical and laser procedures . to date
a virtual eye model has been developed ( see figure 4 ) and used to test the potential for learning enhancement with students of ophthalmology , as detailed table 1 .
we are currently working on specifying and commissioning a prototype of the hardware and drivers of peripheral devices to control a range of open source software such as openscenegraph ( osg ) and blender , thereby allowing real - time manipulation of the virtual eye models in pedagogical scenarios .
develop the prototype peripheral hardware and electronics : 
 globe peripheral and drivers broadcasting the orientation 
pitch , yaw , and tilt  the real - time orientation of the globe.probe peripheral and drivers broadcasting proximity , and orientation of the probe relative to the globe , in real-time.wifi communication with host computer and osg tracking module .
globe peripheral and drivers broadcasting the orientation  pitch , yaw , and tilt  the real - time orientation of the globe .
probe peripheral and drivers broadcasting proximity , and orientation of the probe relative to the globe , in real - time .
this involves writing an osg manipulator module which compiles on windows , macintosh , and linux .
develop and field test software modules utilizing the generated osg manipulator data on the existing eye model , thereby manipulating and displaying : 
 real - time orientation of the globe model affecting the virtual eye model.real-time orientation of the probe relative to the globe affecting the virtual probe and , ultimately ( see 4 below ) , generating synthesized scanner output .
real - time orientation of the probe relative to the globe affecting the virtual probe and , ultimately ( see 4 below ) , generating synthesized scanner output .
develop and field test associated ophthalmology teaching and learning modules utilizing these tools , and including refinement of the existing eye model s appearance .
develop a visual synthesizer module for osg , generating an inset panel within the 3d environment displaying simulated , real - time , ultrasonic scanner output dependent on the probe s position relative to the globe extend the application display capabilities to 3d spectacles and thus fully immersive 3d augmented reality experiences , for example : 
 within simulated microscope apparatus.a multiuser server for small group anatomy tutorials utilizing 3d spectacles .
this needs to track each user s head position relative to the assumed location of the virtual model . within simulated microscope apparatus . a multiuser server for small group anatomy tutorials utilizing 3d spectacles
this needs to track each user s head position relative to the assumed location of the virtual model .
to date a virtual eye model has been developed ( see figure 4 ) and used to test the potential for learning enhancement with students of ophthalmology , as detailed table 1 .
we are currently working on specifying and commissioning a prototype of the hardware and drivers of peripheral devices to control a range of open source software such as openscenegraph ( osg ) and blender , thereby allowing real - time manipulation of the virtual eye models in pedagogical scenarios .
develop the prototype peripheral hardware and electronics : 
 globe peripheral and drivers broadcasting the orientation 
pitch , yaw , and tilt  the real - time orientation of the globe.probe peripheral and drivers broadcasting proximity , and orientation of the probe relative to the globe , in real-time.wifi communication with host computer and osg tracking module .
globe peripheral and drivers broadcasting the orientation  pitch , yaw , and tilt  the real - time orientation of the globe .
probe peripheral and drivers broadcasting proximity , and orientation of the probe relative to the globe , in real - time .
this involves writing an osg manipulator module which compiles on windows , macintosh , and linux .
develop and field test software modules utilizing the generated osg manipulator data on the existing eye model , thereby manipulating and displaying : 
 real - time orientation of the globe model affecting the virtual eye model.real-time orientation of the probe relative to the globe affecting the virtual probe and , ultimately ( see 4 below ) , generating synthesized scanner output .
real - time orientation of the probe relative to the globe affecting the virtual probe and , ultimately ( see 4 below ) , generating synthesized scanner output .
develop and field test associated ophthalmology teaching and learning modules utilizing these tools , and including refinement of the existing eye model s appearance . develop a visual synthesizer module for osg , generating an inset panel within the 3d environment displaying simulated , real - time , ultrasonic scanner output dependent on the probe s position relative to the globe extend the application display capabilities to 3d spectacles and thus fully immersive 3d augmented reality experiences , for example : 
 within simulated microscope apparatus.a multiuser server for small group anatomy tutorials utilizing 3d spectacles .
this needs to track each user s head position relative to the assumed location of the virtual model . within simulated microscope apparatus .
this needs to track each user s head position relative to the assumed location of the virtual model .
. further refinement of these models and appropriate hardware integration will allow us to develop this tool for the benefit of teaching ocular ultrasound as well as surgical and laser procedures without having to put patients at risk .
it is important for us to develop this technology further for the benefit of the ophthalmological profession and fraternity .
 ocular ultrasound is now in increasing demand in routine ophthalmic clinical practice not only because it is noninvasive but also because of ever - advancing technology providing higher resolution imaging . 
 it is however a difficult branch of ophthalmic investigations to grasp , as it requires a high skill level to interface with the technology and provide accurate interpretation of images for ophthalmic diagnosis and management . 
 it is even more labor intensive to teach ocular ultrasound to another fellow clinician . 
 one of the fundamental skills that proved difficult to learn and teach is the need for the examiner to  mentally convert  2-dimensional b - scan images into 3-dimensional ( 3d ) interpretations . 
 an additional challenge is the requirement to carry out this task in real time . 
 we have developed a novel approach to teach ocular ultrasound by using a novel 3d ocular model . 
 a 3d virtual model is built using widely available , open source , software . 
 the model is then used to generate movie clips simulating different movements and orientations of the scanner head . using blender , 
 quicktime motion clips are choreographed and collated into interactive quizzes and other pertinent pedagogical media . 
 the process involves scripting motion vectors , rotation , and tracking of both the virtual stereo camera and the model . 
 the resulting sequence is then rendered for twinned right- and left - eye views . finally , the twinned views are synchronized and combined in a format compatible with the stereo projection apparatus . this new model will help the student with spatial awareness and allow for assimilation of this awareness into clinical practice . 
 it will also help with grasping the nomenclature used in ocular ultrasound as well as helping with localization of lesions and obtaining the best possible images for echographic diagnosis , accurate measurements , and reporting . 
Introduction
Methods
Results and discussion
Future development
Possible hardware integration
Items include
Conclusion