 |
|
|
|
|
|
 Title: |
US6064749:
Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
[ Derwent Title ]
|
| Country: |
US United States of America
|
| |
| Inventor: |
Hirota, Gentaro; Carrboro, NC 28510
State, Andrei; Chapel Hill, NC 27516
|
| Assignee: |
None
|
| Published / Filed: |
2000-05-16
/ 1996-08-02
|
| Application Number: |
US1996000691684
|
| IPC Code: |
Advanced:
G06K 9/00;
G06T 7/00;
Core:
more...
IPC-7:
G06K 9/00;
|
| ECLA Code: |
G06T7/00P; G06F3/01B;
|
| U.S. Class: |
382/103;
345/007;
359/630;
|
| Field of Search: |
382/100,154,162,291,294,295
345/285,7-9,419,424,473-474,112-114,435,439
356/012
359/013,630
348/239,586
|
| Government Interest: |
This invention was made with government support under Defense Advanced Research Projects Agency grant number DABT63-93-C-0048. The government has certain rights in this invention.
|
| Priority Number: |
| 1996-08-02 |
US1996000691684 |
|
| Abstract: |
Systems, methods and computer program products which have the registration accuracy of vision-based tracking systems and the robustness of magnetic tracking systems. Video tracking of landmarks is utilized as the primary method for determining camera position and orientation but is enhanced by magnetic or other forms of physical tracking camera movement and orientation. A physical tracker narrows the landmark search area on images, speeding up the landmark search process. Information from the physical tracker may also be used to select one of several solutions of a non-linear equation resulting from the vision-based tracker. The physical tracker may also act as a primary tracker if the image analyzer cannot locate enough landmarks to provide proper registration, thus, avoiding complete loss of registration. Furthermore, if 1 or 2 landmarks (not enough for a unique solution) are detected, several may be utilized heuristic methods are used to minimize registration loss. Catastrophic failure may be avoided by monitoring the difference between results from the physical tracker and the vision-based tracker and discarding corrections that exceed a certain magnitude. The hybrid tracking system is equally applicable to see-through and video augmented reality systems.
|
| Attorney, Agent or Firm: |
Myers Bigel Sibley & Sajovec ;
|
| Primary / Asst. Examiners: |
Chang, Jon; Patel, Jayami K.
|
| Maintenance Status: |
CC Certificate of Correction issued
|
| INPADOC Legal Status: |
Show legal status actions
|
| Family: |
None
|
First Claim:
Show all 35 claims |
That which is claimed is:
1. A method of registering a computer generated graphic to objects in the real world to provide a composite augmented reality image, the method comprising:
- obtaining a first image corresponding to the field of view of a camera;
- determining the location within the first image of a landmark to create an initial landmark location;
- detecting the physical movement of the user operated camera to create a camera displacement;
- obtaining a second image corresponding to the field of view of the camera;
- predicting the location of the landmark within the second image based on the camera displacement that reflects the physical movement of the camera independent of the first and second images obtained by the camera and the initial landmark location determined from the first image;
- defining a search region within the second image based upon the predicted location of the landmark within the second image;
- locating the landmark within the defined search region of the second image to create an actual landmark location; and
- registering the computer generated graphic to objects in the real world based upon the actual landmark location so as to provide a composite augmented reality image.
|
| Background / Summary: |
Show background / summary
|
| Drawing Descriptions: |
Show drawing descriptions
|
| Description: |
Show description
|
| Forward References: |
Show 39 U.S. patent(s) that reference this one
|
|
|
|
|
|
|
| U.S. References: |
Go to Result Set:
All U.S. references
| Forward references (39)
|
Backward references (19)
|
Citation Link
Buy
PDF |
Patent |
Pub.Date |
Inventor |
Assignee |
Title |
 |
US5436638 |
1995-07 |
Bolas et al. |
Fakespace, Inc. |
Image display method and apparatus with means for yoking viewpoint orienting muscles of a user
|
|
|
US5446834 |
1995-08 |
Deering |
Sun Microsystems, Inc. |
Method and apparatus for high resolution virtual reality systems using head tracked display
|
|
|
US5471541 |
1995-11 |
Burtnyk et al. |
National Research Council of Canada |
System for determining the pose of an object which utilizes range profiles and synethic profiles derived from a model
|
|
|
US5483961 |
1996-01 |
Kelly et al. |
|
Magnetic field digitizer for stereotactic surgery
|
|
|
US5495576 |
1996-02 |
Ritchey |
|
Panoramic image based virtual reality/telepresence audio-visual system and method
|
|
|
US5526022 |
1996-06 |
Donahue et al. |
Virtual I/O, Inc. |
Sourceless orientation sensor
|
|
|
US5531227 |
1996-07 |
Schneider |
Schneider Medical Technologies, Inc. |
Imaging device and method
|
|
|
US5548694 |
1996-08 |
Gibson |
Mitsubishi Electric Information Technology Center America, Inc. |
Collision avoidance system for voxel-based object representation
|
|
|
US5585813 |
1996-12 |
Howard |
Rockwell International Corporation |
All aspect head aiming display
|
|
|
US5606627 |
1997-02 |
Kuo |
Eotek Inc. |
Automated analytic stereo comparator
|
|
|
US5613013 |
1997-03 |
Schuette |
Reticula Corporation |
Glass patterns in image alignment and analysis
|
|
|
US5625765 |
1997-04 |
Ellenby et al. |
Criticom Corp. |
Vision systems including devices and methods for combining images for extended magnification schemes
|
|
|
US5706195 |
1998-01 |
Corby, Jr. et al. |
General Electric Company |
Augmented reality maintenance system for multiple rovs
|
|
|
US5710878 |
1998-01 |
McCoy et al. |
|
Method for facilitating material application for a group of objects of a computer graphic
|
|
|
US5717414 |
1998-02 |
Bergsneider et al. |
Lockheed-Martin Tactical Defense Systems |
Video image tracking and mixing system
|
|
|
US5719598 |
1998-02 |
Latham |
Loral Aerospace Corporation |
Graphics processor for parallel processing a plurality of fields of view for multiple video displays
|
|
|
US5850352 |
1998-12 |
Moezzi et al. |
The Regents of the University of California |
Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images
|
|
|
US5889951 |
1999-03 |
Lombardi |
Viewpoint Corporation |
Systems, methods, and computer program products for accessing, leasing, relocating, constructing and modifying internet sites within a multi-dimensional virtual reality environment
|
|
|
US5914748 |
1999-06 |
Parulski et al. |
Eastman Kodak Company |
Method and apparatus for generating a composite image using the difference of two images
|
|
|
|
|
|
|
|
| Foreign References: |
None
|
| Other References: |
M. Bajura and U. Neumann, Dynamic Registration Correction in Augmented-Reality Systems, Proceedings of the Virtual Reality Annual International Syumposium '95 (Mar. 11-15, 1995), Research Triangle Park, pp. 189-196 (1995).
M. Bajura and U. Neumann, Dynamic Registration Correction in Video-Based Augmented Reality Systems, IEEE Computer Graphics and Applications, pp. 52-60, (Sep. 1995).
R. Azuma, A Survey of Augmented Reality, SIGGRAPH 1995 Course Notes #9 (Developing Advanced Virtual Reality Applications), pp. 1-40 (1995).
R. Azuma and G. Bishop, Improving Static and Dynamic Registration in an Optical See-through HMD, SIGGRAPH 94 (Orlando, FL, Jul. 24-29, 1994), Computer Graphics Proceedings, Annual Conference Series, pp. 197-203 (1994).
M. Fischler and R. Bolles, Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography, Communications of the ACM, vol. 24, No. 6, pp. 381-395 (Jun. 1981).
R. Holloway, Registration Errors in Augmented Reality Systems, Ph.D. dissertation, University of North Carolina at Chapel Hill (Aug. 1995).
A. Janin, et al., A videometric head tracker for augmented reality applications, Proceedings of SPIE, pp. 308-315 (Nov. 1994).
A. Kancherla, et al., A Novel Virtual Reality Tool for Teaching Dynamic 3D Anatomy, Proceedings of CVRMed '95 (Nice, France, Apr. 3-5, 1995), pp. 163-169.
D. Lowe, Three-Dimensional Object Recognition from Single Two-Dimensional Images, Artificial Intelligence, 31 (1987), pp. 355-395.
D. Lowe, Robust Model-based Motion Tracking Through the Integration of Search and Estimation, International Journal of Computer Vision, 8:2 (1992), pp. 113-122.
J.P. Mellor, Realtime Camera Calibration for Enhanced Reality Visualization, Proceedings of CVRMed '95 (Nice, France Apr. 305, 1995), pp. 471-475.
M. Mine, Characterization of End-to-End Delays in Head-Mounted Display Systems, University of North Carolina at Chapel Hill Technical Report TR93-005 (Mar. 1993).
I. Sutherland, A head-mounted three dimensional display, Fall Joint Computer Conference (1968), pp. 757-764.
R. Tsai, A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses, IEEE Journal of Robotics and Automation, vol. RA-3, No. 4 (Aug. 1987), pp. 323-344.
M. Tuceryan, et al., Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System, IEEE Transactions on Visualization and Computer Graphics, vol. 1, No. 3 (Sep. 1995), pp. 255-273.
M. Uenohara and T. Kanade, Vision-Based Object Registration for Real-Time Image Overlay, 1995 Conference on Computer Vision, Virtual Reality and Robotics in Medicine (Nice, France, Apr. 1995), pp. 13-22.
L. Wang and W. Tsai, Computing Camera Parameters using Vanishing-Line Information from a Rectangular Parallelepiped, Machine Vision and Applications (1990), pp. 129-141.
M. Ward, et al., A Demonstrated Optical Tracker With Scalable Work Area for Head-Mounted Display Systems, Proceedings of the 1992 Symposium on Interactive 3D Graphics (Boston, MA, Mar. 1-Apr. 1, 1992), pp. 43-52.
T. Yoo and T. Olano, Instant Hole.TM. (Windows onto Reality), University of North Carolina at Chapel Hill Technical Report TR93-027 (1993).
M. Bajura and U. Neumann, Dynamic Registration Correction in Augmented-Reality Systems, University of North Carolina at Chapel Hill--Department of Computer Science Technical Report TR94-022.
|
|
 Nominate this for the Gallery...
|
|
