## Interactive construction of 3d models from panoramic mosaics (1998)

### Cached

### Download Links

- [www12.informatik.uni-erlangen.de]
- [www.ri.cmu.edu]
- [www.ri.cmu.edu]
- DBLP

### Other Repositories/Bibliography

Venue: | IEEE Computer Vision and Pattern Recognition |

Citations: | 81 - 3 self |

### BibTeX

@INPROCEEDINGS{Shum98interactiveconstruction,

author = {Heung-yeung Shum and Mei Han and Richard Szeliski},

title = {Interactive construction of 3d models from panoramic mosaics},

booktitle = {IEEE Computer Vision and Pattern Recognition},

year = {1998},

pages = {427--433}

}

### Years of Citing Articles

### OpenURL

### Abstract

This paper presents an interactive modeling system that constructs 3D models from a collection of panoramic image mosaics. A panoramic mosaic consists of a set of images taken around the same viewpoint, and a transformation matrix associated with each input image. Our system first recovers the camera pose for each mosaic from known line directions and points, and then constructs the 3D model using all available geometrical constraints. We partition constraints into soft and hard linear constraints so that the modeling process can be formulated as a linearlyconstrained least-squares problem, which can be solved efficiently using QR factorization. The results of extracting wire frame and texture-mapped 3D models from single and multiple panoramas are presented. 1

### Citations

662 | Plenoptic modeling: an image-based rendering system - McMillan, Bishop - 1995 |

322 | Determining the epipolar geometry and its uncertainty: A review
- Zhang
- 1998
(Show Context)
Citation Context ...ast-squares, or we also update (R, m, n) using full bilinearly constrained non-linear least-squares. However, to better handle feature measurements taken from different viewpoints, it is more optimal =-=[Zha97]-=- to modify Eq.(5) s.t. (x − t) ‖x − t‖ · (RT ˜pj) =0,j =0, 1. (10) 8 Experiments We have implemented our system on a PC and tested it with single and multiple panoramas. The system consists of two par... |

271 | Creating full view panoramic image mosaics and environment maps
- Szeliski, Shum
- 1997
(Show Context)
Citation Context ...era calibration problem is implicitly recovered as part of the panorama construction [Ste95, KW97, SK97]. Due to recent advances, it is now possible to construct panoramas even with hand-held cameras =-=[SS97b]-=-. Previous work on 3D reconstruction from multiple panoramas [MB95, KS96] has not attempted to exploit important regularities present in the environment, such as walls with known orientations. Fortuna... |

187 |
Matrix computations, third edition
- Golub, Loan
- 1996
(Show Context)
Citation Context ...ts. Intuitively, the difference between soft and hard constraints is their weights in the least-squares formulation. Soft constraints have unit weights, while hard constraints have very large weights =-=[GV96]-=-. Some constraints (e.g., a point is known) are inherently hard, therefore equality constraints. Some constraints (e.g., a feature location on a 2D model or panorama) are most appropriate as soft cons... |

121 | R.: “3-d scene data recovery using omnidirectional multibaseline stereo - Kang, Szeliski - 1997 |

110 | True multi-image alignment and its application to mosaicing and lens distortion correction - Sawhney, Kumar - 1999 |

67 | Accurate internal camera calibration using rotation, with analysis of sources of error - Stein - 1995 |

66 | Vanishing point calculation as a statistical inference on the unitsphere
- Collins, Weiss
- 1990
(Show Context)
Citation Context ...jection plane’’ is perpendicular to the line (i.e., ñpi · ˜m =0), we want to minimize e = ∑ (ñpi · ˜m) 2 = ˜m T ( ∑ ñpiñ T pi) ˜m. (2) i This is equivalent to finding the vanishing point of the lines =-=[CW90]-=-. The advantage of the above formulation is that the sign ambiguity of ñpi can be ignored. When only two parallel lines are given, the solution is simply the cross product of two line projection plane... |

60 | Semiautomatic 3-D model extraction from uncalibrated 2-D camera views
- Becker, Bove
- 1995
(Show Context)
Citation Context ...cts other possible matching points from one image to others. In Becker’s modeling system 3 , the problem of lens distortion (encounted in images taken with wide field of view lens) is also considered =-=[BB95]-=-. By employing the known structure of building exteriors, the Facade system 4 directly recovers a solid 3D model (blocks) from multiple images [TDM96]. Our system differs from previous interactive mod... |

51 | R.: Panoramic Image Mosaics
- Shum, Szeliski
- 1997
(Show Context)
Citation Context ...t-squares ‖A2x2 − (b − A1x1)‖ 2 because Ax − b = AQQ T x − b = A1x1 + A2x2 − b [ x1 Finally x = Q x2 = A2x2 − (b − A1x1). ] . If C is not of full rank, other approaches such as the elimination method =-=[SS97a]-=- can be used. 6.3 Decomposing the linear system Before we can apply the equality-constrained linear system solver, we must check whether the linear system formed by all constraints is solvable. In gen... |

42 | 3D reconstruction of urban scenes from sequences of images - Faugeras, Laveau, et al. - 1995 |

27 |
Determining Camera Parameters from the Perspective Projection of a Rectangle
- Haralick
- 1989
(Show Context)
Citation Context ...le. As with the parallelogram, we get one line direction m1 from 2 parallel lines. And because m1·m2 = 0 and np2 · m2 =0, where np2 = R T ñp2, we obtain the other line direction m2 = m1 × np2. Unlike =-=[Har89]-=-, we do not need to know specify all four corners of a rectangle. Using the techniques described above, we can therefore recover the surface orientation of an arbitrary plane (e.g., tilted ceiling) pr... |

19 | Characterization of errors in compositing panoramic images - Kang, Weiss - 1999 |

19 | Reconstructing polyhedral models of architectural scenes from photographs
- Taylor, Debevec, et al.
- 1996
(Show Context)
Citation Context ...n with wide field of view lens) is also considered [BB95]. By employing the known structure of building exteriors, the Facade system 4 directly recovers a solid 3D model (blocks) from multiple images =-=[TDM96]-=-. Our system differs from previous interactive modeling systems in that we use multiple panoramic image mosaics (therefore large fields of view), instead of multiple images (generally small fields of ... |

13 |
TotalCalib: a fast and reliable system for off-line calibration of images sequences
- Bougnoux, Robert
- 1997
(Show Context)
Citation Context ...ied points. Explicit camera calibration is therefore necessary. 1 www.photomodeler.com The TotalCalib system 2 , on the other hand, estimates the fundemental matrix from a few selected matched points =-=[BR97]-=-. It then predicts other possible matching points from one image to others. In Becker’s modeling system 3 , the problem of lens distortion (encounted in images taken with wide field of view lens) is a... |

5 |
Geometric reasoning for constructing 3D scene descriptions from images
- Walker, Herman
- 1988
(Show Context)
Citation Context ...urate estimates of the 3D model. Our results show that it is desirable and practical for the modeling system to take advantage of as many regularities and priori knowledge about man-made environments =-=[WH88]-=- (such as vertice lines and planes) as possible. We are working on several extensions to improve the usability of our system. For example, we have implemented an automatic line snapping technique whic... |