Differences between revisions 3 and 4
Revision 3 as of 2010-02-17 15:49:11
Size: 2989
Editor: 130
Comment:
Revision 4 as of 2010-04-26 21:28:29
Size: 2472
Editor: ChrisSquire
Comment:
Deletions are marked like this. Additions are marked like this.
Line 9: Line 9:
== The technology ==
Computer Vision techniques are used in the complex task of having a computer understand the world from visual snapshots, and in recent years, there have been lengthening strides of advancement. [[http://photosynth.net|Photosynth]] is an example of recent technology taking 2d photos and using them to form a 3d snapshot. This has already been done for the [[http://photosynth.net/view.aspx?cid=293ba420-ea9c-4349-bc94-b583adb72728|UCC clubroom]] (requires the Silverlight plugin) by Samuel Spencer. Photosynth is a great way of navigating your photos in 3d, but the point cloud that is generated is of note as it can provide a 3d shapes for objects and surfaces.
== Techniques ==
The use of PhotoTour [[http://phototour.cs.washington.edu/bundler/|Bundler]], [[http://grail.cs.washington.edu/software/cmvs/|CMVS]] and [[http://grail.cs.washington.edu/software/pmvs/|PMVS2]] is (in that order) a workflow that can produce a dense point cloud. Compared to just a year ago, when Bundler and Photosynth produced camera positions and a sparse, low quality point cloud, this workflow can produce impressive results. CMVS splits photos into batches of a manageable size, PMVS then reconstructs those batches and the union of them is the end product.
Line 12: Line 12:
A number of feature detection algorithms exist to pick out features in 2d images, some of which are patent encumbered and/or usage-limited. However, the same process is at work regardless of the specific algorithms and code used - find features in photos, match these features between multiple photos, extrapolate a camera position for them then process the scene as desired. MapTek, a Perth-based mining company, developed [[http://www.maptek.com/products/i-site/index.html|iSite]], a LASER-based 3D scene detection technology. One model takes 70 megapixel panorama images along with the laser points, though is made for large scale surveys. Perhaps we could borrow something from their range.
Line 14: Line 14:
While it may be annoying for those taking photos, the more-the-better principle applies here. The more obscure angles (close in on the bookshelves, from down on the floor or from up in the loft) the more detail and less issue with blank sections that were occluded. So, with that in mind.. if you'd like to take photos, don't be surprised if you're asked to get into weird positions and pull a muscle :)

== An alternative ==

MapTek, a Perth-based mining company, developed [[http://www.maptek.com/products/i-site/index.html|iSite]], a LASER-based 3D scene detection technology. Perhaps we could borrow it.
== Schedule ==
I (Chris) aim to test the Bundler->CMVS->PMVS2 workflow for usability on a small set of photos to be captured this week. From there, decisions and future happenings of the project can be planned.
Line 21: Line 18:
 * [TPG] tpg, John Hodge
 * [CJS] spartan, Chris Squire
 * [TPG] [[mailto:tpg@ucc|tpg]], John Hodge
 * [CJS] [[mailto:spartanhelmet@ucc|spartan]], Chris Squire

Description

James Cameron made a movie in 3D, so it's only fair that Cameron Hall gets the same treatment - we're a little more deserving than a Pocohontas parable. Having a 3d representation of the clubs would be good to have for a variety of purposes, including but not limited to..

  • A historical document for the Cameron Hall clubs in a tangible, graphical form
  • An opportunity to mess with modern computer vision algorithms
  • Vanity shots can be taken as those expensive DSLR cameras a number of UCCans own are shown off in a similarly vain manner
  • Bragging rights - doing new things to keep us ahead of other historic clubs with electronic coke machines
  • .. and if you're into that sort if thing, playing various PC games on a map of Cameron Hall - "Bomb has been planted!" as you flashbang unigames or "SPY AS UNISFAN" as a dispenser goes down

Techniques

The use of PhotoTour Bundler, CMVS and PMVS2 is (in that order) a workflow that can produce a dense point cloud. Compared to just a year ago, when Bundler and Photosynth produced camera positions and a sparse, low quality point cloud, this workflow can produce impressive results. CMVS splits photos into batches of a manageable size, PMVS then reconstructs those batches and the union of them is the end product.

MapTek, a Perth-based mining company, developed iSite, a LASER-based 3D scene detection technology. One model takes 70 megapixel panorama images along with the laser points, though is made for large scale surveys. Perhaps we could borrow something from their range.

Schedule

I (Chris) aim to test the Bundler->CMVS->PMVS2 workflow for usability on a small set of photos to be captured this week. From there, decisions and future happenings of the project can be planned.

The people

  • [TPG] tpg, John Hodge

  • [CJS] spartan, Chris Squire

  • The poor souls who have to figure out the archaic data format many years from now, if it's timecapsuled
  • .. and hopefully you

Stay tuned for updates!