Pictures Software Seamlessly Inserts New Objects Into Existing Photographs

aturnis · 10-26-2011, 11:13 PM

Pretty cool. link.

A simple programming tool can build a model of a scene in a two-dimensional photograph and insert a realistic-looking synthetic object into it. Unlike other augmented reality programs, it doesn’t use any tags, props or laser scanners to model a scene’s geometry — it just uses a small number of markers and accounts for lighting and depth. The result is an augmented scene with proper perspective, which looks so realistic that testers could not distinguish between an original photo and a modified one.
With just a single image and some annotation by a user, the program creates a physical model of a scene, as demonstrated in the video below.

Technology, Rebecca Boyle, computer graphics, editing software, image editing program, photo editing programs, photograph, PhotoshopKevin Karsch, Varsha Hedau, David Forsyth and Derek Hoiem at the University of Illinois at Urbana-Champaign developed a new image composition algorithm to generate an accurate lighting model. It uses geometry to build upon existing light-estimation methods, and it can work with any type of rendering software, the researchers explain. It works by breaking down the scene’s geometry and depth of field, and then determining how much of the scene’s overall illumination is a result of reflection (albedo) and how much directly emanates from light fixtures. This provides light parameters that can be transposed onto an inserted object. The team has developed algorithms for interior lights and for external light sources, typically light shafts from the sun.

To test how well it worked, Karsch et al. showed some study participants a series of images — some with no synthetic objects, and some with synthetic objects inserted in one of three ways: either an existing light-derivation method, their new algorithm with a simplified lighting model, and their new algorithm in all its light-modeling glory. The subjects had computer science or graphics backgrounds.

“Surprisingly, subjects tended to do a worse job identifying the real picture as the study progressed,” the authors explain in a paper describing their method. “These results indicate that people are not good at differentiating real from synthetic photographs, and that our method is state of the art.”
The method could be used for video games, movies, home decorating or other uses. The work is slated to be presented at SIGGRAPH Asia 2011.

**kysirsoze** · 10-26-2011, 11:27 PM

That's neat.

listopencil · 10-26-2011, 11:59 PM

Wow. Impressive. I expect better special effects in low budget films now.

Extra Point · 10-27-2011, 06:26 AM

Cool stuff!

**bevischief** · 10-27-2011, 06:53 AM

Quote:

Originally Posted by listopencil

Wow. Impressive. I expect better special effects in low budget films now.

I sure how so...

Amnorix · 10-27-2011, 06:57 AM

The phrase "a picture is worth 1,000 words" is going to be replaced by "a picture is worth one word -- fake."

**Ming the Merciless** · 10-27-2011, 11:01 AM

**loochy** · 10-27-2011, 11:06 AM

Quote:

Originally Posted by bevischief

I sure how so...

what is this I don't even

**Gadzooks** · 10-27-2011, 11:08 AM

Rob Gronkowski could have used this as an excuse for those photos the other day.

10-26-2011, 11:13 PM
aturnis MVP Join Date: Apr 2001 Location: Iowa Casino cash: $9975811	Software Seamlessly Inserts New Objects Into Existing Photographs Pretty cool. link. from Kevin Karsch on Vimeo. A simple programming tool can build a model of a scene in a two-dimensional photograph and insert a realistic-looking synthetic object into it. Unlike other augmented reality programs, it doesn’t use any tags, props or laser scanners to model a scene’s geometry — it just uses a small number of markers and accounts for lighting and depth. The result is an augmented scene with proper perspective, which looks so realistic that testers could not distinguish between an original photo and a modified one. With just a single image and some annotation by a user, the program creates a physical model of a scene, as demonstrated in the video below. Technology, Rebecca Boyle, computer graphics, editing software, image editing program, photo editing programs, photograph, PhotoshopKevin Karsch, Varsha Hedau, David Forsyth and Derek Hoiem at the University of Illinois at Urbana-Champaign developed a new image composition algorithm to generate an accurate lighting model. It uses geometry to build upon existing light-estimation methods, and it can work with any type of rendering software, the researchers explain. It works by breaking down the scene’s geometry and depth of field, and then determining how much of the scene’s overall illumination is a result of reflection (albedo) and how much directly emanates from light fixtures. This provides light parameters that can be transposed onto an inserted object. The team has developed algorithms for interior lights and for external light sources, typically light shafts from the sun. To test how well it worked, Karsch et al. showed some study participants a series of images — some with no synthetic objects, and some with synthetic objects inserted in one of three ways: either an existing light-derivation method, their new algorithm with a simplified lighting model, and their new algorithm in all its light-modeling glory. The subjects had computer science or graphics backgrounds. “Surprisingly, subjects tended to do a worse job identifying the real picture as the study progressed,” the authors explain in a paper describing their method. “These results indicate that people are not good at differentiating real from synthetic photographs, and that our method is state of the art.” The method could be used for video games, movies, home decorating or other uses. The work is slated to be presented at SIGGRAPH Asia 2011.
Posts: 13,873

10-26-2011, 11:27 PM	#2
kysirsoze SNAP THE ****ING BALL!!! Join Date: Sep 2007 Location: KCMO Casino cash: $3246946	That's neat.
Posts: 11,401

10-26-2011, 11:59 PM	#3
listopencil Immanentize The Eschaton Join Date: Oct 2002 Location: In Partibus Infidelium Casino cash: $1715880	Wow. Impressive. I expect better special effects in low budget films now. __________________ Good friends we have had, oh, good friends we've lost...along the way. In this great future, you can't forget your past. So dry your tears, I say.
Posts: 56,051

10-27-2011, 06:26 AM	#4
Extra Point MVP Join Date: Sep 2005 Location: Prairie Village, KS Casino cash: $10004900	Cool stuff!
Posts: 7,845

10-27-2011, 06:57 AM	#6
Amnorix In BB I trust Join Date: May 2003 Location: Boston, Mass. Casino cash: $10029808	The phrase "a picture is worth 1,000 words" is going to be replaced by "a picture is worth one word -- fake." __________________ "I love signature blocks on the Internet. I get to put whatever the hell I want in quotes, pick a pretend author, and bang, it's like he really said it." George Washington
Posts: 43,125

10-27-2011, 11:01 AM	#7
Ming the Merciless Emporer of Mongo Join Date: Apr 2010 Location: Milky Way Casino cash: $2477556	wow __________________ ---- 2018 Adopt-A-Chief : Chris Conley 2017 Adopt-A-Chief : FRANK ZOMBO Click here-->*The Holy Chiefsplanet Lexicon **
Posts: 44,496

10-27-2011, 11:08 AM	#9
Gadzooks MFIC Join Date: Jul 2009 Location: Tromsø, Norway Casino cash: $3819219	Rob Gronkowski could have used this as an excuse for those photos the other day.
Posts: 7,771