Last week I worked some visual effects shots for a Latin music video of two Sony artists Dyland & Lenny. One of the locations was a greenhouse-like structure with an open door. Through the door was a bluescreen which was supposed to be replaced with a beautiful tropical beach vista. Sounds simple, right? Not even close!

There were a few key factors that made the bluescreen keying a huge challenge.

The approach I took with most of the shots was to manually mask out the rectangular area of the door, tracking all the camera movement and perspective shifts…
Then key and finesse the artist’s body with any and all methods available. This included segmenting off different areas of detail and chromakeying them with individual settings, using luma mattes and animated masks with “inner/outer” key. In a few cases, full-out rotoscoping was required.
As mentioned, the camera moved very freely – panning, tilting and dollying. The background image had to be tracked with whatever reference was available in the rest of the image. I used only 2D tracking but actually ended up figuring out a cool technique for adjusting After Effects’ perspective corner pin tracking results which I’m sure will come extremely handy in the future.

Lastly, because of the 16mm large grain format and low shutter speed, the image had a very specific look which had to be emulated on the artificial background to make it look natural. With a combination of color correction, blurring and film grain, I got a pretty close match. Ironically, the grain was the most processor-demanding effect and increased the rendering time exponentially.
Overall, it’s not the most impressive keying job, but considering the limitations, I’m pretty proud of the results. And the music video is very nice. Look for it… um, wherever it is that Spanish music videos come out. MTV Latino?…
Not just as easy as a simple key job when you have all of these things going against you (even his pants!). When does it become simpler to film at the beach and then put in a CGI greenhouse :) – thanks so much for doing these blogs, hopefully comments will pick up as you drive traffic to your various sites. I find this behind the scenes stuff fascinating and would also love a return of the behind the scenes of a Captain D production though I realize that he is just a pet project and not a paying customer (yet!) :) Keep it up man, great work!
Bill
Web video at its best! Do you have any tips for someone just out of school
I love to make your life ez my friend. You should post the video on this blog. I’m pretty happy with the final results.
[...] Read about the challenging visual effects production of this video here. [...]