Thursday, September 28, 2017

Physical Cameras in Stingray

This is a quick blog to share some of the progress Olivier Dionne and I made lately with Physical Cameras in Stingray. Our goal of implementing a solid physically based pipeline has always been split in three phases. First we validated our standard material. We then added physical lights. And now we are wrapping it up with a physical camera.

We define a physical camera as an entity controlled by the same parameters a real world camera would use. These parameters are split into two groups which corresponds to the two main parts of a camera. The camera body is defined by it's sensor size, iso sensitivity, and a range of available shutter speeds. The camera lens is defined by it's focal length, focus range, and range of aperture diameters. Setting all of these parameters should expose the incoming light the same way a real world camera would.

Stingray Representation

Just like our physical light, our camera is expressed as an entity with a bunch of components. The main two components being the Camera Body and the Camera Lens. We then have a transform component and a camera component which together represents the view projection matrix of the camera. After that we have a list of shading environment components which we deem relevant to be controlled by a physical camera (all post effects relevent to a camera). The state of these shading environment components is controled through a script component called the "Physical Camera Properties Mapper" (more on this later). Here is a glimpse of what the Physical Camera entity may look like (wip):

So while there are a lot of components that belongs to a physical camera, the user is expected to interact mainly with the body and the lens components.

Post Effects

A lot of our post effects are dedicated to simulate some sort of camera/lens artifact (DOF, motion blur, film grain, vignetting, bloom, chromatic aberation, ect). One thing we wanted was the ability for physical cameras to override the post processes defined in our global shading environments. We also wanted to let users easily opt out of the physically based mapping that occurred between a camera and it's corresponding post-effect. For example a physical camera will generate an accurate circle of confusion for the depth of field effect, but a user might be frustrated by the limitations imposed by a physically correct dof effect. In this case a user can opt out by simply deleting the "Depth Of Field" component from the camera entity.

It's nice to see how the expressiveness of the Stingray entity system is shaping up and how it enables us to build these complex entities without the need to change much of the engine.

Properties Mapper

All of the mapping occurs in the properties mapper component which I mentioned earlier. This is simply a lua script that gets executed whenever any of the entity properties are edited.

The most important property we wanted to map was the exposure value. We wanted the f-stop, shutter speed, and ISO values to map to an exposure value which would simulate how a real camera sensor reacts to incoming light. Lucky for us this topic is very well covered by Sebastien Lagarde and Charles de Rousiers in their awesome awesome awesome Moving Frostbite to Physically Based Rendering document. The mapping basically boils down to:

The second property we were really interested in mapping is the field of view of the camera. Usually the horizontal FOV is calculated as 2 x atan(h/2f) where h is the camera sensor's width and f is the current focal length of the lens. This by itself gives a good approximation of the FOV of a lens, but as was pointed out by the MGS5 & Fox Engine presentation, the focus distance of the lens should also be considered when calculating the FOV from the camera properties.

Intuitively we though that the change in the FOV was caused by a change in the effective focal length of the lens. Adjusting the focus usually shifts a group of lenses up and down the optical axis of a camera lens. Our best guess was that this shift would increase or decrease the effective focal length of the camera lens. Using this idea we we're able to simulate the effect that changing the focus point has on the FOV of a camera:

While this gave us plausible results in some cases, it does not map accurately to a real world camera with certain lens settings. For example we can choose a focal length offset that gives good FOV mapping for a zoom lens set to 24mm but incorrect FOV results when it's set to 70mm (see video above). This area of lens optics is one we would like to explore more in the future.

In the future we will map more camera properties to their corresponding post-effects. More on this in a follow up blog.

Validating Results

To validate our mappings we designed a small, controlled environment room that we re-created in stingray. This idea was inspired by the "Conference Room" setup that was presented by Hideo Kojima in the MGS5 & Fox Engine presentation. We used our simplified, environment room to compare our rendered results with real world photographs.

Controlled Environment:

Stingray Equivalent:

Since there is no convenient way to adjust the white balancing in Stingray, we decided to white balance our camera data and use a pure white light in our Stingray scene. We also decided to compare the photos and renders in linear space in the hope to minimize the source of potential error.

White balancing our photographs:

Our very first comparison we're disapointing:

We tracked down the difference in brightness to a problem with how we expressed our light intensity. We discovered that we made the mistake of using the specified lumen value of our lights as it's light intensity. The total luminous flux is expressed in lumens, but the luminous intensity (what the material shader is interested in) is actually the luminous flux per solid angle. So while we let the users enter the "intensity" of lights in lumens, we need to map this value to luminous intensity. The mapping is done as lumens/2π(1-cos(½α)) where α is the apex angle of the light. Lots of details can be found here. This works well for point lights and spot lights. In the future our directional lights will be assumed to be the sun or moon and will be expressed in lux, perhaps with a corresponding disk size.

With this fix in place we started getting more encouraging results:

There is lots left to do but this feels like a very good start to our physically based cameras. This is my last post on the Stingray blog but you can follow Olivier on Twitter if you want to stay up to date with the advances made by the Stingray rendering team. Cheers!

200 comments:

OneDrive makes sharing and record organization less requesting in the cloud, enabling people to securely store, access, and offer their archives and photos from wherever, finished their contraptions.www.office.com/setup

AOL Email Support is one of the best email service providers that helps in AOL email related issues.,Find solutions to your AOL Mail, login, Desktop Gold, AOL application, watchword and membership questions. Discover the help alternatives to contact client mind by email, visit, or telephone number..call TOllfree 1855-888-4421Please visit...Aol Email Support

Office.com/setup - Instructions for Office Setup Installation with the assistance of this Blog. Get the guidelines for establishments help with Microsoft Office Follow the direction on the page. you can download and install Office, Help with moving up to Windows 10, Installation process for Office 365 HomeFor Installation Help Please Visit...Office Setup

Office.com/setup - Instructions for Office Setup Installation with the help of this Blog. Get the installation help for Microsoft Office Follow the bearing on the page. you can download and introduce Office, Help with installation process of Windows 10, Installation process for Office 365 Home For Installation Help Please Visit...office setupInstall officeInstall Microsoft office

Learn how to transfer your Norton security to a new computer, Formatted or ... If you do not have an account, click Create account, and then complete the sign-up process. In the Norton Setup window, click Download Norton.

This article will help the reader to know what to take into consideration when shopping for a new video camera. This article is geared towards DIY (Do It Yourself) type people needing to make professional quality videos on their own. I cover different styles of cameras and tips to help you get started on the road to making great high quality video content. Buy Dashcam Bluetooth

Activate Webroot Antivirus to resolve any problems associated with security of your Desktop, Mobile, Tablet or Laptop just you need to do a single click www.webroot.com/safe For office Setup Visit www.office.com/setup

Brainy Provide education franchise opportunities and online education business opportunities along with how to start online education franchise business and investment information and complete course structure for 7-12 years kids.

Joint Supplements For Dogs. Our select triple action Glucosamine, Chondroitin and Turmeric formula works to not only relieve pain, ease limb heaviness and joint aches but also lubricates joints and strengthens cartilage to increase your pet s mobility and greatly improve their quality of life Relieves stiffness and inflammation in pets sufferin.

Thanks for sharing nice information with us. i like your post and all you share with us is uptodate and quite informative, i would like to bookmark the page so i can come here again to read you, as you have done a wonderful job. Photo cameras user manuals

These few features will help you get the best home security system which will bring you peace of mind and security you so deserve in your Hikvision Melbourne Just ensure your research and evaluation is thorough before entering into any related deals.

Security measures such as Sydney Serious CCTV cameras, recorders, and fingerprint/password protected access control systems ensure legal help if things go wrong. More important, they can actually prevent or stop things from going south.

Fantastic post, very informative. I wonder why the other specialists of this sector do not notice this. You must continue your writing. I'm confident, you have a great readers' base already! reviewworldall

avast support is a world-renowned name in the internet security domain. The company delivers a wide selection of antivirus and security software to deal with the harmful online threats lurking in the internet market. There are a number of errors that can affect the performance of the antivirus and makes it unable to protect your device. These errors should be fixed immediately to ensure the continued protection of your device. At avast-support.net, we offer the support services for the same.

Are you one of those Binance users who end up getting trapped in the errors and troubles? Are you coming across problems while withdrawing coins in Binance? If yes, you can get in touch with the superior team of professionals in the industry. Dial Binance Support Number 1-877-330-7540 and get out of the box assistance and remedies from the professionals who are around the clock to assist you. The team is always there to aid you until you aren’t able to execute the process and memorize it for the long run. Binance Support Number1-877-330-7540

Bitdefender Login offers unmatched security coverage for all your connected devices including Windows, Mac, Androids. iOS, etc. It is globally recommended for utmost convenience both at the time of usage and setup.

Thank you for sharing excellent information. Your website is so cool. I am impressed by the details that you have on this website. It reveals how nicely you understand this subject. Bookmarked this website page, will come back for extra articles. You, my friend, ROCK! I found simply the info I already searched everywhere and simply could not come across. What a great web site. Visit@: my sites :- office.com/setup »Norton.com/setup»McAfee.com/Activate

Agarwal packers and movers are the best packers as the activities delegated by them are so reliable and smooth that is loved by all. They do not compromise with safety at any step of the move. I liked their services as not a single issue came in their packing and everything was perfect and the staff was quite disciplined one. There was no attitude in their staff. Just enjoy the taste of their service.

Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!

Welcome to my own where that you can appreciate that how girl Escorts administrations delivering by way of me and my exclusive administrations at above Delhi Escorts all affordable bills at 24 hours. Presently a days, individuals are dwelling unpleasant and boisterous lifestyles.

Today’s Many people are choosing the Apple iMac now a days because of its lovely capabilities. It has were given a slender and smooth layout body. in relation to performance Apple iMac is certainly a wonder.imac support number

Jeewangarg is a one-stop solution for all of your digital marketing needs whether to build your online presence or establish your own brand. We are specialized in building a website, doing Effective SEO for websites and providing the best Google Adwords Services and Digital Marketing Agency to our valuable clients. Though, there are numerous factors that separate us from any other SEO Services in Delhi, here are a few that we believe would not be too much to mention.

Emedkit are a global pharmaceutical company whose mission is to advance the well-being of people around the world especially in countries like India, USA, Russia, Romania, Peru, and China. Our products include treatments for diseases such as Ledifos tablets, HIV/AIDS, Cancer, Hepcinat Lp tablets, Cancer Medicine. We provide our products at the lowest possible price as we stock bulk qualities and we deal both in drop shipping and bulk shipping.

Excellent Post, Very informative. Plan Your next Holidays with Indian Travel Store and get some Exciting Deals on Tours & Travels Packages for Shimla, Manali, Nepal, Bhutan, Rajasthan, Dalhousie, Dharamshala, Kerala, Uttarakhand and many more. Book your next Shimla Manali Tour Package with us for availing some great deals.

Servo Star is a prominent Servo Stabilizer manufacturer, providing a wide range of Servo Voltage stabilizers in India and an array starting from 5 KVA to 5000 KVA for residential, industrial and medical use.

This is highly informatics, crisp and clear. I think that everything has been described in a systematic manner so that reader could get maximum information and learn many things.Brother Printer Not Printing

Hello, I have browsed most of your posts. This post is probably where I got the most useful information for my research. Thanks for posting, we can see more on this. Are you aware of any other websites on this subject.Dell support assistant not responding

You could definitely see your skills in the article you write. The world hopes for even more passionate writers like you who aren’t afraid to say how they believe. All the time go after your heart.How To Factory Reset Computer

Hello, I have browsed most of your posts. This post is probably where I got the most useful information for my research. Thanks for posting, we can see more on this. Are you aware of any other websites on this subject.Dell support assistant

I really thank you for the valuable info on this great subject and look forward to more great posts. Thanks a lot for enjoying this beauty article with me. I am appreciating it very much! Looking forward to another great article. Good luck to the author! All the best!Reset icloud Password

I'm very thankful to you to give us this amazing information. I appreciate your intelligence and knowledge. And if you are facing error code 2147500037 in your Brother Printer then visit our website and solve this problem in no time by following the simple steps given by our printer experts.How to fix Brother Printer error code 2147500037

1.To begin with, navigate to the hp support page 2.Find the software and drivers option on the top blue bar3.In the next page select the option as printer4.You will have to type in the printer model which is, in this case, HP Envy 50555.The next page will have the list of HP Envy 5055 drivers6.Choose the correct one and click on the download7.After the download completes, continue with the instructions on the screen to complete the HP Envy 5055 driverIf you want to know anything else regarding the HP printers, call us using the toll-free number.

Kerala is the dream destination of all the tourists, adventurers, honeymooners, and visitors. If you also want to book kerala tour packages for family then explore the range of best kerala tour packages with price by Indian Travel Store and select one among a wide range of kerala tour packages which suits your budget and requirements.

I'm very thankful to you to give us this amazing information decumar new visit our website and solve this problem in no time by following the simple steps given by our printer experts. COMBO DECUMAR SUPER

Love problem solution is the biggest issue of today’s generation. They don’t know how to handle this, it makes them feel like a hell, they try to act stupid and suddenly their life turns from happy to the Grey world.

office.com/setup : At the point when we are working or serve the client just one in our mind that is "Consumer loyalty". We think each agents believing resembles as we have and we are continually hoping to improve our capacity to address the issue of our customers.We have huge number of trucks and other development gear to take the necessary steps in a great way and our trustworthiness, workplace and advancement to take the organization on high. At the point when each client really fulfilled , then individuals says that is the privilege choice.For More : office.com/setup \ Microsoft office setup Best Regards

Being the best streaming service in the US, Roku has a keen track of all your activities using the Roku account that you create. Roku also needs you to complete the Roku.com/link for activating the account. Here are certain things that we assist you on to complete the Roku activation.For any further queries on Roku com link Activation, feel free to contact our active customer care team, working round the clock at the toll-free number.

If you are looking office software downloading, then you will receive a Microsoft Office product key, in your registered email address, which will be required at the time of product activation. If you have purchased the Office product Offline, then you will receive its product key in the box along with the setup CD. office.com/setup

Often the Are generally Weight reduction plan is unquestionably an low-priced and flexible weight-reduction plan product modeled on individuals seeking out shed some pounds combined with at some point maintain a far healthier your life. la weight loss solidworks 2018 premium

After 20 years of working with Senior Executives across the world it's interesting to see the mistakes when appointing Senior Executives. There can be many reasons why, but one reason is not understanding the differences of working in a Family Business and a Non-Family Business. I've recently met several Senior Executives who are unhappy with their employment because of this lack of knowledge and understanding and I'm meeting Business owners who didn't realise there was a difference. These Business Owners feel that money and title is enough and stick to the Mantra of "Surely experienced 'C' level Executives can work in any company?" buy cheap graphic design software

Hulu Plus is available for streaming on popular gaming consoles like PlayStation 3 (PS3), Xbox 360 and Roku, as well as on the computer. By downloading the Hulu Plus application and activating your account, you can stream television shows and movies from the Hulu site. visit hulu.com/activate now.

Are you having trouble in sign in to the Binance account? If you are having trouble in signing in and now seeking remedies that could help you in fixing all your problems. To deal with all these troubles, you should directly contact with the team over Binance customer care number which is functional and users can Binance Customer Service Number have conversation with the team to get verified solutions that would help in fixing all your troubles immediately. Contact the team anytime to avail possible best solutions that are the required medicine to all your queries.

Have you forgotten your password of Blockchain customer care UNITED STATES account? Do you know how to recover it? To recover your password one should have the access of their email id . If you still unable to reset it on your own then, don’t Blockchain Customer Service Number need to get panic at all as you can always take assistance from the experts by dialing Blockchain Customer care number at any time and from any city. The customer care support team will fix your issue with perfect precision in no time.

Binance two-factor authentication is the most important element of the account as it has the responsibility of securing your account and make sure the required and stored information is protected. If you don’t know how to deal with the functionalities of Binance, Binance Customer Service Number you can always take help from the team of elite professionals who are always there to resolve your queries in no time via calling on Binance customer service number. By speaking to the team of skilled professionals, you can always take help from the experts for assistance.

Are you facing error in executing the password recovery process of your Blockchain account? If you don’t know how to eliminate password issues and looking for solution to deal with error, you can always ask for help from the team of skilled professionals who are Blockchain Customer Service Number there to assist you. You can call on Blockchain customer service number which is functional and users can have conversation with the team anytime related to issues. You can always take help in eliminating errors from the bottom.

This article is really useful and informative. I was looking for this information today and found so many pieces of content on the internet in which I would say this is really helpful. I contacted I See Media three months back and taken their social media services which lead my business to have a good value through social media.

What is Search Engine Optimization (SEO)? In simple words, Search Engine Optimization (SEO) can be defined as the Do's and Don'ts of Search engines that if followed properly can improve the visibility of your website which will eventually lead to better sales and promotion of your website, products and services. DA 30+

What is Search Engine Optimization (SEO)? In simple words, Search Engine Optimization (SEO) can be defined as the Do's and Don'ts of Search engines that if followed properly can improve the visibility of your website which will eventually lead to better sales and promotion of your website, products and services. link building service

What is Search Engine Optimization (SEO)? In simple words, Search Engine Optimization (SEO) can be defined as the Do's and Don'ts of Search engines that if followed properly can improve the visibility of your website which will eventually lead to better sales and promotion of your website, products and services. niche

thanks for sharing this information with us. I am just surfing on internet and suddenly found this blog. Very Nice blog. Please have a look on my blog which is based on travel delta airlines phone number

I keep reading good content about Quickbooks customer support. And this blog attracted my attention very quickly. Seeking Quickbooks customer support from right source plays a crucial role. This is what this piece of blog is all about. They have provided all necessary details about Quickbooks and related support needs. It Is a Good read!

This blog gives a piece of clear information about Kaspersky customer service phone number. After reading it thoroughly, I have realized what we can miss if we don’t seek expert’s help for Kaspersky antivirus related queries as soon as we face any issue.

Are you facing any issues related to McAfee Antivirus then you call Mcafee antivirus customer support Number +1 888-309-0939. Our Mcafee antivirus customer support team offers excellent quality customer service across the globe.

I did not know the entire benefits of Garmin Nuvi Update. But since I have read this blog on map update, I have installed all available updates for my garmin device. I must say that this piece of blog has helped me improve navigation experience. I am not suggesting all my friends to read this blog and get Garmin map update with this team.

We did not know the all benefits of Panda Antivirus Support Number. I have read this blog on Antivirus I have installed all available updates. I must say that this piece of blog has helped me improving navigation experience. I am not suggesting all my friends to read this blog and get Antivirus Panda Support with this team. You can use Panda Antivirus to get panda help desk update. Be it Norton Internet security, panda, Kaspersky, McAfee, or any other antivirus.

Are you finding it difficult to resolve MyEtherWallet two-factor authentication expansion error? Do you need solutions to fix this error completely from the roots? If you are not aware of these steps and you are looking for one, you can always take help from the team of elite professionals who are there to guide you. You can always call on MyEtherWallet customer care number which is always functional and the MyEtherWallet Customer Service Number team is ready to support you at every corner, therefore, you can reach them for availing better remedies from the roots.

Is your Binance account experiencing any kind of errors? Its true that not a week goes by when we don’t hear about hacking troubles take place on the exchange platform. If you don’t know how to deal with this error and need remedies from the elite professionals, you can always take help from them and rectify all your Binance Customer Service Number queries immediately from the roots. Reach them via calling on Binance customer care number which is always applicable and the team can contact them at any time related to their queries.

Yes it could be argued that the opening ‘flash forward’ is unnecessary and the intriguing way the story is set up – each character is deliberately set aside with on screen name captions – doesn’t really pay off with the type of intricate ‘character study’ it was promising, it’s still admirable that a potentially silly premise is treated with such square-jawed conviction. 먹튀사이트

Wow! Very amazing blog thanks for sharing this amazing information with us. Its really very awesome to read. If you are also one of the HP wireless printer customer service number User and is looking forward to get the HP Printer Setup done over your MAC operating system in your Computer then this is a perfect place for getting all the information.

Thanks for sharing this fantastic blog, really very informative. Your writing skill is very good, you must keep writing this type of blogs. Url Roku Com Link that comes up on the screen is an indication that there’s something wrong with the internet connection as Roku needs a strong connection for playing the videos.