Welcome to the course “Augmented Reality & Video Service Emerging Technologies.” The level of AR (Augmented Reality) and advanced video & multimedia technology included in a product is what determines the level of value and luxury. The objective of this course is to teach all important technologies that are used in state-of-the-art AR, Skype, and YouTube video and multimedia products and services. This includes the advanced video and real-time multimedia delivery mechanisms based on H.264/MPEG-4 AVC, MPEG-DASH, CDN, and mobile CDN. If you have knowledge of these core technologies, you can understand the operations that are used in every advanced video and multimedia system in the World. As the future World of business and products are driven to be more and more video and multimedia oriented, having knowledge of these core technologies will enable you to lead your company to become the true World leader in AR and video multimedia technology products, services, and business. Thus, I cordially welcome you into the beautiful and powerful World of advanced AR and video multimedia!

Reviews

Filled StarFilled StarFilled StarFilled StarHalf Faded Star

4.6 (17 ratings)

5 stars

10 ratings

4 stars

7 ratings

From the lesson

AR Technology

The second module “AR Technology” focuses on AR (Augmented Reality) technologies, operation workflow, and Cloud support technologies. First, the features of AR technological components, and the role of AR feature detection/description technology and the IPD (Interest Point Detection) process is introduced. Second the advantages of AR cloud cooperative computation and AR cloud offloading is covered. In addition, the types of AR feature extraction descriptor types, feature detector requirements, and influencing factors are covered.

Taught By

Jong-Moon Chung

Professor, School of Electrical & Electronic Engineering

Transcript

The lecture module AR Technology, is what we will study about. Starting off with AR system components and workflow will be the first topic. AR technology components, looking into them, there is the content provider and server-based systems, and you can see this is where the content is actually stored. A part of the content can be made small and stored on the portable mobile device which could be like a smartphone, a head-mounted display, or glasses. However, the majority of the original database will be at the content providing server. The contents' file data format would be in the form of 3D graphical assets, geographic information, text image, movies, air content container, point of interest information. This would be the domain of what we're looking into. Interacting with the device through a communication protocol will be what you'll see over there in the middle, which would include the protocol of the server to the individual client device, and details about this will be discussed in the following lecture modules that will follow this module, within this course. So, just hang in there. Looking into the details of the protocol, which also contain the video protocol as well as the networking protocols, then we come into the user side in which we can see software framework and application program, as well as the browser part. The software framework part has units in which the required software, as in terms of the firmware operating system, and the user application software are all prepared together to support the automated reality application. There is a lot of video processing software that is included in here as well which the following lectures in this course, I will explain in detail. Then there is the application program and browser. These units are what supports the actual application device such that once the overall augmented reality information is provided, how will that be used to serve the specific application. The browser, of course, will be used to find information in a larger domain such that customized applications, as well as user designed, or user desired information can be retrieved accurately. Looking into this specific modules on a user, there is the detection and tracking technology that needs to be conducted. This is focused on recognition units where computer vision, markers and features, tracking sensors and camera API are executed. Then there's the rendering process that needs to be done to support visualization. This is composed of techniques that support computer graphics API, video composition and depth composition. Then there's interaction that needs to be done. There's the UI, the user interface that needs to be designed such that it is comfortable to use and it is very effective on its features. Then there's gesture, voice and haptics. Haptic technology is something in which on a screen, in a virtual domain or an augmented reality domain, you touch something in the air and you're really not touching that object. However, a button that you push or something that you lift up gives you a feeling as if you're touching or pushing that object, such that a certain shape, a certain pulse is given to you that you feel like you're actually touching a real object. This is what haptic technology is about. In other words it is a virtual technology where the actual feel is given to a virtual action. Looking at the domain of how the detection, tracking, interaction, rendering all work together in the air system, is shown right here. Where the detection gives information to the tracking unit in the air system. In addition, the interaction part of the air system is combined with a tracking information and send to the rendering unit. This information is then combined with any type of input from the user to be put into the system, and this input domain of interaction that will be included into the rendering unit. This will be done as in terms of the user interface or haptic interface, and other units as well. Then that input will be included, rendered and a visual feedback will be provided to the user, as you see right here. The user will see this information on classes, head mounted displays, a window, a windshield, a computer monitor, a notebook or laptop computer monitor, a tablet computer monitor or your smartphone. These are the references that I used and I recommend them to you. Thank you

Explore our Catalog

Join for free and get personalized recommendations, updates and offers.