John S. Robotham has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

Abstract: Embodiments relate to display of visual content on a client device using server-side rasterization of visual content. According to some embodiments, visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The server system can perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, images at the client device, and so on. The approach can be “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: Embodiments relate to display of visual content on a client device using server-side rasterization of visual content. According to some embodiments, visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The server system can perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, images at the client device, and so on. The approach can be “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: The present invention relates to display of visual content on a client device using server-side rasterization of visual content. Visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The invention allows the server to perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, and images at the client device. The approach is “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: The present invention relates to display of visual content on a client device using server-side rasterization of visual content. Visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The invention allows the server to perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, and images at the client device. The approach is “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: The present invention relates to display of visual content on a client device using server-side rasterization of visual content. Visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The invention allows the server to perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, and images at the client device. The approach is “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: The present invention relates to display of visual content on a client device using server-side rasterization of visual content. Visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The invention allows the server to perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, and images at the client device. The approach is “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: A technique for representing a visual scene as a directed acyclic graph of data and operators that generates a sequence of image frames over specified time intervals. The graph specifies temporal and spatial values for associated visual elements of the scene. Time is modeled in the inheritance properties explicitly defined within the scene graph hierarchy, by assigning temporal attributes to each media element. Branch nodes of the graph specify transforms for the temporal and spatial coordinate systems. To evaluate the appearance or behavior of the scene and in particular the global time values of particular elements at a given time instant, the graph is traversed in a direction from a root node down toward the leaf nodes, thereby causing temporal transformations specified along the branches of the graph to modify time parameters of the scene data at the nodes. Child nodes are preferably evaluated after being transformed, to determine the extent to which they contribute the data to the final scene.

Abstract: A method of navigating within a plurality of bit-maps through a client user interface, comprising the steps of displaying at least a portion of a first one of the bit-maps on the client user interface, receiving a gesture at the client user interface, and in response to the gesture, altering the display by substituting at least a portion of a different one of the bit-maps for at least a portion of the first bit-map.

Abstract: The present invention relates to display of visual content on a client device using server-side rasterization of visual content. Visual content is rendered on a server system, transformed into bitmaps compatible with the display attributes of a client device, and transmitted for display on the client device. The invention allows the server to perform, in effect, as a remote browser for displaying Web pages, e-mail, e-mail attachments, electronic document and forms, database queries and results, drawings, presentations, and images at the client device. The approach is “remote” because the server does the rendering and the client provides the interface; “multi-level” because rendered visual content is represented as a multi-level set of raster representations; and constitutes a “browsing system” because the client and server share data about the source visual content element being browsed, and the client performs a specific browsing function assisted by the server.

Abstract: In a media production system, two-dimensional images captured from physical objects are analyzed to create three-dimensional representations of the physical objects within a virtual stage. The physical objects are manipulated as abstract representations in the unified virtual stage. Representations of physical and synthetic objects are choreographed in the virtual stage within an integrated system which can also generate a media product in the form of a two-dimensional image stream of the physical and synthetic objects with optional synchronized audio tracks. To facilitate choreography, a composite display of the three-dimensional virtual stage and a two-dimensional preview are provided. Also provided are a display showing temporal representations of elements within the scene and an object catalog of object oriented representations of elements within the scene.

Abstract: A technique for representing a visual scene as a directed acyclic graph of data and operators that generates a sequence of image frames over specified time intervals. The graph specifies temporal and spatial values for associated visual elements of the scene. Time is modeled in the inheritance properties explicitly defined within the scene graph hierarchy, by assigning temporal attributes to each media element. Branch nodes of the graph specify transforms for the temporal and spatial coordinate systems. To evaluate the appearance or behavior of the scene and in particular the global time values of particular elements at a given time instant, the graph is traversed in a direction from a root node down toward the leaf nodes, thereby causing temporal transformations specified along the branches of the graph to modify time parameters of the scene data at the nodes. Child nodes are preferably evaluated after being transformed, to determine the extent to which they contribute the data to the final scene.

Abstract: A technique for displaying a visual representation of an estimated three-dimensional scene structure and the values of various parameters associated with the scene, together with a visual representation of at least one two-dimensional image used in the scene structure estimation algorithm. A user inputs information by adjusting parameters and/or specifying an element or region of the visual representations and supplies mark-ups and other information such as attributes for the element or region to be applied during a next iteration of the scene structure estimation algorithm. The scene structure estimation algorithm is then re-executed and the process repeats until the user is satisfied with the resulting visual scene structure.

Abstract: An integrated media production technique for refining a finish quality media content. The technique permits a media production to be defined as a computerized choreography model of a virtual stage containing data objects representing live/recorded image elements as well as synthetic-abstract elements and multiple versions thereof. Elements of the choreography model are iteratively rendered, blended, adjusted, and selected until a desired quality result is achieved.

Abstract: A technique for converging upon a computer-based model of a real world or synthetic scene. The computer model makes use of abstraction-based data objects as well as image-based data objects. A correlation mesh provides links between related image-based and abstraction-based objects. An initial step in a process analyzes an input image stream and user inputs to derive initial image-based objects and abstraction-based objects for the scene model. Subsequent steps in the process allow user inputs to refine the image-based objects, abstraction-based objects and/or the correlation mesh. As a result, refinements to the image-based object model of the scene can improve the abstraction-based model of the scene, and refinements to the abstraction-based object model can improve the image-based model.

Abstract: In a media production system, two-dimensional images captured from physical objects are analyzed to create three-dimensional representations of the physical objects within a virtual stage. Representations of physical and synthetic objects are manipulated and choreographed in the virtual stage within an integrated system which also generates a media product in the form of a two-dimensional image stream of the physical and synthetic objects with optional synchronized audio tracks. A correlation is maintained between object models in the virtual stage and the original two-dimensional images so that information from those images can be included in the final product. To facilitate direction of combined media products, a composite display of the three-dimensional virtual stage and a two-dimensional preview are provided. Also provided are a score display providing temporal representations of elements within the scene and an object catalog of object oriented representations of elements within the scene.

Abstract: A computer system, having a graphical user interface for authoring and playing a multimedia presentation having one or more multimedia events, displays a representation of a story, including a representation of a start position, indicating the beginning of the multimedia presentation, a representation of an end position, indicating the end of the multimedia presentation, and a representation of a unidirectional path line connecting the start position and the end positions. The representation of at least one icon, associated with a source of multimedia material, may be linked to the path line. The link, called a call spot, represents a call to the multimedia, allowing icons to be shared by many presentations or to be shown at different times in the same presentation. The multimedia presentation starts at the start position, plays the multimedia material represented by the at least one icon, and then continues along the unidirectional path line and completes at the end position.