Multiple visual perspectives in video of private and public activities including those in public areas such as entertainment venues captured by cameras located near the activities can be transmitted over data networks to a server where video-related data is processed and recorded for selective display...http://www.google.es/patents/US8184169?utm_source=gb-gplus-sharePatente US8184169 - Providing multiple video perspectives of activities through a data network to a remote multimedia server for selective display by remote viewing audiences

Multiple visual perspectives in video of private and public activities including those in public areas such as entertainment venues captured by cameras located near the activities can be transmitted over data networks to a server where video-related data is processed and recorded for selective display by authorized, remote video display devices (e.g., HDTV, set-top boxes, computers, handheld devices) in wired/wireless communication with the server. Users can be registered and authorized to access the server to provide/access video captured by cameras at activities. Wireless handheld devices can selectively retrieve video-related data captured at activities for server storage and subsequent display by video display devices. Captured video/pictures can be organized in a server based on at least one of: activity title, activity time, activity date, activity place, wireless handheld device location at time of video recording, distance from location of interest. Simultaneous display of multiple videos on a display can be synchronized.

Imágenes(14)

Reclamaciones(25)

1. A system for remote viewing of at least one activity from at least two different visual perspectives to a remote audience, said system comprising:

a server to receive the at least two different visual perspectives of the at least one activity simultaneously captured during the at least one activity as a streaming video signal by a combination of at least one of a plurality of cameras singularly included in each of at least one of a plurality of hand held devices and at least one of a plurality of standalone cameras, all located near the at least one activity;

said server having circuitry to process the streaming video signal into video-related data and record the video-related data in a database associated with said server;

selection means to selectively retrieve and display said streaming video display signal by at least one user of a plurality of users over at least one of a plurality of remote video display devices authorized to communicate with the server and retrieve streaming video-related data over a data network; and

at least one of a plurality of wireless hand held devices communicating with said server, wherein each of said at least one of said plurality of wireless hand held devices includes integrated components comprising a GUI based menu driven touch screen display and a video processing unit with video tuning hardware to select segments of the streaming video signal viewable on said GUI based menu driven touch screen display as real time or pre-recorded video footage.

2. The system of claim 1, further comprising a registration module to register the at least one user and authorize the at least one user access to said server to retrieve the streaming video signal of the at least two different visual perspectives from said database.

3. The system of claim 1, further comprising a registration module to register the at least one user and authorize the at least one user access to said server to upload the streaming video signal into said database of the at least one activity captured by the combination of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras camera, and operated by the at least one user.

4. The system of claim 3, further comprising an activity organization module to organize the streaming video signal uploaded into said database from a combination of streaming video signals emanating from the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras, operated by the at least one user, wherein video from the streaming video signal is automatically organized by said server based on at least one of: at least one activity title, an activity time, an activity date, an activity place, a location of the at least one wireless handheld device at a time of a video recording of the streaming video signal.

5. The system of claim 1, further comprising an activity organization module to organize the streaming video signal simultaneously captured during the at least one activity by a combination of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras, located near the at least one activity and provided to said server, wherein said streaming video signal is automatically organized by at least one of said server based on at least one of: at least one activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices at a time of recording of the streaming video signal.

6. The system of claim 1, further comprising a registration module to register at least one user remote video display device among the at least one of a plurality of remote video display devices and authorize at least one registered user access to said server to allow the at least one registered user to selectively retrieve and display the streaming video-related data captured at the at least one activity.

7. The system of claim 1, further comprising an activity organization module to provide selective access to the streaming video signal of the at least two different visual perspectives from said server, wherein said streaming video signal is provided to at least one remote video display device among said remote video display devices from said server based on a request from at least one registered user for at least one of: at least one activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices at a time of video recording, and a distance from a location of interest.

8. The system of claim 1, further comprising a community association module to associate at least one user registered with at least one of a plurality of online communities also registered within said server and to provide the at least one registered user selective access to the streaming video signal of the at least one activity stored on said server that were captured using a combination of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras, by the at least one registered user located near the at least one of said plurality of activities and stored on said server in association with the at least one online community, wherein the streaming video signal is provided to the at least one registered user from said server based on requests from the at least one registered user of at least one of: a name of said at least one of said plurality of online communities at least one activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices at a time of a recording of the streaming video signal, and a distance from a location of interest.

9. The system of claim 2, further comprising a community association module to associate the at least one user with at least one of a plurality of online communities also registered within said server and to provide at least one registered user selective access to the streaming video signal of activities stored in said database that were captured using a combination of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras, operated by the at least one registered user located near the at least one activity and stored in said database in association with the at least one of said plurality of online communities, wherein said streaming video signal is provided to the at least one registered user from said server based on requests from the at least one registered user of at least one of: a name of the at least one of said plurality of online communities, an activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices at a time of recording of the streaming video signal, and a distance from a location of interest.

10. The system of claim 3, further comprising a community association module to associate at least one registered user with at least one online community also registered within said server and to provide the at least one registered user selective access to the streaming video signal of activities stored in said database that were captured using a combination of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras, operated by the at least one registered user located near the at least one activity and stored in said database in association with the at least one online community, wherein said streaming video signal is provided to the at least one registered user from said server based on requests from the at least one registered user of at least one of: a name of the at least one online community, an activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices at a time of recording of the streaming video signal, a distance from a location of interest.

11. The system of claim 3, further comprising a community association module adapted to associate at least one registered user with at least one online community also registered within said server and to provide the at least one registered user selective access to the streaming video signal of the at least one activity stored on said server that were captured using the combination of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras, by the at least one registered user within the at least one online community located near the at least one of said plurality of activities and stored on said server in association with the at least one online community, wherein said streaming video signal is provided to the at least one registered user from said server based on requests from the at least one registered user of at least one of: a name of the at least one online community, an activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices at a time of recording of the streaming video signal, and a distance from a location of interest.

12. The system of claim 4, further comprising a community association module adapted to associate at least one registered user with at least one online community also registered within said server and to provide the at least one registered user selective access to an organized streaming video signal of the at least one activity captured using the combination of the at least one of said plurality of cameras and the at least one of said plurality standalone cameras, by the at least one registered user of an activity and provided to said server, wherein said organized streaming video signal is provided to the at least one registered user from said server based on requests from the at least one registered user of at least one of: at least one activity title, an activity time, an activity date, an activity place, a location the at least one of said plurality of wireless handheld devices at a time of recording the streaming video signal, and a distance from a location of interest.

13. A system for remote viewing of an at least one activity from at least two different visual perspectives to a remote audience, said system comprising:

a remote server to: receive the at least two different visual perspectives of the least one activity simultaneously captured during the at least one activity by a combination of at least one camera of a plurality of cameras singularly included in each at least one of a plurality of hand held devices and at least one of a plurality of standalone cameras, located at the at least one activity, process the at least two different visual perspectives into streaming video-related data and record the streaming video-related data for selective retrieval and display by at least one user and at least one of a plurality of remote video display devices authorized to communicate with the remote server over a data network;

a registration module to register the at least one user and the at least one remote video display device and authorize the at least one user access to said remote server to provide a streaming video image captured at the at least one activity and selectively retrieve the streaming video-related data for selective display by the at least one remote video display device;

an activity organization module for organizing said streaming video-related data, wherein said streaming video signal is automatically organized by said server based on identifying data including at least one of: the at least one activity title, activity time, activity date, activity place, location of an at least one a plurality of wireless handheld devices at time of the streaming video signal recording, and said activity organization module further configured to provide selective access to organized said streaming video signal from said remote server by said at least one remote video display device based on a request for at least one of: the at least one activity title, activity time, activity dater activity place, at least one of a plurality of wireless handheld devices location at time of video recording, distance from location of interest; and

a video processing unit in the at least one hand held device to parse said streaming video signal by tuning video frequency channels and delivering said signal to an onboard touch screen display.

14. The system of claim 13, further comprising a community association module adapted to associate at least one registered user with at least one online community also registered within said remote server and to provide the at least one registered user selective access to the streaming video signal of the at least one activity stored on said remote server captured using the combination of at least one camera and the at least one standalone by the at least one registered user located near the at least one activity and stored on said remote server in association with the at least one online community, wherein said streaming video signal is provided to the at least one registered user from said remote server based on requests from the at least one registered user of at least one of: a name of the at least one online community, at least one activity title, an activity time, an activity date, an activity place, a location of the at least one of said plurality of wireless handheld devices location at a time of recording of the streaming video signal, and a distance from a location of interest.

15. A method for providing remote video viewing opportunities of at least one activity to a remote audience, said method comprising:

providing a server to: receive at least two of a plurality of different visual perspectives of the at least one activity captured by a combination of at least one of a plurality of cameras singularly included in each of at least one of a plurality of hand held devices and at least one of a plurality of standalone cameras, located at the at least one activity, process the at least two different visual perspectives into video-related data and record the video-related data for selective retrieval by and display on at least one of a plurality of remote video display devices authorized to communicate with the server over a data network;

receiving the at least two different visual perspectives of the at least one activity captured by the combination of the at least one camera and the at least one standalone camera, located at the at least one activity, wherein said at least two different visual perspectives are received at the server through a data network as video;

processing the at least two different visual perspectives at the server into video-enabled data and recording the, video-enabled data in a memory associated with the server;

providing video-related data selected by at least one of a registered user associated with the at least one remote video display device, wherein said video-related data is provided to said at least one remote video display device from said server over said data network; and

further processing the video-related data through a video processing unit in the at least one hand held device parsing said data by tuning frequencies and delivering said data to an onboard touch screen display.

16. A method for providing remote video viewing opportunities of at least one activity to a remote audience, said method comprising:

receiving at least two of a plurality of different visual perspectives of the at least one activity captured as at least two of a plurality of streaming video images by a combination of at least one of a plurality of cameras singularly included in each of at least one of a plurality of hand held devices and at least one of a plurality of standalone cameras, located at the at least one activity, whereby said at least two of said plurality of streaming video images are delivered to a server, said server providing a digital gateway in transmitting the at least two of said plurality of streaming video images to a data network;

processing the at least two of said plurality of different visual perspectives at the server, whereby said server processes the at least two of said plurality of streaming video images as video-enabled data and records the video-enabled data in a memory device;

processing a wireless transmission medium comprising said at least two of said plurality of streaming video images selectable through a selection means at the at least one of said plurality of hand held devices selectively viewing simultaneously the at least two of said plurality of different visual perspectives through a touch screen display; and

further processing the at least two of said plurality of streaming video images through video processing within the at least one of said plurality of hand held devices while tagging said images with GPS attributes.

17. The method of claim 16, said method further comprising: registering and authorizing at least one registered user to access said server to receive and process the at least two of said plurality of streaming video images captured at the at least one activity using the combination of the least one of a plurality of cameras and the at least one of said plurality of standalone cameras and to selectively retrieve said video-related data captured at the at least one activity for display by the at least one of said plurality of hand held devices, wherein said at least one of said plurality of hand held device devices comprises at least one of a plurality of video processing cellular phones.

18. The method of claim 16, said method further comprising:

organizing said at least two of said plurality of streaming video images captured by at least two a of plurality of registered users at the at least one activity using at least one of the at least one of said plurality of cameras and the at least one of said plurality of standalone cameras wherein said at least two of said plurality of streaming video images are provided to said server to process said at least two of said plurality of streaming video images based on identifying attribute data including at least one of: at least one activity title, an activity time, an activity date, an activity place, a GPS position of the at least one of said plurality of handheld devices at a time of recording of the at least one of said plurality of streaming video images, and a distance from a location of interest; and

capturing said at least two of said plurality of streaming video images with said at least one of said plurality of hand held devices wherein said at least one of said plurality of hand held devices defines a position of the at least one of said plurality of cameras through GPS tracking hardware and establishes an accurate clock time by importing external time data through an established link, wherein a time frame and said GPS tracking hardware register said at least two of said plurality of streaming video images with a specific coordinate pair in time and space.

19. The method of claim 18, further comprising providing through the selection means at least one user access to said at least one of said plurality of streaming video images based on attribute data filtering.

20. The method of claim 16, further comprising:

registering at least one user of at least one of a plurality of online communities at a server to receive and process at least one streaming video image; and

authorizing the at least one user to: access said server to receive and process the at least one streaming video image;

storing in a storage means the at least one streaming video image captured at the at least one activity using the combination of at least one of said plurality of cameras and the at least one of said plurality of standalone cameras;

and selectively retrieve with a selection means video-related data associated with the at least one streaming video image by said at least one user on a subscription basis from said server to display on at least one remote video display device.

21. A method for providing remote video viewing opportunities of at least one of a plurality of activities to a remote audience, said method:

registering at least one user at a server adapted to receive and process at least one of a plurality of streaming video images;

authorizing through a subscription service the at least one user to access said server to receive and process said at least one streaming video image;

providing the at least one streaming video image captured at the at least one activity using a combination of at least one of a plurality of cameras singularly included in each at least one of a plurality of wireless hand held devices and at least one of a plurality of standalone cameras, and to selectively retrieve video-related data associated with the at least one streaming video image captured at the at least one activity for display by an at least one of a plurality of remote video display devices;

receiving at least one of a plurality of different visual perspectives of the at least one activity captured as the at least one streaming video image by the combination of at least one camera and at least one standalone camera, located at the at least one activity, at said server, wherein said server adapted to receive and process the at least one streaming video image, wherein said different visual perspectives received at the server to a subscriber based data network;

processing the at least one different visual perspective at the server, wherein said server receives and processes the at least one streaming video image into video-enabled data and recording the video-enabled data in a memory associated with said server;

organizing the at least one streaming video image captured by the at least one user at the at least one activity using the combination of the at least one camera and the at least one standalone camera and interfacing with said server to receive and process the at least one video image based on identifying at least one of the following data-attributes: the at least one activity title, activity time, activity date, activity place, location of the at least one wireless handheld device at time of video recording; and

providing the at least one user access to an organized arrangement of at least two of the plurality of streaming video images from said server, wherein said server receives and processes said at least two images in a synchronized split screen fashion per request from an at least one registered user based on at least one of: the at least one activity title, activity time, activity date, activity place, the at least one wireless handheld device location at time of the at least one video image recording, wherein said video-related data is provided to said at least one video display device from said server to receive and process the at least one streaming video image proceeded by transmission over the data network;

and further processing the video-related data through a video processing unit in the at least one hand held device parsing said data by tuning frequencies and delivering said data to an onboard touch screen display.

22. A method for providing remote video viewing opportunities of at least one of a plurality of activities to a remote audience, said method comprising:

registering at least one user populating at least one of a plurality of online communities accessing a server adapted to receive and process video;

authorizing the at least one registered user associated with said online communities to access said server adapted to receive and process video captured at the at least one activity using a combination of at least one of a plurality of cameras singularly included in each at least one of a plurality of wireless hand held devices and at least one of a plurality of standalone cameras, and to selectively retrieve video-related data captured at the at least one activity for display by at least one of a plurality of video display devices;

receiving at least one of a plurality of different visual perspectives of the at least one activity captured as video by the combination of the at least one camera and the at least one standalone camera located at the at least one activity in the proximity of said server, wherein said server functions to receive and process video of said at least one different visual perspective through a data network;

processing the at least one different visual perspective at said server into video-enabled data and recording the video-enabled data in a memory associated with said server;

organizing video captured by the at least one user at the at least one activity in an image processing unit included in the at least one of wireless handheld device, wherein said at least one hand held device processes incoming and outgoing video with said processing unit based on identifying attribute data including at least one of: the at least one online community name, the at least one activity title, activity time, activity date, activity place, the at least one wireless handheld device location at time of video recording, distance from a location of interest; and

providing the at least one user access to the organized video from said at least one hand held device to receive and process video based on a request from the at least one user of at least one of: the at least one activity title, activity time, activity date, activity place, the at least one wireless handheld device location at time of video recording, wherein said video-related data is provided to said at least one video display device from said server to receive and process video over said data network.

23. A system for synchronized remote viewing of at least one of a plurality of activities from at least two of a plurality of visual perspectives to a remote audience, said system comprising:

a multimedia server including a video synchronization module, wherein said server comprising circuitry to simultaneously receive the at least two of the plurality of visual perspectives captured during the at least one activity as video by a combination of at least one of a plurality of cameras singularly included in each at least one of a plurality of wireless hand held devices and at least one of a plurality of standalone cameras, wherein the combination of the at least one camera and the at least one standalone camera are configured to generate video image tags with time of capture information, and said video synchronization module processes the at least two of the plurality of visual perspectives into video-related data for selective retrieval and synchronized display on at least one of a plurality of remote video display devices comprising at least one of a plurality of hand held device displays; and

said at least one of said plurality of hand held device displays including an onboard video processing unit, an onboard GPS chipset, said onboard video processing unit having circuitry to process incoming and outgoing video furnished with GPS space and time coordinates on a toolbar screen inset.

24. The system of claim 23, further comprising a video synchronization engine for synchronizing the playing of video of the at least two of the plurality of visual perspectives of the at least one activity on the at least one of the plurality of remote video display devices based on time of capture information related to said video image tags on images.

25. A method for providing synchronized viewing of at least two of a plurality of visual perspectives recorded in video format by a remote audience, said method comprising:

receiving in a server the at least two of said plurality of visual perspectives of an activity captured as video and time stamped with time of capture information by a combination of at least one of a plurality of cameras singularly included in each at least one of a plurality of wireless hand held devices and at least one of a plurality of standalone cameras, located at an at least one of a plurality of activities;

processing the at least two of said plurality of visual perspectives on the server for synchronized and simultaneous display as at least two of a plurality of video images on a single video display screen;

displaying simultaneously and in synchronicity with respect to time the at least two of said plurality of visual perspectives as the at least two video images of said plurality of video images on said single video display screen; and

recording video of said at least two of said plurality of perspectives captured from the combination of at least one camera among the plurality of cameras and at least one standalone camera among the plurality of standalone cameras, and transmitting said video over a commercial cellular network interfacing with the Internet to at least one wireless hand held device among said plurality of wireless hand devices.

Descripción

CROSS-REFERENCE TO RELATED APPLICATIONS AND PRIORITY

The present application is continuation of U.S. patent application Ser. No. 12/210,971, entitled “Providing Multiple Video Perspectives of Activities Through A Data Network to a Remote Multimedia Server for Selective Display by Remote Viewing Audiences,” which was filed on Sep. 15, 2008 now U.S. Pat. No. 7,782,363, the disclosure of which is incorporated herein by reference in its entirety.

U.S. patent application Ser. No. 12/210,971 is a continuation-in-part of U.S. patent application Ser. No. 10/620,098 entitled “Providing Multiple Synchronized Camera Views for Broadcast From a Live Venue Activity to Remote Viewers” filed on Jul. 14, 2003 now U.S. Pat. No. 7,796,162, which is a continuation-in-part of U.S. patent application Ser. No. 09/708,776, entitled “Providing Multiple Perspectives for a Venue Activity Through an Electronic Hand Held Device, filed Nov. 8, 2000, now U.S. Pat. No. 7,149,549, which was a non-provisional of a provisional patent application, Ser. No. 60/243,561, entitled “Providing Multiple Perspectives for a Venue Activity Through an Electronic Hand Held Device,” filed Oct. 26, 2000.

U.S. patent application Ser. No. 12/210,971 is also a continuation-in-part of U.S. patent application Ser. No. 09/902,348, entitled “Providing Multiple Perspectives of a Venue Activity to Electronic Wireless Hand Held Devices,” and filed on Jul. 10, 2001 now U.S. Pat. No. 7,812,856, which was a non-provisional of a provisional patent application, Ser. No. 60/243,561, entitled “Providing Multiple Perspectives for a Venue Activity through an Electronic Hand Held Device,” filed on Oct. 26, 2000.

U.S. patent application Ser. No. 12/210,971 is also a continuation-in-part of U.S. patent application Ser. No. 10/015,458 entitled “Wireless Transmission of In Play Camera Views to Hand Held Devices” filed on Dec. 13, 2001.

U.S. patent application Ser. No. 12/210,971 is also a continuation-in-part of U.S. patent application Ser. No. 11/864,052, entitled “Processing of entertainment venue-based data utilizing wireless hand held devices,” filed Sep. 28, 2007, which is a continuation of U.S. patent application Ser. No. 11/498,415 entitled “Broadcasting Venue Data to a Wireless Hand Held Device,” filed on Aug. 2, 2006 now U.S. Pat. No. 7,376,388, which is also continuation of U.S. patent application Ser. No. 09/708,776 entitled “Providing Multiple Perspectives for a Venue Activity Through an Electronic Hand Held Device,” filed Nov. 8, 2000, now U.S. Pat. No. 7,149,549 and which claims the benefit of U.S. Provisional Application Ser. No. 60/243,561, which was filed on Oct. 26, 2000, and which also a continuation of U.S. patent application Ser. No. 09/887,492, entitled “Systems, Methods and Apparatuses for Brokering Data Between Wireless Devices and Data Rendering Devices,” which was filed on Jun. 22, 2001, and which claims priority as a continuation to U.S. Provisional Patent Application, Ser. No. 60/214,339, entitled “Systems, Methods and Apparatuses for Brokering Data Between Wireless Devices and Data Rendering Devices,” which was filed on Jun. 27, 2000. The specifications of the aforementioned U.S. patent application Ser. Nos. 10/620,098, 09/708,776, 09/902,348, 10/015,458, 11/863,052, 09/887,492, 60/243,561, and 60/214,339 are herein incorporated herein in their entirety by reference.

U.S. patent application Ser. No. 12/210,971 is also related to issued U.S. Pat. No. 7,376,388, also incorporated herein by reference in its entirety for its teaching.

TECHNICAL FIELD

Embodiments are related to video-enabled data-processing devices and systems. Embodiments also relate to techniques for providing increased viewing opportunities for video and photographic perspectives of activities that can occur during their recording privately or at public entertainment venues and community environments, such as sports stadiums, arenas, convention centers, concert halls, political convention, trade shows, Olympic events, and the like. Embodiments additionally relate to techniques for transmitting video-related data captured by cameras located near an activity over a data network to a server. Servers can be located at or away from a recorded activity. More particularly, embodiments are also related to a system capable of processing video-related data including multiple visual perspectives or vantage points captured by multiple cameras located at or near the activity and stored in a remote multimedia server for selective display of visual perspectives at a variety of user video display devices (e.g., digital televisions, set-top boxes, computers, wireless handheld devices) in wired or wireless communication with multimedia servers and service providers.

BACKGROUND OF THE INVENTION

Most modern sports stadiums and live entertainment facilities, convention centers, halls or arenas and the like (herein also collectively referred to as “entertainment venues”) employ cameras positioned to capture video images at diverse locations within the stadium. The audience at a typical sporting event, for example, can generally view advertisements, instant replays, and other sports related data on the large television screens within the sports stadium itself. Audiences viewing sporting events remotely (e.g., from their homes) can also view video, instant replays, advertisements and other sports related data; however, video feeds that are broadcasted remotely through satellite and cable television networks or displayed at the venue are limited to a single aspects provided for broadcast to remote displays one at a time from venue controlled media or broadcast media directors. Media directors, normally located in a broadcast room/booth, have access to several perspectives of an activity captured by cameras located at the entertainment venue simultaneously and can cause the real time play and replay of various aspects of the action at the event while also enabling commentators to provide comments about what is being displayed. Video feeds are typically transmitted/broadcasted under licensing arrangements with broadcasting entities for viewing by a remote viewing audience.

Fans/spectators of an entertainment venue activity have been limited in the past over what video perspectives they can view because video broadcasted from or shown at a venue because perspectives are pre-selected by media directors and broadcasters for the remote viewing audience. The remote viewing audience can utilize television sets to view broadcasted video transmitted through cable television, satellite and radio frequency (RF) transmissions. Computers can also be used to view streaming video data transmitted over data networks. Despite the availability of remote resources for the remote viewing audience user to view video captured by cameras at entertainment venues, the user is still currently restricted to viewing a single pre-selected (or released) video. Furthermore, video perspectives are limited by the amount and placement of cameras located within the entertainment venue and controlled by entertainment venue operators and licensees. Even in situation where multiple perspectives of an activity are recorded, images recorded from various perspectives are not synchronized to a particular time period and location. What are needed are more video viewing options for remote viewing audiences where multiple perspectives of an activity are available as recordings. What is also needed are video media viewing options that enable remote viewing audiences to view multiple perspectives of an activity from the same point in time and at different angles with respect to the activity.

It is therefore desirable given the present invention that remote viewing audiences be provided enhanced viewing options in the form of multiple viewing perspectives captured by cameras within the entertainment venue as well as any other activity, public or private, wherein cameras may be utilized to capture video. The present inventor believes that additional video perspectives provided in the form of new video viewing options captured at entertainment venues and of other activities not necessarily tied to an official sports venue can be provided to remote viewing audiences over current data networks (wired and wireless) for display at various user devices (e.g., computers, High Definition Televisions (HDTVs), set-top boxes such as TiVO™ devices and those provided by cable and satellite companies like Comcast™, DirecTV™ and Dish Network™, and handheld devices, such as Palm™, Blackberry™ and iPhone™ PDAs, other data/video-enabled cellular telephones, and other hand held wireless video-enabled devices such as Apple iTouch™, Nintendo DS™ and Sony Playstation™ (PSP) devices). iPhone™ and iTouch™ are registered trademarks of Apple Inc., Blackberry™ is a trademark of Research In Motion Ltd., Palm™ is a trademark of Palm Inc., TiVO™ is a trademark of TiVo Inc., DIRECTV™ is a trademark of DIRECTV Inc., Dish Network is a trademark of EchoStar Communications Corporation, Nintendo DS™ is a trademark of Nintendo of America Inc., and Sony PSP™ is a trademark of Sony Corporation Entertainment America Inc.

Much of what is needed to teach aspect of the present invention has already been described in the patent applications that are incorporated herein by reference with priority extending back to the years 2001 and 2000. Since then, video sharing websites and online communities have come into being such as YouTube.com™, MySpace.com™ Flickr™, Fancast™ and MyFrontRow.com™ for basic video and picture sharing, and Second Life™ (abbreviated SL), for more engaged interaction by community members virtually using avatars. YouTube is a trademark of Google Inc., MySpace™ is a trademark of MySpace Inc., Flickr™ is a trademark of Yahoo Inc., Facebook™ is a trademark of Facebook Inc., Fancast™ is a trademark of Comcast Corporation, MyFrontRow™ is a trademark of Front Row Technologies, LLC, and Second Life™ is a trademark of Linden Research Inc. The number on online communities with video and picture sharing capabilities continues to grow; but there is still much room for improvement in the delivery of media to end users such as those that are members of an online community, or to remote spectators watching high definition television through cable and satellite broadcasting services. Enhanced video and picture management and retrieval where multiple perspectives of the same activity when available will provide a higher level of service value to end users of current online multimedia services and resources and is what is still needed in online communities as they continue to develop. Enhanced video and picture capturing, sharing, searching and viewing capabilities for multimedia content providers, enablers and broadcasters will now be possible with the reaching of the present invention.

Handheld computing devices (i.e., also referred to as “hand held devices” Or “wireless handheld devices”) have become increasingly popular over the past decade for storing and maintaining information. Many handheld devices include video recording capabilities and can communicate with available wired and wireless data communications networks including the Internet via wireless communication transceiver links to data communications networks (e.g., cellular data networks that are 3G enabled). Handheld devices that are capable of displaying and recording video and can communicate wirelessly with data networks were also taught in the prior patent applications for which the present application claims priority.

The present inventor further believes that viewing audiences can also be provided enhanced access to captured video content through servers where the data is identified for access from the multimedia servers based on title, location, date, and other related data. A geotag or geostamp is a sequence of characters that can be associated with data to denote a time and location at which a certain event occurred. A geotag can typically include information about latitude, longitude, time, and elevation. Data can be taken from Global Position Satellites (GPS). Although tags with geographical information can be used in association with captured video and pictures, current wireless handheld devices with integrated cameras, GPS and wireless data communications capabilities are not adapted to automatically tag pictures as they are taken. Geographical tagging without automation (and possible standardization) is simply not convenient for most users because tagging requires too much time or steps using available software and hardware to determine and associate with captured video and picture data.

The present inventor believes that wireless GPS-enabled handheld devices that include video cameras, video recording capabilities and wireless data communications can be utilized to provide video and still pictures with geographical information, automatically. It would also be more desirable and acceptable for general use if video and pictures could automatically be tagged with location, time and date information so that subsequent retrieval from a server can be facilitated based on a location, date and time of interest. It would also be desirable if users accessing servers containing tagged video and pictures could retrieve video and picture related data based on membership or access to a particular community, or to be able to search a point in time and location of interest. For example, a user may want to search for content from a specific GPS location and within a specific distance from the GPS location, at a specific date and within a particular point of or span in time. Such a capability would be of high value and very useful for entertainment, business and national security purposes.

The present invention enables many new capabilities for video related media to address a broad spectrum of applications and the needs of end users. The present invention provides enhancements over spectator access to video and picture related data accessible via servers, online services and communities, and over a data communications and broadcast networks and end user multimedia hardware.

BRIEF SUMMARY

One aspect of the present invention provides improved methods and systems for delivering activity-related video data and pictures to a multimedia server for access by remote video display devices having access to the multimedia server.

It is another aspect of the present invention to provide improved methods and systems for delivering video captured from different visual perspectives of an activity, such as private activities as well as public activities including those occurring in an entertainment venue, to a server for processing and access by remote display devices.

It is still another aspect of the present invention to provide methods and systems for providing multiple visual perspectives from an activity for viewing through remote display devices.

It is yet another aspect of the present invention to provide systems and associated methods that provide on-demand video action and instant replays from multiple camera angles captured from venue and/or private user cameras focused on the activity.

It is yet another aspect of the present invention that venue and/or private user handheld devices with cameras that are focused on the activity can capture video including identifying data such as electronic tag bearing the date, time and location information where the video (or pictures) were captured (e.g., GPS location and time stamped where time stamping can be provided from GPS-UTC or from Atomic clock time).

It is another aspect of the present invention to provide wireless handheld devices with wireless data network communications, a video camera, GPS and software enabling automatic geographic location and time tagging for recorded media.

It is yet another aspect of the present invention that enables users to access a multimedia server and access video and photos captured of an activity and including identifying data such as electronic tag bearing the date, time and location information where the video (or pictures) were captured (e.g., GPS and time stamped) and also enables the users to search for video and/or photos of an activity based on time, date, location, title, category, and also enable the limiting of distance from the location of interest and timeframe for which data should be retrieved when location information is provided with the data.

It is yet another aspect of the present invention that enables users to access video of an activity in multiple visual perspectives from a multimedia server and simultaneously play/replay the multiple visual perspectives of video in synchronicity based on data tagging embedded in video data.

According to unique features of the present invention, systems and methods provide increased remote video viewing opportunities of activities, private and public, including activities that occur at entertainment venues. Video-related data including multiple visual perspectives captured by cameras located at or near the activity can be transmitted over wired/wireless data networks to a server where video-related data is processed and recorded for selective display by authorized, remote video display devices (e.g., HDTV, set-top boxes, computers, and wireless handheld devices) also in wired/wireless communication with the server. Users and online communities can be registered with multimedia servers or a service and users can be authorized to access a server to provide video captured at an activity. Single user registration or registration in association/membership with a community is enabled. Video can be captured by users using a camera included in a wireless handheld device. Registered user can selectively retrieve video-related data captured at the activity for display by video display devices. Captured video can be organized in servers based on at least one of: activity title, activity time, activity date, activity place, GPS location of wireless handheld device at time of video recording.

A server can be provided that is adapted to: receive different visual perspectives of a public activity captured by more than one camera located at the activity, process the different visual perspectives into video-related data and record the video-related data for selective retrieval and display by user video display devices authorized to communicate with the remote server over a data network.

A registration module can be provided that is adapted to register users and authorize user access to the server to: provide video captured at the activity using a camera included in a wireless handheld device and selectively retrieve video-related data captured at the activity for display by a user video display device.

An activity organization module can be provided that is adapted to organize video captured by a user at the activity using a camera included in a wireless handheld device and provided to the server, wherein the video is automatically organized by the server based on identifying data including at least one of: activity title, activity time, activity date, activity place, GPS position of wireless handheld device at time of video recording, and the activity organization module can be further adapted to provide a user selective access to the organized video from the server based on a request from the user of at least one of: activity title, activity time, activity date, activity place, wireless handheld device GPS position at time of video recording. GPS information typically includes the latitude, longitude, and time (e.g., UTC or Atomic clock time). The time, date and location can be specified when provided as part of the search criteria for media (e.g., GPS Lat xx.xx.xx and Long xx.xx.xx within a 0.5 mile radius, from 1700 hrs to 1730 hrs). Proper “time” identification tagging of video when/as recorded is important where synchronization of multiple perspectives for accurate viewing simultaneously on displays associated with video display devices is desired. Accurate timing can be provided by GPS-based UTC time and also by Atomic Clock time to ensure that video of an activity recorded by/from disparate sources can be synchronized when played or replayed on remote video systems.

A community association module can be provided that is adapted to associate registered users with online communities also registered within the server and to provide a user with selective access to organized video of activity captured by a cameras used by community members of an activity and provided to a server, wherein the video is provided to the user from the server based on a request from the user of at least one of: activity title, activity time, activity date, activity place, wireless handheld device location (e.g., GPS) at time of video recording, and distance from a location of interest.

A method providing increased remote video viewing opportunities of activities including those public and private that occur at entertainment venues to a remote audience can include the step of registering users and online communities at a server adapted to receive and process video and authorizing the users associated with online communities to access said server adapted to receive and process video to provide video captured at the activity using a camera included in a wireless handheld device and to selectively retrieve video-related data captured at the activity for display by video display devices.

A method step can be provided for receiving different visual perspectives of an activity captured as video by more than one camera located at an activity at a server adapted to receive and process video, wherein the different visual perspectives are received at the server adapted to receive and process video through a data network.

A method step can be provided for processing the different visual perspectives at the server adapted to receive and process video into video-enabled data and recording the video-enabled data in a memory (e.g., database) associated with the server adapted to receive and process video.

A method step can be provided for organizing video captured by a user at the activity using a camera included in a wireless handheld device and provided to the server adapted to receive and process video based on identifying data including at least one of: online community name, activity title, activity time, activity date, activity place, wireless handheld device GPS position at time of video recording.

A method step can be provided for providing user access to the organized video from the server adapted to receive and process video based on a request from the user of at least one of: activity title, activity time, activity date, activity place, wireless handheld device GPS position at time of video recording. The video-related data is provided to the video display devices from a server adapted to receive and process video over a data network. Again, it is a feature of the present invention that the time, date and location of an event capture can be specified when provided as part of the search criteria for recorded media (e.g., GPS lat xxxxxx and long xxxxxx within a 0.5 mile radius, from 1700 hrs to 1730 hrs, on Dec. 31, 2008). Again, accurate timing recorded on the media, e.g., if provided by GPS-based UTC time and also by Atomic Clock time, can ensure that video of an activity recorded by/from disparate sources can be synchronized when played or replayed on remote video systems; especially when multiple perspectives are played on a display simultaneously over split screen views provided in a video display.

Yet another method step can be provided that enables accessed video of an activity in multiple visual perspectives from a multimedia server to be simultaneously play/replay in synchronicity on a video display based on data tagging embedded in video data.

The above and other aspects of the invention are achievable as will now be further described.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features believed characteristic of this invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objects, and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:

FIG. 1 depicts a diagram wherein several cameras are recording various perspectives of an activity at a venue;

FIG. 2 illustrates a block diagram of camera-enabled handheld devices recording video of an activity from different perspectives for transmission through a wireless gateway for storage at a multimedia server;

FIG. 3 illustrates a block diagram of cameras recording video data of an activity for storage in a server and a remote client accessing the stored video from the sever over a data network;

FIG. 4 illustrates a block diagram of cameras recording video data of an activity for storage in a server and a handheld multimedia device, capable of viewing video, accessing captured video as streaming data from the server through a wireless data communications network and/or as a broadcast;

FIG. 5 illustrates a system diagram of video captured by cameras at an activity provided to a server and the video data provided to wireless handheld devices located near the activity through data communications hardware, and also data provided by data communication hardware through a data network to remote multimedia content provider hardware for transmission via cable, radio frequency transmission or satellite to a multimedia presentation device (e.g., high definition television, set-top box, computer or handheld devices located away from the activity);

FIG. 9 illustrated a exemplary screen shot for a video archiving and subscription service entitled MyFrontRow™ which enables community and individual user registrations, video archiving, and video retrieval for video captured at activities by venue operators, fans and privately owned, video camera-enabled, handheld device users; and

FIGS. 10-14 illustrate flow diagrams of various methods for providing increased remote video viewing opportunities of activities including private activities and public activities that occur at entertainment venues and within physical communities to a remote audience, in accordance with features of the present invention.

DETAILED DESCRIPTION

Referring to FIG. 1, illustrated is an example of an entertainment venue 100, such as a football stadium. An entertainment venue typically includes a public attendee seating area 101, which is typically divided according to seats and sections, surrounding an activity area 110, which is typically reserved for access by authorized personnel and performers/athletes. The seating area 101 surrounding the activity area 110 and can be divided into sections, e.g., sections A through N is shown. Several venue controlled video cameras C1-Cn can be deployed throughout the entertainment venue 100 and can typically surround the activity area 110 to provide multiple vantage points from which to capture video for broadcast and display of the activity taking place in the entertainment venue. In addition to entertainment venue controlled cameras C1-Cn, many private handheld devices enabled with video cameras M1-Mn and owned/carried by attendees (e.g., spectators and fans) can be located throughout the entertainment venue. An entertainment venue 100 can be utilized for sports activities, concert activities, political rallies, or other activities requiring a large space. Entertainment venue controlled cameras C1-Cn together with private handheld cameras M1-Mn provide an opportunity for vast coverage of the activity area 110.

FIG. 1 illustrates how effectively an entertainment area 110 can be covered by various video cameras capturing video and/or pictures of an activity. Entertainment venue controlled camera one (C1) 121 is shown located near the center field location of the venue providing a central venue of the activity area 110. Entertainment venue controlled cameras two (C2) 122 and three (C3) 123 are shown located at opposite end zone locations of the activity area 110. Entertainment venue controlled camera n (Cn) 124 is shown at the opposite side of the activity area 110 in Section H. The entertainment venue controlled cameras C1-Cn can obviously provide good visual coverage of the activity area; but it can be appreciated that attendee handheld devices equipped with video recording capabilities are mobile and can also be deployed in several areas through the public attendee area 101, thereby providing an even richer selection of video perspectives for fans that might be observing the activity, or may be located at home or any other remote location outside of the venue proper.

Attendee handheld device one (M1) 131 is shown located in Section A with a slightly different vantage point that entertainment venue controlled camera one (C1) 121. Attendee handheld device one (M1) 131 clearly compliments the perspective captured by entertainment venue controlled camera one (C1) 121 from Section A. Attendee handheld devices two (M2) 132 and three (M3) 133 are located at centralized end zone locations (Sections E and K respectively). Attendee handheld devices two and three clearly provide views that were not covered by the entertainment venue controlled cameras. Another attendee handheld device (Mn) 134 is shown located in Section G, providing yet another perspective for activity fans.

The deployment of multiple cameras as shown for the entertainment venue illustrated in FIG. 1 offers unique multimedia content, which can be of value to all spectators. Although an entertainment venue 100 is shown in FIG. 1, it should be appreciated that an “activity” does not have to take place within a public “entertainment” venue to be recorded by video cameras. Indeed, activities of interest can also take place at private or public events and locations that do not draw large scale attendance but are nevertheless of high interest. For example, a little league baseball game might be recorded by several parents attending the game. A competition that is distributed over a vast area, such as a bike or auto race, can be captured from various, distributed perspectives. Views captured by private attendees at such events are of value to all attendees and can be shared by using a multimedia server in accordance with features of the present invention. Camera views can be captured by more than camera deployed about and/or in surrounding a live sports or entertainment venue activity 110, such as a racing event, ball game, concert, golf, Olympic event, political rally, boxing or wresting ring, and casino activities such as sports book. The activity does not have to be entertainment based to be of value and can be stored in a server by individuals working alone or as a member of an organized community/group. Proper “time” identification tagging of video when/as recorded is important where synchronization of multiple perspectives for accurate viewing simultaneously on displays associated with video display devices is desired. Accurate timing can be provided by GPS-based UTC time and also by Atomic Clock time to ensure that video of an activity recorded by/from disparate sources can be synchronized when played or replayed on remote video systems.

An activity can also be of educational, commercial or government interest. For example, if a natural disaster or terrorist act occurred where several witnesses were able to record the event with personal handheld video cameras, the video images may be of very high value from a national security or investigation standpoint and can be shared via a multimedia server adapted to collect and organize various videos. The Department of Homeland Security (DHS) and government investigative and intelligence agencies, for example, would be interested in collecting as much information about an unfortunate, public event as possible in order to find those responsible, or to prevent future occurrences. A Hollywood scenario in the 2008 movie release “Vantage Point” is a fictitious action movie that provides moviegoers a scenario where an attempted assassination of the president is told from five different points of view. Although fictitious, the scenario revealed in this movie is a good example where video data in synchronicity from different vantage points from a real-world situation can become highly valuable and necessary for investigative purposes. As another example, a casino operator can also be very interested in monitoring various perspectives within the casino for security purposes. Fulfillment of these needs and other application can be envisaged now given the present invention.

Referring again to the illustration in FIG. 1, assuming that the venue 101 is instead a town or a city, the activity 110 of interest may be observed by spectators at various locations surrounding the activity. If witnesses to an activity also have the means to capture video or photographs of the activity and could upload the captured data into a server where the date, time and location for the data is also identified, then researchers or investigators can easily find important, high value information about the activity from servers. Again, proper “time” identification tagging of video when/as recorded is important where synchronization of multiple perspectives for accurate viewing simultaneously on displays associated with video display devices is desired. Accurate timing can be provided by GPS-based UTC time and also by Atomic Clock time to ensure that video of an activity recorded by/from disparate sources can be synchronized when played or replayed on remote video systems. GPS tagging, which will be described in more detail below, can actually provide date, time and location with great accuracy and may be best suited for providing this information on media.

Those skilled in the art can appreciate that hand held devices can be implemented as a Internet-enabled cellular communications device, such as a Blackberry™ iPhone, and Palm Treo™ Smart phones and PDA devices sold today include high-speed data network access (e.g., HSPA-HSDPA, WiMAX, Edge, GSM, etc.), providing video streaming, provide Internet access, and can capture video with greater than 1 megapixel image capturing capability. Global position system (GPS) chipsets are also provided on handheld devices today. Handheld devices such as PDAs and Smart Phones have been thoroughly described in the patent applications which are incorporated by reference with priority. Furthermore, those skilled in the art are currently well informed about most of the features and operation of handheld devices. For these reasons, additional detail is not required for a generally understanding of wireless handheld devices as they are used with or to carry out the unique features of the present invention.

To the extent the provision of wireless handheld devices with wireless data network communications, GPS and video recording camera can be improved to best operate in accordance with features of the present invention, a software module can be provided as part of the multimedia features in a handheld device that can automatically include a data tag on the recorded media that can indicate the location and time of video or picture recording. For example, a time and location sentence can be embedded in the digital file or as a message embedded in pixilated media that will provide the time and location of the recorded activity. A data tag sentence that will indicate that a photograph or video was captured on Dec. 31, 2008 at UTC time 12:35:19 and at GPS location Latitude 48 deg 07.038′ N; Longitude 11 deg 31.000′ E can be provided in a simplified format that can read as follows: 12312008,123519,4807.038,N,01131.000,E. An abbreviated data tag can be easily searched for in searchable databases within a server. The server and/or data base can be programmed to convert the data tag into searchable media where a user of a multimedia service may request that video/pictures be found from a within one half mile of a specification GPS location within a range of time by entering indentifying information into search field over a graphical user interface (GUI). An example search can include the following: Search within Distance=0.5 mile(s) of GPS Location=Latitude 48 deg 07.038′ N and Longitude 11 deg 31.000′ E; at Time=1700 hrs to 1730 hrs; Date=Dec. 31, 2008). Access to recorded media, therefore, can be provided to users from the server based on search criteria specific to the timeframe, date and location of the data's capture as described above. For example, a researcher can request from the multimedia server that video and pictures of an activity taking place at a specific location, at a specific date, during a given timeframe as receive only media that is relevant to the exact activity of interest (e.g., winning touchdown, questionable call by a referee, a spectacular public sighting, a catastrophic event, and event of political, educational and investigative interest).

As described above, if wireless handheld devices have GPS capability and integrated video cameras, software programming can be incorporated as a companion application with multimedia software used to capture/record video and photographs to enabling the tagging of any media captured by the video camera (video or pictures) to include an associated data stamp that includes, the date, time, and GPS location for the captured video or picture data as it is actually recorded. It can even be possible to include the direction in degrees (e.g., using an electronic compass) and altitude of the handheld device when the video/pictures were actually captured by the camera. Additional data can be entered into the server when video/photos are uploaded, such as title, location or event names, etc. Users can later access the multimedia data, now organized as video or pictures from a server with at least one of: activity title, activity time, activity date, activity place, wireless handheld device GPS position at time of video recording, altitude at capture, orientation or direction of capture by handheld during capture (i.e., provided in degrees from magnetic north an electronic compass integrated in the camera/handheld device).

It is appreciated that privacy may come into play with certain technology. The idea of automatically tagging video or photographs when they are captured by cameras may not settle well with some users. For this reason, Handheld devices can also be programmed to enable the user/owner of the cameras to disable or suppress tagging for photograph if location information is not desired. This may be an important privacy feature depending on the sensitivity of the multimedia content being recorded by the camera. The software module can allow GPS to be overriding by depressing a button, soft-button or set up parameter before taking video footage with the handheld device.

Referring to FIG. 2, a block diagram of camera-enabled handheld devices 131-134 including integrated video cameras 137 for recording video of an activity 110 for transmission through a wireless gateway 140 for storage at a server 150 is illustrated. In accordance with a feature of the present invention, a server 150 can be provided that is capable of receiving different visual perspectives of a activity 110 captured by more than one camera 131-134 located at, near and/or around the activity 110. The server 150 can process the different visual perspectives of the activity 110 into video-related data and record the video-related data for selective retrieval and display by user video display devices authorized to communicate with the server 150 over data networks.

A registration module 151 can be provided with the server 150 that is adapted to register users and authorize user access to the server to: provide video captured at the activity 110 using a camera 137 included in a wireless handheld device 131 and selectively retrieve video-related data captured at the activity for display by a user video display devices.

An activity organization module 152 can be provided with the server 150 that is adapted to organize video captured by users at the activity using a cameras 131-134 including a camera 137, where videos of various perspectives of the activity 110 are provided to the server 150, and wherein the video is automatically organized by the server based on identifying data including at least one of: activity title, activity time, activity date, activity place, location (e.g., GPS stamp as a location data tag) of wireless handheld device at time of video recording. The activity organization module can be further adapted to provide a user selective access to the organized video from the server based on a request from the user of at least one of: activity title, activity time, activity date, activity place, and wireless handheld device location at time of video recording. Camera orientation, location and direction can also be features that are used as information associated with an electronic tag included with video images.

A community association module 153 can be provided with the server 150 that is adapted to associate registered users with online communities (e.g., membership group) also registered within the server 150 and to provide a user selective access to organized video of activity captured using a camera 137 included in a wireless handheld device 131 by registered community members attending an activity and which are provided to the server 150. Video can then be provided to all registered users of the community from the server 150 based on a request from the registered community user of at least one of: activity title, activity time, activity date, activity place, wireless handheld device location at time of video recording.

A video synchronization module 154 can be provided with the server as shown in FIG. 2, or with the remote client (e.g., HDTV, set-top box, and other video display devices not shown in FIG. 2). The video synchronization module 154 when provided is adapted to simultaneously play/replay video captured from different visual perspectives of an activity in synchronization with each other based on the time that the simultaneous videos were captured. Synchronization is possible using time stamp information embedded as data tagging information in video data associated with streaming video.

Those skilled in the art can appreciate that although real time video data may be transmitted to server 100, past captured video images can also be stored/archived within server 100 and transferred to user display devices such as hand held device 131 for display at display. For example, instant replays may be transferred as video data to hand held device 131 upon the request of a user of hand held device 131 at a venue, or a user watching an activity from home can request the replay for display on a high definition television set, or through a video router, on a computer or on a handheld device. Such instant replay footage can be displayed on display screen of various, data network enabled devices for the user to view.

Referring to FIG. 3, a block diagram 200 of cameras 131-134 recording video data 221-224 of an activity 110 for storage in a server 150 and a remote client 180 having a display 185 and adapted to access the stored video data 221-224 from the sever 150 over a data network 170.

Referring to FIG. 4, a block diagram 300 of cameras 121-124 recording video data 221-224 of an activity 110 for storage in a server 150 and a handheld multimedia device 380 having a display screen 385 and capable of viewing the video data 221-224 by accessing the video data 221-224 from the server 150 through a wireless data communications network as streaming video and/or as a broadcast. Server 100 can also communicate with handheld devices through a wireless cellular communication network (e.g., 3G, HSPA/HSDPA, Edge, WiMAX, CDMA, or other wireless communication means). A wireless data transmitter/receiver 340 capable of supporting the wireless data communications can be integrated with hand held device 380.

Referring to FIG. 5, a system diagram 400 of video captured by cameras 421-422 at an activity 110 provided to a server 150 and the video data provided to wireless handheld devices 310 located near the activity through data communication hardware 340. Data can also provided by data communication hardware 340 through a data network 170 to remote multimedia content provider hardware 450 for transmission via cable 430, radio frequency transmission 420 or satellite 440 to a multimedia presentation device 410 (e.g., high definition television, set-top box used with satellite and cable television service such as devices provided by TiVo™, computer or handheld devices located away from the activity 110) is illustrated. In the illustration, the example activity 110 is shown as a boxing ring incorporate cameras surrounding the ring and synchronized in a master-slave relationship located over the ring for automated the capture of video using master-slave camera technology. Servers and multimedia devices referred to herein can include systems such as those supported by subscription services (e.g., digital cable television and satellite television providers) and digital recording equipment. Thereafter, multiple camera view data can be viewed and replayed via cable or satellite to a users/subscriber's remote viewer (e.g., HDTV display, set-top boxes).

Those skilled in the art can appreciate that wireless networks and servers can also receive and retransmit other data, in addition to video data. For example, a server or other computer system may be integrated with wireless network to provide team and venue data, which can then be transferred to wireless data transmitter receiver from wireless network and displayed thereafter as team and venue information within display screen of a users display device. Other data that may be transferred to hand held device for display include real-time and historical statistics, purchasing, merchandise and concession information, and additional product or service advertisements.

Data can also include box scores, player matchups, animated playbooks, shot/hit/pitch charts, historical information, and offense-defense statistics. In a concert venue, for example, as opposed to a sporting event, information pertaining to a particular musical group can be also transferred to the hand held device, along with advertising or sponsor information. Note that both the video data and other data described above generally comprise types of venue-based data. Venue-based data, as referred to herein, may include data and information, such as video, audio, advertisements, promotional information, propaganda, historical information, statistics, event scheduling, and so forth, associated with a particular venue and generally not retrievable through public networks. Information data can be transmitted together with video data received from data transmitter. Such information may be displayed as streaming data within a dedicated display area of a user's video display or simply stored in a database for later retrieval by the user.

A wireless gateway 124 and server 150 can be associated with a wireless network implemented in association with stadium venue 100. Those skilled in the art can appreciate that such a wireless network can be geographically located in a stadium venue 100, or the immediate surrounding area. It should also be appreciated that a server can operate across a country and still operate as taught herein to register user, retrieve, store and provide video form/to registered users. Capacity and transmission bandwidth are the only constraints for a multimedia delivery system. These limitations continue to be overcome with faster servers, optical data networks, and high bandwidth wireless data communication networks such as 3G cellular and WiMAX.

It can be appreciated by those skilled in the art that the system illustrated with respect to FIGS. 6 to 8 generally describes an example of one type of computer network in which the embodiments disclosed can be implemented. It can be appreciated that other types of computer networks can also be utilized in accordance with alternative embodiments of the present invention, such as, for example, token ring networks, Intranets or organizationally dedicated computer networks rather than a more open computer network, such as the Internet. FIGS. 6-8 are thus presented for illustrative purposes only and are not considered limiting features of the system as data network communications systems continue to evolve and improve. Note that the term “Internet” is well known in the art and is described in greater detail herein. Also note that the client/server architecture described in FIGS. 6-8 represents merely an exemplary embodiment. It is believed that the present invention can also be embodied in the context of other types of network architectures, such as, for example company “Intranet” networks, wireless communication networks, cellular (3G, HSDPA or high-speed downlink packet access which is part of the high speed packet access family of protocols, and future, e.g., HSPA+, etc. as released), WiMAX, and the like.

FIG. 6 illustrates a block diagram illustrative of a client/server architecture system 600 in which one or more embodiments can be implemented. As indicated in FIG. 6, user requests 601 for data can be transmitted by a client 610 (or other sources) to a server 650. Server 650 can be analogous, for example, to sever 100 described earlier herein. Server 650 can be implemented as a remote computer system accessible over the Internet, the meaning of which is known, or other communication networks. Server 650 can perform a variety of processing and information storage operations. Based upon one or more user requests, server 650 can present the electronic information as server responses 602 to the client process. The client process may be active in a first computer system, and the server process may be active in a second computer system, communicating with one another over a communications medium, thus providing distributed functionality and allowing multiple clients to take advantage of information processing and storage capabilities of the server, including information retrieval activities such as retrieving documents from a managed service environment.

FIG. 7 illustrates a detailed block diagram of a client/server architectural system 700 in which one or more embodiments can be implemented. Although the client 710 and server 750 are processes that are generally operative within two computer systems, such processes can be generated from a high-level programming language, which can be interpreted and executed in a computer system at runtime (e.g., a workstation), and can be implemented in a variety of hardware devices, either programmed or dedicated.

Client 710 and server 750 communicate utilizing the functionality provided by HTTP 701. Active within client 710 can be a first process; browser 715, which establishes connections with server 750, and presents information to the user. Any number of commercially or publicly available browsers can be utilized in various implementations in accordance with one or more embodiments. For example, a browser 715 can provide the functionality specified under HTTP 701. A customer administrator or other privileged individual or organization can configure authentication policies, as indicated herein, using such a browser 715.

Server 750 can execute corresponding server software, such as a gateway, which presents information to the client in the form of HTTP responses 701. A gateway is a device or application employed to connect dissimilar networks (i.e., networks utilizing different communications protocols to serve digital television customers) so that electronic information can be passed or directed from one network to the other. Gateways transfer electronic information, converting such information to a form compatible with the protocols used by the second network for transport and delivery. Embodiments can employ Common Gateway Interface (CGI) 704 for such a purpose.

In computer to computer environments where a data network such as the Internet is used to transfer data, the HTTP responses 701 generally correspond with “Web” pages represented using HTML 702, or other form data 706 generated by server 750. Server 750 can provide HTML 702. The Common Gateway Interface (CGI) 704 can be provided to allow the client program to direct server 750 to commence execution of a specified program contained within server 750. Through this interface, and HTTP responses 701, server 750 can notify the client of the results of the execution upon completion.

FIG. 8 illustrates a high-level network diagram illustrative of a computer network 800, in which embodiments can be implemented. Computer network 800 can be representative of the Internet, which can be described as a known computer network based on the client-server model discussed herein. Conceptually, the Internet includes a large network of servers 814-820 that are accessible by clients 802-812, typically users of personal computers, through an Internet service provider 822.

Each of the clients 802-812 can operate a browser 715 to access one or more servers 814-820 via service provider 822. Each server 814-820 can operate a so-called “Web site” that supports files in the form of documents and web pages. Clients 802-912 and server 814-820 can also operate as a peer-to-peer network, which is popular for data/file sharing. A network path to servers 814-820 can be generally identified by a Universal Resource Locator (URL) having a known syntax for defining a network collection. Computer network 800 can thus be considered a “Web-based” computer network.

FIG. 9 illustrates a pictorial view of a sample graphical user interface “web page” window 900 that can be implemented as a graphical user interface display in accordance with features of the present invention. Those skilled in the art will appreciate that the term “webpage” refers simply to a “page” of an Internet “web” site. The term “homepage” is commonly utilized in the Internet computer networking arts to refer to a primary web page or primary web “site”. Subsets or specific related areas can be referred to simply as “pages.” FIG. 9 illustrates a web browser-based graphical user interface “window” 900 in which multiple perspectives of activity taking place within a venue such as venue 100 can be selected by a user and displayed within the display screen of a client such as 802 that is in communication with a server 150 via the Internet 800. Window 900 can display, for example, a web browser application. Where multiple visual perspectives of the same activity are available, they can be simultaneously displayed in separate display areas as will be further described. Additionally, where video has been time tagged (e.g., using Atomic clock, UTC time and GPS, as previously described), video can be synchronized to run simultaneously so that more than one visual perspective of the same activity can be seen at the same time. This provides the user a greater viewing experience. A display area streaming a particular view of interest to the user can be selected and enlarged (blown up) up to a full screen view for enhanced viewing. Streaming videos can be reversed, forwarded and replayed at will by the user. All video streams, when synchronized, can be reversed, forwarded and replayed in synchronization where the video are data tagged as described herein.

Icons 921 are generally displayed within the web browser application which can permit a user to implement web browser commands. In graphical user interface environments, icons are typically small graphical images displayed to represent objects that can be manipulated by a user via a pointing device such as a mouse. For example, the icon entitled “Find” 905 can be utilized to implement a command that instructs the web browser application to search for a particular web page or database content. The icon entitled “Sign In” 910 enables registered users to log into the server 150 and utilize its multimedia data services and tools 955 to upload video or retrieve videos. Videos can be searched for using video “Find” 905 button, which can bring up a search engine or search fields. The current hypertext address of the displayed web page is shown as Universal Resource Locator (URL) address 908. Thus, the current URL for the displayed web page is “http://www.myfrontrow.com”. Window 900 can include a scroll bar 923, used with an up-arrow feature, and a down-arrow feature. An elevator 924 permits a user to scroll up and down a displayed web page to view portions of the web page not currently displayed within window 900. Button 960 to be used to find a community or group, or register with a community as a member. Communities can be used for private group members to privately share video from multiple perspective of a related activity which is of interest to the community.

Graphical video images 921 and 922, which are images of different perspective captured simultaneously of the same activity, can be displayed simultaneously within window 900. Images 921 and 922 can be viewed within a video display area such as, for example, video display area 940, which is graphically displayed in a “split screen” format. A variety of other display areas 942-950 can also displayed photographs and videos within window 900. Video data associated with live action video images displayed within video display area 940 can be displayed within these display areas. Live action video data from other various venues can be displayed simultaneously within display areas 942-950. Selection buttons 951, 952, 953 and 954, when selected by a user, can permit a user to view various recorded and live video perspectives via the web page 900, including multiple perspective of activities including events taking place within a venue such as venue 100 or via cameras such as video cameras 121, 122, 123, 124 and mobile handheld video camera 137.

Various selection buttons and hypertext links are displayed within homepage window which contain links to other web “pages” or portions of web site associated with the URL—www.myfrontrow.com. For example, selection button 951, when selected by a user, permits the user to access and post video data to an associated web page with the topic “news”. Similarly, Selection button 952, when selected by a user permits the user to access and/or post video data of interest to a Blog. Selection button 953, for example, permits the user to access and post video data to an associated web page dealing with the topic “sports”. A mouse click on the selection button 954 permits a user to access “Entertainment” other than sports such as movies or shows. Selection button 955, when selected by a user, permits a user to access tools that will enable the user to manage video images streamed to web page 900, such as, for example, video images 921 and 922 associated with the events taking place within venue 100. Selection of button 956 will enable a user to access the user's private videos (e.g., for viewing or uploading and deletion). Button 957 enables users to “sign up” to the web site and its services. Selection button 958, when selected by a user, enables the listing of various venues available for video display. Selection button 958, when accessed by a user, can also permit the user to retrieve live streaming video and audio entertainment data from a user's preferred (or registered) venues such as, for example, venues 100, or a private activity. Button 959 enables users to view recent videos uploaded into the website, e.g., the www.myfrontrow.com website. Finally, button 960 enables users to search for communities and register with communities of interest to the member. Button 960 also enables the user to access tools for setting up/register new communities and enable invited party access by setting up usernames and passwords for guests.

The Video Synchronization Engine 970 button invokes the synchronization capabilities, either at the server or on the remote viewers/devices and enables simultaneous video play and replay synchronization based on “timing” data embedded in streamed videos. With video synchronization, video streams of images 921 and 922, as well as 942 an 944, can be displayed on display 900 in synchronicity based on the time (e.g., GPS-UTC, Atomic clock) that the videos were recorded at the same activity. For optimum viewing the display 900 and its individual windows can be expanded to a full screen view (and reduced again) using features available currently with most media players.

It should be appreciated that remote viewers/devices that take advantage of access to multimedia, synchronized camera views can not only include venue-based hand held devices and Internet connected computer, but can include remote video receiving systems monitors such as those offered from cable and satellite service provider with enhanced digital capabilities such as high definition television (HDTV) formatting, or other digital enabled viewing systems and devices that might come into to use in the form of a home multimedia server used for providing home-based customers with enhanced multimedia entertainment access and control. It can now be appreciated that, when multiple visual perspectives of the same activity are available, multiple videos can be simultaneously displayed in separate display areas (e.g., split screens) on the video screen in a similar manner as described with respect to the GUI in FIG. 9. Time tagged video can be synchronized to run simultaneously on the television screen, whether it is an HDTV bid screen, or a projection based screen) so that more than one visual perspective of the same activity can be seen, in synchronicity, at the same time. Like a computer mouse is typically used to navigate around a screen and select media in a computer, a wireless remote control can be used to navigate about the content being displayed on a large video screen to display single or multiple views of live or recorded video streams from content providers (e.g., cable and satellite programming providers providing on demand sports programming). Set-top boxes can be enabled with programming that will allow, via wireless remote control, for user navigation and selection of video perspective for display and can also enable rewinding, fast forwarding, pause and replay capabilities which are already available on set-top boxes as associated remote controls for viewing single perspective videos. Enhanced functionality in accordance with unique features of the present invention provides a greater viewing experience by programming customers.

With teaching of the present invention, it can even be envisaged that multiple perspectives can be recorded for movies and shows by film makers and producers of the “Movie Industry” in order to enhance home video entertainment. Although movie theatres are still routinely attended, home video rental or on-demand video streams purchases are becoming a much larger part of the movie industries revenue stream. In fact, new movie releases are being provided in DVD sales and rental and online services very shortly after their debut and theatre runs. With this in mind, it can be appreciated that enhanced movie releases for the home entertainment market can include, for example, four perspectives of an action scene that can be viewed simultaneously in a split screen format similar to the presentation format shown on the display 185 in FIG. 3, on a home-based video monitor such as the monitor HDTV 410 mentioned in FIG. 4. Flat panel displays and home theatre rear projections screen are so large today that they can support simultaneous display. Flat panels displays are now widely available to consumers at sizes up to sixty-five inches (65″) measured diagonally. The different vantage points or perspectives can be of a single character or of different characters at different location operating at the same time in a movie scene, such as the perspective shown of two hockey players 921, 922 shown in the split screen format 940 on the display 900 described in FIG. 9, which may be at different location on the playing field for the game. Such distributed, but synchronized scenarios became popular in the Fox™ television broadcast series “24”, where several scenes of characters hypothetically operating at different locations at the same time were shown in split screen areas of the viewing display. This is only illustrative of how a concept of video synchronization would be amusing and valuable, depending on the application. A financial premium may be recognized for the sale of a recoded movie in a multiple perspective format, where a single perspective can be viewed at view disruption, or several views can be shown simultaneously in split screen synchronized format. Again, all recorded video streams, when synchronized using a video synchronization engine, can be reversed, forwarded and replayed in synchronization where the video is data tagged as described herein. Synchronization engine software can be configured to function automatically on the display or set-top box where simultaneous video perspectives are being streamed and timing information is available. With movies as another possible application for the present invention, it should be appreciated that the definition of “activity” herein should extend to movie-related entertainment media.

Referring to FIG. 10, a flow diagram 1000 of a method for providing increased remote video viewing opportunities of activities including private activities and public activities that occur inside outside of entertainment venues to a remote audience is illustrated, in accordance with features of the present invention. The method starts can begin as indicated at Block 1010. As illustrated at Block 1020, a server ban be provided that can be adapted to: receive different visual perspectives of a public activity captured by more than one camera located at an activity, process the different visual perspectives into video-related data and record the video-related data for selective retrieval by and display on video display devices authorized to communicate with the server over a data network. Thereafter as described at Block 1030, different visual perspectives of an activity captured by more than one camera located at an activity can be received, wherein the different visual perspectives received at the server through a data network. As shown in Block 1040, the different visual perspectives are processed at the server into video-enabled data and recording the video-enabled data in a memory associated with the server. Then, as shown at Block 1050, video-related data selected by video display devices is provided to video display devices. The video-related data can be provided to the video display devices from the server over a data network. The method then ends at Block 1060.

As illustrated in FIG. 11, a method is depicted that can provide increased remote video viewing opportunities of activities to a remote audience is illustrated. The method begins at Block 1110. Then as shown in Block 1120, different visual perspectives of an activity captured as video by more than one camera located at an activity at a server adapted to receive and process video are received. The different visual perspectives are received at the server through a data network. Thereafter, as illustrated at Block 1130, the different visual perspectives can be processed at the server adapted to receive and process video into video-enabled data and recording the video-enabled data in a memory associated with the server. Next, as described at Block 1140, video-related data selected by video display devices can be provided to video display devices. The video-related data can be provided to the video display devices from the server adapted to receive and process video over a data network. The method can then terminate as shown at Block 1150.

Referring to FIG. 1200, a flow diagram of a method providing increased remote video viewing opportunities of activities to a remote audience is illustrated. The method begins at Block 1210. Thereafter, as described in Block 1220, users can be registered at a server adapted to receive and process video and authorizing the users to access the server adapted to receive and process video to provide video captured at the activity using a camera included in a wireless handheld device and to selectively retrieve video-related data captured at the activity for display by video display devices. As described at in block 1230, different visual perspectives of an activity captured as video by more than one camera located at an activity are received at the server adapted to receive and process video. The different visual perspectives can be received at the server through a data network. Thereafter, as depicted at Block 1240, the different visual perspectives are processed at the server adapted to receive and process video into video-enabled data and then recorded in a memory associated with the server adapted to receive and process video. As indicated next at Block 1250, video captured by a user at the activity using a camera included in a wireless handheld device and provided to the server adapted to receive and process video are processed based on identifying data including at least one of activity title, activity time, activity date, activity place, location of wireless handheld device at time of video recording. Then as shown in Block 1260, user access is provided to the organized video from the server adapted to receive and process video based on a request from the user of at least one of: activity title, activity time, activity date, activity place, wireless handheld device location at time of video recording. The video-related data can be provided to video display devices from the server adapted to receive and process video over a data network. The method can then terminate as indicated at Block 1270.

Referring to FIG. 13, a method providing increased remote video viewing opportunities of activities to a remote audience is illustrated. The method begins at block 1310. As depicted next at Block 1320, users and online communities (e.g., memberships, groups) are registered at a server adapted to receive and process video and authorizing the users associated with online communicates to access the server adapted to receive and process video to provide video captured at the activity using a camera included in a wireless handheld device and to selectively retrieve video-related data captured at the activity for display by video display devices. Thereafter as described and in Block 1330, different visual perspectives of an activity captured as video by more than one camera located at an activity are received at a server adapted to receive and process video. The different visual perspectives are received at the server adapted to receive and process video through a data network. Then next, as illustrated in Block 1340, the different visual perspectives can be processed at the server adapted to receive and process video into video-enabled data and can be recorded the video-enabled data in a memory associated with the server adapted to receive and process video. Thereafter, as described at Block 1350, video captured by a user at the activity using a camera included in a wireless handheld device and provided to the server adapted to receive and process video and can be organized based on identifying data including at least one of: online community name, activity title, activity time, activity date, activity place, wireless handheld device location at time of video recording. As shown in Block 1360, user access can be provided to the organized video from the server adapted to receive and process video based on a request from the user of at least one of: activity title, activity time, activity date, activity place, wireless handheld device location at time of video recording, wherein the video-related data is provided to the video display devices from the server adapted to receive and process video over a data network. The method can then terminate, as indicated at Block 1370.

Referring to FIG. 14, a method providing synchronized viewing of more than one visual perspective recorded in video format by a remote audience is illustrated. The method begins at block 1410. As depicted next at Block 1420, receiving in a server different visual perspectives of an activity captured as video and time stamped with time of capture information by more than one camera located at an activity is received in a server. As shown in Block 1430, the different visual perspectives are processed on the server for synchronized and simultaneous display as more than one video on a single video display device. As shown in Block 1440, the different visual perspectives are displayed simultaneously and in synchronicity with respect to time as more than one video on a single video display. The method can then terminate (and the end of a user's viewing session), as indicated at Block 1450.

The embodiments and examples set forth herein are presented in order to best explain the present invention and its practical application and to thereby enable those skilled in the art to make and utilize the invention. However, those skilled in the art will recognize that the foregoing description and examples have been presented for the purpose of illustration and example only. The description set forth is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching without departing from the spirit and scope of the following claims.

Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene