H04N5/23238—Control of image capture or reproduction to achieve a very large field of view, e.g. panorama

Abstract

The invention provides a real-time error correcting system for automobile navigation. The real-time error correcting system comprises a wide-angle camera, a video error correcting unit, a 360 degree panoramic video composite unit and an image identification unit, wherein the wide-angle camera is used for taking panoramic videos in realistic scenes, the video error correcting unit is used for obtaining video data from the wide-angle camera so as to conduct error correcting, and calculation capacity of the video error correcting unit is more than 100GFLOPS; the 360 degree panoramic video composite unit is used for obtaining videos from the video error correcting unit and compositing the videos to the panoramic videos; the image identification unit is used for obtaining data from the 360 degree panoramic video composite unit, and capable of conducting image identification to the data. The wide-angle lens real-time error correcting system used for automobile navigation is capable of achieving error correcting process and image recognition to images taken by the wide-angle camera timely, and can be applied to automobile navigation.

Description

Translated from Chinese

一种汽车导航设备 A vehicle navigation device

技术领域 FIELD

[0001] 本发明涉及一种汽车导航设备，具体地说，涉及一种使用广角摄像头的汽车导航设备。 [0001] The present invention relates to a vehicle navigation apparatus, particularly, relates to a wide-angle camera of the car navigation device.

背景技术 Background technique

[0002] 众所周知，广角摄像头的基本特点是，摄像头视角大，视野宽阔。 [0002] As we all know, the basic characteristics of a wide-angle camera is a large camera viewing angle, wide field of vision.从某一视点观察到的景物范围要比人眼在同一视点所看到的大得多，而且景深长，可以摄取到相当大的景物范围。 Viewed from a certain viewpoint to the scene in a much greater range than the human eye can see the same view, and depth of field long, it can be taken to the scene of considerable range.

[0003] 然而，所有广角摄像头都有会有一定程度桶形畸变的存在，例如，如图1A-1BK示，图1A示出了由广角摄像头摄取的带有一定程度桶形畸变的图像，而图1B示出了对图1A中的带有一定程度桶形畸变的图像进行纠错处理后得到的图像，可见，所有由广角镜头拍摄得到的图像都有会有一定程度桶形畸变，然而，通过变形的图像很难达到理想的图像识别效果。 [0003] However, all have a wide-angle camera have a certain degree of barrel distortion is present, for example, shown in FIG. 1A-1BK, FIG. 1A shows an image with a barrel distortion to some extent taken by wide-angle camera, and FIG 1B shows an image after error correction processing on the image of FIG. 1A with a degree of barrel distortion obtained, visible, all images photographed by the wide-angle lens will have some degree of barrel distortion, however, by modified image is difficult to achieve over the image recognition results.因此，在对由广角镜头拍摄的变形的图像进行识别之前，需要对由广角镜头得到的变形的图像进行纠错。 Thus, prior to the deformation of images taken by the wide-angle lens to identify, the need for deformation of the image obtained by the wide-angle lens for error correction.

[0004] 鱼眼镜头是一种广角镜头，可以达到超过180度的视角，这在汽车导航中非常有用。 [0004] The fisheye lens is a wide-angle lens, can reach more than 180 degrees of viewing angle, which is useful in car navigation.用户可以通过仅仅两个鱼眼摄像头而得到360度视角的视频。 The user may be 360-degree view video obtained by only two fish-eye cameras.而导航所需的视频是一个持续的数据流，每秒钟有多个帧。 And the required navigation data is a continuous video stream, a plurality of frames per second.如果进行视频纠错，必须对每一帧进行纠错，这将造成短时间内有大量数据需要处理，对设备的性能有很高的要求，而现有技术中还没有能够做到对两个鱼眼镜头得到的图像进行实时纠错处理和图像识别并可用于汽车导航的系统。 If the video error correction, error correction must be performed for each frame, which will result in a short time with a large amount of data to be processed, there are high demands on the performance of the device, while the prior art has not been able to do for two fisheye image obtained in real-time error correction process and an image recognition system may be used for car navigation.

[0005] 所以，需要一种能够对两个鱼眼镜头得到的图像进行实时纠错的系统和导航设备，来实时地对两个鱼眼镜头拍摄到的图像进行纠错处理和图像识别，并适用于汽车导航。 [0005] Therefore, a need for a system capable of real-time correction of the navigation apparatus and two fisheye image obtained by the captured image processing and image recognition error correction in real time of two fish-eye lens, and suitable for car navigation.

发明内容 SUMMARY

[0006] 为了解决上述问题，本发明提供了一种汽车导航用的视频实时纠错系统，所述系统包括:广角摄像头，用于摄取现实场景的全景视频；视频纠错单元，用于从广角摄像头获取视频数据并对所获取视频数据进行纠错；360度全景视频合成单元，用于从视频纠错单元获取视频数据，并将所述视频数据合成为全景视频；和图像识别单元，用于从360度全景视频合成单元获取数据，并对所述数据进行图像识别。 [0006] In order to solve the above problems, the present invention provides a real-time video car navigation system with error correction, the system comprising: a wide-angle camera, for panoramic video capture reality scene; video error correcting unit configured from the wide the camera acquires the video data and the acquired video data error correction; 360-degree panoramic video synthesizing unit, configured to obtain video data from the video error correction unit, and the video data into panoramic video; and an image recognition unit for acquiring data from the video compositor unit 360 degree, and the image recognition data.

[0007] 优选地，其中所述广角摄像头包括:第一鱼眼摄像头，用于摄取视角至少为180度广角的视频；第二鱼眼摄像头，用于摄取视角至少为180度广角的视频，第一鱼眼摄像头和第二鱼眼摄像头设置为能摄取到现实场景的全景图象的位置关系。 [0007] Preferably, wherein said wide-angle camera comprising: a first fisheye camera, for uptake of at least 180 degrees wide viewing angle video; second fisheye camera for picking up at least 180 degrees wide viewing angle video, a first a fish-eye camera and a fisheye camera disposed second positional relationship to reality scene can be ingested into the panoramic image.

[0016] 本发明另一方面提供了一种汽车导航设备，所述设备包括:广角摄像头，用于摄取现实场景的全景视频；视频纠错单元，用于从广角摄像头获取视频数据并对所获取视频数据进行纠错；360度全景视频合成单元，用于从视频纠错单元获取视频，并将所述视频合成为全景视频；图像识别单元，用于从360度全景视频合成单元获取数据，并对所述数据进行图像识别；和辅助驾驶单元，用于从图像识别单元获取数据，根据图像识别单元所识别出的内容提供驾驶信息以辅助驾驶。 [0016] aspect of the invention there is provided a car navigation apparatus, the apparatus comprising: a wide-angle camera, for panoramic video capture reality scene; video error correction unit, configured to obtain video data from the wide-angle camera and acquired video data error correction; 360-degree panoramic video synthesizing unit, configured to obtain video from the error correction unit, and the video is a panoramic video synthesis; image recognition unit, configured to obtain data from the video compositor unit 360 degree, and performing image recognition on the data; and an auxiliary driving unit, for acquiring data from the image recognition unit, the image content providing driving information according to an identification unit to assist the driver.

[0017] 优选地，其中所述广角摄像头包括:第一鱼眼摄像头，用于摄取视角至少为180度广角的视频；第二鱼眼摄像头，用于摄取视角至少为180度广角的视频，第一鱼眼摄像头和第二鱼眼摄像头设置为至少能摄取到现实场景的全景图象的位置关系。 [0017] Preferably, wherein said wide-angle camera comprising: a first fisheye camera, for uptake of at least 180 degrees wide viewing angle video; second fisheye camera for picking up at least 180 degrees wide viewing angle video, a first a fish-eye camera and a fisheye camera disposed second positional relationship to at least capable of taking panoramic images of a real scene.

[0026] 本发明提供的实时纠错系统及使用了该系统的导航设备，可以做到实时地对广角镜头拍摄到的图像进行纠错处理和图像识别，协助司机安全驾驶，甚至达到无人驾驶。 [0026] The present invention provides a real-time error correction system and uses the navigation equipment of the system, the image can be done in real time on a wide-angle shots to an error correction processing and image recognition, help drivers to drive safely, even to the drone.

[0027] 本发明的其它功能和优点将在下面的说明书中阐述，部分将由说明书明显看出，或者从发明的实践中得知。 [0027] Other features and advantages of the invention will be set forth in the description which follows and in part will be apparent from the description, or may be learned from practice of the invention.本发明的优点将由书面的说明、权利要求书和附图特别指出的结构实现和得到。 Advantages of the invention will be realized and attained by the structure written description and drawings, particularly pointed out in the claims.

[0028] 应该理解的是上述概括性说明和后述的详细说明是示例性的和解释性的，意图提供对于本发明权利要求的更进一步的解释。 [0028] It should be understood that the foregoing general description and the following detailed description is explanatory and are intended to provide further respect the present invention as claimed in claim exemplary explanation.

附图说明 BRIEF DESCRIPTION

[0029] 附图提供了对于本发明更进一步的理解，并入说明书中并构成说明书的一部分，解释本发明的实施例，并与说明书一起用于解释本发明的原理。 [0029] The accompanying drawings provide a further understanding of the present invention, are incorporated in and constitute a part of this specification, illustrate embodiments of the invention, and, together with the description serve to explain the principles of the present invention.

[0030] 附图中: [0030] In the drawings:

[0031] 图1A示出了由广角镜头摄取的带有一定程度桶形畸变的图像。 [0031] FIG 1A shows an image with a barrel distortion to some extent taken by the wide-angle lens.

[0033] 图2根据一个示范性实施例，示出了本发明所提供的用于汽车导航的实时纠错系统的结构图。 [0033] FIG 2 according to an exemplary embodiment, a block diagram for illustrating a car navigation system in real-time error correction provided by the present invention.

[0034] 图3根据一个示范性实施例，示出了使用图形处理器进行并行计算的硬件结构图 [0034] FIG 3 according to an exemplary embodiment, shows a hardware configuration diagram of the graphics processor using parallel computing

[0035] 图4根据一个示范性实施例，示出了应用本发明所提供的实时纠错系统的汽车导航设备的结构图。 [0035] FIG. 4, according to one exemplary embodiment, a block diagram illustrating a car navigation apparatus in real time correction system according to the present invention is provided by the application.

具体实施方式 detailed description

[0036] 在本申请中，将围绕一种实时纠错系统及使用了该系统的导航设备来描述示范性实施例。 [0036] In the present application, we will focus on a real-time error correction system and a navigation apparatus using the system described exemplary embodiment.本领域普通技术人员应认识到，下面的描述仅仅是示例性的而并非意图进行任何方式的限定。 Those of ordinary skill in the art should realize that the following description is merely exemplary and not intended to be limiting in any way.受益于本申请的本领域的技术人员将容易获得其他实施例的启示。 The benefit of this disclosure those skilled in the art will readily derive other embodiments of inspiration.现在，将更为详细地描述如附图中所示的示范性实施例的实施方式。 Now, embodiments of the exemplary embodiment as shown in the drawings will be described in more detail.贯穿全部附图以及下列描述，相同的附图标记将尽可能用于表示相同或相似的对象。 Throughout the drawings and the following description, the same reference numerals as used to denote the same or similar objects.

[0037] 现在将详细地引用本发明优选的实施例，其实例在附图中示出。 [0037] Reference will now be the preferred embodiments of the invention in detail, which are illustrated in the accompanying drawings.

[0038] 本发明一方面提供了一种视频实时纠错系统，所述实时纠错系统能够对由广角镜头拍摄的视频进行实时纠错系统。 [0038] In one aspect the present invention provides a real-time video error correction system, the error correction system capable of real-time correction system for real-time video captured by a wide-angle lens.图2根据一个示范性实施例，示出了本发明所提供的用于汽车导航的视频实时纠错系统200的结构图。 FIG 2 according to an exemplary embodiment, a block diagram illustrating an error correction system of the present invention, real-time video is provided for car navigation 200.所述视频实时纠错系统200包括:广角摄像头210、视频纠错单元220、360度全景视频合成单元205和图像识别单元206。 Real-time correction of the video system 200 comprising: a wide-angle camera 210, a video correction unit 220,360 205-degree panoramic video synthesis unit 206 and an image recognition unit.

[0039] 其中，广角摄像头210，用于摄取现实场景的全景视频。 [0039] wherein the wide-angle camera 210, for panoramic video capture reality scene.优选地，广角摄像头210的广角镜头可以使用至少两个的用于摄取较宽的摄影视角的鱼眼镜头。 Preferably, the wide-angle lens wide-angle camera 210 may be used for at least two intake wider viewing angle fisheye photography.鱼眼镜头是一种广角镜头，可以达到超过180度的视角，这在汽车导航中非常有用。 Fisheye lens is a wide-angle lens, you can reach more than 180 degrees of viewing angle, which is useful in the car navigation.用户可以通过仅仅两个鱼眼摄像头而得到360度视角的视频。 The user may be 360-degree view video obtained by only two fish-eye cameras.如图2所示，广角摄像头包括:第一鱼眼摄像头201、第二鱼眼摄像头202。 2, the wide-angle camera comprising: a first fisheye camera 201, second camera 202 fisheye.第一鱼眼摄像头201和第二鱼眼摄像头202的鱼眼镜头均为视角至少为180度的广角镜头，第一鱼眼摄像头201和第二鱼眼摄像头202设置为至少能摄取到现实场景的全景图像的位置关系。 The first fisheye camera 201 and the second fisheye camera 202 fisheye both viewing angle of at least 180 degrees wide-angle lens, the first fisheye camera 201 and the second fisheye camera 202 is set to at least ingested into reality scene panorama the positional relationship of the image.

[0040] 视频纠错单元220，用于从广角摄像头获取视频数据并对所获取视频数据进行纠错。 [0040] Video error correcting unit 220, configured to obtain video data from the wide-angle camera acquires the video data and the error correction.由于汽车导航系统是实时系统，需要较高的可靠性和快速反应能力。 As the car navigation system is a real-time system that requires high reliability and rapid response capability.因此，需要高性能的并行计算能力来处理实时的视频，所述处理单元的运算能力至少为100GFL0PS。 Therefore, a high-performance parallel computing capabilities to handle real-time video, the computing power of the processing unit at least 100GFL0PS.优选地，视频纠错单元220可以包括分别用于对从第一鱼眼摄像头201和第二鱼眼摄像头202所获取的视频数据进行纠错的两个视频纠错模块，即，第一鱼眼视频纠错模块203和第二鱼眼视频纠错模块204。 Preferably, the error correction unit 220 may include a video for each fish-eye camera for the first 201 and the second video data fisheye camera 202 acquired from the error correction of two video error correction module, i.e., a first fisheye video error correction module 203 and the second error correction module 204 fish-eye video.第一鱼眼视频纠错模块203和第二鱼眼视频纠错模块204分别用于从第一鱼眼摄像头201和第二鱼眼摄像头202获取视频数据并对所获取视频数据进行纠错。 A first error correction module 203 fish-eye video and a second video fish-eye correction module 204 are used to acquire video data 202 and the video data acquired from the first error correction fisheye camera 201 and the second fisheye camera.优选地，视频纠错单元的帧缓存至少为512MB。 Preferably, a video frame buffer error correction unit is at least 512MB.

[0041] 360度全景视频合成单元205用于从视频纠错单元获取视频220获取已纠正好的视频数据，并将第一鱼眼视频纠错模块203输出的视频数据和第二鱼眼视频纠错模块204输出的视频数据视频合成为360度的全景视频，输出给图像识别单元206。360度全景视频合成单元205可以使用现有技术中的全景视频合成方法，例如，；全景视频合成的流程图可以包括以下步骤:1)将各个视频流中的同步帧都一一对应起来；2)对一组同步的视频帧进行柱面坐标变换后，提取图像中的特征点；3)根据特征点对相邻的视频流中的每一帧进行拼接融合，得到由全景帧组成的全景视频。 [0041] 360-degree panoramic video compositor unit 205 for acquiring video from the error correction unit 220 acquires the video data have been corrected well, and the video data 203 output from the first error correction module fish eye video and a second video correction fisheye video synthesizing the video data outputted from error module 204 is a 360-degree panoramic video output to the image recognition unit 206.360 degree panoramic video compositor unit 205 may use a panoramic video prior art synthesis method, for example,; panoramic video synthesis process Fig may comprise the following steps: 1) the respective video streams are synchronized frame tie it; 2) a set of synchronized video frames after the cylindrical coordinate conversion, extracts feature points in the image; 3) the feature point for each frame in the video stream adjacent fusion splicing, to give a panoramic view panorama video frames.

[0042] 图像识别单元206从360度全景视频合成单元205获取数据，并使用有高计算性能的处理器对所述数据进行图像识别。 [0042] The image recognition unit 206 205 acquires data from the video compositor unit 360 degree, and the use of high performance processor calculates the image recognition data.图像识别单元206主要用于对从360度全景视频合成单元205获取的全景图像中的障碍物、行人和车进行识别。 Image recognition unit 206 is mainly used for the 360 ​​degree panoramic image synthesis unit 205 acquires the video of an obstacle, a pedestrian and a vehicle identification.

[0043] 优选地，视频纠错单元220、360度全景视频合成单元205和图像识别单元206可以使用具有强大的并行运算能力的图形处理器来实现，如图3所示，根据一个实施例，示出了使用图形处理器进行并行计算的硬件结构框图，如图所示，使用图形处理器进行并行计算的硬件结构一般包括CPU301、主存储器302、图形处理器GPU (graphics processingunits)存储器303和图形处理器GPU304。 [0043] Preferably, the video correction unit 220,360 degree panoramic video synthesizing unit 205 and the image recognition unit 206 may use a graphics processor having a powerful parallel computing capability to implement, shown in Figure 3, according to one embodiment, It shows a block diagram of a hardware configuration using a graphics processor for parallel computing, as shown, using a graphics processor for parallel computing hardware configuration generally includes the CPU 301, a main memory 302, a graphics processor GPU (graphics processingunits) and graphics memory 303 processor GPU304.在进行运算处理时，首先，将数据从主存储器302复制到GPU存储器303，CPU301发送指令给图形处理器GPU304驱动图形处理器GPU304进行运算处理，然后图形处理器GPU304在其多个核心305中根据CPU301的指令和GPU存储器303中的数据进行并行运算，再将运算结果传输给GPU存储器303，最后将数据从GPU存储器303复制到主存储器302。 When performing arithmetic processing, first, copying data from the main memory 302 to the GPU memory 303, the CPU 301 sends instructions to the graphics processor, a graphics processor GPU304 GPU304 drive performs arithmetic processing, and a graphics processor in accordance with its plurality of core GPU304 305 CPU301 GPU instructions and data memory 303 in parallel operation, then the calculation result is transmitted to the GPU memory 303, and finally to copy data from the GPU memory 303 to main memory 302.由于图形处理器GPU304有上百个可以并行运算的核心305，因此图形处理器有强大的并行处理能力。 Because the graphics processor GPU304 there are hundreds of parallel computing core 305, so the graphics processor has a powerful parallel processing capabilities.当数据处理的运算量远大于数据调度和传输的需要时，图形处理器在性能上可以大大超越传统的中央处理器。 When the amount of computation required is much greater than the data processing and transmission scheduling data, graphics processor performance can be far beyond the traditional central processor.

[0045] 图4根据一个示范性实施例，示出了使用本发明所提供的上述实时纠错系统的汽车导航设备的结构图。 [0045] FIG. 4, according to one exemplary embodiment, a block diagram illustrating a car navigation apparatus in real time using the error correction system of the present invention is provided.所述汽车导航设备400包括:视频实时纠错系统200和汽车导航辅助单元401。 The car navigation apparatus 400 comprising: a real-time video system 200 and an error correction unit 401 car navigation aid.其中，汽车导航辅助单元401用于从视频实时纠错系统200中的图像识别单元206获取数据，根据视频实时纠错系统200中的图像识别单元206所识别出的与驾驶安全相关的信息，例如，全景图象中的障碍物、行人和车等，汽车导航辅助单元401通过将这些驾驶安全相关的信息提供给司机，来提醒司机，协助司机进行驾驶，甚至可以通过使用该汽车导航设备400达到无人驾驶。 Wherein the car navigation unit 401 for auxiliary data 206 acquired from the real-time video image recognition unit 200 error correction system, based on information related to driving safety real time video error correction system 200 in the image recognition unit 206 recognizes, e.g. panoramic image of obstacles, pedestrians and vehicles, car navigation auxiliary unit 401 by providing these driving safety-related information to the driver, to remind drivers to assist drivers were driving, even through the use of the car navigation device 400 to reach unmanned.

[0046] 由此可见，本发明提供的实时纠错系统及使用了该系统的导航设备，可以做到实时地对广角镜头得到的图像进行纠错处理和图像识别，协助司机安全驾驶，甚至达到无人驾驶。 [0046] Thus, the present invention provides a real-time error correction system and uses the navigation equipment of the system, can be done in real-time image obtained by wide-angle lens performs error correction processing and image recognition, help drivers to drive safely, even to no people driving.

[0047] 本领域技术人员可以理解的是，本发明并不局限于上述实施例，根据本发明的教导还可以做出更多种的变型和修改，这些变型和修改均落在本发明所要求保护的范围以内。 [0047] Those skilled in the art will appreciate that the present invention is not limited to the above embodiment, in accordance with the teachings of the present invention may be made more of the variations and modifications, all such variations and modifications fall within the invention as claimed within the scope of protection.本发明的保护范围由附属的权利要求书及其等效范围所界定。 The scope of the present invention is defined by the appended claims and their equivalent scope.

2.如权利要求1所述的系统，其中所述广角摄像头包括: 第一鱼眼摄像头，用于摄取视角至少为180度广角的视频； 第二鱼眼摄像头，用于摄取视角至少为180度广角的视频，第一鱼眼摄像头和第二鱼眼摄像头设置为至少能摄取到现实场景的全景图象的位置关系。 2. The system according to claim 1, wherein said wide-angle camera comprising: a first fisheye camera, for uptake of at least 180 degrees wide viewing angle video; fisheye second camera, for capturing angle of view of at least 180 degrees wide-angle video, a first and a second fisheye camera fisheye camera disposed positional relationship to at least capable of taking panoramic images of a real scene.

3.如权利要求2所述的系统，其中所述视频纠错单元包括: 第一鱼眼视频纠错模块，用于从第一鱼眼摄像头获取视频数据并对所获取视频数据进行纠错； 第二鱼眼视频纠错模块，用于从第二鱼眼摄像头获取视频数据并对所获取视频数据进行纠错。 3. The system according to claim 2, wherein the video correction unit comprises: a first video fisheye error correction module, configured to obtain the video data and video data acquired from the first error correction fisheye camera; the second video fish eye correction module, configured to obtain the video data and video data acquired from the second error correction fisheye camera.

4.如权利要求1所述的系统，其中所述视频纠错单元的帧缓存为512MB以上。 The system as claimed in claim 1, wherein said video frame buffer is error correcting unit 512MB or more.

5.如权利要求1所述的系统，其中所述视频纠错单元使用图形处理器。 5. The system according to claim 1, wherein said video graphics processor to use the error correcting unit.

6.如权利要求1所述的系统，其中所述视频纠错单元支持CUDA 2.0或者CUDA 2.0以上。 6. The system according to claim 1, wherein the video correction unit support CUDA 2.0 CUDA 2.0 or more.

7.如权利要求1中所述的系统，其中所述图像识别单元的运算能力为100GFL0PS以上。 7. The system according to claim 1, wherein the image recognition unit 100GFL0PS more computing power.

8.如权利要求1中所述的系统，其中所述图像识别单元使用图形处理器。 8. The system according to claim 1, wherein the image recognition unit uses the graphics processor.

9.如权利要求1所述的系统，其中所述图像识别单元支持CUDA 2.0或者CUDA 2.0以上。 9. The system according to claim 1, wherein the image recognition unit support CUDA 2.0 CUDA 2.0 or more.

10.如权利要求1所述的系统，其中所述视频纠错单元的运算能力为100GFL0PS以上。 10. The system according to claim 1, wherein the computing capacity of the video correction unit is 100GFL0PS above.

11.一种汽车导航设备，所述设备包括: 广角摄像头，用于摄取现实场景的全景视频； 视频纠错单元，用于从广角摄像头获取视频数据并对所获取视频数据进行纠错； 360度全景视频合成单元，用于从视频纠错单元获取视频，并将所述视频合成为全景视频； 图像识别单元，用于从360度全景视频合成单元获取数据，并对所述数据进行图像识别；和辅助驾驶单元，用于从图像识别单元获取数据，根据图像识别单元所识别出的内容辅助驾驶。 A car navigation apparatus, the apparatus comprising: a wide-angle camera, for panoramic video capture reality scene; video error correction unit, configured to obtain video data from the wide-angle camera acquires the video data and the error correction; 360 panoramic video synthesizing unit, the error correcting unit for acquiring video from the video, and the video is a panoramic video synthesis; image recognition unit, configured to obtain data from the video compositor unit 360 degree, and the image recognition data; and an auxiliary driving unit, for acquiring data from the image recognition unit, the auxiliary drive according to the image content of the identification unit.

12.如权利要求11所述的设备，其中所述广角摄像头包括: 第一鱼眼摄像头，用于摄取视角至少为180度广角的视频； 第二鱼眼摄像头，用于摄取视角至少为180度广角的视频，第一鱼眼摄像头和第二鱼眼摄像头设置为至少能摄取到现实场景的全景图象的位置关系。 12. The apparatus of claim 11, wherein said wide-angle camera comprising: a first fisheye camera, for uptake of at least 180 degrees wide viewing angle video; fisheye second camera, for capturing angle of view of at least 180 degrees wide-angle video, a first and a second fisheye camera fisheye camera disposed positional relationship to at least capable of taking panoramic images of a real scene.

13.如权利要求12所述的设备，其中所述视频纠错单元包括:第一鱼眼视频纠错模块，用于从第一鱼眼摄像头获取视频数据并对所获取视频数据进行纠错； 第二鱼眼视频纠错模块，用于从第二鱼眼摄像头获取视频数据并对所获取视频数据进行纠错。 13. The apparatus of claim 12, wherein the video correction unit comprises: a first video fisheye error correction module, configured to obtain the video data and video data acquired from the first error correction fisheye camera; the second video fish eye correction module, configured to obtain the video data and video data acquired from the second error correction fisheye camera.