适用于 Betaflight 的热图像可见光相机目标跟踪 AI 板

适用于 Betaflight 的热图像可见光相机目标跟踪 AI 板

AI-Powered All-Weather Target Detection and Recognition up to 200 米

介绍

热的 + Digital Dual Cam

• Dual-light Fusion Imaging

• Visible / 热的 / Fast Recognition / Clear Insight

• 超紧凑 / Ultra-light / Ultra-stable

该 Visible-Thermal Dual lens Camera 是一个 dual-mode imaging fusion module specifically engineered for drones. It seamlessly integrates visible light imaging, infrared thermal imaging, and dual-spectrum fusion imaging into a single compact unit. Featuring advanced motion stabilization 和 all-weather imaging capabilities, it ensures reliable performance in dynamic environments.

When mounted on a drone, the module enables accurate pedestrian and vehicle detection within a range of 10 至 200 米, making it ideal for FPV竞速无人机, small UAVs, drone gimbals, and other aerial applications.

主要特点

• High-sensitivity vanadium oxide uncooled detector

• 支持 AI Super-Resolution, output resolution up to 720 × 576

• 内置 AI processing 能力

• 低延迟 imaging performance

• 超低功耗: < 0.8W¯¯

• 紧凑型设计 with high integration: 20 × 20 × 36 毫米

The product adopts a 模块化设计 for flexibility and ease of integration.

• Dual-spectrum imaging module: 23 × 36 毫米

• Image processing module: 36 × 36 毫米

• Ultra-lightweight: < 37 G

It is fully compatible with open-source flight controllers 例如 Beta flight, 和其他人, and can be mounted on a drone in less than 5 分钟, ensuring quick deployment and user convenience.

DUAL CAM MODULE

• Flexible switching between 可见光, infrared, 和 dual-light fusion video

• 支持 electronic zoom for enhanced detail

• 超低延迟 (<60 毫秒) analog output for real-time decision-making

• 融合的 AI capabilities for intelligent imaging

IMAGE AI PROCESSING MODULE

• Image Enhancement: Incorporates advanced algorithms including 3D 降噪, wide dynamic range (宽动态范围), 和 non-uniformity correction (NUC)

• High-Frequency Vibration Suppression: 支持 electronic 3D anti-shake 和 image stabilization for clear and stable visuals

• 双光谱融合: Enables real-time fusion of visible and thermal imaging video, delivering superior situational awareness

By integrating deep learning algorithms 和 high-performance AI chips, 系统提供 full-field automatic target recognition and tracking. This not only reduces pilot workload but also enhances autonomous navigation 并确保 precise mission execution.

ELECTRONIC IMAGE STABILIZATION

• Multi-axis correction: Effectively eliminates horizontal, 垂直的, and rotational vibrations

• Sub-pixel motion compensation: Achieved through precise coordination of 惯性测量单元 和 image sensor data for smoother, clearer imaging

MULTI-TARGET RECOGNITION

• Automatically detects and identifies pedestrians and vehicles 之内 200 米

• Capable of recognizing 30+ targets in real time across the field of view

引脚定义

Terminal 数字	信号 Code	信号 名称
1	DCIN_5V-12V	电源
2	接地	地面
3	UART3_TX_3V3	UART Transmit
4	UART3_RX_3V3	UART Receive
5	USB_DP	USB Positive
6	USB_DN	USB Negative
7	接地	地面
8	PAL_OUT	CVBS Video

规范

DUAL-SENSOR CAMERA MODULE

模块 外形尺寸: 36.0mm×22.4mm×26.5mm (长×宽×高)

Video 输出: 720×576 CVBS Analog Video

数字的 THERMAL

传感器 1920×1080 @50Hz Sensor: 640×512@50Hz

场地 的 View: 130°(H)×109°(V) 场地 的 View: 35°(H)×28°(V)

Low-light 表现: 0.01 勒克斯 NEDT: <40mk

人工智能 图像 PROCESSING MODULE

Firmware Support: 贝塔飞行 (sample only for Betaflight, not support Ardupilot yet)
显示模式: 数字的,热的,Dual-sensor Fusion
界面: CVBS Video,UART,USB2.0
Module dimensions: 36.0mm × 36.0mm × 9.2mm (长×宽×高)
电源: 5~25V
Mounting Hole Positions: 15.5mm × 25.5mm

 

表现 产品规格	探测器 类型	Vanadium oxide uncooled infrared focal plane
	解决	384×288,720×576(人工智能 Super-Resolution)
	Core frame rate	25赫兹、50赫兹
	响应带	8-14一
	NEDT	≤40mk@25℃,F#1.0
Functional 产品规格	Power-on time	<5s
	Brightness/Contrast Adjustment	Manual/Automatic
	Polarity	White hot (默认)/Black hot/Pseudocolor
	Crosshair	Display/Hidden(默认)/移动
	图像处理	Filtering noise reduction,DDE,Mirroring(up/down/left/right)
电气 参数	Digital Video Output	USB/BT.656
	Analog Video Output	CVBS Interface(PAL:720×576)
	通讯接口	UART
	电源范围	DC 4.5-5V
	典型功耗	<0.8W@25Hz
身体的 特征	Core Size	20mm×20mm×36mm
	重量	24G(including lens)
	工作温度	-40℃~+65℃
Optical 镜片	Focal Length 9.1mm(默认)	28°(H)×21°(V)
	Focal Length 5.0mm	49°(H)×38°(V)
	Focal Length 4.6mm	53°(H)×41°(V)

重量

配饰

FPV AI DB-Vision ATR x1
Flight Controller Connection Cable x 2
Hex Socket Cylindrical Head Screw M2*6 x 4

常问问题

Q: Can I get digital video output through the USB-C port?
一个: 没有. The USB-C port on this device is mainly used for debugging and maintenance purposes.

Q: How can I access the video stream from the device?
一个: The video stream is provided through the network via RTSP. You can access the digital video by connecting the device to the network and viewing the RTSP stream using compatible software (such as VLC or other RTSP-supported players).

Q: What is the RTSP address to view the video stream?
一个: The RTSP stream can be accessed using the following address:
rtsp://192.168.3.100/live.sdp

Q: Do I need to set my computer’s IP address to 192.168.3.xxx?
一个: 是. Your computer and the video source must be on the 同一网段. Please set your computer’s IP address to 192.168.3.xxx (例如, 192.168.3.101). This ensures that your computer and the video source are on the same subnet and can communicate properly.

Q: How can I switch to the thermal camera?
一个: You need to use the PC control software IRUserTool.exe.

1. 打开 IRUserTool.exe 在你的电脑上.
2. 前往 Output Settings.
3. 选择 Video Source 作为 热像仪 要么 Visible Camera depending on your needs.
4. Choose the desired pseudo-color (palette) for the thermal image.

After selecting the thermal camera, the video stream will output the thermal image.

Q: Is the camera interface LVDS? Can I connect another LVDS camera to the same board?
一个: 没有. The camera interface is 米皮, not LVDS. 现在, the board does not support connecting an additional LVDS camera. The board is designed to work with the built-in MIPI camera interface, and it does not provide support for external LVDS camera connections.

Q: I can ping the device, but there is no video output. 我应该怎么办?
一个: You need to update the device software using the PC update tool:

1. 跑步 Update_tool_en_V1.2.exe 在你的电脑上.
2. Upgrade the device twice with the software package:
   CCI6911-V3.1-SOC-APP-V1.0.0.28.

After completing these updates, the video output should work correctly.

Q: The throttle and pitch are swapped. How can we fix this?
一个: This issue is usually related to incorrect channel mapping on the remote controller. The throttle and pitch channels may be assigned the same or conflicting channel settings as the AI module, which results in control interference or incorrect input behavior.

To resolve this, you need to reconfigure the remote controller channel settings (channel encoding). Please swap or remap the corresponding channels on the transmitter so that each function matches the correct channel assignment used by the AI module. After adjusting the channel mapping, the throttle and pitch controls should function normally.

Q: Do I need the file AiGuidanceData5inches.bin to install it on the flight controller?
一个: 是. The file AiGuidanceData5inches.bin is required for the installation. You need to use the PC configuration tool irusertool.exe to upload and install this file to the flight controller. The installation is completed through this upper-computer software by connecting the flight controller to your computer.

1. What is the Dual Cam Module?
The Dual Cam Module is a compact visible-thermal fusion camera designed for drones, supporting visible light, infrared, and dual-spectrum imaging in one unit.

2. How does dual-light fusion imaging work?
Dual-light fusion imaging combines visible light video 和 thermal infrared imaging to provide clearer situational awareness in various environments.

3. What are the key advantages of dual-spectrum fusion?
Dual-spectrum fusion improves 目标识别, depth perception, and visibility in low-light or foggy conditions.

4. How compact is the camera module?
The camera features a 23 × 36 mm dual-spectrum module 和一个 36 × 36 mm image processing module, with total weight under 50G.

5. Can the module be installed quickly on drones?
是, the module is 即插即用 and can be installed on a drone in less than 5 分钟.

6. Is the system compatible with open-source flight controllers?
The camera supports popular flight controllers like 贝塔飞行, Ardupilot, and other open-source platforms.

7. What is the maximum detection range?
The system can detect and recognize pedestrians and vehicles up to 200 米.

8. How many targets can be recognized simultaneously?
The AI engine can recognize and track 超过 30 targets in real time within the field of view.

9. Does the system support AI-powered recognition?
是, it integrates deep learning algorithms 和 AI chips 为了 automatic target recognition and tracking.

10. What is the latency of the video output?
The module delivers 超低延迟 (<60 多发性硬化症) analog output, ensuring real-time decision-making.

11. Does the system support electronic zoom?
是, the Dual Cam Module includes electronic zoom functionality for flexible viewing.

12. What algorithms are used for image enhancement?
The AI processing module integrates 3D 降噪, wide dynamic range (宽动态范围), 和 non-uniformity correction (NUC).

13. How does electronic image stabilization work?
它使用 multi-axis correction 和 sub-pixel motion compensation by combining 惯性测量单元 和 传感器数据.

14. Does the system reduce drone vibration effects?
是, electronic 3D de-shake technology suppresses high-frequency vibrations for smooth imaging.

15. Can the module operate in all weather conditions?
是, 这 AI all-weather detection system ensures reliable operation in fog, 雨, and low-light conditions.

16. What type of sensor is used for thermal imaging?
它具有一个 high-sensitivity vanadium oxide uncooled detector.

17. What is the thermal resolution of the camera?
该模块支持 384 × 288 thermal resolution, enhanced to 720 × 576 和 AI Super-Resolution.

18. Is this module suitable for FPV racing drones?
是, its ultra-lightweight (<50G) 和 low-latency output make it ideal for FPV竞速无人机.

19. Can it be used on drone gimbals?
是, the module is compatible with small drone gimbals for stabilized imaging.

20. Does the system support autonomous navigation?
是, AI-powered target tracking 支持 autonomous navigation and mission execution.

21. How does this module reduce pilot workload?
By automating target recognition and tracking, the system minimizes manual monitoring.

22. What is the power consumption of the module?
The system is energy efficient, consuming less than 0.8W¯¯.

23. Does the module support analog video output?
是, the camera supports low-latency analog output for FPV systems.

24. Can the module detect targets at night?
是, 这 thermal infrared imaging works in complete darkness.

25. Is this camera suitable for hunting applications?
是, 它非常适合 outdoor hunting, 奉献 thermal and visible dual imaging.

26. Can it be used in vehicle assistance and autonomous driving?
是, 系统支持 pedestrian and vehicle detection, 使其适合于 ADAS applications.

27. Is the module resistant to vibrations during drone flight?
是, it features electronic image stabilization 和 vibration suppression.

28. Can the system recognize multiple moving targets?
是, the AI processor can track 多于 30 moving targets simultaneously.

29. What is the main benefit of thermal imaging for drones?
Thermal imaging allows drones to see heat signatures, 使能 night operations and hidden target detection.

30. How does AI Super-Resolution improve image quality?
AI Super-Resolution upscales thermal images from 384×288 to 720×576, improving clarity and detail.

31. Is the module lightweight enough for small drones?
是, weighing less than 50G, 它适合 mini and micro drones.

32. Can the module support precision missions?
是, 这 AI recognition and tracking system is optimized for precision mission execution.

33. What kind of stabilization does it support?
它支持 multi-axis stabilization, reducing blur caused by horizontal, 垂直的, and rotational movements.

34. Does the module require additional cooling?
没有, it is based on an uncooled thermal detector, ensuring low power and simple integration.

35. What applications benefit most from this module?
Key applications include 无人机, 第一人称视角赛车, hunting, vehicle assistance, 和监视.

36. Can it operate in foggy conditions?
是, 这 dual-light fusion imaging enhances visibility in fog and low-contrast environments.

37. How does it perform in daylight?
In daylight, visible imaging provides detailed clarity, 尽管 fusion mode combines with thermal data for reliability.

38. Is the system modular?
是, 它有一个 模块化设计 with separate dual-spectrum imaging 和 image processing modules.

39. How quickly can the system start working?
它支持 rapid deployment, operational within minutes of installation.

40. Can it be integrated with AI-based drone software?
是, it is compatible with AI navigation and computer vision platforms.

41. Is the module suitable for security surveillance?
是, it is well-suited for surveillance drones and perimeter monitoring.

42. Can the module be used for SAR (搜救)?
是, 这 thermal detection up to 200m helps in 寻找失踪人员.

43. Does the system support real-time decision-making?
是, 由于 <60毫秒延迟, 它提供 real-time situational awareness.

44. What kind of output does the image processing module provide?
The module outputs fused visible-thermal video with stabilization and AI enhancement.

45. How does wide dynamic range help?
WDR algorithms improve clarity in scenes with high contrast lighting.

46. Can it be used in agriculture drones?
是, thermal and visible fusion assists in crop monitoring and livestock tracking.

47. Does it support autonomous drone navigation?
是, it enhances autonomous drone navigation 和 target recognition and tracking.

48. What industries can benefit from this module?
Industries include 防御, 安全, hunting, 无人机, 监视, and autonomous driving.

49. Is the module suitable for hobbyist drone pilots?
是, its easy installation and lightweight design make it attractive for hobbyists and professionals alike.

50. Why choose this Visible-Thermal Fusion Camera Module?
Because it combines AI-powered imaging, dual-light fusion, low latency, 紧凑的设计, and all-weather performance, making it one of the most versatile modules for drones.

51. Is it compatible with Ardupilot?
这 sample is designed just for Betaflight flight control; Ardupilot is not supported. Ardupilot is harder to debug, has slower response times, and doesn’t perform as well as Betaflight. 因此, the AI board sample hasn’t been used with Ardupilot so far. Adapting probably will not be immediate.

51. Is it compatible with Ardupilot?
是, it has USB Type-C Video Signal Output to Raspberry Pi. To switch the video output, you can use UART commands to switch the output. It can be picture-in-picture, fusion, single visible light, single thermal imaging camera video. Our AI board can provide the target’s location information to the Raspberry Pi board. Our AI board can output the miss distance information of people and vehicles in visible light and thermal imaging modes to the Raspberry Pi board.

From the above video, Physical display of dual-fusion camera module
1. Fusion mode: visible light and thermal imaging fusion (picture in picture)
2. Visible light mode
3. Thermal imaging mode
4. Al target recognition
Dual light fusion mode, visible light mode, thermal imaging mode, and AI recognition mode can be switched!

Q52: If we connect your camera module to a SpeedyBee F405 flight controller running Betaflight, does the camera module communicate with the flight controller via UART using the MSP protocol? Can we use your camera module to control the SpeedyBee F405 flight controller?

QA: 是. Our camera module supports communication with the SpeedyBee F405 flight controller through a UART interface using the MSP protocol. Once connected correctly, the camera module can control the Betaflight-based SpeedyBee F405 without any issues.