Video Capture MIPI

Import live video frames from MIPI card on Zynq-based system

Since R2022b

• 

Libraries:
Vision HDL Toolbox Support Package for Xilinx Zynq-Based Hardware

Description

The Video Capture MIPI block imports video frames from an IMX274 FMC MIPI^® card connected to a Zynq^®-based board into your Simulink^® model. The support package programs the FPGA with an image that demosaics and gamma-corrects the video input from the sensor, and allows capture of the video from Simulink. You can control the frame size and Simulink video signal format options from the Video Capture MIPI block.

The FPGA image also contains an IP core called the FPGA user logic that you can generate from your design by using HDL Workflow Advisor. The block captures the input video after the FPGA user logic.

The video data is in AXI4-Stream Video format on the FPGA. When you capture the video to Simulink, the stream is converted to frame-based video.

The reference design requires the same video resolution and color format for the entire data path. The design you target to the FPGA user logic must not modify the frame size or format of the data.

Examples

Getting Started with MIPI Sensor

Get started with MIPI® video capture and processing by using Vision HDL Toolbox™ Support Package for Xilinx® Zynq®-Based Hardware.

Open Example

Corner Detection with Zynq-Based Hardware and MIPI Sensor

Target corner detection algorithm to the Zynq® hardware with MIPI® interface using the Vision HDL Toolbox™ Support Package for Xilinx® Zynq-Based Hardware.

Open Script

Ports

Output

R, G, B — Color components of input video frame

matrix

The block returns one matrix for each color component of the input video. The dimensions of each matrix match the frame size.

Dependencies

To enable these ports, set Pixel format to RGB and Image signal to Separate color signals.

Data Types: single | double | int8 | int16 | int32 | int64 | uint8 | uint16 | uint32 | uint64 | Boolean | fixed point

Image — Color input video frame

matrix

The block returns a 3-by-height-by-width matrix, where height and width match the frame size.

Dependencies

To enable this port, set Pixel format to RGB and Image signal to One multidimensional signal.

Data Types: single | double | int8 | int16 | int32 | int64 | uint8 | uint16 | uint32 | uint64 | Boolean | fixed point

Parameters

Video source — Source of video stream

IMX274 sensor

The video stream originates from the IMX274 camera board. Set the Frame size parameter to match the resolution of your attached camera.

Frame size — Resolution of input video

1280x720p (default) | 1920x1080p

Select 720p HDTV format (1280x720p) or 1080p HDTV format (1920x1080p).

Frame rate — Rate at which consecutive images are displayed (frames per second)

120 fps (default) | 60 fps

The block sets the Simulink sample time for the captured video frames to 1/Frame rate.

Frame size 1920x1080p supports only 60 fps.

Pixel format — Format of pixel stream

RGB

The RGB pixel stream format returns three 8-bit color components per pixel, which is 24 bits per pixel total. You can also select whether the block returns a multidimensional signal or three separate color signals. For details, see the Image signal parameter.

Image signal — RGB output stream format

Separate color signals (default) | One multidimensional signal

Specify the RGB output stream format as one of these values.

• Separate color signals — The block returns separate height-by-width matrices for each color component. In this case, the block has R, G, and B output ports.

• One multidimensional signal — The block returns a single 3-by-height-by-width matrix. In this case, the block has an Image output port.

Version History

Introduced in R2022b