Main Content

Event Stream Processing

Read and write events, such as Kafka® events

When you install the Streaming Data Framework for MATLAB® Production Server™, you can:

  • Read and write event streams from an event streaming platform, such as Kafka.

  • Simulate the production environment for testing your streaming analytic algorithms. (Requires MATLAB Compiler SDK™)

  • Scale your streaming analytic algorithms by deploying them. (Requires MATLAB Production Server)

Install the Streaming Data Framework for MATLAB Production Server support package from the MATLAB Add-On Explorer. For information about installing add-ons, see Get and Manage Add-Ons (MATLAB).

Functions

expand all

kafkaStreamCreate connection to event stream in Kafka topic (Since R2022b)
inMemoryStreamCreate connection to event stream hosted by MATLAB without schema processing applied (Since R2022b)
testStreamCreate connection to event stream hosted by MATLAB with schema processing applied (Since R2022b)

Basic Import and Export

readtimetableRead timetable from event stream (Since R2022b)
writetimetableWrite timetable to event stream (Since R2022b)
seekSet read position in event stream (Since R2022b)
previewPreview subset of events from event stream (Since R2022b)
identifyingNameEvent stream name (Since R2022b)

Import and Export Options

detectImportOptionsCreate import options based on event stream content (Since R2022b)
eventStreamImportOptionsCreate options for importing events from stream into MATLAB (Since R2022b)
ImportOptionsImport options for event stream (Since R2022b)
getvartypeData types used to export variables to stream (Since R2022b)
setvartypeSet data types used to import and export variables to stream (Since R2022b)
detectExportOptionsCreate export options based on event stream content (Since R2022b)
ExportOptionsExport options for event stream (Since R2022b)
readeventsRead raw events from Kafka stream without schema processing applied (Since R2022b)
flushReset read window boundaries (Since R2022b)
stopStop processing event streams from Kafka topic (Since R2022b)
createTopicCreate topic in Kafka cluster (Since R2022b)
deleteTopicRemove topic from Kafka cluster (Since R2022b)
loggederrorError information for Kafka stream operation (Since R2022b)
categoryListKafka stream provider property list (Since R2022b)
getProviderPropertiesKafka stream configuration property data (Since R2022b)
setProviderPropertiesSet properties specific to Kafka configuration (Since R2022b)
isPropertyDetermine if Kafka stream provider property is set (Since R2022b)
eventStreamProcessorApply stream analytic function to event stream (Since R2022b)
executeExecute event stream processing function on specific number of event windows (Since R2022b)
packagePackage stream processing function into deployable archive configured by EventStreamProcessor (Since R2022b)
seekSet position in event stream to begin processing events (Since R2022b)
startStart processing event streams using local test server (Since R2022b)
startServerStart local test server (Since R2022b)
stopStop processing event streams using local test server (Since R2022b)
stopServerShut down local test server (Since R2022b)
streamingDataCompilerPackage stream processing function into deployable archive (Since R2022b)

Topics

Process Event Streams

Test and Deploy Streaming Analytic Function

Troubleshooting

Obtain Kafka Event Stream Log Files

Locate event stream log files to help with debugging issues.