Stream Processing: Summarize Data Through Aggregation

This video provides an overview of how to leverage the FME platform to reduce a streams data volume via aggregation. The primary goal is to reduce data volumes in memory before committing data to disk.

In this example, windowing is used to group the incoming sensor data based upon time. For each window, duplicates are then removed. This reduces the data volume considerably.