Realtime Data Processing

--

Version 1.0
Created date 02-05-2021

Automated Data Replication and Reconstruction

How can large amounts of data be stored in a fault tolerant manner such that the data remains available in the face of hardware failures?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Automated Data Replication and Reconstruction

Automated Dataset Execution

How can the execution of a number of data processing activities starting from data ingress to egress be automated?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Automated Dataset Execution

Complex Logic Decomposition

How can complex processing tasks be carried out in a manageable fashion when using contemporary processing techniques?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Complex Logic Decomposition

Data Size Reduction

How can the size of the data be reduced to enable more cost effective storage and increased data movement mobility when faced with very large amounts of data?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Data Size Reduction

File-based Sink

How can processed data be ported from a Big Data platform to systems that use proprietary, non-relational storage technologies?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of File-based Sink

High Velocity Realtime Processing

Storing large amounts of data, arriving at fast pace, as a dataset and processing it in a batch manner incurs processing latency, causing a delay before analysis results become available.

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of High Velocity Realtime Processing

Random Access Storage*

The Random Access Storage compound pattern represents a part of a Big Data platform capable storing high-volume and high-variety data and making it available for random access.

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Random Access Storage*

Realtime Access Storage

How can large amounts of data be accessed instantaneously without any delay?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Realtime Access Storage

Realtime Data Processing*

--

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Realtime Data Processing*

Relational Sink

How can large amounts of processed data be ported from a Big Data platform directly to a relational database?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Relational Sink

Streaming Access Storage*

--

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Streaming Access Storage*

Streaming Egress

How can processed data be exported in realtime from a Big Data platform to other systems?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Streaming Egress

Streaming Source

How can high velocity data be imported reliably into a Big Data platform in realtime?

Author Bert Dingemans
Alias --
Stereotypes ApplicationFunction
Details of Streaming Source