Data
Integration

GigaSpaces provides advanced data integration tools with enterprise-grade capabilities that offer simpler integration and faster time-to-value, and scale on-demand to support increasing workloads.

The platform integrates data into the host layer to be consumed by the data services that are created and maintained over the platform. GigaSpaces provides out of the box capabilities for no-code definition, control and monitoring. These tools also support event-based integration and batch ingestion, and apply non-intrusive integration methods into the core systems, such as CDC.

The data integration tools reduce development overhead by automatically scanning the source schema and metadata, and map them to the GigaSpaces data model. These capabilities enable interoperability, easy migration, and reduce learning curves by enabling organizations to leverage existing assets such as existing code and developers’ expertise.

GigaSpaces’ data integration is built over a pluggable connectors framework which provides seamless integrations with third party and proprietary connectors and offers continuous enhancements of GigaSpaces’ built-in integration portfolio.

plane-icon

Change Data Capture (CDC): primarily for core data that
is frequently updated, such as user transactions

plane-icon

Full collections/table updates: smaller tables are executed as a full update

plane-icon

Streams: append data in real time, via a message queue or a bus such as Kafka

plane-icon

Batch updates: data is extracted from the source using
an ETL process; online updates are executed
in incremental batches

data integration diagram

GigaSpaces provides out-of-the-box capabilities for:

green-b

No-code construction of data pipelines

Built-in change management support for data pipeline definition, including adding a new table without stopping
the stream

globe

Declarative data type mapping, with built-in translators for common sources

globe

Built-in data and process monitoring

purple-g

Declarative definition of data validation policies

purple-g

Data freshness indicator, indicates the lag between updates in the System or Record and the visibility of the corresponding data in the Space

silver-g

Initial load for full or selective data

silver-g

Smart and fast recovery mechanisms that reduce potential application downtime to the minimum

green-b

Continues event-based data ingestion

InfoWant to learn more?

|

Download Our Data Integration Technical Paper