Achieving Real-Time Big Data Analytics, Extreme Performance and Scale on AWS 

Big Data is Growing Exponentially

A New Vantage 2018 executive survey of 60 Fortune 1000 companies entitled How Big Data and AI are Driving Business Innovation found that 97.2% are investing in big data and AI. This correlates with the key directions for big data in 2019 noted in Big Data Trends, namely:

• Use of the Internet of Things (IoT) to combine streaming analytics and machine learning
• Use of AI platforms to process big data
• Significant increase in the use of hybrid clouds, which combine an organization’s private cloud with the rental of a public cloud and enable the transfer of applications and data between the two for more flexibility, deployment options, and tools

 

As the quantity of big data grows exponentially, organizations are looking for cost-effective solutions to collect, store and process their data. That’s why the adoption of cloud-based environments is constantly on the rise. 

Cloud-based Environments are on the Rise

A 451 Research report identifies five fundamental ways organizations are using the cloud to maximize the value of big data: faster time to market, lower TCO, reduced management overhead, improved developer agility, and new revenue opportunities.

Cloud-based environments are appealing to organizations seeking to rent servers and a data center infrastructure instead of building, managing, and maintaining their own. The main reasons for moving to the cloud include:

• Increased application traffic resulting in difficultly to scale resources on-the-fly
• Demand for cost-effective solutions to meet growing storage needs
• Reduction of infrastructure overhead and operational costs while increasing the effectiveness of IT processes
• Geographical business expansion without the challenges of establishing a multi-region infrastructure
• Allowing remotely-located employees to access applications and work via the Internet
• Quicker and cost-effective solution for a disaster recovery system
• Automatic tracking and upgrading of underlying server software
• Shifting IT expenditure to a pay-as-you-go model

 

Amazon Web Services (AWS) delivers these advantages, keeping data safe, irrespective of size. And data security is not an issue, shown by the CIA’s 2014 $600 million deal with AWS for a computing cloud and the key U.S. government authorization given in 2016 to three vendors – including AWS and Microsoft – to put highly-sensitive data on their cloud-computing services. 

 

As enterprises worldwide accelerate their adoption of the cloud to introduce new services and applications, they are also constantly seeking solutions that will provide extreme performance, speed and scale on their big data. And that explains the availability of GigaSpaces’ InsightEdge, the fastest big data analytics processing platform, in the AWS Marketplace.

InsightEdge is Now Available on AWS Marketplace

InsightEdge is an In-Memory Computing platform that addresses the speed challenges faced by organizations in their big data stacks, particularly around latency, ingestion rate and scale. 

The software platform provides a powerful, scalable software platform which co-locates business logic, analytics and data processing in the same memory space, resulting in extreme performance. Furthermore, it runs analytics and machine learning models simultaneously on streaming, transactional and historical data, improving the speed and quality of insights from big data.  

 

Support for Real-time Decision Making with the AWS Ecosystem

InsightEdge supports AWS services like Amazon EKS (Kubernetes) which makes it easy to deploy, manage and scale containerized applications using Kubernetes on AWS. The InsightEdge platform ingests, processes and analyzes streaming data from Amazon Kinesis and simultaneously accesses historical data stored on widely-used databases, data lakes and data warehouses – including Amazon DynamoDB, Amazon RDS and Amazon S3 – enabling real-time decision-making based on live and historical data in sub-second latency.

Additionally, the InsightEdge AnalyticsXtreme module is designed to automatically and intelligently move data from the InsightEdge speed layer to Amazon S3 and Amazon EMR big data platform. This advanced mechanism for intelligent tiering ensures that data is efficiently stored in the right storage layer according to performance, while optimizing infrastructure costs across the entire solution and data lifecycle. Access to data lakes can be accelerated by up to 100X faster, reducing the time to run batch analytics by orders of magnitude.

The solution also provides a single logical view of data that spans across real-time and data lakes, including SQL, Spark dataset/DataFrame, and BI tools such as Tableau and Looker.
Multiple Amazon EC2 instance types are supported to address different workloads, whether they are CPU or memory intensive.

Click here to read AnalyticsXtreme Solution Paper>>

Worldwide Service Based on Data Capacity

Customers conveniently pay for the service, which is available across AWS regions in North America, Asia Pacific and Europe and based on data capacity, through AWS. 
 A 14-day free software trial is also available. 

InsightEdge can uniquely replicate data at sub-second latency to these multiple AWS regions for mission-critical applications that are spanned across multi-geographical sites. Data is replicated according to predefined filters that determine the desired data changes, custom aggregations and compression, thereby also reducing network costs. 

 

Simple Process to Set-up InsightEdge on AWS Marketplace

First time setting-up of InsightEdge on AWS is a simple, quick and straightforward process. Access the AWS Marketplace and search for InsightEdge. The following screen will be displayed.

Click on the InsightEdge Platform title. The following screen is displayed in order to subscribe.

Follow these next steps:

Zeppelin should be launched with the appropriate IP address. Click the View Launch Configuration Details link in the Congratulations box to see:

Select the Instance ID with the Instance State defined as running and copy IPV4 Public IP address and paste it in a browser. You will see the Welcome to Zeppelin screen:

Select InsightEdge Basics and you’re ready to start working with InsightEdge on AWS.
For more information on setting-up InsightEdge on AWS, see our documentation.

Summary

Enterprises require extreme performance, speed, and scale as they accelerate their adoption of the cloud to introduce new services and applications. As the volume, velocity, and variety of data increase exponentially, InsightEdge offers a big data speed layer that provides both the necessary performance and the ability to elastically scale for improved business effectiveness. 

The availability of InsightEdge on AWS Marketplace and the leveraging of AWS services increases the accessibility of GigaSpaces’ big data analytics processing platform, seamlessly integrating with the AWS Big Data ecosystem, supporting the delivery of data-driven initiatives and time-sensitive applications. 

For more information about GigaSpaces, contact us for a demo