CHALLENGE

 

Our client’s Data Reporting System is critical to address the IOT business needs, and every downtime has a big impact. A truly cloud analytics platform was also necessary to provide data to Data Scientists in order for them to be able to apply modern data techniques, like machine learning, and extract more value from the collected data to their clients. The existing legacy tools were not going to scale properly and became too expensive to be prepared to deal with the expected high volumes of data delivered from the business.

 

Given the actual on-prem evolution costs, together with the need for a maturing and long-term ease-of-maintenance integrated system, all available options – exclusive or multi-Cloud, or an hybrid on-Prem/ Cloud solution, would have to be considered and evaluated to decide for the best solution.

 

 

SOLUTION

 

After the analysis, the option selected was to move to AWS cloud while keeping it the most “cloud agnostic” possible. The main parts to be migrated were the operational, staging, reporting databases, data warehouses, data marts (to a datalake), the ETL processes and the data APIs. It was also implemented a new analytics platform, from scratch, to empower the serverless cloud computing.

 

Migration supported by AWS such as Kinesis, Glue, DynamoDB, Athena, SageMaker, QuickSight, Redshift and Elastic Search, is a part of the detailed Cloud Migration Strategy that also involved rewriting the application's architecture to better suit its new platform.

 

It was created a definitive Big Data & Analytics Reporting System fully over AWS, which works simultaneously with the on-prem actual platform until the transition is finished. Through the new Analytics platform, this system was complemented with critical services, long required by the Data Scientists, to enable the provision of the structured, semi-structured, and unstructured data in a single place for them to apply new techniques like machine learning.

 

This option also allowed to address, identify and overcome other specific challenges such as the existing technical concerns related with performance issues, latency, interoperability, dependencies of non-cloud apps, and downtime.

 

This solution’s financial interests were also taken care of by carefully balancing all the investments and costs related with the transitory co-existence of the actual on-prem infrastructure and the new AWS Cloud platform.

 

 

BENEFITS

 

Staff Productivity

High efficiency improvement since the needed data reports, that previously took days to produce and make available, are now done within minutes to a few hours. Data Scientists, Business Analysts and Data Engineers have now access to centralized data that responds more quickly to their needs.

 

Cost Savings (TCO)

With the AWS Cloud infrastructure, in particular the provided Serveless services, our client only pays what it uses.

 

Business Agility

Relying on the newly created Big Data Analytics’ Data Lake allows for faster deployment of new features together with a great reduction of errors.

The aggregation of multiple data streams, to be analyzed as a whole, enables Data Scientists to use data across different facets of the IoT business, and thus deliver improved reports with more specific and accurate insights that support new marketing and business strategies.

Also, our client can now deal with unexpected events as this platform is more agile and thus enables cutting costs, quicker moves, and faster decisions as it is easy to scale up and down according to demand.

 

Performance and Scale

Highly performant solution that addresses the IoT explosion of data collected with the ability to scale up and down depending on the seasonal needs.

Now the centralized Data Lake can scale up to petabytes of data, reports are faster than ever, and new models are trained faster according to the client's needs, as the size of the clusters can be adapted, and deployed in seconds. Data is natively redundant and available all over the world.

 

 

We help companies design a Cloud Migration Strategy and deliver the technology to implement and operate highly scalable cloud solutions.

 

Start you Journey towards the cloud today with us.

 

 

​

 

Our experience and mature internal knowledge assure you an easy and fast setup of your Data Analytics Platform Development and your Cloud Migration Strategy.

 

To learn more about our work running on AWS - Amazon Web Services click here.

 

To learn more about how we can support your business and take your ideas forward get in touch with us!