Industry: BFSI
Our client is one of India’s leading private life insurance companies, offering a wide range of innovative products. Their products are designed to meet the long-term life goals of customers, ranging from protection and wealth creation to retirement solutions and more. With 509 branches and over 1,17,700 agents, they are the life goals enablers for over 2.87 crore individuals and have over Rs. 89,446 crores of Assets Under Management.
Business Challenges
The client was using a traditional data warehouse as a central repository of information.
The existing infrastructure was designed for on-prem infrastructure hardware with fixed capacity, lacking flexibility, agility, and scalability to meet business needs.
The current data warehouse infrastructure is particularly sluggish when it comes to computing in situations like data exploration and high concurrency.
The increased cost of the third-party CDC tool that captures the data from sources through logs (push) rather than queries was again a problem.
Solutions
The data was uploaded to the data store/ source storage.
Data flowed from the source storage to the Staging Blob through HVR.
After reaching HVR, the data was replicated, and the change data capture method was also activated. Afterward, data lake storage was loaded into Azure.
Silver layer was created in the Azure Databricks for all 3 load types: Truncate/Insert, Change data capture, and One-time load.
Gold layer was created on top of the Sliver layer while implementing business logic.
An external table was created in Azure Synapse Analytics serverless pool to check ad-hoc Query Analysis.
Power BI dashboard was built on a Gold layer architecture for enhanced data visualization.
Technologies Used
Key KPIs
Single Source of Truth: A unified data platform aggregates data from multiple sources into a single repository to help make more informed decisions.
Data-Driven Insights: Synthesize unrelated data into actionable insights by unlocking the potential of the Power BI dashboard.
Ease of Setup: Fivetran/HVR & Azure handle the given data volume well and are easy to setup & configure.
High Performance: Given a given data volume, data types, and data structures, Databricks handles the data efficiently and robustly.
The collaborative effort between Celebal Technologies and the insurance firm to migrate their on-premises data warehouse to the cloud exemplifies the advantages of embracing modern technology in the insurance industry. By transitioning to a scalable, accessible, and cost-effective cloud environment, the firm positioned itself for future growth and operational excellence while enhancing data security and compliance.
