Why we need Data Platform Data Platform is foundation block in All Data driven organisation. As name indicate it is a place to facilitate all data activity involving various users like Data Engineer, Data Analyst, Data Scientist. Data Platform can be implemented using on-premis , Cloud or Hybrid infrastructure. AWS, Azure and GCP is major…

in Part-1 article we have set up the local env to develop and connect dbt models with databricks platform in this article we will jump into action and transform our data pipeline .

Introduction : Lakehouse is a data management system that merges the advantages of both data lakes and data warehouses. It facilitates the processing of both structured and unstructured data on a single platform, allowing faster analysis and insights. Data is first ingested into a data lake, where it’s stored in…

Every organisation using Data Product to get business insights and decision making. Data Product can only successful if it helps to provide Right data to Right Decision maker at Right Time. Providing relevant data on desired time is quite challenging. Data recency of any Data Product relies on its Data…

Aa a Developer I will define a Technical debt when a Team prioritise a deliverable with compromising code quality over fast delivery and eventually it needs to refactor to evolve or support new functionality. As an Architect I will define a Technical debt, A design or implementation constructs that are…