Lead Data Engineer

Role Overview

We are looking for a skilled Data Engineer with strong expertise in cloud-based data platforms, data engineering frameworks, and modern programming languages. The ideal candidate will have hands-on experience with Azure, Databricks, and large-scale data processing using Python and PySpark. This role requires strong collaboration with stakeholders and the ability to manage programs and deliver scalable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL .


• Build and optimize data workflows on Azure Cloud using Databricks .


• Develop and implement efficient data models to support analytics and reporting requirements.


• Write optimized SQL queries for data transformation, integration, and analysis.


• Collaborate with cross-functional teams to gather data requirements and translate them into technical solutions.


• Work closely with stakeholders to ensure data solutions align with business objectives.


• Develop and maintain components using TypeScript where required for data platform integrations.


• Ensure data quality, reliability, and performance across the data ecosystem.


• Lead or support program management activities , including planning, execution, and delivery of data initiatives.

Required Skills

• Strong programming skills in Python, PySpark, and SQL .


• Hands-on experience with Azure Cloud Platform .


• Experience working with Azure Databricks for large-scale data processing.


• Solid understanding of data modeling concepts and data architecture.


• Proficiency in SQL programming and query optimization.


• Experience with TypeScript development.


• Strong stakeholder management and communication skills.


• Experience in program management or managing complex data initiatives.

Preferred Qualifications

• Experience working with large-scale data platforms and modern data architectures.


• Familiarity with data warehousing and analytics solutions.


• Ability to work in a fast-paced, collaborative environment.