Senior Databricks Architect
Job Title: Senior Databricks Architect
Domain : Financial Services
Job Summary:
We are seeking an experienced Senior Databricks Architect to design and deliver scalable, high-performance data platforms for our Financial Services clients. The ideal candidate will have deep expertise in Databricks, cloud data architectures, and modern data engineering practices, with a strong focus on building governed, secure, and efficient data ecosystems.
Key Responsibilities:
- Architect and implement end-to-end data solutions using Databricks Lakehouse Platform
- Design and develop scalable data pipelines using PySpark, Spark, and SQL
- Lead cloud data platform implementations on AWS/Azure/GCP
- Drive modernization of legacy data systems to cloud-native architectures
- Implement Medallion Architecture (Bronze, Silver, Gold layers)
- Ensure data governance, security, and compliance (especially for Financial Services)
- Collaborate with business stakeholders, data scientists, and engineering teams
- Optimize performance, cost, and reliability of data pipelines
- Mentor and guide data engineering teams and provide architectural leadership.
Required Skills & Qualifications:
- 12+ years of experience in Data Engineering / Data Architecture
- Strong expertise in Databricks, PySpark, and Spark ecosystem
- Hands-on experience with cloud platforms (Azure, AWS, or GCP)
- Experience with data orchestration tools (Airflow, ADF, etc.)
- Solid understanding of data modeling, ETL/ELT, and distributed systems
- Experience with Delta Lake and Unity Catalog is a plus
- Strong knowledge of Financial Services domain (Banking, Insurance, Capital Markets)
- Excellent problem-solving and stakeholder management skills.
Preferred Qualifications:
- Databricks certifications
- Experience with real-time data processing (Kafka, streaming)
- Exposure to AI/ML pipelines and MLOps
- Knowledge of regulatory and compliance frameworks in Financial Services
Recommended Jobs
Customer Success Manager
About MealSuite MealSuite builds end-to-end foodservice technology for healthcare and senior living organizations. Our mission is to help care teams deliver better dining experiences with less eff…
Restaurant Shift Lead
Description Your path begins here at El Pollo Loco An opportunity to start your career as a leader. Supervise assigned shifts while developing skills to become a restaurant manager. Our Shift L…
Banking Center Manager
Join Texas First Bank! Enjoy a generous Sign-On Bonus and Retention Bonus as a thank-you for your commitment. Founded in 1973, Texas First Bank is a fast-growing community bank with 27 locations acr…
Staff Software Engineer - Genesys Technologies / (Hybrid /Onsite)
Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and govern…
Sales Manager
Sales Leader. Quality Storage Buildings. Itasca, TX | Full-Time. The Opportunity: Quality Storage Buildings is seeking a Sales Leader to guide and develop our sales team as we continue to g…
Technical Sales Representative - Permian
If you are a Technical Field Sales Professional looking for an opportunity to grow your career, this role offers the chance to strengthen customer partnerships, drive strategic opportunities, and de…
Collection Specialist
Job ID#: 31661 The Collection Specialist is responsible for contacting customers to collect on mid-stage delinquent loans. This role requires strong communication, negotiation skills, and the abil…
Oiler - Marine
Welcome to ConocoPhillips, where innovation and excellence create a platform for opportunity and growth. Come realize your full potential here. Who We Are We are one of the world's largest indep…
Patient Financial Representative Senior
Job Responsibilities: Performs billing, collections, and account follow-up to ensure accurate claim submission and timely reimbursement. Reconciles cash postings, resolves payment discrepancies…
COBOL Developer | Fort Worth, TX
The Software Developer is competent to work at most levels of technical complexity under broad direction on projects and/or programs. The Software Developer is accountable for designing, coding, test…