Platform Engineer
We are seeking a Platform Engineer with deep expertise in Databricks administration, data governance, and platform‑level engineering standards. This role enables multiple analytics and AI teams to build safely, efficiently, and consistently on a shared Databricks platform by enforcing data quality, ingestion standards, security policies, and cost governance.
You will be the technical owner of platform guardrails, operational stability, access patterns, and cost controls—ensuring the platform scales reliably across business teams. Key Responsibilities
Platform Administration & Governance
- Administer Databricks workspaces, clusters, jobs, Unity Catalog, compute policies, environment configuration, and platform guardrails.
- Implement and maintain RBAC and ABAC access controls for secure, compliant data access.
- Define and enforce data ingestion standards, naming conventions, schema rules, Delta Lake design patterns, and data quality expectations.
- Set platform‑wide standards for ingestion pipelines, Delta architecture, lineage, versioning, and validation.
- Review and approve onboarded pipelines for compliance with platform requirements.
- Partner with data engineering teams to uplift patterns and enforce consistency.
- Manage workspace and catalog permissions, row/column‑level policies, attribute‑based filtering, and workspace isolation.
- Collaborate with security teams to maintain compliance and enforce global data protection standards.
- Implement cost thresholds, alerts, compute policies, and usage dashboards to prevent overspend.
- Monitor job and cluster costs, detect anomalies, and recommend optimization actions.
- Provide visibility into SKU‑level spend and workspace cost patterns.
- Ensure platform reliability through automated testing, CI/CD templates, and code governance.
- Build dashboards to track code compliance, data access, pipeline health, schema drift, and cost thresholds.
- Resolve platform incidents and prevent recurrence by strengthening guardrails and configurations.
- Define “handrails” for building on the platform: ingestion, Delta conventions, CI/CD, observability, and AI/ML patterns.
- Coach data/analytics teams on compliant onboarding and optimal platform usage.
- Maintain internal documentation, patterns, code templates, and guidance.
- 5+ years in data engineering or platform engineering, with at least 2–3 years in Databricks administration.
- Expert knowledge of Unity Catalog, cluster policies, Delta Lake, Spark, workspace configuration, and jobs.
- Strong grounding in data governance, data modeling, ingestion frameworks, schema enforcement, versioning, and lineage.
- Proven experience implementing RBAC and ABAC in Databricks or similar platforms.
- Experience with cost optimization, monitoring, billing logs, and compute governance.
- Strong Python/PySpark and SQL skills; familiarity with DLT, Airflow, or Databricks Workflows.
- Strong communication skills with ability to set standards and influence teams diplomatically.
- Experience in large-scale enterprise data platforms (Azure/AWS/GCP).
- Familiarity with Trading & Supply or other high‑stakes analytical environments.
- Experience creating dashboards for governance, cost, compliance, and pipeline health.
- Experience with CI/CD, GitHub Actions, Azure DevOps, or similar tools.
- Teams consistently follow ingestion and data standards.
- Platform costs stabilized and predictable.
- Strong adoption of platform guardrails, templates, and operational dashboards.
- Reduced incidents related to access, cost, or ingestion quality.
Recommended Jobs
Nationwide Commercial HVAC Service Technician
Job Title : Nationwide HVAC Service Technician Job Location : San Antonio TX FLSA Status : Non-Exempt Ready to take your HVAC career nationwide? Join a powerhouse team building and serv…
Retail Customer Service Representative - Mon-Fri
Brite Star is seeking a Retail Customer Service Representative (CSR) to join our growing team with a Monday – Friday work schedule. Job Description: The Retail Customer Service Representative (C…
Heavy Equipment Operator
Minimum 5yr experience operating Heavy equipment Class A CDL preferred Experienced in finish blade, front loader, and backhoe operations performing low and high risk excavations. Capable of p…
News Producer
OVERVIEW OF THE COMPANY Fox TV Stations FOX Television Stations owns and operates 29 full power broadcast television stations in the U.S. These include stations located in 14 of the top 15 larg…
Portfolio Leasing Manager
ABOUT GREYSTAR Greystar is a leading, fully integrated global real estate platform offering expertise in property management, investment management, development, and construction services in ins…
Mover / Professional Mover
Mover / Professional Mover Compensation: Competitive hourly pay rate, tips, and bonus! College Hunks Hauling Junk and Moving is looking to hire Movers! Get paid to stay fit, build your resum…
Registered Nurse (RN) Float Pool
Registered Nurse (RN) – Float Pool – PRN, Days Bring your passion to Texas Health so we are Better + Together Work location: Texas Health Southwest – 6100 Harris Parkway, Fort Worth, TX 76132 …
Shift Lead
Job Description Job Description Benefits: ~401(k) ~ Dental insurance ~ Employee discounts ~ Flexible schedule ~ Free food & snacks ~ Health insurance ~ Paid time off ~ Training & d…
Test & Commissioning Technician (DFW)
At Alstom, we understand transport networks and what moves people. From high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling and digital mobility,…
Certified Nursing Assistant (CNA) - Sign on Bonus
Lutheran Sunset Ministries in Clifton, TX is looking for caring, compassionate and dependable CNA's for our nursing home. Sign on bonus for full-time positions. Shift: Full-time, 8 hour shifts…