Job Description
Job Description
Lead Data Engineer – Databricks
Location: Bay Area, CA / Remote – Local or Nearby Candidates Only
Experience: 12+ Years
Domain: Healthcare – Mandatory
Work Authorization: USC / H4 EAD / GC EAD / L2S / H1B
Mandatory Skills:
- Databricks, Delta Lake, Apache Spark/PySpark, Python, SQL, Healthcar
Job Description:
We are looking for a Lead Data Engineer with Databricks expertise to design, develop, and optimize scalable data engineering solutions in the Healthcare domain
Required:
- 10–15+ years of Data Engineering experience.
- Active Databricks Certification required; Databricks Certified Data Engineer Professional preferred.
- Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL.
- Experience with Unity Catalog, Delta Live Tables (DLT), Databricks SQL, and Databricks Workflows.
- Strong knowledge of Medallion Architecture (Bronze/Silver/Gold) and data modeling.
- Experience with AWS, Azure, or GCP.
- Experience with Airflow or similar orchestration tools.
- Strong understanding of Git, CI/CD, and data pipeline development.
- Experience leading data engineering projects and mentoring teams.
- Healthcare industry experience is mandatory.