Job Description

Job Title: SAP Hana Databricks Technical Lead

Location: Santa Clara, CA

Role Overview

We are seeking an experienced Tech Lead with strong expertise in SAP HANA and proven hands-on skills in Databricks, Delta Lake, and Azure Data Factory . This role will lead the migration initiative from SAP systems to a modern Databricks-based DPaaS 2.0 platform , ensuring seamless data integration, scalable pipelines, and optimized performance across enterprise-grade data workloads.

The ideal candidate will combine deep data engineering expertise with strong SAP HANA knowledge , playing a critical role in architecting, developing, and optimizing end-to-end data pipelines in a secure Azure environment.

Key Responsibilities

• Lead the migration of large-scale SAP HANA workloads to Databricks-based platforms on Azure.
• Design, develop, and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks (PySpark, Spark SQL), and Delta Lake .
• Implement robust data lineage, monitoring, and orchestration frameworks to ensure data quality and reliability.
• Drive performance optimization initiatives on Databricks workloads, ensuring scalability and cost efficiency.
• Architect and develop custom transformation logic using Python & PySpark for SAP and non-SAP data sources.
• Collaborate with enterprise stakeholders, SAP teams, and cloud architects to design secure, scalable, and compliant data solutions .
• Ensure adherence to data governance, validation, and reconciliation standards throughout the migration process.
• Provide technical leadership and mentorship to junior engineers in Azure data engineering best practices .

Mandatory Skills

• Databricks & Delta Lake: Hands-on experience in pipeline development, Spark SQL, PySpark, and Delta Lake implementation for scalable data pipelines.
• Azure Data Factory (ADF): Strong expertise in building, orchestrating, and managing ETL pipelines integrating Databricks, Blob Storage, and SAP sources.
• Performance Optimization: Proven experience in tuning Databricks workloads for efficiency, scalability, and cost-effectiveness.
• Python & PySpark: Proficiency in developing reusable data processing scripts, transformations, and integration logic.
• SAP HANA Expertise: Deep understanding of SAP HANA architecture, data modeling, and large-scale data extraction/transformation/migration .

Good-to-Have Skills

• ETL Tools SAP Data Services (BODS): Experience in creating, deploying, and optimizing SAP-specific ETL jobs, including handling complex mappings and CDC scenarios.
• Data Profiling & Validation: Strong skills in data reconciliation, quality checks, and validation during large-scale data migrations.
• Azure Cloud & Networking: Familiarity with Azure compute, storage, VNet, and networking configurations, including IAM, RBAC, VPN, and security controls .

Qualifications

• Bachelor s or Master s degree in Computer Science, Information Systems, or related field .
• 8 12+ years of progressive experience in data engineering and SAP environments .
• Demonstrated track record of leading end-to-end migration projects in enterprise settings.
• Excellent communication, leadership, and stakeholder management skills.

Job Tags

Similar Jobs