AWS & Databricks Lead Engineer - Immediate Joiners

Kces

14 years

0 Lacs

Pune Maharashtra India

Posted:3 days ago| Platform:

Apply

Skills Required

aws databricks ai data engineering support governance model deployment drive integration compliance security management development enablement design collaboration evaluation strategies architecture ml devops pipeline monitoring marketing technology certifications azure collaborative

Work Mode

On-site

Job Type

Contractual

Job Description

ob Title: Senior AI & Data Engineering Lead – Databricks on AWS Location: Pune (Hybrid preferred) Experience: 14+ Years Notice Period: Immediate Joiners Preferred Budget: competitive Position Overview: We are looking for an experienced Senior AI & Data Engineering Lead to support a high-impact MarTech initiative, focusing on Databricks on AWS , data governance, and secure model deployment. The ideal candidate will drive integration with cloud platforms, AI governance, and ensure compliance with security and privacy frameworks including PCI and PII. Key Responsibilities: 1. Dependency & Security Management Coordinate with security teams to initiate and track approvals for tech package dependencies. Collaborate with Cloud Data Platform to onboard dependencies onto Databricks Development on AWS. 2. CI/CD Enablement for Databricks on AWS Establish Continuous Integration (CI) pipelines for Databricks deployment assets. Engage in the design and rollout of Continuous Deployment (CD) pipelines in collaboration with Cloud Platform teams. 3. Implementation of PCI/PII Guardrails Work with AI Governance to apply best practices for PCI and PII data protection on Databricks. Drive moderation and validation processes with peer reviews. 4. AI Model Evaluation & Serving Liaise with AI Governance and Security teams to identify, evaluate, and approve suitable AI models for SMB AI applications. Execute model evaluation frameworks and finalize model serving strategies. 5. Data Classification Compliance Collaborate with Data Privacy and AI Governance teams to document and obtain approvals for data classification efforts tied to SMB AI apps. 6. Architecture & SOAR Approvals Drive preparation and approval of SOAR (Solution Architecture) artifacts with stakeholders and architecture review boards. Required Skills & Experience: 14+ years of experience in data engineering, AI/ML pipelines, or DevOps for data platforms. Hands-on experience with Databricks on AWS including CI/CD pipeline management. Strong exposure to AI governance, data privacy, PCI/PII compliance , and secure data practices. Excellent collaboration skills to work with cross-functional teams (Cloud, Security, AI Governance, Data Privacy). Prior experience in model evaluation, deployment, and monitoring frameworks. Good to Have: Familiarity with SOAR processes and solution architecture approval workflows. Experience working with SMB applications or enterprise-level marketing technology (MarTech) systems. Certifications in cloud platforms (AWS, Azure), Databricks, or data governance frameworks. Why Join Us: Opportunity to work at the intersection of AI, governance, and cloud platforms. Collaborative environment with high visibility and impact. Immediate start with flexible budget based on profile strength. Show more Show less