Posted:3 days ago|
Platform:
On-site
ROLES & RESPONSIBILITIES
Job Description:
Define end-to-end architecture for SAS to PySpark migration.
Proven experience in data migration projects, specifically migrating from SAS to PySpark
Lead the architectural design for migration project, leveraging Azure services, SQL, Databricks, and PySpark to create scalable, efficient, and reliable solutions.
Utilize Databricks to design and implement advanced data transformation and processing tasks using Databricks, PySpark and ADF
Strong understanding of data integration, ETL, and data warehousing concepts
Design, deploy, and manage Databricks clusters for data processing, ensuring performance and cost efficiency, and troubleshoot cluster performance issues as needed.
Mentor and guide developers on the use of PySpark for data transformation and analysis, sharing best practices and reusable code patterns.
Document architectural designs, migration plans, and best practices to ensure alignment and reusability within the team and across the organization.
Collaborate with stakeholders to translate business requirements into technical specifications and design robust data pipelines, storage solutions, and transformation workflows.
Support UAT and production deployment planning.
Strong communication and collaboration skills
EXPERIENCE
SKILLS
Infogain
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Mumbai, Maharashtra
Salary: Not disclosed
Mumbai, Maharashtra
Salary: Not disclosed
