Jobs
Interviews
Infogain logo

Data Technical Architect (Senior)

14 - 18 years

0 Lacs

maharashtra

Posted:1 week ago| Platform: Shine logo

Apply

Skills Required

data architecture etl databricks pyspark

Work Mode

On-site

Job Type

Full Time

Job Description

You will lead the architectural design for a migration project, utilizing Azure services, SQL, Databricks, and PySpark to develop scalable, efficient, and reliable solutions. Your responsibilities will include designing and implementing advanced data transformation and processing tasks using Databricks, PySpark, and ADF. A strong understanding of data integration, ETL, and data warehousing concepts is essential for this role. You will be tasked with designing, deploying, and managing Databricks clusters for data processing, ensuring both performance and cost efficiency. Troubleshooting cluster performance issues as needed will also be part of your responsibilities. Mentoring and guiding developers on the usage of PySpark for data transformation and analysis, sharing best practices and reusable code patterns will be crucial. It would be beneficial to have experience in end-to-end architecture for SAS to PySpark migration. Documenting architectural designs, migration plans, and best practices to ensure alignment and reusability within the team and across the organization is necessary. You should have experience in delivering end-to-end solutions and effectively managing project execution. Collaborating with stakeholders to translate business requirements into technical specifications and designing robust data pipelines, storage solutions, and transformation workflows will also be a key responsibility. Supporting UAT and production deployment planning and possessing strong communication and collaboration skills are essential for this role. You should have 14-16 years of experience with primary skills in Data Architecture and additional skills in ETL, Data Architecture, Databricks, and PySpark. About the Company: Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. They engineer business outcomes for Fortune 500 companies and digital natives in various industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. Infogain is a Microsoft Gold Partner and Azure Expert Managed Services Provider. The company has offices in multiple locations across the US and globally.,

More Jobs at Infogain

Aws Data Engineer

Pune, Delhi NCR, Bengaluru

4 - 6 yrs
|

INR 13 - 23 Lacs

SAP Developer (Senior)

Bengaluru

5 - 8 yrs
|

INR 6 - 11 Lacs

Dot NET Fullstack (React) Developer (Senior)

Bengaluru

6 - 8 yrs
|

INR 13 - 15 Lacs

Application Support Engineer (Senior)

Bengaluru

6 - 8 yrs
|

INR 8 - 10 Lacs

Dot NET Core Developer (Senior)

Bengaluru

6 - 8 yrs
|

INR 13 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Infogain logo
Infogain

IT Services and IT Consulting

Los Gatos CA

RecommendedJobs for You

Data Technical Architect (Senior)

Infogain

maharashtra

Data Technical Architect (Senior)

Infogain

maharashtra