Posted:19 hours ago|
Platform:
Work from Office
Full Time
We are seeking an technical leader for a hybrid Senior Programmer and Data engineer & Solutions Architect role. This position is for a hands-on expert who not only possesses mastery in Apache Spark development but also has a proven track record of architecting complex, end-to-end data solutions on AWS and on-premise.
You will be the technical leader for new data initiatives, responsible for designing the architectural blueprints for our data lake platforms and then leading the hands-on implementation of those designs. We need a strategic thinker who can solve our most complex technical challenges and proactively drive things to add values to the domain..
Requirements:Core Technical Qualifications
Experience: 8-10+ years in programming & data engineering, with a clear progression into technical leadership and architectural roles.
Architecture: Demonstrable, hands-on experience designing and implementing large-scale data lake solutions from the ground up.AWS Expertise: Mastery of the AWS data ecosystem (S3, Glue, EMR, Redshift, Kinesis, Lambda, Athena).Spark Mastery: Expert-level development and performance-tuning skills in Apache Spark.Programming: Mandatory, deep proficiency in Scala or Python. Language Flexibility: Non-negotiable willingness and proven ability to code in python / scala as required by project needs.
Preferred Qualifications (Added Advantage)
AI/ML Architecture: Experience designing data systems to support AI/ML and MLOps workflows (e.g., feature stores, model training pipelines).
Gen AI Implementation: Proven experience integrating Generative AI models or building the supporting data infrastructure.
Key Responsibilities
Technical & Development (The "Senior Engineer")
Expert Development: Act as the most senior developer on the team, writing clean, optimized, and complex code for data processing using Apache Spark (Scala/PySpark).
Performance Tuning: Lead efforts in optimizing and performance-tuning Spark applications, data structures, and cloud infrastructure at scale.Problem Solving: Take ownership of the most difficult technical challenges and see them through to resolution.Solution Design: Architect and own the end-to-end design of our data lake and data platform solutions, ensuring they are scalable, reliable, and cost-effective.Platform Optimization: Design and implement data models, ETL/ELT processes, and data pipelines, ensuring they are optimized for performance, scalability, and cost.Innovation & Evaluation: Act as the lead technical consultant; evaluate new technologies (especially in AI/ML) and architect solutions that bring measurable value to the product.Mentorship: Mentor other engineers, conduct in-depth code reviews, and set the standard for technical excellence.
Globallogic
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
pune
27.5 - 42.5 Lacs P.A.
bengaluru
6.0 - 10.0 Lacs P.A.
bengaluru
6.0 - 10.0 Lacs P.A.
2.0 - 7.0 Lacs P.A.
chennai
0.5 - 0.5 Lacs P.A.
bengaluru
18.0 - 27.5 Lacs P.A.
noida, delhi / ncr
15.0 - 25.0 Lacs P.A.
hyderabad
6.0 - 10.0 Lacs P.A.
chennai
25.0 - 40.0 Lacs P.A.
bengaluru
12.0 - 20.0 Lacs P.A.
