Posted:12 hours ago|
Platform:
Work from Office
Full Time
Business Area:
Engineering
Seniority Level:
Mid-Senior level
Job Description:
At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, were the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world s largest enterprises.
We are seeking an experienced Staff Software Engineer to join our Replication Manager team at Cloudera. In this role, you will be responsible for designing, developing, and maintaining enterprise-grade data replication solutions that enable seamless data movement across hybrid and multi-cloud environments. Youll work on critical infrastructure that helps Fortune 500 companies manage their data lifecycle and migration strategies.
As a Staff Software Engineer you will:
Design and implement scalable data replication services for HDFS, Hive, HBase, Apache Iceberg, and other big data technologies.
Develop robust APIs and microservices for the Replication Manager platform.
Lead complex technical initiatives involving data migration between on-premises clusters and cloud environments (AWS S3, Azure ADLS Gen2).
Architect fault-tolerant, distributed systems for high-volume, petabyte-scale data operations with minimal downtime and data consistency guarantees.
Optimize replication performance and implement advanced features like bandwidth throttling, scheduling, and policy management.
Mentor junior engineers and provide technical guidance on best practices.
Implement monitoring, alerting, and observability features for replication jobs.
Ensure security and governance policies are maintained using tools like Apache Atlas.
Partner with Cloudera Data Platform (CDP) teams and collaborate with field engineering to address customer requirements and escalations.
Participate in code reviews and contribute to technical documentation.
We re excited about you if you have:
8+ years of software engineering experience with distributed systems.
Strong proficiency in Java, Scala, or Python for backend development.
Deep understanding of Apache Hadoop ecosystem (HDFS, Hive, HBase, YARN).
Experience with modern data formats including Apache Iceberg, Delta Lake, and Hive ACID tables.
Experience with cloud platforms (AWS, Azure, GCP) and their storage services.
Proven experience designing and implementing large-scale distributed systems, understanding CAP theorem and data consistency models.
Knowledge of API design, microservices architecture, security protocols, and data governance frameworks.
Strong background in SDLC, agile methodologies, CI/CD pipelines, and automated testing frameworks.
You may also have:
Experience with Apache Ranger/Atlas or Apache Iceberg replication specifics.
Knowledge of enterprise backup/DR or history in data migration/ETL.
Open-source contributions or experience in customer-facing support roles.
What you can expect from us:
Generous PTO Policy
Support work life balance with Unplugged Days
Flexible WFH Policy
Mental & Physical Wellness programs
Phone and Internet Reimbursement program
Access to Continued Career Development
Comprehensive Benefits and Competitive Packages
Paid Volunteer Time
Employee Resource Groups
EEO/VEVRAA
#LI-Hybrid
#LI-AB1
Cloudera
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
hyderabad
7.0 - 10.0 Lacs P.A.
bengaluru
30.0 - 35.0 Lacs P.A.
hyderābād
7.05 - 10.0 Lacs P.A.
bengaluru
1.8 - 9.0 Lacs P.A.
bengaluru
Experience: Not specified
7.0 - 10.0 Lacs P.A.
chennai
7.0 - 10.0 Lacs P.A.
bengaluru
12.0 - 16.0 Lacs P.A.
bengaluru
50.0 - 100.0 Lacs P.A.
bengaluru
50.0 - 65.0 Lacs P.A.
bengaluru
15.0 - 20.0 Lacs P.A.