Principal Apache Hadoop Engineer - Remote Work

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Principal Apache Hadoop Engineer at BairesDev

We are seeking a Principal Apache Hadoop Engineer with deep expertise in big data ecosystem, HDFS architecture, MapReduce paradigm, and YARN resource management. The technology stack includes popular open source big data technologies - Apache Hadoop, and related ecosystem tools. Thus, there is ample scope for collaboration and contribution to open source. The ideal candidate will lead the design and optimization of large-scale distributed data processing systems, drive architectural decisions, and mentor engineering teams while delivering cutting-edge solutions for complex big data challenges.

What You'll Do:

- Contribute actively to Apache Hadoop and related open source projects as a core contributor, spending 20% of your time on upstream development.

- Design and optimize big data ecosystem architectures for large-scale data processing.

- Architect advanced HDFS components to ensure highly reliable distributed data storage.

- Lead MapReduce paradigm implementation for complex scalable data processing workflows.

- Drive YARN resource management optimization for maximum cluster efficiency and performance.

- Mentor engineering teams and provide technical leadership across projects.

What we are looking for:

- 10+ years of experience in software development.

- Strong expertise in big data ecosystem and distributed data processing systems.

- Deep understanding of advanced HDFS architecture and distributed file system concepts.

- Proficiency in MapReduce paradigm and complex parallel processing techniques.

- Proven experience with YARN resource management and large-scale cluster orchestration.

- Core contributions to Apache open source projects (Hadoop, HDFS, Spark, or similar).

- Advanced level of English.

How we make your work (and your life) easier:

- Excellent compensation in USD or your local currency if preferred.

- Paid parental leave, vacation, & national holidays.

- Innovative and multicultural work environment.

- Collaborate and learn from the global Top 1% of talent in each area.

- Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!

Apply now!