Big Data Engineer

Job Title:

Location:

Experience:

• Strong hands-on experience with:Apache Spark, Apache Hive, PySpark, Python,Hadoop ,Cloudera Ecosystem
• Good understanding of ETL processes and Big Data platforms
• Experience supporting cloud platforms:AWS,Google Cloud Platform (GCP)
• Familiarity with CI/CD pipelines and DevOps practices
• Strong analytical and debugging skills to investigate production issues
• Ability to deep dive into code and guide L1 support teams
• Bachelor’s or Master’s degree in Computer Science or related field
  

Good-to-Have (Not Mandatory)

• Awareness of Agile methodologies and experience with JIRA
• Understanding of batch processing systems and scheduling tools
• Experience with Unix/Linux systems
  

Job Responsibilities

• Act as a technical SME for ETL and Big Data processes, leading issue investigations and problem resolution
• Provide hands-on support for data pipelines developed using Spark, Hive, and PySpark
• Ensure smooth functioning of Big Data workflows on Cloudera or Hadoop clusters
• Work closely with DevOps and Cloud teams to support solutions on AWS/GCP environments
• Assist and guide L1 support teams in triaging and resolving incidents
• Collaborate with development, QA, and operations teams in an Agile environment
• Maintain and optimize data pipelines and jobs for performance and reliability
• Manage and contribute to CI/CD processes as part of the development lifecycle