Job
Description
Role Description Job Title: Senior Big Data Engineer Experience Range: 5 to 10 years Hiring Location: Pune Notice Period: 0-30 Days Job Description We are seeking a Big Data Engineer with 5+ years of experience to play a key role in building, managing, and optimizing our big data pipelines . This role involves working with cutting-edge technologies to enhance product capabilities while collaborating with cross-functional teams. Key Responsibilities Work closely with Technical Leaders to design and implement robust Big Data solutions. Participate in design discussions and brainstorming sessions to evaluate tools and frameworks for Big Data processing. Develop and maintain data processing pipelines using distributed frameworks like Apache Spark and Hadoop. Implement ETL processes and optimize data workflows using Apache Airflow, dbt, and related tools. Ensure data quality, security, and performance in large-scale data processing environments. Collaborate with multi-region software and support teams to ensure seamless data integration. Stay up to date with the latest advancements in Big Data technologies and contribute to continuous improvements. Must-Have Skills 4+ years of experience in Data Engineering. Strong understanding of Big Data ecosystems, including Spark and Hadoop. Proficiency in ETL processes and data pipeline orchestration using Apache Airflow, dbt, or similar tools. Strong programming skills in Python, Java, or Scala, along with SQL expertise. Experience with version control tools (Git) and build tools like Gradle, Maven, or SBT. Experience in cloud-based data platforms (AWS, GCP, or Azure). Strong understanding of object-oriented programming, data structures, algorithms, and performance optimization. Excellent problem-solving, communication, and collaboration skills. Good-to-Have Skills Experience with data warehouse platforms (Snowflake, Redshift, BigQuery). Familiarity with streaming data processing frameworks (Kafka, Flink). Knowledge of containerization and orchestration tools (Docker, Kubernetes). Exposure to DevOps practices and CI/CD pipelines. Qualifications Bachelor’s/Master’s degree in Computer Science, Information Technology, or a related field. 5-7 years of professional experience in Big Data Engineering. Skills java,Microservices,Python,Big Data Show more Show less
