Job
Description
You have an exciting opportunity to join a staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across various sectors. As an on-site Big Data Engineer in India, your role will involve designing, building, and optimizing data pipelines and platform components for critical data applications. **Role Overview:** As a Big Data Engineer, you will be responsible for: - Designing and implementing end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components. - Developing ETL jobs and data transformation logic in Python/SQL to ensure scalability and maintainability. - Integrating and processing real-time data streams using Kafka and related ingestion tools, ensuring low-latency delivery to downstream systems. - Authoring Hive queries and optimizing performance for large-scale datasets, and tuning Spark jobs to reduce cost and improve throughput. - Collaborating with data engineers, analysts, and stakeholders to translate business requirements into robust data models and pipelines. - Implementing monitoring, logging, and automated testing for data workflows, troubleshooting production issues, and performing root-cause analysis. **Key Responsibilities:** - Apache Spark - Hadoop HDFS - Apache Hive - Apache Kafka - SQL - Python - Preferred: Scala, Apache Airflow, AWS EMR **Qualifications Required:** - Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience). - Proven experience delivering on-site in enterprise Big Data environments, familiarity with production deployment practices, and CI/CD for data workflows. - Strong troubleshooting mindset with experience in performance tuning and data quality assurance. **Additional Details:** This firm offers an on-site delivery model with high-impact projects for large enterprise clients, providing opportunities to work end-to-end on data platforms. You will be part of a collaborative engineering culture with technical mentoring and exposure to modern data stack components. Additionally, competitive compensation and opportunities for certification/training in cloud and Big Data technologies are provided. This is a remarkable opportunity for a Big Data Engineer in India to contribute to impactful projects and enhance your skills in the dynamic field of Big Data engineering. You have an exciting opportunity to join a staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across various sectors. As an on-site Big Data Engineer in India, your role will involve designing, building, and optimizing data pipelines and platform components for critical data applications. **Role Overview:** As a Big Data Engineer, you will be responsible for: - Designing and implementing end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components. - Developing ETL jobs and data transformation logic in Python/SQL to ensure scalability and maintainability. - Integrating and processing real-time data streams using Kafka and related ingestion tools, ensuring low-latency delivery to downstream systems. - Authoring Hive queries and optimizing performance for large-scale datasets, and tuning Spark jobs to reduce cost and improve throughput. - Collaborating with data engineers, analysts, and stakeholders to translate business requirements into robust data models and pipelines. - Implementing monitoring, logging, and automated testing for data workflows, troubleshooting production issues, and performing root-cause analysis. **Key Responsibilities:** - Apache Spark - Hadoop HDFS - Apache Hive - Apache Kafka - SQL - Python - Preferred: Scala, Apache Airflow, AWS EMR **Qualifications Required:** - Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience). - Proven experience delivering on-site in enterprise Big Data environments, familiarity with production deployment practices, and CI/CD for data workflows. - Strong troubleshooting mindset with experience in performance tuning and data quality assurance. **Additional Details:** This firm offers an on-site delivery model with high-impact projects for large enterprise clients, providing opportunities to work end-to-end on data platforms. You will be part of a collaborative engineering culture with technical mentoring and exposure to modern data stack components. Additionally, competitive compensation and opportunities for certification/training in cloud and Big Data technologies are provided. This is a remarkable opportunity for a Big Data Engineer in India to contribute to impactful projects and enhance your skills in the dynamic field of Big Data engineering.
