Big Data Engineer

We're Hiring: Big Data Engineer

Big Data Engineer

Location:

Key Responsibilities:

• Design, develop, and maintain scalable Big Data processing solutions.
• Build and optimize distributed data processing pipelines using Python and Apache Spark/PySpark.
• Work extensively with the Hadoop ecosystem, including HDFS and Hive.
• Develop and optimize Spark SQL queries for large-scale data processing.
• Integrate data platforms with REST APIs and GraphQL services.
• Work with Kubernetes for container orchestration and deployment.
• Implement and maintain CI/CD pipelines.
• Work with Apache Iceberg for modern data lake and table management solutions.

Required Technical Skills:

• Strong programming experience in Python.
• Hands-on experience with Apache Spark and PySpark.
• Strong knowledge of Hadoop and Hive.
• Experience with Spark SQL.
• Knowledge of REST APIs and GraphQL.
• Experience with Kubernetes and CI/CD.
• Apache Iceberg experience is an added advantage / required for relevant positions.

IMPORTANT STRICT REQUIREMENT

WE ARE LOOKING ONLY FOR CORE BIG DATA ENGINEERS.

AWS Data Engineers – NOT REQUIRED
Azure Data Engineers – NOT REQUIRED GCP Data Engineers – NOT REQUIRED

Interested candidates can share their updated resumes at:

Please share this opportunity with relevant connections.