3 - 6 years
18 - 22 Lacs
Posted:1 week ago
email-bushra@bharatjobs.com
JD - Big Data Engineer Key Responsibilities Design, develop, and optimize scalable data pipelines for batch and real-time processing. Build and maintain ETL/ELT workflows using modern data engineering frameworks. Process and analyze large datasets using distributed computing technologies. Develop and optimize Spark applications for high-volume data processing. Build streaming data solutions using Kafka and related technologies. Implement workflow orchestration and scheduling using Airflow. Work with data storage systems including HDFS, S3, Hive, and NoSQL databases. Ensure data quality, reliability, and observability across data platforms. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Monitor and troubleshoot production data pipelines and platform issues. Implement CI/CD practices and automation for data engineering workflows. Contribute to platform modernization initiatives involving containerization and cloud-native technologies. Required Technical Skills Programming Python Scala SQL Java is a plus Big Data Technologies Apache Spark (Core, SQL, Structured Streaming) Apache Hive Apache Kafka Apache NiFi Apache Airflow Hadoop Ecosystem (HDFS, YARN) Aerospike is a plus Kibana Grafana Elasticsearch DevOps & Platform Tools Git Jenkins Linux Bitbucket Jira Confluence Kubernetes Podman
Free courses, interview questions and practice for each skill.
Work from Office
Full Time
Athena Consultancy Services
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Bengaluru
Salary: Not disclosed
Chennai, Bengaluru
16.0 - 31.0 Lacs P.A.
Kochi, Bengaluru
Salary: Not disclosed
Bengaluru
Salary: Not disclosed
Pune
18.0 - 22.5 Lacs P.A.
Chennai, Bengaluru
14.0 - 24.0 Lacs P.A.
Chennai
Salary: Not disclosed
Hyderabad
Salary: Not disclosed
Chennai, Bengaluru
Salary: Not disclosed
Gurugram
Salary: Not disclosed
AI Job Matching Summary