Senior Data Engineer

2 - 31 years

15 - 17 Lacs

Bengaluru/Bangalore

Posted:21 hours ago| Platform: Apna logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Our client is a cutting-edge IT services organization dedicated to accelerating digital transformation outcomes for customers. They specialize in advising, integrating, and deploying innovative technologies to enable business agility in today’s fast-paced, hybrid IT environment. Their teams collaborate to transform insights into innovation, overcoming complexity with speed and precision. Job Description: Senior Data Engineer (NoSQL & Distributed Systems) What you will do: Utilize your 7+ years of software development and data engineering experience with a strong focus on NoSQL databases and distributed data systems. Design, deploy, troubleshoot, and optimize technologies such as Apache Cassandra, Clickhouse, MongoDB, Apache Spark, Apache Flink, and Apache Airflow. Solve complex data engineering challenges in a fast-moving environment and implement practical, scalable solutions. Collaborate with cross-functional teams to build DevOps-centric data pipelines and solutions using the latest tools and technologies. Provide high-level engineering support for customer-deployed data systems and respond promptly to their requests. Technical Skills Required: Deep expertise in NoSQL databases (Apache Cassandra, Clickhouse, MongoDB) including installation, configuration, and production performance tuning. Strong experience with real-time data processing frameworks such as Apache Spark and Apache Flink, including deployment and management on Kubernetes or container orchestration platforms. Proficiency in configuring and fine-tuning Spark and Flink clusters for optimal resource allocation, fault tolerance, and job execution. Skilled in developing and automating Apache Airflow DAGs to orchestrate complex data workflows and manage scheduling, retries, and dependencies. Solid background in container orchestration (Kubernetes) to manage operators and ensure scalability and high availability. Expertise in infrastructure automation and deployment with tools like Terraform, Chef, Ansible, Jenkins, GitLab CI, or Bamboo. Strong scripting skills in Python, Bash, or Go for automation and workflow orchestration. Proven ability to troubleshoot and optimize distributed data systems and maintain high system reliability.

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Pune, Maharashtra, India

Pune/Pimpri-Chinchwad Area

Chennai, Tamil Nadu, India

Chandigarh, Chandigarh, India

Pune, Maharashtra, India