Senior Engineer - Data Engineering

Altimetrik

3 - 7 years

20 - 25 Lacs

chennai

Posted:5 days ago| Platform:

Apply

Skills Required

rdbms gcp data processing data quality apache big data operations automotive sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Senior Engineer - Data Engineering, with Automotive domain having 3 - 7 years of experience, is expected to lead the design, development, and optimization of data engineering solutions leveraging big data technologies such as Hadoop and Apache Spark.
The ideal candidate will possess a robust understanding of distributed data processing and demonstrate expertise in Python for data manipulation and analysis using libraries like Pandas and NumPy.
Familiarity with cloud services, particularly Google Cloud Platform (GCP), is critical for deploying and managing applications in a cloud environment.
Proficiency in Terraform for infrastructure as code is necessary, along with knowledge of Apache Airflow for orchestrating complex data workflows.
The role requires a strong grasp of RDBMS concepts and SQL, and experience with Google BigQuery and Google Dataflow for big data processing tasks.
Good to have certifications such as the Google Cloud Professional Data Engineer or Cloudera Certified Professional (CCP): Data Engineer, along with experience in CI/CD pipeline tools and Agile development practices.

Lead the design, development, and optimization of data engineering solutions leveraging big data technologies such as Hadoop, Apache Spark, and cloud services like Google Cloud Platform (GCP).
Develop and maintain scalable data pipelines using tools like Apache Airflow and Google Dataflow to ensure efficient data integration and processing.
Utilize Python and various libraries to implement data transformation and manipulation tasks, ensuring data quality and reliability.
Design and manage RDBMS solutions while integrating with big data systems to provide comprehensive data solutions.
Collaborate with cross-functional teams to gather requirements and translate them into technical specifications for data projects.
Mentor and guide junior data engineers, fostering a culture of learning and development within the team.
Implement CI/CD practices using tools like Tekton to streamline deployment processes and enhance operational efficiency.
Monitor data workflows and troubleshoot issues in a timely manner, ensuring high availability and performance of data services.
Stay updated with industry trends and best practices in data engineering, big data technologies, and cloud services.

More Jobs at Altimetrik

.net/ dotnet developer- 6+yrs- pune/chennai- Client- Citi Bank

Pune, Chennai

5 - 10 yrs

INR 20 - 35 Lacs

SDET- 5+yrs- Chennai/Pune- Client- Citi Bank

Pune, Chennai

5 - 10 yrs

INR 12 - 22 Lacs

Java Full Stack Developer

Pune, Chennai

6 - 10 yrs

INR 18 - 32 Lacs

Software Engineering Manager

Bengaluru

13 - 15 yrs

INR 37 - 45 Lacs

GEN AI Engineer

Pune, Gurugram, Bengaluru

3 - 8 yrs

INR 12 - 22 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.