Associate Data Engineer

2 - 6 years

3 - 5 Lacs

Posted:2 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

What you will do
In this vital role we seek a skilled Data Engineer to build and optimize our data infrastructure. As a key contributor, you will collaborate closely with cross-functional teams to design and implement robust data pipelines that efficiently extract, transform, and load data into our AWS-based data lake and data warehouse. Your expertise will be instrumental in empowering data-driven decision making through advanced analytics and predictive modeling.

Roles & Responsibilities:
  • Building and optimizing data pipelines, data warehouses, and data lakes on the AWS and Databricks platforms.
  • Managing and maintaining the AWS and Databricks environments.
  • Ensuring data integrity, accuracy, and consistency through rigorous quality checks and monitoring.
  • Maintain system uptime and optimal performance
  • Working closely with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Exploring and implementing new tools and technologies to enhance ETL platform performance.

What we expect of you
We are all different, yet we all use our unique contributions to serve patients.
Basic Qualifications:
Bachelors degree and 2 to 6 years.

Functional Skills:
Must-Have Skills:
  • Proficient in SQL for extracting, transforming, and analyzing complex datasets from both relational and columnar data stores. Proven ability to optimize query performance on big data platforms.
  • Proficient in leveraging Python, PySpark, and Airflow to build scalable and efficient data ingestion, transformation, and loading processes.
  • Ability to learn new technologies quickly. Strong problem-solving and analytical skills. Excellent communication and teamwork skills.

Good-to-Have Skills:
  • Experienced with SQL/NOSQL database, vector database for large language models
  • Experienced with data modeling and performance tuning for both OLAP and OLTP databases
  • Experienced with Apache Spark, Apache Airflow
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  • Experienced with AWS, GCP or Azure cloud services

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Amgen Inc logo
Amgen Inc

Biotechnology

Thousand Oaks

RecommendedJobs for You

hyderabad, telangana, india

gautam buddha nagar, uttar pradesh, india