Data Engineer

3 - 5 years

10 - 15 Lacs

Posted:3 weeks ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking an AWS-Data Engineer with strong experience across the entire Cloud Data stack. The ideal candidate should have extensive experience in data pipelines (ELT/ETL), data warehousing and dimensional modeling, and curation of data sets for Data Scientists and Business Intelligence users. Experience in building Data Lake. This candidate should also have excellent problem-solving ability dealing with large volumes of data and various data sources.
Key Responsibilities:
  • Design, Build and Operate the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud migration tools, and big data technologies.
  • Optimize various RDBMS engines in the cloud and solve customers security, performance, and operation problems.
  • Design, Build, and Operate large, complex data lakes that meet functional / non-functional business requirements.
  • Optimize various data types of ingestion, storage, processing, and retrieval from near real-time events, and IoT, to unstructured data as images, audio, video, and documents, and in between.
  • Work with customers and internal stakeholders including the Executive, Product, Data, Software Development, and Design teams to assist with data-related technical issues and support their data infrastructure and business needs.
  • Understand and Develop AI/ML models using AWS AI/ML services (e.g., Sage Maker, Rekognition , Comprehend) and collaborate with data scientists and engineers to implement machine learning solutions
Qualifications:
  • 3+ years of experience in a Data Engineer role in a cloud-native eco-system.
  • Bachelor (Graduate preferred) degree in Computer Science, Mathematics, Informatics, Information Systems, or another quantitative field.
  • 3+ years working experience in AWS Glue ETL, Redshift, Step Function, Athena
  • Experience in implementing data pipelines for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Spark, Spark Experience in Lake Formation Orchestration, Maintain and enhance models for SDLC using CI/CD pipelines in AWS.
  • Experience in Relational and NoSQL databases, such as MySQL or Postgres and DynamoDB.
  • Functional and scripting languages: Python, Advanced SQL.
  • Experience building and optimizing big data pipelines, architectures, and data sets.

Mock Interview

Practice Video Interview with JobPe AI

Start Machine Learning Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
ACL Digital logo
ACL Digital

Information Technology and Services

Palo Alto

RecommendedJobs for You