Software Development Engineer (Data Engineering)

3 - 5 years

15 - 30 Lacs

Posted:4 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Position summary:

Key Responsibilities:

  • Work with cloud-based data solutions (Azure, AWS, GCP).
  • Implement data modeling and warehousing solutions.
  • Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
  • Designing and optimizing data storage solutions, including data warehouses and data lakes.
  • Ensuring data quality and integrity through data validation, cleansing, and error handling.
  • Collaborating with data analysts, data architects, and software engineers to understand data requirements and deliver relevant data sets (e.g., for business intelligence).
  • Implementing data security measures and access controls to protect sensitive information.
  • Monitor and troubleshoot issues in data pipelines, notebooks, and SQL queries to ensure seamless data processing.
  • Develop and maintain Power BI dashboards and reports.
  • Work with DAX and Power Query to manipulate and transform data.

Basic Qualifications

  • Bachelor’s or master’s degree in computer science or data science
  • 3-5 years of experience in data engineering, big data processing, and cloud-based data platforms.
  • Proficient in SQL, Python, or Scala for data manipulation and processing.
  • Proficient in developing data pipelines using Azure Synapse, Azure Data Factory, Microsoft Fabric.
  • Experience with Apache Spark, Databricks and Snowflake is highly beneficial for handling big data and cloud-based analytics solutions.

Preferred Qualifications

  • Knowledge of streaming data processing (Apache Kafka, Flink, Kinesis, Pub/Sub).
  • Experience in BI and analytics tools (Tableau, Power BI, Looker).
  • Familiarity with data observability tools (Monte Carlo, Great Expectations).
  • Contributions to open-source data engineering projects.

 

 

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You