Software Engineer II - Data Engineer

2 - 4 years

4 - 6 Lacs

Posted:1 month ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking a Data Engineer to help design, build, and optimize data pipelines and platforms that support our growing data needs. In this role, you will work closely with senior engineers and cross-functional teams to integrate diverse data sources, ensure data quality, and contribute to the development of scalable, secure, and reliable data infrastructure.

 

Responsibilities

  • Build and maintain reliable, high-performance data pipelines for batch and streaming use cases.
  • Integrate data from multiple sources including enterprise systems, cloud-native services, APIs, and unstructured datasets.
  • Collaborate with senior engineers to implement best practices in data modeling, pipeline design, and performance optimization.
  • Contribute to building self-service data platforms for data discovery, access, and lifecycle management.
  • Support implementation of governance, compliance, and security policies across data systems.
  • Develop automation scripts for deployment and monitoring of data infrastructure.
  • Work with team members to resolve issues, improve processes, and ensure data availability and accuracy.

Core Qualifications

  • bachelors degree in Computer Science, Engineering, or related field.
  • 2 to 4 years of experience in data engineering or backend software development.
  • Proficiency in Python and SQL for data processing and pipeline development.
  • Experience with distributed computing frameworks like Spark, Kafka, or similar.
  • Familiarity with AWS services and Infrastructure as Code (IaC) tools such as Terraform or AWS CDK.
  • Knowledge of data storage systems (eg, S3, Redshift, Snowflake, or similar).
  • Basic understanding of data governance and compliance requirements.

Preferred Skills

  • Exposure to data catalog/discovery tools such as DataHub or Collibra.
  • Familiarity with containerized applications (Docker, Kubernetes).
  • Understanding of real-time data pipelines and streaming technologies.
  • Awareness of privacy and regulatory standards (eg, GDPR, CCPA).

What Diligent Offers You

  • Creativity is ingrained in our culture.

    We are innovative collaborators by nature. We thrive in exploring how things can be differently both in our internal processes and to help our clients
  • We care about our people.

    Diligent offers a flexible work environment, global days of service, comprehensive health benefits, meeting free days, generous time off policy and we'llness programs to name a few
  • We have teams all over the world

    . We may be headquartered in New York City, but we have office hubs in Washington D.C., Vancouver, London, Galway, Budapest, Munich, Bengaluru, Singapore, and Sydney.
  • Diversity is important to us.

    Growing, maintaining and promoting a diverse team is a top priority for us. We foster and encourage diversity through our Employee Resource Groups and provide access to resources and education to support the education of our team, facilitate dialogue, and foster understanding

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Diligent Corporation logo
Diligent Corporation

Business Consulting and Services

Melbourne Florida

RecommendedJobs for You