Big Data Engineer

Location:

Job Code:

Role:

Type of Commute:

Skill Set:

Desired Industry Experience:

No. of open position:

Role Description:

Job Title: Big Data Engineer

Employment Type:

Summary

high-energy and innovative Big Data Engineer

cloud-native application development

Key Responsibilities

Technical

• Collaborate with users, technical leads, project managers, and cross-functional development teams to

  design, develop, and deliver

  scalable data-driven software solutions.


• Actively

  code in Python and/or Java

  , leveraging technologies such as

  Apache Spark, Hive, Databricks, Git, Linux, AWS, PostgreSQL, and GreenPlum

  .


• Design and develop

  Big Data solutions

  using

  Hadoop, Spark, EMR, Hive

  , and related distributed processing frameworks.


• Build and integrate

  cloud-native applications

  and

  microservices-based architectures

  .


• Apply

  object-oriented design patterns

  to create enterprise-level, modular, and maintainable solutions.


• Demonstrate strong problem-solving skills to enhance existing processes, workflows, and system performance.


• Optimize and fine-tune

  Big Data pipelines

  for performance and reliability.


• Follow disciplined software development practices, adhering to coding standards, quality guidelines, and corporate policies.

Quality

• Translate business requirements into

  effective technical designs

  and high-quality implementations.


• Create and execute

  unit tests

  to ensure software quality and stability before delivery to QA.


• Maintain thorough documentation and ensure adherence to software best practices.


• Exhibit strong

  communication and collaboration skills

  , working effectively with cross-functional and cross-geography teams.

Project/Team

• Work in an

  Agile/Scrum

  development environment with a focus on continuous integration and iterative delivery.


• Contribute to the team s success through

  knowledge sharing, peer reviews,

  and collaborative problem-solving.

Qualifications

• Bachelor s degree in

  Computer Science

  , Information Technology, or a related field.

Desired Skills:

Experience

• 5+ years

  of proven experience in a

  Big Data environment

  .


• Hands-on experience with

  distributed data processing

  ,

  data pipeline development

  , and

  cloud-based data solutions

  .

Preferred Skills

• Experience with

  AWS

  or other cloud environments for Big Data workloads.


• Strong knowledge of

  Spark

  ,

  Hive

  ,

  Hadoop

  ,

  Databricks

  , and

  data integration frameworks

  .


• Familiarity with

  CI/CD pipelines

  ,

  version control (Git)

  , and

  Linux-based development

  .


• Exposure to

  PostgreSQL

  ,

  GreenPlum

  , and

  NoSQL

  data stores.


• Excellent analytical, debugging, and performance optimization skills.