Data Engineer-Specialist

Preferred Knowledge/Skills

As a Data Engineer, you will develop and maintain robust data pipelines and infrastructure to support real-time and batch data processing. Your work will enable data-driven decision-making across the organization by ensuring data is clean, reliable, and accessible.

Requirement

• 
  Experience in building and managing data pipelines using tools like Apache Spark.
• 
  Proficiency in programming languages such as Python, Java, or Scala.
• 
  Strong SQL skills and experience with relational databases.
• 
  Experience with cloud platforms such as AWS, Azure, or GCP.
• 
  Knowledge of data lakes and cloud storage solutions like S3, ADLS, or GCS.
• 
  Experience with ETL/ELT tools and frameworks such as Airflow, dbt, or Glue.
• 
  Strong analytical and debugging skills.
• 
  Effective communication and collaboration in a team-oriented environment.

Responsibilities

• 
  Build and optimize scalable data pipelines and workflows for batch and real-time processing.
• 
  Work closely with data scientists, analysts, and software engineers to support data requirements.
• 
  Develop and maintain data ingestion and transformation processes.
• 
  Automate data workflows and contribute to CI/CD for data pipelines.
• 
  Participate in Agile ceremonies such as sprint planning, daily standups, and sprint reviews to ensure project timelines and deliverables are met