Data Engineer - Specialist

As a DataEngineer, you will develop and maintain robust data pipelines andinfrastructure to support real-time and batch data processing. Your work willenable data-driven decision-making across the organization by ensuring data isclean, reliable, and accessible.

Requirement

• Experience in building and managing datapipelines using tools like Apache Spark.
• Proficiency in programming languages such asPython, Java, or Scala.
• Strong SQL skills and experience withrelational databases.
• Experience with cloud platforms such as AWS,Azure, or GCP.
• Knowledge of data lakes and cloud storagesolutions like S3, ADLS, or GCS.
• Experience with ETL/ELT tools and frameworkssuch as Airflow, dbt, or Glue.
• Strong analytical and debugging skills.
• Effective communication and collaboration ina team-oriented environment.

Responsibilities

• Build and optimize scalable data pipelinesand workflows for batch and real-time processing.
• Work closely with data scientists, analysts,and software engineers to support data requirements.
• Develop and maintain data ingestion andtransformation processes.
• Automate data workflows and contribute toCI/CD for data pipelines.
• Participate in Agile ceremonies such assprint planning, daily standups, and sprint reviews to ensure project timelinesand deliverables are met