Data Engineer (RTS)

About The Role

Data Engineer

Requirements

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Work with structured and unstructured datasets to ensure data quality, accuracy, and availability.
• Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets for analytics and reporting.
• Optimize query performance and ensure real-time/near-real-time data processing for RTS.
• Implement data security, governance, and compliance standards.
• Troubleshoot data-related issues and ensure system reliability and scalability.
• Stay updated with emerging tools and best practices in big data and cloud-based data engineering.
  

Required Skills & Experience

• 5-8 years of proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL, Python, or Scala.
• Hands-on experience with big data technologies (Hadoop, Spark, Kafka, Hive, etc.).
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., Redshift, Snowflake, BigQuery, Data Lake).
• Strong understanding of ETL/ELT frameworks, data warehousing, and data modeling.
• Experience with real-time data streaming and processing frameworks.
• Good knowledge of CI/CD, version control (Git), and DevOps practices.
• Excellent problem-solving and communication skills.
  

Nice-to-Have

• Experience in containerization and orchestration (Docker, Kubernetes, Airflow, etc.).
• Knowledge of data governance and security best practices.
• Familiarity with machine learning pipelines.
  

Education

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.