Senior Data Engineer

Senior Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines and data workflows.
• Build and optimize data architectures to support analytics, reporting, and machine learning initiatives.
• Manage and optimize data storage solutions (data warehouses, data lakes, cloud platforms).
• Ensure data quality, integrity, governance, and security across systems.
• Collaborate with cross-functional teams to understand data needs and deliver solutions aligned with business goals.
• Monitor and troubleshoot data pipeline performance, ensuring high availability and reliability.
• Mentor junior engineers and contribute to best practices and coding standards.

Required Skills & Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• Proven experience (X+ years) as a Data Engineer, with at least Y years in a senior role.
• Strong proficiency in SQL and experience with relational as well as NoSQL databases.
• Expertise in programming languages such as Python, Java, or Scala.
• Hands-on experience with cloud platforms (AWS, GCP, or Azure).
• Familiarity with big data technologies (Hadoop, Spark, Kafka, Hive, etc.).
• Strong understanding of data modeling, ETL processes, and workflow orchestration tools (Airflow, Luigi, etc.).
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Preferred Skills

• Experience with containerization and orchestration (Docker, Kubernetes).
• Knowledge of streaming data processing frameworks.
• Exposure to DevOps practices and CI/CD pipelines.
• Familiarity with machine learning workflows and MLOps.