Data Engineer (D.E 1.0)

Experience:

Location:

Employment Type:

Role Description

We are seeking experienced Data Engineers with strong expertise in PySpark and Azure to design, build, and maintain scalable data platforms. The role involves end-to-end ownership of data pipelines, governance, and analytics enablement in a large-scale, production-grade environment.

Key Responsibilities

• Design and implement data pipelines to collect, clean, and transform data from multiple sources
• Build and maintain data storage and processing systems including databases, data warehouses, and data lakes
• Ensure data security, compliance, and governance standards are met
• Develop and implement data governance policies and procedures
• Collaborate with business analysts, data analysts, data scientists, and stakeholders to deliver data solutions
• Work with Big Data Solution Architects to design, prototype, and optimize data ingestion pipelines
• Ensure solutions are production-ready with respect to operational, security, and compliance standards
• Participate in Agile ceremonies and provide technical support for issue resolution
• Communicate clearly with business stakeholders on progress, risks, and blockers
• Maintain documentation and share knowledge across teams

Required Skills & Experience

• 8+ years of experience in data engineering and big data solution development
• Strong hands-on experience with Azure (mandatory)
• Proficiency in PySpark, Python, and SQL
• Experience working with Databricks
• Experience with Azure DevOps and CI/CD pipelines
• Experience with unit and integration testing for data pipelines
• Strong experience querying and manipulating data from relational and big data systems
• Experience using code quality tools and static analysis
• Exposure to Power BI or other data visualization tools
• Experience working on high-traffic, large-scale software products

Good to have

• Experience with other cloud platforms such as AWS or GCP
• Strong leadership, communication, and problem-solving skills

Qualifications

• Graduate in Engineering or equivalent