Senior Data Engineer

long-term role (2–3 years)

Pune

replace the incumbent onsite Data Engineer

Strong hands-on skills on Python / Scala (approximately 80%)

collaboration with other teams and business stakeholders

Responsibilities :

• Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
• Architects, designs, implements and maintains reliable and scalable data infrastructure to move, process and serve data.
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
• Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
• Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline,
• Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
• Actively contributes to improve developer velocity.

Qualifications

• BS degree in computer science or related field
• Deep and hands-on experience (typically 7 to 12 years) designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
• Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#)
• Hands on experience working on Databrick, Apache Spark,
• Advanced database and SQL knowledge
• Experience designing and implementing large-scale distributed data systems
• Skillful in building and scaling infrastructure services using Amazon Web Services or Microsoft Azure
• Deep knowledge and hands-on experience in technologies across all data lifecycle stages
• Strong stakeholder management and ability to lead initiatives through technical influence
• Continuous learning and improvement mindset