Principal Engineer - Data Engineering

Key Responsibilities:

:

• Influence and contribute to engineering initiatives and practices at the enterprise (Target Tech) level
• Optimize data platform performance, provide expertise on choosing right tools, technologies and lead architecture of automated, scalable, resilient and self-healing data platform.
• Explore ways to enhance quality, reliability and ensure excellence in the end-to-end delivery of complex engineering solutions
• Collaborate with other engineers across products and data scientists to continually improve the development standards and practices at data engineering and larger Target Tech
• Be a thought leader and mentor for internal and external technical talent and actively contribute to the external technical community
• Work with engineering leaders to build a high performing engineering team and provide technical leadership, coaching, motivation and participate in the selection of technical talent.
• Work closely with our product, UX, platform and data teams to implement an intuitive, coherent, and engaging user experience
• Manage complex cross-team coordination and dependencies
• Ensure high quality, stable, and performant code
• Perform code and design reviews that guarantee code quality
• Evaluate and communicate different engineering solutions and trade-offs
• Develop clean, well-tested code to deliver functionality that meets business objectives
• Identify long-term tech opportunities that bring value and develop a roadmapfor future work to ensure continued product health and innovation
• Identify opportunities to perform or lead POC/POT with our teams

About you:

• 4-year degree or equivalent.
• 15+ years of experience in technology development or services, including deep expertise in data modelling, pipeline development, with a focus on Spark, Scala, Python/Java and associated libraries and frameworks.
• 4+ years of experience in strategic planning and setting technical direction.
• Deep understanding of data architecture patterns, data governance, best practices, testing and performance optimization techniques.
• Expertise in open source technologies like Hadoop, public Cloud platforms, database fundamentals, dev ops practises and performance tuning
• Lead and mentor a team of data engineers, providing technical guidance and fostering a collaborative and innovative environment.
• Drive the technical roadmap for the data platform, making strategic decisions to enhance performance, maintainability, and scalability.
• Conduct code reviews and provide constructive feedback to ensure code quality, maintainability, and adherence to coding standards.
• Stay up-to-date with the latest data technologies, tools, and trends, and evaluate their potential application within the organization.
• Collaborate with cross-functional teams to identify and address technical challenges and optimize development processes.
• Actively participate in architectural discussions, providing valuable insights and advocating for best practices.
• Lead by example, demonstrating a strong work ethic, excellent problem-solving skills, and a commitment to continuous learning.