Senior Data Engineer

The role

You will be responsible for the complete design and implementation of sophisticated data architectures and pipelines that support AI systems. You ensure the integrity, accessibility, and security of data within robust enterprise solutions, enabling seamless integration of AI technologies into existing infrastructures. A key focus of this role involves the development of automated data pipelines and workflows designed to enhance productivity and operational efficiency. Collaborating with a multidisciplinary team of experts, you will work to design and optimize AI solutions, leveraging a diverse range of skills to address complex challenges and drive technological advancement. 

Expertise and experience

• Bachelors degree in data science, computer science, or a related field; certifications in AI or data engineering are highly desirable.
• Minimum of 4 to 5 years of experience in end-to-end design and implementation in data solutions, with a strong emphasis on of AI-driven data systems
• Demonstrated ability to assess and select architectural frameworks that support seamless integration and effective utilization of AI technologies.
• Familiarity with the AWS ecosystem, including experience in performance tracking and optimization of AI deployments.
• Strong background in data architecture, ETL processes, and data warehousing, ensuring robust and efficient solution delivery.

Technical Leadership

• Lead initiatives in designing scalable data infrastructures that support sophisticated AI applications.
• Establish and uphold architectural standards and best practices, fostering a culture of innovation and responsibility.
• Mentor and guide junior engineers in understanding architectural considerations and applying them to AI projects.

Personal Specification - Desired Characteristics (Skills Required)

• Demonstrated proficiency in designing scalable cloud architectures within platforms like AWS and Microsoft.
• In-depth knowledge of data warehouse architecture, best practices, and performance optimization.
• Advanced skills in AI/ML frameworks emphasizing real-world applications.
• Strong ability in programming languages like Python, particularly for managing large datasets and AI models.
• Experience in assessing, selecting, and implementing architectural frameworks, with a focus on advanced AI solutions.
• Familiarity with integrating Large Language Models (LLMs) to enhance AI solutions, including the development and tracking of performance metrics within AI systems.