Sr Data Analytics Engineer

• Implement best practices for design, architecture, and implementation of high-performance, scalable, highly available, and optimized platforms on cloud.
• Guide and support teams on architecture decisions, best practices, and technical solutions, with an emphasis on providing architectural guidance and expertise.
• Design frameworks for deployment of data pipelines and applications to support internal users with their data requirements and reporting.
• Drive automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI)/Continuous Delivery (CD) tools such as Jenkins.
• Work with internal infrastructure teams on monitoring, security, and configuration of the platform environment and applications.
• Collaborate with internal business units and data science teams on business requirements, data access, processing/transformation, and reporting needs; provide guidance on leveraging existing and new tools to provide solutions; effectively support and partner with businesses on implementation, technical issues, and training on the data ecosystem.
• Work with the team on managing Azure resources (Databricks, ADF pipelines, etc) and continuously improve deployment processes of applications.
• Support provisioning, monitoring, configuration, and maintenance of tools and services.
• Promote the integration of new cloud technologies and continuously evaluate new tools that will improve the organization s capabilities while leading to lower total cost of operation.
• Work with the team to implement data governance, access control, and identify and reduce security risks.

• bachelors or masters Degree in Computer Science, Information Systems, Engineering, or related technical fields.
• 3-5 years experience in software development, including experience in Big Data and/or Cloud Services. Prior experience with Spark required.
• Experience in Azure cloud services, Linux Operating Systems, Shell scripting, Python, and DevOps/CI/CD frameworks.
• Experience with continuous integration/delivery tools like Jenkins and infrastructure as code using Terraform.
• Knowledge and experience of Azure data-related services such as Azure Databricks, Data Factory, EventHub, ADLS, etc; self-learner with the ability to experiment and adopt new tools to build more efficient processes.
• Experience with one or more object-oriented/object function scripting languages (Python, Java, Scala, etc).
• Experience with relational SQL and NoSQL databases, including Synapse, MS SQL, RDS, etc. Good to have experience with data pipeline and workflow management tools: Oozie, Airflow, etc
• Good to have experience with relational SQL and NoSQL databases, including RDS, MS SQL, DynamoDB, etc, and with data pipeline and workflow management tools: Databricks workflows, Oozie, Airflow, etc
• Good combination of technical and interpersonal skills with strong written and verbal communication.
• Takes initiative on process and system improvements.
• Documents and communicates testing results, ensuring clear task ownership and defined target timelines.
• Demonstrates a solution-oriented mindset by identifying, communicating, and acting on issues and initiatives.
• Experience working with fast-paced operations/dev teams and DevOps.

Who are you:

• bachelors degree or foreign equivalent degree in Computer Science or a related field required
• Excellent communication skills.
• Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.
• Owns success - Takes responsibility for the successful delivery of the solutions.
• Strong desire to improve upon their skills in tools and technologies