Associate Data Analyst

Caring. Connecting. Growing together.

Role Summary:

We are looking for a Junior Data Engineer with 3-5 years of experience, specializing in Python and Azure Databricks, to join our Data Engineering team. The ideal candidate will have hands-on experience building scalable data pipelines and working within the Azure ecosystem, particularly with Databricks for distributed data processing.

Primary Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python and Azure Databricks
• Implement and optimize Apache Spark jobs within Azure Databricks for batch and streaming data processing
• Collaborate with cross-functional teams to understand data requirements and deliver reliable data solutions
• Integrate data from various sources including Azure Data Lake, Blob Storage, and SQL-based systems
• Apply best practices for data quality, validation, and transformation
• Monitor and troubleshoot data workflows to ensure performance and reliability
• Maintain technical documentation for data pipelines and processes
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

• 3+ years of experience in data engineering or software development
• Hands-on experience with Azure Databricks, including notebooks, clusters, jobs, and Delta Lake
• Experience with Azure Data Lake, Azure Blob Storage, and Azure Data Factory
• Solid understanding of Apache Spark and distributed computing concepts
• Familiarity with version control tools (e.g., Git)
• Knowledge of data modeling, ETL or ELT processes, and performance optimization
• Solid proficiency in Python, including experience with data manipulation libraries (e.g., Pandas, PySpark)

Preferred Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field
• Experience with CI/CD pipelines and DevOps practices in Azure
• Familiarity with orchestration tools like Azure Data Factory or Databricks Workflows
• Understanding of data governance, security, and compliance in cloud environments
• Exposure to Agile methodologies and collaborative development practices

What We Offer:

• Opportunity to work on modern data platforms and technologies
• Supportive team environment with a focus on learning and growth
• Competitive compensation and benefits aligned with Grade 25
• Access to training and certifications in Azure and Databricks