Job
Description
We are seeking a highly skilled and motivated Senior Data Engineer to join our growing team. The ideal candidate will be a strong problem-solver with excellent Python and SQL literacy, capable of transforming high-level business problems into practical, production-ready data solutions. This role offers an exciting opportunity to work with cutting-edge data technologies and contribute to our data-driven initiatives. Responsibilities: Design, develop, and maintain robust and scalable data pipelines to ingest, transform, and load data from various sources. Translate complex business problems described at a high level into actionable data engineering requirements and solutions. Independently research, design, and implement practical data solutions, from conceptualization to production deployment. Ensure data quality, integrity, and reliability across all data pipelines and systems. Collaborate effectively with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data needs and deliver impactful solutions. Optimize data processing workflows for performance and efficiency. Contribute to the continuous improvement of data engineering processes, tools, and best practices. Potentially engage in exploratory data analysis to uncover insights and inform data model design (if applicable). Required Skills and Experience: Mandatory Skills: Strong proficiency in Python for data manipulation, scripting, and building data pipelines. Expertise in SQL, including advanced querying, database design, and optimization. Problem-Solving: Proven ability to start from a high-level problem description, practically understand it, independently devise a solution, and successfully implement it in production. Desired/Secondary Skills (Plus Points): Familiarity and hands-on experience with Azure cloud services (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics). Experience with Databricks for big data processing and analytics (e.g., PySpark). Some experience with exploratory data analysis (EDA) is welcome.
