Senior Python Data Engineer — Azure Databricks & Power BI

About the role

We’re looking for a Senior Python Data Engineer (4+ years) with deep hands-on experience in Azure Databricks, PySpark, Spark SQL, and Power BI. You’ll design, build, and optimize reliable data platforms and analytics solutions—partnering with product, analytics, and business teams in a fast-paced, collaborative environment.

What you’ll do

• Design and implement scalable ETL/ELT pipelines on Azure Databricks using PySpark/Spark SQL.

• Model data for semantic layers powering BI and analytics use cases.

• Build and maintain Power BI datasets, reports, and dashboards (DAX, data modeling, Power Query).

• Write, refactor, and optimize Python notebooks for transformation, feature engineering, and analysis.

• Ensure data quality, accuracy, and consistency across reporting platforms; implement validations and checks.

• Automate data workflows and report refreshes with Python and Power BI.

• Collaborate on data governance, security, and compliance practices in cloud environments.

• Partner cross-functionally to translate business requirements into robust technical solutions.

Required qualifications

• 4+ years of software/data engineering experience with a strong emphasis on Python.

• Expertise in PySpark (DataFrames/Datasets) and Spark SQL for scalable pipelines.

• Proven experience building interactive Power BI dashboards and reports.

• Strong SQL skills (complex queries, performance tuning, joins across multiple tables/views).

• Familiarity with Azure services—especially Azure Data Lake and Azure Data Factory.

• Solid understanding of data governance, data management, security, and compliance in the cloud.

• Track record of ensuring data integrity and reliability across analytics/BI layers.

Nice to have

• Experience with Azure AI, Azure Copilot Studio, Azure Fabric.

• Workflow automation using Power Automate.

• Streaming ingestion with Azure Event Hubs or Apache Kafka; real-time data pipelines.

• Familiarity with SDLC best practices and Agile/Scrum delivery.

Skills & collaboration

• Hands-on with Power BI: DAX, Power Query, data modeling.

• Strong grasp of reporting fundamentals (KPIs, business metrics, dimensional modeling concepts).

• Excellent communication and stakeholder management; able to turn business needs into technical designs.

• Comfortable working independently, context-switching across multiple priorities, and participating in mobbing/pairing and cross-team collaboration.

• Strong problem-solving and code review skills; quality-first mindset.

Why join us

• Work on high-impact, production-grade data platforms used across the business.

• Ownership, autonomy, and an opportunity to shape our data engineering standards.

• Collaborative culture that values learning, craftsmanship, and measurable outcomes.