Senior Python Data Engineer

Job Summary

We are seeking a highly skilled Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate will have extensive experience in designing and implementing data solutions using various technologies, including PySpark, Spark SQL, and Power BI. This role requires a proactive individual who can work independently and collaboratively in a fast paced environment.

Required Technical Skills:

• 4+ years of hands-on experience in software development, with a strong emphasis on Python programming.

• Expertise in PySpark (Spark SQL, DataFrames, and Datasets) for building and optimizing scalable data pipelines. (PySpark)

• Design and develop interactive dashboards and reports using Power BI.

• Write and optimize Python notebooks for data transformation, and analysis.

• Ensure data accuracy, consistency, and integrity across reporting platforms.

• Automate data workflows and reporting processes using Python and Power BI.

• Understanding of data governance, data management, security, and compliance in cloud environments.

• Familiar with Azure cloud services, especially Azure Data Lake, Azure Data Factory,

• Modeling data for Data Warehousing and Visualization projects through Semantic Layers.

• Skilled in writing complex SQL queries and building views involving joins across multiple tables.

Nice to have Skills:

• Experience Azure AI, Azure Copilot Studio and Azure Fabric.

• Experience building workflows with Power Automate.

• EventHub or Kafka for streaming data ingestion.

• Proficient in designing and implementing real-time data streaming solutions.

• Experience across the Software Development Lifecycle (SDLC), with a strong grasp of Agile Scrum methodologies. Skills & Collaboration

• Hands-on experience with Power BI (including DAX, Power Query, and data modeling).

• Strong understanding of reporting fundamentals, KPIs, and business metrics.

• Ability to work independently and manage multiple tasks simultaneously.

• Excellent communication and problem-solving skills

• Strong collaboration mindset with enthusiasm for mobbing sessions and cross team coordination.

• Excellent problem-solving and code review skills.

• Strong communication skills with the ability to understand business requirements and translate them into technical solutions.

Job Types: Full-time, Permanent

Pay: ₹2,700,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Work Location: In person