Senior Data Engineer with Databricks and Power BI (DAX)

Job Title: Senior Data Engineer with Databricks and Power BI (DAX) Experience

Key Responsibilities:

- Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.
- Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.- Optimize data storage and retrieval processes to enhance performance and reduce latency.- Ensure data quality and integrity by implementing best practices for data governance and validation.- Mentor junior data engineers and contribute to knowledge sharing within the team.- Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

Skills and Tools Required:

- Proficiency in Databricks and experience with Spark for big data processing.
- Strong experience with Power BI, particularly in building reports and dashboards using DAX.- Solid programming skills in Python or Scala for developing data pipelines.- Knowledge of SQL and experience with relational databases and data warehousing concepts.- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.- Understanding of data modeling, ETL processes, and data integration methodologies.- Excellent problem-solving skills and attention to detail.- Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill AreaTools & TechnologiesData EngineeringDatabricks, Apache Spark, Delta LakeProgrammingPython, SQL, PySparkBI & VisualizationPower BI, DAX, Power QueryCloud PlatformsAzureDevOps & CI/CDGit, Azure DevOpsData GovernanceUnity Catalog, Data Lake Security

Regards

Yamini