Data Engineer

Job Title: Senior Data Engineer with Databricks and Power BI (DAX)

Job Description:

As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining robust data pipelines and data architectures to support advanced analytics and reporting initiatives. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions that empower the organization to make data-driven decisions. Your expertise in Databricks and Power BI (DAX) will be critical in optimizing data workflows and visualizing complex datasets.

Key Responsibilities:

- Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.
- Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.- Optimize data storage and retrieval processes to enhance performance and reduce latency.- Ensure data quality and integrity by implementing best practices for data governance and validation.- Mentor junior data engineers and contribute to knowledge sharing within the team.- Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

Skills and Tools Required:

- Proficiency in Databricks and experience with Spark for big data processing.
- Strong experience with Power BI, particularly in building reports and dashboards using DAX.- Solid programming skills in Python or Scala for developing data pipelines.- Knowledge of SQL and experience with relational databases and data warehousing concepts.- Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.- Understanding of data modeling, ETL processes, and data integration methodologies.- Excellent problem-solving skills and attention to detail.- Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill Area Tools & Technologies
Data Engineering Databricks, Apache Spark, Delta LakeProgramming Python, SQL, PySparkBI & Visualization Power BI, DAX, Power QueryCloud Platforms AzureDevOps & CI/CD Git, Azure DevOpsData Governance Unity Catalog, Data Lake Security

Preferred Qualifications:

- Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.
- Previous experience in a similar data engineering role, particularly within a corporate environment.- Knowledge of additional BI tools and data visualization platforms is a plus.

Interested people share me your updated CV: lakshmi.k@acesoftlabs.com