Engineering |Analyst/Consultant| Databricks

Work you'll do

Roles:

Data bricks Data Engineering Consultant, Senior Consultant, Manager, Associate Director

We are seeking highly skilled Data bricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Data bricks platform. Your experience in data engineering, along with a deep understanding of Data bricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers.

Mandatory Skills:

Data bricks, Spark, Python / SQL

Responsibilities

• Design, develop, and optimize data workflows and notebooks using Data bricks to ingest, transform, and load data from various sources into the data lake.
• Build and maintain scalable and efficient data processing workflows using Spark (Py-Spark or Spark SQL) by following coding standards and best practices.
• Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.
• Develop data models and schemas to support reporting and analytics needs.
• Ensure data quality, integrity, and security by implementing appropriate checks and controls.
• Monitor and optimize data processing performance, identifying, and resolving bottlenecks.
• Stay up to date with the latest advancements in data engineering and Databricks technologies.

Qualifications

• Bachelor's or master's degree in any field
• 2-6 years of experience in designing, implementing, and maintaining data solutions on Data bricks
• Experience with at least one of the popular cloud platforms Azure, AWS or GCP
• Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes
• Knowledge of data warehousing and data modelling concepts
• Experience with Python or SQL
• Experience with Delta Lake
• Understanding of DevOps principles and practices
• Excellent problem-solving and troubleshooting skills
• Strong communication and teamwork skills