Azure Databricks Senior Consultant

EY GDS Data and Analytics (D And A) – Azure Databricks - Senior

We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.

Your key responsibilities

• Develop & deploy azure databricks in a cloud environment using Azure Cloud services
• ETL design, development, and deployment to Cloud Service
• Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams
• Design and optimize model codes for faster execution

Skills and attributes for success

• 3 to 7 years of Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions
• Extensive hands-on experience implementing data migration and data processing using Azure services: Databricks, ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, etc.
• Hands-on experience in Azure data bricks & Pyspark to develop ETL pipelines
• Utilize Pyspark within Databricks notebooks for data processing and transformations.
• Integrate and orchestrate data from various sources, ensuring data quality and accuracy.
• Build reusable rules for Data Quality and required transformations.
• Optimize data pipelines for performance and scalability.
• Implement data governance and security measures to comply with regulations.
• Maintain documentation of data pipelines and workflows for knowledge sharing.
• Proficiency in Databricks, Azure Data Factory,Python & SQL is essential.
• Familiarity with ETL principles, data warehousing, and big data technologies.
• Strong problem-solving skills and communication abilities.

To qualify for the role, you must have

• Be a computer science graduate or equivalent with 3 to 7years of industry experience
• Have working experience in an Agile base delivery methodology (Preferable)
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
• Strong analytical skills and enjoys solving complex technical problems
• Proficiency in Software Development Best Practices
• Excellent debugging and optimization skills
• Experience in Enterprise grade solution implementations & in converting business problems/challenges to technical solutions considering security, performance, scalability etc
• Excellent communicator (written and verbal formal and informal).
• Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support. 
• Client management skills

Ideally, you’ll also have

• Experience on Banking and Capital Markets domains

Skills and attributes for success

• Use an issue-based approach to deliver growth, market and portfolio strategy engagements for corporates
• Strong communication, presentation and team building skills and experience in producing high quality reports, papers, and presentations.
• Experience in executing and managing research and analysis of companies and markets, preferably from a commercial due diligence standpoint.

What we look for

• A Team of people with commercial acumen, technical experience and enthusiasm to learn new things in this fast-moving environment
• An opportunity to be a part of market-leading, multi-disciplinary team of 1400 + professionals, in the only integrated global transaction business worldwide.
• Opportunities to work with EY Advisory practices globally with leading businesses across a range of industries

What working at EY offers

At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.

You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:

• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you