Pyspark with ADB Consultant

At Capgemini Invent, we believe that difference drives change. As inventive transformation consultants, we combine our strategic, creative, and scientific capabilities to collaborate closely with clients in delivering cutting-edge solutions. Join our team to lead transformation customized to address our client's challenges of today and tomorrow, informed and validated by science and data, superpowered by creativity and design, all underpinned by purpose-driven technology. What you will appreciate about working with us: We acknowledge the importance of flexible work arrangements to provide support. Whether it's remote work or flexible work hours, you will find an environment that fosters a healthy work-life balance. At the core of our mission lies your career growth. Our array of career growth programs and diverse professions are designed to assist you in exploring a world of opportunities. Equip yourself with valuable certifications in the latest technologies such as Generative AI. Your Role: We are seeking a skilled PySpark Developer with expertise in Azure Databricks (ADB) and Azure Data Factory (ADF) to become a part of our team. The ideal candidate will have a pivotal role in designing, developing, and implementing data solutions using PySpark for large-scale data processing and analytics. Your Profile: - Design, develop, and deploy PySpark applications and workflows on Azure Databricks for data transformation, cleansing, and aggregation. - Implement data pipelines using Azure Data Factory (ADF) to orchestrate ETL/ELT processes across heterogeneous data sources. - Conduct regular financial risk assessments to identify potential vulnerabilities in data processing workflows. - Collaborate with Data Engineers and Data Scientists to integrate and process structured and unstructured data sets into actionable insights. Capgemini is a global business and technology transformation partner, aiding organizations in accelerating their dual transition to a digital and sustainable world while making a tangible impact for enterprises and society. With a responsible and diverse group of 340,000 team members in more than 50 countries, Capgemini, with its strong over 55-year heritage, is trusted by clients to unlock the value of technology to address the entire breadth of their business needs. It provides end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, generative AI, cloud, and data, combined with its deep industry expertise and partner ecosystem.,