Job
Description
Role Overview: You will be working as a Python Developer with Databricks at Capgemini Invent, where you will play a crucial role in developing and maintaining scalable data pipelines, managing cloud environments on Azure, and ensuring smooth integration with APIs. The ideal candidate for this role will have strong proficiency in Python, Databricks (PySpark), Azure DevOps, and a good understanding of cloud services, DevOps practices, and API testing. Key Responsibilities: - Develop and Maintain Data Pipelines: Design, develop, and maintain scalable data pipelines using Python and Databricks (PySpark). - Data Processing: Apply strong proficiency in Python and advanced Python concepts to process and manipulate large datasets effectively. - API Ingestion: Experience in API ingestion, working with data in JSON format to integrate and automate data workflows. - Cloud Management: Use Azure Portal for managing cloud environments and services. - Databricks PySpark: Work with Databricks and PySpark to build distributed data processing applications. - DevOps & Agile Methodology: Implement DevOps best practices and work within a Scrum framework to ensure continuous integration and continuous delivery (CI/CD) pipelines. - API Testing & Automation: Use Postman to test and automate APIs for robust integration and data workflows. - Collaboration: Work closely with cross-functional teams to implement solutions aligned with business objectives and technical requirements. Qualification Required: - Programming Skills: Strong proficiency in Python with experience in data processing libraries (e.g., Pandas, NumPy). - Databricks Experience: Hands-on experience with Databricks (PySpark) for data processing and analysis. - Cloud Platform: Experience using Azure Portal to manage cloud environments and services. - API Handling: Expertise in working with APIs, specifically with data ingestion and integration in JSON format. - DevOps Methodology: Familiarity with DevOps practices and experience working in Agile/Scrum environments. - API Testing Tools: Proficiency with Postman for API testing and automation. - Version Control: Experience using Visual Studio Code and version control systems like Git. Additional Details: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. They combine expertise in strategy, technology, data science, and creative design to help CxOs envision and build what's next for their businesses. Role Overview: You will be working as a Python Developer with Databricks at Capgemini Invent, where you will play a crucial role in developing and maintaining scalable data pipelines, managing cloud environments on Azure, and ensuring smooth integration with APIs. The ideal candidate for this role will have strong proficiency in Python, Databricks (PySpark), Azure DevOps, and a good understanding of cloud services, DevOps practices, and API testing. Key Responsibilities: - Develop and Maintain Data Pipelines: Design, develop, and maintain scalable data pipelines using Python and Databricks (PySpark). - Data Processing: Apply strong proficiency in Python and advanced Python concepts to process and manipulate large datasets effectively. - API Ingestion: Experience in API ingestion, working with data in JSON format to integrate and automate data workflows. - Cloud Management: Use Azure Portal for managing cloud environments and services. - Databricks PySpark: Work with Databricks and PySpark to build distributed data processing applications. - DevOps & Agile Methodology: Implement DevOps best practices and work within a Scrum framework to ensure continuous integration and continuous delivery (CI/CD) pipelines. - API Testing & Automation: Use Postman to test and automate APIs for robust integration and data workflows. - Collaboration: Work closely with cross-functional teams to implement solutions aligned with business objectives and technical requirements. Qualification Required: - Programming Skills: Strong proficiency in Python with experience in data processing libraries (e.g., Pandas, NumPy). - Databricks Experience: Hands-on experience with Databricks (PySpark) for data processing and analysis. - Cloud Platform: Experience using Azure Portal to manage cloud environments and services. - API Handling: Expertise in working with APIs, specifically with data ingestion and integration in JSON format. - DevOps Methodology: Familiarity with DevOps practices and experience working in Agile/Scrum environments. - API Testing Tools: Proficiency with Postman for API testing and automation. - Version Control: Experience using Visual Studio Code and version control systems like Git. Additional Details: Capgemini Invent is the digital innovation, consulting, and transformation brand of the Capgemini Group. They combine expertise in strategy, technology, data science, and creative design to help CxOs envision and build what's next for their businesses.
