Big Data Developer

You will be a Big Data Developer with at least 12 years of overall experience in the IT industry, including 5 years specifically in Big Data projects. Your main responsibilities will include working on Azure handling Big Data projects, event streaming using Kafka, Scala and Java programming, Spark framework, and performance optimization. You will also be expected to build reusable frameworks with high quality and work on CI/CD practices. - Handle Big Data projects on Azure platform - Utilize Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream, and Big Data technologies - Work on event streaming using Kafka for at least 1 year - Develop reusable frameworks with high quality standards - Implement CI/CD practices using Azure DevOps, GitHub, and adhere to best practices, code quality, and branching strategies - Automate tasks and deploy production standard code with unit testing, continuous integration, and versioning - Load transformed data into storage and reporting structures in various destinations - Conduct peer reviews, unit testing, and deployment to production - Demonstrate strong problem-solving and logical reasoning abilities - Must have at least 12 years of experience in the IT industry - Should have a minimum of 5 years of experience in Big Data projects - At least 3 years of experience in Azure handling Big Data projects - Proficiency in Scala and Java programming, Spark framework, and performance optimization - Familiarity with Azure Databricks, Azure Data Factory, Azure Function apps, Apache Kafka, and event stream technologies - Optional skills in Airflow and Python would be a plus,