Big Data Engineer

As a Big Data Engineer with 10+ years of experience, your role will involve handling Big Data projects using Azure technologies such as Azure Databricks, Azure Data Factory, and Azure Function apps. You will also work with Apache Spark, Scala, Java, Apache Kafka, and event stream technologies. Your key responsibilities will include: - Vent streaming using Kafka - Hands-on experience with Scala and Java programming, Spark framework, and performance optimization - Building reusable frameworks with high quality - Working on CI/CD using tools like Azure DevOps and GitHub, and following best practices, code quality, and branching strategies - Automating tasks and deploying production standard code with unit testing, continuous integration, and versioning - Loading transformed data into storage and reporting structures in various destinations - Conducting peer reviews, unit testing, and deployment to production - Applying strong problem-solving skills and logical reasoning - Understanding all aspects of the Software Development Lifecycle - Being enthusiastic about learning new skills and applying them in projects - Working independently at client locations, with a client-facing role - Working at the Bangalore client office for a minimum of 3 days a week Optional skills that would be beneficial for this role include Airflow and Python proficiency. You should have overall experience in the IT industry, with at least 5 years specifically in Big Data projects on Azure. Your ability to work effectively in a client-facing role and your commitment to high-quality work will be essential for success in this position.,