Sr. Data Engineer (Big Data)

You will be responsible for designing, developing, and maintaining big data solutions utilizing Hadoop, Hive, and Spark. You will also be involved in developing data processing pipelines with Spark (Scala/Java) and implementing real-time streaming solutions using Kafka. Working with PostgresSQL for data management and integration will be part of your responsibilities. Collaboration with teams to deliver scalable and robust data solutions is essential. You will be expected to use Git for version control and Jenkins for CI/CD pipeline automation. Additionally, deploying and managing workloads on AWS and/or Azure cloud platforms will be within your scope of work. To enhance your analytics capabilities, you will leverage Databricks for advanced Spark analytics. Having a Databricks Spark certification is preferred. Troubleshooting data and performance issues and optimizing processes for efficiency will also be a key part of your role.,