Big Data Engineer

Job Description

Description We are seeking a skilled Big Data Engineer to join our dynamic team in India. The ideal candidate will have experience in designing and implementing big data solutions, ensuring that our data processing systems are efficient, reliable, and scalable. Responsibilities Design, develop, and maintain scalable data processing systems and architecture. Implement and manage data pipelines for extracting, transforming, and loading (ETL) data from various sources. Collaborate with data scientists and analysts to understand data requirements and provide data solutions. Optimize and tune data processing systems for maximum performance and scalability. Monitor and troubleshoot data systems, ensuring high availability and reliability. Ensure data security and compliance with regulations and best practices. Skills and Qualifications Bachelor's or Master's degree in Computer Science, Engineering, or related field. 5-10 years of experience in big data technologies such as Hadoop, Spark, and Kafka. Proficiency in programming languages such as Java, Scala, or Python. Experience with database systems including SQL and NoSQL databases (e.g., MongoDB, Cassandra). Strong understanding of data modeling, data warehousing, and data architecture principles. Familiarity with cloud platforms such as AWS, Azure, or Google Cloud for data solutions. Knowledge of data governance, data quality, and data security practices.