Big Data Engineer

Description

We are looking for a skilled Big Data Engineer to join our team in India. The ideal candidate will have a strong background in big data technologies and a passion for working with large datasets to drive business insights.

Responsibilities

• Design and implement scalable data pipelines and architectures for processing large datasets.
• Work with data scientists and analysts to develop and optimize data models and algorithms.
• Ensure data quality and integrity by implementing robust data validation processes.
• Monitor and troubleshoot data processing workflows and systems for performance optimization.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Stay updated with the latest trends in big data technologies and best practices.

Skills and Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 4-7 years of experience in big data technologies such as Hadoop, Spark, and Kafka.
• Proficiency in programming languages like Java, Scala, or Python.
• Experience with database technologies like SQL, NoSQL (Cassandra, MongoDB), and data warehousing solutions.
• Strong understanding of data modeling and ETL processes.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Knowledge of data visualization tools like Tableau or Power BI is a plus.