Big Data Engineer

Job Description

Description We are seeking a skilled Big Data Engineer to join our team in India. The ideal candidate will have a strong background in data engineering, with a focus on designing and building scalable data processing systems. You will work closely with our data science and analytics teams to ensure that our data infrastructure meets the evolving needs of our business. Responsibilities Design, develop, and maintain scalable data pipelines for processing large data sets. Collaborate with data scientists and analysts to understand data requirements and deliver reliable data solutions. Implement ETL processes to extract, transform, and load data from various sources into data warehouses. Optimize data storage and retrieval processes for improved performance and efficiency. Monitor and troubleshoot data pipeline performance issues and implement enhancements as needed. Skills and Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field. 2-8 years of experience in data engineering or related roles. Proficiency in big data technologies such as Hadoop, Spark, and Hive. Experience with programming languages such as Python, Java, or Scala. Strong understanding of SQL and NoSQL databases, including MongoDB, Cassandra, and others. Familiarity with cloud platforms like AWS, Google Cloud, or Azure for data storage and processing. Knowledge of data modeling and data warehousing concepts. Ability to work with large data sets and perform complex data manipulations efficiently.