Job
Description
Description We are seeking an experienced Data Engineer with 4-9 years of hands-on experience to join our dynamic team. The ideal candidate will be responsible for designing and implementing robust data pipelines and ensuring data quality for analytics and reporting purposes. You will work closely with cross-functional teams to support data-driven decision-making and enhance our data infrastructure. If you are passionate about data and possess strong technical skills, we would love to hear from you. Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes to support business analytics and reporting needs. Collaborate with data scientists and analysts to understand data requirements and ensure the availability of clean, structured, and reliable data. Optimize and automate data ingestion, transformation, and storage processes. Monitor and troubleshoot data pipeline performance and implement improvements as necessary. Implement data governance and data quality best practices to ensure data integrity and security. Work with cloud-based data platforms (e.g., AWS, Azure, Google Cloud) to manage data infrastructure and storage solutions. Skills and Qualifications Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 4-9 years of experience as a Data Engineer or in a similar role. Proficiency in programming languages such as Python, Java, or Scala for data processing and manipulation. Experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). Strong knowledge of data warehousing concepts and experience with ETL tools (e.g., Apache NiFi, Talend, Informatica). Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and data processing frameworks. Experience with cloud platforms and services (e.g., AWS Redshift, Google BigQuery, Azure Data Lake). Understanding of data modeling and data architecture principles. Excellent problem-solving skills and ability to work with complex data sets.
