Data Engineer, Specialist

Role Overview: As a Data Engineer at our company, you will be responsible for designing, developing, and optimizing data pipelines and architectures to ensure efficient data processing. Your role will involve working with complex datasets, integrating various data sources, and maintaining high data quality and reliability standards. Key Responsibilities: - Develop and maintain efficient ETL (Extract, Transform, Load) pipelines to handle large datasets from different sources. - Build and manage data storage solutions using both relational and non-relational databases, focusing on high availability, performance, and scalability. - Collaborate with APIs, third-party data sources, and internal databases to create unified datasets that offer valuable insights for business stakeholders. - Partner with business intelligence analysts, data scientists, and software engineers to implement data-driven solutions that align with business requirements. - Design optimized data schemas and structures to support analytical workloads and enhance query performance. - Utilize orchestration tools such as Apache Airflow or Prefect to automate ETL workflows and enhance operational efficiency. - Offer technical guidance, conduct code reviews, and advocate for best practices within the data engineering team. Qualifications Required: - Bachelor's degree in Computer Science, Information Technology, or related field. - Proven experience in designing and optimizing data pipelines and architectures. - Proficiency in working with relational and non-relational databases. - Strong knowledge of ETL processes and data integration techniques. - Familiarity with orchestration tools like Apache Airflow or Prefect. - Excellent collaboration skills and ability to work with cross-functional teams. - Prior experience in providing technical guidance and promoting best practices in data engineering. (Note: No additional details of the company were provided in the job description.),