Data Engineer

Role Overview: As a Data Engineer at WAC, you will play a pivotal role in ensuring the availability, reliability, and scalability of the data infrastructure. You will collaborate closely with cross-functional teams to support data-driven initiatives, enabling data scientists, analysts, and business stakeholders to access high-quality data for critical decision-making. Key Responsibilities: - Design, develop, and maintain efficient ETL (Extract, Transform, Load) processes and data pipelines to collect, process, and store data from various sources. - Create and manage data warehouses and data lakes, optimizing storage and query performance for both structured and unstructured data. - Implement data quality checks, validation processes, and error handling to ensure data accuracy and consistency. - Administer and optimize relational and NoSQL databases, ensuring data integrity and high availability. - Identify and address performance bottlenecks in data pipelines and databases to improve system efficiency. - Implement data security measures and access controls to protect sensitive data assets. - Collaborate with data scientists, analysts, and stakeholders to understand data needs and provide support for analytics and reporting projects. - Maintain clear and comprehensive documentation for data processes, pipelines, and infrastructure. - Monitor data pipelines and databases, proactively identify issues, and troubleshoot and resolve data-related problems in a timely manner. Qualifications Required: - Bachelor's degree in Computer Science, Information Technology, or a related field (advanced degrees are a plus). - 4+ years of experience in data engineering roles. - Proficiency in programming languages such as Python, Java, or Scala. - Experience with data warehousing solutions (e.g., AWS Redshift, Google BigQuery) and database systems (e.g., PostgreSQL, MongoDB). - Strong knowledge of ETL processes, data integration, and data modeling. - Familiarity with data orchestration and workflow management tools (e.g, Apache Airflow). - Understanding of data security best practices and data governance principles. - Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment. - Strong communication skills and the ability to explain complex technical concepts to non-technical team members.,