We are seeking a Data Engineer to play a crucial role in designing, constructing, and maintaining scalable data systems and infrastructure. Your primary responsibilities will include collaborating with various teams to gather requirements, develop data pipelines, and establish best practices for data governance, security, and analytics. This position presents an exciting opportunity to shape the core of our data environment and directly impact how we harness data for business insights and innovation. In this role, you will architect and implement data solutions by designing and constructing scalable data platforms using cloud services such as AWS, Azure, or GCP, along with on-premises technologies. You will be tasked with developing best practices for data storage, ingestion, and processing, both in batch and streaming formats. Your expertise will be instrumental in creating and managing robust ETL/ELT workflows that handle various data types while optimizing data pipelines for reliability, scalability, and performance. Furthermore, you will be responsible for defining and enforcing data governance policies, ensuring compliance with relevant data privacy regulations, and implementing metadata management and cataloging solutions. Automating the detection of new data sets, schema changes, and lineage updates will be a key aspect of your role. Additionally, you will establish automated checks and alerts for data quality, completeness, and consistency, troubleshooting and resolving data-related issues as needed. Your collaboration skills will be put to the test as you work closely with cross-functional stakeholders to translate requirements into scalable technical solutions. Qualifications for this role include a Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent experience, along with at least 4 years of hands-on experience in data engineering or related fields. Technical skills essential for this position include proficiency in cloud platforms, distributed data processing tools, SQL, programming languages, real-time data streaming solutions, data modeling, and modern data architecture patterns. Experience with data governance, security, and data quality frameworks is highly desirable. Soft skills such as excellent communication, stakeholder management, and the ability to explain complex technical concepts to diverse audiences are crucial for success in this role. Certifications in cloud platforms, infrastructure-as-code, orchestration tools, and containerization for data engineering pipelines are considered advantageous. If you are passionate about leveraging data for business insights and innovation and possess the technical skills and collaborative mindset required for this role, we encourage you to apply.,
