Senior Data Engineer

Job Description

• Design, develop, and manage data solutions in an enterprise environment. • Lead the development and optimization of data pipelines and data models within Snowflake. • Work with Python and SQL to build scalable data processing solutions. • Design and implement data warehouses in Snowflake, ensuring efficient data organization and retrieval. • Develop production-ready data ingestion and processing pipelines using Spark, Scala, and Python. • Implement and manage orchestration tools such as Airflow, Informatica, or Automic. • Ensure data governance, metadata management, and data lineage tracking. • Utilize SQL analytical functions to support advanced data analytics. • Develop scripts using Shell scripting and JavaScript for automation and optimization. • Follow CI/CD, automated testing, and performance engineering best practices. • Work with Git, Confluence, and Jira for version control, documentation, and project tracking. • Troubleshoot and resolve data-related issues, ensuring system reliability and efficiency. • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders.