Job Description

About Us PibyThree (πby3) is a Global Cloud Consulting & Services provider founded by tenured IT professionals from the industry. PibyThree's expertise is in Cloud Transformation, Cloud FinOps, IT Automation, Application Modernization and Data & Analytics. The mission is to make businesses successful, leveraging technology for automation and enhanced productivity Job Summary: We are seeking an experienced Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Snowflake, and data warehousing concepts. The Data Engineer will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures. Key Responsibilities Design, develop, and deploy data pipelines using Azure Data Factory (ADF) Work with Snowflake to design and implement data warehousing solutions Collaborate with cross-functional teams to identify and prioritize data requirements Develop and maintain data architectures, data models, and data governance policies Ensure data quality, security, and compliance with regulatory requirements Optimize data pipelines for performance, scalability, and reliability Troubleshoot data pipeline issues and implement fixes Stay up-to-date with industry trends and emerging technologies in data engineering Requirements 4+ years of experience in data engineering, with a focus on cloud-based data platforms (Azure preferred) 2+ years of hands-on experience with Azure Data Factory (ADF) 1+ year of experience working with Snowflake Strong understanding of data warehousing concepts, data modeling, and data governance Experience with data pipeline orchestration tools such as Apache Airflow or Azure Databricks Proficiency in programming languages such as Python, Java, or C# Experience with cloud-based data storage solutions such as Azure Blob Storage or Amazon S3 Strong problem-solving skills and attention to detail Excellent communication and collaboration skills Nice To Have Experience with data discovery and metadata management tools such as Azure Purview or Alation Knowledge of data security and compliance frameworks such as GDPR or HIPAA Experience with containerization using Docker and Kubernetes Certification in Azure Data Factory, Snowflake, or other relevant technologies Skills: amazon s3,c#,data warehousing,java,azure databricks,data governance,pyspark,data pipeline orchestration,azure blob storage,azure data factory,snowflake,data bricks,apache airflow,data modeling,python Show more Show less