Data Engineer

As a Data Engineer, you will be responsible for the following: - Proficient in Python including popular python packages such as Pandas, NumPy, etc., and SQL. - Strong background in distributed data processing and storage using technologies like Apache, Spark, Hadoop. - Demonstrated skills in large scale (TBs of data) data engineering including modeling data and creating production-ready ETL pipelines. - Development experience with at least one cloud platform, with a high preference for Azure and familiarity with AWS, GCP. - Knowledge of data lake and data lake house patterns. - Expertise in ETL performance tuning and cost optimization. - Understanding of data structures, algorithms, and implementation of good software engineering practices. Nice to Have: - Experience with Azure Databricks. - Knowledge of DevOps for ETL pipeline orchestration. - Tools: GitHub actions, Terraform, Databricks workflows, Azure DevOps. - Certifications in Databricks, Azure, AWS, GCP are highly preferred. - Familiarity with code version control using Git. Please note that the job offers a hybrid work mode and requires a notice period of immediate availability. As a Data Engineer, you will be responsible for the following: - Proficient in Python including popular python packages such as Pandas, NumPy, etc., and SQL. - Strong background in distributed data processing and storage using technologies like Apache, Spark, Hadoop. - Demonstrated skills in large scale (TBs of data) data engineering including modeling data and creating production-ready ETL pipelines. - Development experience with at least one cloud platform, with a high preference for Azure and familiarity with AWS, GCP. - Knowledge of data lake and data lake house patterns. - Expertise in ETL performance tuning and cost optimization. - Understanding of data structures, algorithms, and implementation of good software engineering practices. Nice to Have: - Experience with Azure Databricks. - Knowledge of DevOps for ETL pipeline orchestration. - Tools: GitHub actions, Terraform, Databricks workflows, Azure DevOps. - Certifications in Databricks, Azure, AWS, GCP are highly preferred. - Familiarity with code version control using Git. Please note that the job offers a hybrid work mode and requires a notice period of immediate availability.