Assistant Manager - Brand Marketing-Data Engineering-Cloud Data Engineering

Role Overview: As a Data Engineer Consultant, your primary responsibility will be designing, developing, and maintaining data assets and data-related products. You will collaborate with multiple stakeholders to ensure the successful implementation of data workflows. Key Responsibilities: - Write Pyspark scripts to develop data workflows efficiently. - Utilize SQL to query metadata and tables from various data management systems like Oracle, Hive, Databricks, and Greenplum. - Use big data technologies such as Hadoop, Spark, and distributed computing frameworks. - Communicate effectively with stakeholders and work closely with the business team for data testing. - Establish comprehensive data quality test cases, procedures, and implement automated data validation processes. - Collaborate with the team to automate data workflows using tools like Hue and Apache Oozie. - Apply problem-solving and troubleshooting skills to resolve data-related issues. Qualifications Required: - Strong knowledge of Python and Pyspark. - Proficiency in SQL, Hadoop, Hive, Azure, Databricks, and Greenplum. - Familiarity with big data technologies and distributed computing frameworks. - Degree in Data Science, Statistics, Computer Science, or related fields. - 5-7 years of experience in Data Engineering. - Proficiency in programming languages like Python, Pyspark, and SQL. - Experience in Azure cloud computing platform, including Azure Data Factory and Azure Databricks. - Excellent communication, problem-solving, and analytical skills with strong attention to detail and accuracy.,