Area Manager-Data Engineering-Cloud Data Engineering

As a Data Engineer, your role will involve designing, developing, and maintaining scalable and efficient data pipelines using PySpark and Databricks. You will be responsible for performing data extraction, transformation, and loading (ETL) from diverse structured and unstructured data sources. Additionally, you will develop and maintain data models, data warehouses, and data marts in Databricks. Key responsibilities for this role include: - Proficiency in Python, Apache Spark, and PySpark - Integrating third party data from multiple sources with internal data - Writing and optimizing complex SQL queries for high performance and scalability across large datasets - Collaborating closely with data scientists, analysts, and business stakeholders to gather and understand data requirements - Ensuring data quality, consistency, and integrity throughout the data lifecycle using validation and monitoring techniques - Developing and maintaining modular, reusable, and well-documented code and technical documentation for data workflows and processes - Implementing data governance, security, and compliance best practices No additional details about the company were provided in the job description. As a Data Engineer, your role will involve designing, developing, and maintaining scalable and efficient data pipelines using PySpark and Databricks. You will be responsible for performing data extraction, transformation, and loading (ETL) from diverse structured and unstructured data sources. Additionally, you will develop and maintain data models, data warehouses, and data marts in Databricks. Key responsibilities for this role include: - Proficiency in Python, Apache Spark, and PySpark - Integrating third party data from multiple sources with internal data - Writing and optimizing complex SQL queries for high performance and scalability across large datasets - Collaborating closely with data scientists, analysts, and business stakeholders to gather and understand data requirements - Ensuring data quality, consistency, and integrity throughout the data lifecycle using validation and monitoring techniques - Developing and maintaining modular, reusable, and well-documented code and technical documentation for data workflows and processes - Implementing data governance, security, and compliance best practices No additional details about the company were provided in the job description.