Azure Data Engineer

As a Data Engineer, you should have 8-12 years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer. A bachelor's degree in Computer Science, Information Technology, Engineering, or a related field is required. You must be proficient in Python, SQL, and have a deep understanding of PySpark. Additionally, expertise in Databricks or similar big data solutions is necessary. Strong knowledge of ETL/ELT frameworks, data structures, and software architecture is expected. You should have proven experience in designing and deploying high-performance data processing systems and extensive experience with Azure cloud data platforms. Your responsibilities as a Data Engineer will include: - Designing, constructing, installing, testing, and maintaining highly scalable and robust data management systems. - Applying data warehousing concepts to design and implement data warehouse tables in line with business requirements. - Building complex ETL/ELT processes for large-scale data migration and transformation across platforms and Enterprise systems such as Oracle ERP, ERP Fusion, and Salesforce. - Extracting data from various sources like APIs, JSONs, and Databases. - Utilizing PySpark and Databricks within the Azure ecosystem to manipulate large datasets, improve performance, and enhance scalability of data operations. - Developing and implementing Azure-based data architectures consistent across multiple projects while adhering to best practices and standards. - Leading initiatives for data integrity and normalization within Azure data storage and processing environments. - Evaluating and optimizing Azure-based database systems for performance efficiency, reusability, reliability, and scalability. - Troubleshooting complex data-related issues within Azure and providing expert guidance and support to the team. - Ensuring all data processes adhere to governance, data security, and privacy regulations. Qualifications required for this role: - 8-12 years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer. - Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. - Proficiency in Python, SQL, and a deep understanding of PySpark. - Expertise in Databricks or similar big data solutions. - Strong knowledge of ETL/ELT frameworks, data structures, and software architecture. - Proven experience in designing and deploying high-performance data processing systems and extensive experience with Azure cloud data platforms.,