Senior Data Engineer

As a Data Bricks and Python Engineer at Oracle FSGIU - Finergy, your role involves designing, developing, testing, and deploying high-performance and scalable data solutions using Python, PySpark, and SQL. You will collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. It is important to implement efficient and maintainable code following best practices and coding standards. Your key responsibilities include: - Working with the Databricks platform for big data processing and analytics. - Developing and maintaining ETL processes using Databricks notebooks. - Implementing and optimizing data pipelines for data transformation and integration. - Staying updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks. - Sharing knowledge with the team and contributing to a culture of continuous improvement. - Utilizing expertise in SQL to design, optimize, and maintain relational databases. - Writing complex SQL queries for data retrieval, manipulation, and analysis. Qualifications required for this role: - 4 to 8 years of experience in Databricks and big data frameworks. - Advanced proficiency in AWS, including EC2, S3, and container orchestration (Docker, Kubernetes). - Proficient in AWS services and data migration. - Experience in Unity Catalogue. - Familiarity with batch and real-time processing. - Data engineering with strong skills in Python, PySpark, and SQL. In summary, as a Data Databricks and Python Engineer at Oracle FSGIU - Finergy, you will play a crucial role in developing high-performance data solutions, collaborating with cross-functional teams, and staying updated on the latest industry trends to contribute to the success of the Finergy division within Oracle FSGIU.,