Software Engineer III Data Engineering

As a Senior Application Engineer in the Planning and Analysis - Data Platform Team (FPNAE), your role involves focusing on managing and optimizing finance-related data through effective data lake utilization, data governance, and seamless data integration. Your goal will be to deliver high-quality, timely data in a controlled manner to reduce risk and cost. You should be skilled in AWS, event-driven architecture, RESTful API design, and modern application development, with expertise in Python frameworks, database management, and Databricks for data engineering. Key Responsibilities: - Design and Develop Cloud-Native Applications: Architect, build, and maintain scalable applications on AWS using event-driven patterns such as Lambda, SNS/SQS, and EventBridge. - API Development: Create robust RESTful APIs using Python frameworks like FastAPI and Django to ensure high performance and security. - Database Engineering: Design, implement, and optimize operational databases, primarily PostgreSQL, including schema design, indexing, and query optimization. - Data Engineering & Analytics: Collaborate with data teams to integrate applications with Databricks, supporting ETL pipelines, data processing, and analytics workflows. - Application Lifecycle Management: Participate in the full software development lifecycle, including requirements gathering, design, coding, testing, deployment, and maintenance. - DevOps & Automation: Implement CI/CD pipelines, automate deployments, and monitor application health using AWS-native and third-party tools. - Collaboration & Documentation: Work closely with cross-functional teams (product, data, infrastructure) and document technical solutions, architecture, and best practices. Required qualifications, capabilities, and skills: - AWS Expertise: Proven experience with AWS services like EC2, Lambda, S3, RDS, SNS/SQS, EventBridge, IAM, and CloudFormation. - Event-Driven Architecture: Strong understanding and practical experience in designing event-driven systems and microservices. - RESTful API Development: Deep knowledge of REST principles and hands-on experience building APIs with FastAPI and Django. - Python Programming: Advanced proficiency in Python, with experience in application engineering and scripting. - Database Management: Solid experience with PostgreSQL, including performance tuning and operational management. - Databricks Knowledge: Good understanding of the Databricks platform, Spark, and data engineering concepts. - DevOps Practices: Experience with CI/CD, infrastructure as code, and application monitoring. - Soft Skills: Excellent problem-solving, communication, and teamwork abilities.,