Software Engineer III PySpark, Databricks

As a Software Engineer III at JPMorgan Chase within the Corporate Technology, you will be part of an agile team responsible for designing and delivering trusted market-leading technology products in a secure, stable, and scalable manner. Your role involves executing software solutions, technical troubleshooting, and creating secure production code that aligns with design constraints. Additionally, you will contribute to the continuous improvement of software applications and systems through data analysis and insights. **Key Responsibilities:** - Execute software solutions and troubleshoot technical issues with innovative problem-solving approaches - Develop and maintain high-quality production code that runs synchronously with appropriate systems - Produce architecture and design artifacts for complex applications, ensuring compliance with design constraints - Analyze and synthesize data sets to create visualizations and reports for software application enhancements - Proactively identify data patterns and issues to improve coding hygiene and system architecture - Contribute to software engineering communities of practice and events exploring new technologies - Foster a team culture of diversity, equity, inclusion, and respect **Qualifications Required:** - Formal training or certification in software engineering concepts with a minimum of 3 years of practical experience - Over 4 years of hands-on experience with Spark, SQL, Databricks, and the AWS cloud ecosystem - Proficiency in Apache NiFi, Lakehouse/Delta Lake architectures, system design, application development, testing, and operational stability assurance - Strong programming skills in PySpark and SparkSQL, along with expertise in orchestration using Airflow - Thorough understanding of Big Data, data warehousing concepts, and experience with CI/CD processes - Solid grasp of agile methodologies, DevOps practices, application resiliency, and security measures - Demonstrated knowledge of software applications and technical processes in areas like cloud, artificial intelligence, and machine learning **Additional Details:** - The preferred qualifications include familiarity with Snowflake, Terraform, and LLM, as well as exposure to AWS Glue, S3, SQS, SNS, Lambda, etc. - AWS certifications like SAA, Associate Developer, Data Analytics Specialty, or Databricks certification are advantageous.,