Data Engineer

Job Description

S&P Global Commodity Insights is looking for an experienced Python, distributed data processing framework Developer (Data Engineer) to join our team, full-time. An ideal candidate will be a key player in the growth and development of this brand new platform. They will a play a role in the planning, development and deployment of the product following the full SDLC. They should be comfortable handling new challenges involving emerging technologies. The candidate must follow best practices for software development and has experience building reusable and maintainable application code for future projects. Development experience with cloud platforms such as Amazon Web Services (AWS), Azure or Google Cloud is desirable. Required Skills & Experience Proven ability to contribute effectively in a software engineering team, working closely with product management, quality engineers, and business analysts. Strong experience with Data Engineering and Big Data technologies such as Databricks, Big Data processing engines and Airflow, including ETL processes. 4+ years of hands-on experience in Python development frameworks. Solid experience with SQL technologies, including PostgreSQL, Oracle, or equivalent databases. Experience with AWS cloud services, as well as message brokering systems and containerization platforms (familiarity with Jenkins is a plus). Exposure to additional programming languages like Java or .Net is an advantage. Demonstrated experience working within an Agile framework, with a focus on continuous improvement and iterative development. Eagerness to work within a highly collaborative team environment, spanning both onshore and offshore locations. Excellent interpersonal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. Basic Qualifications: Bachelor's degree in computer science or a related field. Prior experience in software development, computer engineering, or a similar discipline. Proven ability to work effectively in a team environment, adhering to Agile software development principles. Strong interpersonal and written communication skills. Demonstrated success in managing multiple tasks simultaneously. High energy, self-motivated, and proactive attitude.