Specialist Software Engineer - Data

As a Software Developer at our organization, you will be responsible for independently designing components, developing code, and testing case scenarios using Talend on Big Data while adhering to relevant software craftsmanship principles and meeting acceptance criteria. Your role will also involve completing the assigned learning path, participating in team ceremonies such as agile practices, and delivering on all aspects of the Software Development Lifecycle (SDLC) in-line with Agile and IT craftsmanship principles. You will be expected to deliver high-quality clean code and designs that can be re-used, collaborate with other development teams to define and implement data pipelines, and ensure timely communication with counterparts, stakeholders, and partners. Additionally, you will assess production improvement areas, manage and address production loads, and provide suggestions for automating repetitive production activities. Your responsibilities will also include performing bug-free release validations, producing metrics, tests, and defect reports, assisting in developing guidelines, and increasing the coverage of data models, data dictionary, data pipeline standards, and the storage of source, process, and consumer metadata. Strong communication skills and an understanding of the Agile/Scrum development cycle are essential for this role. To be successful in this position, you should have 4 to 5 years of experience in Databricks, Data Factory, ADF, ADB, Hive, PySpark, SparkSQL, DataLake, DataLakeHouse, deltalake, Azure SQL, Logic Apps, KeyValut, Log Analytics and Metrics, ETL & ELT concepts. Hands-on experience with Azure DevOps and an understanding of build and release pipelines will be advantageous. You should be able to extract data from source systems using Data Factory pipelines and workflows in Azure Data Bricks, and have knowledge of error handling and root cause analysis. Furthermore, you are expected to standardize integration and migration flows, develop scalable and reusable frameworks for ingesting and enhancing datasets, possess good analytical and troubleshooting skills, ensure data quality and accuracy through testing and validation, and work effectively in a team with a cross-cultural environment. Effective verbal and written communication skills are crucial for collaborating with all counterparties. If you are looking for a stimulating and caring environment where you can make a positive impact on the future and grow both personally and professionally, we welcome you to join our team. At our organization, we value diversity and inclusion, and we believe that everyone's initiatives play a significant role in shaping the world of tomorrow.,