Etl Developer

Role & responsibilities

Serve as a technical resource in managing and developing governance, process and procedures for the database ETL environment

• Resolve increasingly complex problems and develop and implement solutions where expertise is required to interpret against policies, guidelines or processes
• Collaborate, consult, and present technical information to Environment Management
• Serve as a technical resource in managing and developing governance, process and procedures for the database ETL environment
• Resolve increasingly complex problems and develop and implement solutions where expertise is required to interpret against policies, guidelines or processes
• Collaborate, consult, and present technical information to management as it pertains to the database ETL environment
• Typically referred to as a technical resource and advisor within the database ETL environment
• Mentor junior level engineers and IT staff members
• Design of data processes in Synapse, ADF, and Spark that land, clean and transform data for the ODS
• Ensure the data processes are designed and tuned for optimal performance and make recommendations for change
• Operate with large data volumes and tune for best performance on data loading and transformation
• Design detailed documentation for lakehouse data structures and ensure accuracy is maintained
• Serve as technical resource for data consumers to ensure a data driven culture exists at Cenlar

Preferred candidate profile

• Bachelor's degree in computer science, data engineering, or a related field or equivalent work experience.
• Minimum 5 to 8 years of experience designing, developing, and supporting databases
• Experience in data engineering, data management, or DevOps roles
• Strong ability in programming languages such as Pyspark, Python, C#, Scala or Power BI
• Experience with data storage technologies (e.g., Azure Data stack, SQL on VM and cloud storage solutions such as Azure)
• Proven experience using ADF/Spark/SQL/Synapse/Databricks at a high level
• Experience with data orchestration tools and frameworks (e.g., Apache Airflow)
• Strong ability in version control systems (e.g., Git) and CI/CD pipelines
• Knowledge of cloud data platforms such as Azure and AWS
• Strong problem-solving and troubleshooting skills
• Ability to lead the development and implementation of increasingly complex and multi-faceted data projects
• Strong problem-solving and troubleshooting skills coupled with the ability to recommend and develop process improvement strategies
• Organizational skills with the ability to lead the development and implementation of increasingly complex and multi-faceted data projects
• Highly skilled and motivated team player with demonstrated success in communicating increasingly complex subject matter to all levels of the organization including management