Data Engineer III

Job responsibilities

• Supports review of controls to ensure sufficient protection of enterprise data. Design and develop data solutions leveraging the Databricks platform, ensuring efficiency, scalability, resiliency and performance.
• Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request. Supports review of controls to ensure sufficient protection of enterprise data. Stay updated on evolving capabilities in the Data Lakehouse space and evaluate and implement the ones that meets our requirements
• Updates logical or physical data models based on new use cases
• Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
• Adds to team culture of diversity, equity, inclusion, and respect

Required qualifications, capabilities, and skills

• Formal training or certification on data engineering concepts and 3+ years applied experience
• Experience across the data lifecycle
• Experience developing application leveraging Python
• Experience across the data lifecycle
• Expertise on SQL (e. g. , joins and aggregations)
• Expertise on Spark and related technologies
• Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
• Experience working in an agile environment

• Experience on AWS cloud platform
• Knowledge of Data Mesh architecture

Job responsibilities

• Supports review of controls to ensure sufficient protection of enterprise data. Design and develop data solutions leveraging the Databricks platform, ensuring efficiency, scalability, resiliency and performance.
• Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request. Supports review of controls to ensure sufficient protection of enterprise data. Stay updated on evolving capabilities in the Data Lakehouse space and evaluate and implement the ones that meets our requirements
• Updates logical or physical data models based on new use cases
• Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
• Adds to team culture of diversity, equity, inclusion, and respect

Required qualifications, capabilities, and skills

• Formal training or certification on data engineering concepts and 3+ years applied experience
• Experience across the data lifecycle
• Experience developing application leveraging Python
• Experience across the data lifecycle
• Expertise on SQL (e. g. , joins and aggregations)
• Expertise on Spark and related technologies
• Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
• Experience working in an agile environment

• Experience on AWS cloud platform
• Knowledge of Data Mesh architecture