Data Engineer III

Job responsibilities

• Supports review of controls to ensure sufficient protection of enterprise data
• Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request
• Updates logical or physical data models based on new use cases
• Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
• Adds to team culture of diversity, opportunity, inclusion, and respect

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience, Bachelor's degree required.

• Azure Data Factory (ADF), Integration Run Time (IR), File System Data Ingestion, Relational Data Ingestion

  .
• Migrating SQL database

  to Azure data Lake, Azure data lake Analytics, Azure Data Factory, Azure SQL Database, Data Bricks and Azure SQL Data warehouse

  .
• Experience in Developing Spark applications using Spark - SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
• Solid understanding of agile methodologies, CI/CD, Non-Functional requirements like Resiliency, performance and Security.
• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, etc.)

• Independent and self-motivated
• Strong interpersonal and communication skills
• Exposure to cloud technologies