Python Data Engineer

The Data Engineer will work on data engineering projects for various business units, focusing on delivery of complex data management solutions by leveraging industry best practices. They work with the project team to build the most efficient data pipelines and data management solutions that make data easily available for consuming applications and analytical solutions. A Data engineer is expected to possess strong technical skills.

Experience: -

Knowledge of and skills in various programming languages primarily Python

Must to have knowledge on Back-end frameworks

Thorough understanding of containers and functions. Deployment experience with Kubernetes (K8s) or Functions is highly desirable.

Experience using Cloud Native CI/CD tools (Azure Pipelines/Circle CI/Jenkins X).

Experience deploying workloads to AWS or Azure with strong knowledge and understanding of the cloud provider's API / associated services and infrastructure

Experience in test driven development & writing of unit and integration tests is a must

Knowledge of other Cloud (Google Cloud Platform, Cloudera etc), and Integration services technologies is highly desirable.

Experience working in agile teams with demonstrated application of the principles.

Demonstrable proficiency in developing complex JavaScript applications.

Experience of working with lean startup/agile development methodologies

Strong analytical, problem-solving, and troubleshooting skills.

Experienced with modern coding, testing, debugging and automation techniques.

Rave about the benefits of CI/CD

Have a high bar for user experience and quality.

You are data driven and customer obsessed.

Key Characteristics

Availability to solve production issues/taking ownership of interfaces deployed on prod etc

Understanding in RDBMS and NoSQL databases (e.g., PostgreSQL, MongoDB).

Ability to troubleshoot and resolve database issues.

In-depth knowledge and experience in RESTful API interfaces.

Comprehensive understanding of ETL processes from end-to-end.

Technology champion who constantly pursues skill enhancement and has inherent curiosity to understand work from multiple dimensions.

Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.

Has worked on real data challenges and handled high volume, velocity, and variety of data.

Is proficient in designing data integrations and data processes across different types of architecture patterns using native cloud services, or custom application codes

Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.

Contributes to community building initiatives like CoE, CoP.