Python Data Engineer

Data Engineer will work on data engineering projects for various business units, focusing on the delivery of complex data management solutions by leveraging industry best practices. They work with the project team to build the most efficient data pipelines and data management solutions that make data easily available for consuming applications and analytical solutions. A Data engineer is expected to possess strong technical skills.

Experience: -

•Knowledge of and skills in various programming languages, primarily Python

•Must have knowledge of Back-end frameworks

•Thorough understanding of containers and functions. Deployment experience with Kubernetes (K8S) or Functions is highly desirable.

•Experience using Cloud Native CI/CD tools (Azure Pipelines/Circle CI/Jenkins X).

•Experience deploying workloads to AWS or Azure with strong knowledge and understanding of the cloud provider's API / associated services and infrastructure

•Experience in test-driven development & writing of unit and integration tests is a must

•Knowledge of other Cloud (Google Cloud Platform, Cloudera, etc), and Integration services technologies is highly desirable.

•Experience working in agile teams with demonstrated application of the principles.

•Demonstrable proficiency in developing complex JavaScript applications.

•Experience of working with lean startup/agile development methodologies

•Strong analytical, problem-solving, and troubleshooting skills.

•Experienced with modern coding, testing, debugging and automation techniques.

•Rave about the benefits of CI/CD

•Have a high bar for user experience and quality.

•You are data-driven and customer-obsessed.

Key Characteristics:

•Availability to solve production issues/taking ownership of interfaces deployed on prod etc

•Understanding in RDBMS and NoSQL databases (e.g., PostgreSQL, MongoDB).

•Ability to troubleshoot and resolve database issues.

•In-depth knowledge and experience in RESTful API interfaces.

•Comprehensive understanding of ETL processes from end-to-end.

•Technology champion who constantly pursues skill enhancement and has an inherent curiosity to understand work from multiple dimensions.

•Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.

•Has worked on real data challenges and handled high volume, velocity, and variety of data.

•Is proficient in designing data integrations and data processes across different types of architecture patterns using native cloud services, or custom application codes

•Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.

•Contributes to community building initiatives like CoE, CoP.