- Design, code, and develop new features/fix bugs/add enhancements
- Analyze and improve efficiency, scalability and stability of various system resources
- Lead and Mentor junior engineers and drive a culture of technical perfection.
- Drive creative and innovative solutions to complex problems, exemplifying good technical discernment.
- Drive improvements and new approaches to address potential systemic pain points and technical debt, anticipate and avoid problems.
- Take a hands-on approach in the development of prototypes, independently and with others, to establish design decisions and/or technical feasibility.
-
Evaluate, Install, Setup, Maintain and Upgrade, Data Engineering, Machine Learning and CI/CD infrastructure tools hosted on Cloud (GCP/AWS)
-
Drive the CI/CD infrastructure tooling related work in collaboration with various internal teams to get the user stories, epics, goals to closure
-
Propose, participate, implement architecture level enhancements/changes strategically through Dev/Stage/Prod environments
-
Design, evangelize, deliver comprehensive best practices & efficient usage of available tooling resources/capabilities to run high-performance systems
-
Provide innovative & strategic solutions along with cost & risk analysis, to improve stability, scalability, performance of the tools infrastructure
-
Perform troubleshooting, analysis, and resolution of environmental issues
-
Innovate and automate processes/tasks to improve operational efficiency
-
Document and maintain application setup, runbooks, administration guides and troubleshooting guides
Required Skills:
Proficiency with a deep learning framework such as TensorFlow
Experience in building data engineering pipelines
Experience in Python, Spark/PySpark/Hadoop.
Understanding or hands on experience with ML Platforms like Google Vertex AI.
Expertise in building Cloud Native application (GCP/AWS)
Programming Skills
o Algorithms
o Design Skills
o Refactoring Skills
o Debugging Skills
o Unit testing Skills
CI/CD
o Jenkins
o Github Actions
Database
o SQL Databases (Oracle/MySQL/MSSQL etc.,)
o No SQL Databases
o Data Lake, Snowflake, Big Query
Education:
Graduate in any discipline
Experience:
5 - 7 Years.
EXPERIENCE
SKILLS
- Primary Skill: Data Engineering
- Sub Skill(s): Data Engineering
- Additional Skill(s): Big Data