Data Specialist

• Bachelors degree in computer science or a related field

• At least 6+ years of experience in Software engineering

• Strong skills in SQL (Minimum 2+ years of recent experience)

• At least 2+ years of experience recent experience in programming - Python development

• Experience with relational databases such as Snowflake, MySQL or PostgreSQL

• Experience with designing and developing software applications for cloud computing platforms such as AWS.

• Good in Communication

• Should also have experience with Python frameworks, such as Pandas, NumPy, and Pyramid.
• A solid understanding of fundamental computer science principles, including data structures and algorithms, is necessary.
• Capable of thriving in high-pressure situations and delivering results within tight time constraints.
• Demonstrated passion for technology coupled with an eagerness to contribute to a collaborative team environment.

Roles responsibilities

• Responsible for developing and maintaining Data engineering processes, Python applications and services.
• Responsible for data analysis validations on data process migrations.
• Troubleshooting and debugging code
• Deploying applications to production.
• Working with DevOps teams to ensure that applications are running smoothly.

Skill/Tool level detail:

Top candidates will have proven experience in the following

• Designing, creating, deploying, and sustaining software solutions on a large scale.
• Implementing application architectural patterns, including but not limited to MVC, Microservices, and Event-driven architectures.
• Utilizing CI/CD tools such as Azure DevOps, Jenkins, GoCD, etc., for seamless software deployment.
• Deploying and managing software on public cloud platforms like

  AWS

  .
• Collaborating within an Agile framework, preferably following Scrum methodologies.
• Proficiency in managing and deploying applications using container orchestration tools, specifically

  ECS (Elastic Container Service).

  Good understanding of Docker fundamentals.
• Other AWS services like

  Lambda, cloudformation, cloudwatch, S3.

• Good working knowledge on Python modules like

  Pandas, Numpy, mutlithreading, requests

  , etc
• Possess a solid understanding of version control systems, with a particular focus on

  GIT

  .
• Proficiency with

  SQL

  .

Good to have

• Proficient in managing diverse data stores, including Snowflake, Elasticsearch, MySQL, and Oracle.
• Well-versed in developing Snowflake procedures, tasks, and other Snowflake components.
• Experienced in working with message brokers such as AWS SQS and AWS SNS.
• Proficient in utilizing batch or stream processing systems, including Apache Spark and AWS Glue.
• Familiarity with scheduling tools like

  Apache Airflow and Perfect

  .
• Skilled in developing and working with Restful APIs.
• Hands-on experience with API tools like Swagger, Postman, and Assertible.
• Advocate of Test-Driven Development (TDD) and Behaviour-Driven Development (BDD).
• Extensive hands-on experience with testing tools like Selenium and Cucumber, with expertise in seamlessly integrating them into CI/CD pipelines.