Senior Data Engineer

Job Title: Senior Data Engineer

Location:

Position Overview:

Senior Data Engineer

Educational Qualifications:

• Bachelor’s degree in

  Engineering

  ,

  Computer Science

  ,

  Information Technology

  , or a related field.
• A Master’s degree in the relevant domain is an added advantage.
• Degree must be from a recognized university.

Experience Required:

• 3 to 6 years

  of relevant experience in data engineering or related roles.

Key Skills & Competencies:

• Strong programming skills in

  Python

  , with sound knowledge of

  Object-Oriented Programming (OOP)

  .
• Ability to write reusable, scalable, testable, and efficient code.
• Hands-on experience or working knowledge of web frameworks like

  Django

  or

  Flask

  (preferred).
• Experience with

  web scraping

  using tools like BeautifulSoup, Scrapy, or Selenium.
• Proficiency in working with both

  SQL

  and

  NoSQL

  databases.
• Familiarity with

  big data technologies

  like

  Hadoop

  ,

  Spark

  ,

  Talend

  , etc.
• Experience in building

  ETL pipelines

  and integrating data from various sources (web services, file systems, APIs).
• Understanding of

  HTML/XML parsing

  .
• Ability to handle and process both

  structured and unstructured data

  (text, images, etc.).
• Good to have: solid grasp of

  Data Structures and Algorithms

  .
• Comfortable working with

  Microsoft Excel

  for data transformation and automation.

Key Responsibilities:

• Design, build, and maintain

  analytical data systems

  and

  data pipelines

  .
• Collect, clean, transform, and analyse large datasets from multiple sources.
• Convert data from

  MS Excel

  into Python DataFrames or similar structures for automation and analysis.
• Develop ETL scripts to enable smooth data flow across systems.
• Collaborate with

  business stakeholders

  and

  engineering teams

  to define and implement data solutions.
• Translate business requirements into technical specifications.
• Follow

  best coding practices

  and ensure adherence to

  coding standards

  .
• Ensure all

  non-functional requirements

  (scalability, performance, security) are met.
• Participate in

  interface design

  , reporting framework development, and enhancements.
• Maintain accurate and up-to-date

  technical documentation

  .
• Provide regular project/task updates to the

  Project Manager

  .
• Offer constructive feedback and mentorship where applicable.