Associate Data Engineer

Associate Data Engineer

Roles & Responsibilities

• Data Solution Development:

  Design, develop, and maintain data solutions for data generation, collection, and processing. You will be a key team member in the design and development of data pipelines and will create

  ETL

  processes to migrate and deploy data across systems.

• Collaboration & Requirements:

  Collaborate effectively with cross-functional and product teams to understand data requirements and design solutions that meet business needs. You will also participate in sprint planning meetings and provide estimations on technical implementation.

• Data Modeling & Security:

  Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency. You will also implement data security and privacy measures to protect sensitive data.

• Cloud & Technology:

  Leverage cloud platforms (

  AWS

  preferred) to build scalable and efficient data solutions. You will explore new tools and technologies to improve

  ETL

  platform performance and adhere to best practices for coding, testing, and designing reusable code.

Qualifications

• A Bachelor's degree with 0-3 years of experience or a Diploma with 4-7 years of experience in Computer Science, IT, or a related field.

• Must-Have Skills:

• Hands-on experience with

  big data

  technologies and platforms such as

  Databricks

  and

  Apache Spark

  (

  PySpark, SparkSQL

  ).
• Proficiency in data analysis tools like

  SQL

  for extracting, transforming, and analyzing complex datasets.
• Experience with

  ETL

  tools and various

  Python

  packages related to data processing.

• Good-to-Have Skills:

• Experience with data modeling, performance tuning on relational and graph databases.
• Knowledge of

  Python/R, Databricks, SageMaker

  , or other cloud data platforms.
• Experience with software engineering best practices, including

  CI/CD

  and automated testing.

• Professional Certifications:

• AWS Certified Data Engineer

  or

  Databricks Certificate

  is preferred.

Soft Skills

• Problem-Solving:

  Excellent critical-thinking and problem-solving skills, with the ability to identify and resolve complex data-related challenges.

• Communication:

  Strong communication and collaboration skills, with a demonstrated ability to function in a team setting.

• Initiative:

  A high degree of initiative and self-motivation, with a proactive approach to exploring new technologies.