Cognite Data Engineer- EXP: 4 to 12 years Across PAN India

Job Title: Data Engineer

Cognite Data Fusion

Position Overview: As a Junior Data Engineer, you will be instrumental in designing, developing, and maintaining scalable data pipelines and infrastructure. Your primary focus will be on integrating and optimizing data workflows using Cognite Data Fusion and Python, thereby facilitating seamless data accessibility and analysis across the organization.

Key Responsibilities:

• Data Pipeline Development:

  Design, implement, and optimize end-to-end data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.

• Data Integration:

  Utilize Cognite Data Fusion to automate and scale the contextualization of various data sources, ensuring efficient data integration and accessibility.

• Programming:

  Develop robust ETL processes and data workflows using Python, ensuring code quality, scalability, and maintainability.?

• Collaboration:

  Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.?

• Data Quality Assurance:

  Implement data validation and quality checks to ensure accuracy, consistency, and reliability of data.?

• Documentation:

  Maintain comprehensive documentation of data processes, workflows, and system architectures.?

• Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.?

• Proficiency in Python programming language.?

• Familiarity with data integration platforms
• Understanding of data modelling, database design, and data warehousing concepts.?

• Experience with SQL and working with relational databases.?

• Basic knowledge of cloud platforms such as AWS or Azure is a plus.?
• Strong problem-solving skills and attention to detail.?
• Excellent communication and collaboration abilities.?

Preferred Qualifications:

• Experience with data pipeline and workflow management tools.?
• Knowledge of big data technologies and frameworks.
• Familiarity with data visualization tools and techniques (Grafana is a plus).