Data Architect

About Solidatus

At Solidatus, we’re changing how organisations understand their data. We’re an award-winning, venture-backed software company—often called the ‘Git for Metadata.’ Our platform helps businesses harvest, model, and visualise complex data lineage flows. Our unique lineage-first approach, combined with active AI development, provides organisations with unparalleled clarity and robust control over their data’s journey and meaning. As a growing B2B SaaS business (<100 employees), your work here directly shapes our product. People know us for innovation and a great, collaborative culture. Join us as we expand globally and define the future of data understanding!

Role Overview

We are seeking an experienced Data
Pipeline Engineer
/ Data Lineage Engineer
to assist in the preparation of data lineage solutions for our client’s existing data pipelines. This role involves collaborating with cross-functional teams to ensure the integrity, accuracy and timeliness of their data lineage solution. You will be working directly with our clients helping them get the maximum value from our product and ensuring they achieve their contractual goals.

Experience
(4-10 years)

QUALIFICATIONS

• Proven experience as a Data Engineer, or in a similar role, with hands-on experience building and optimizing data pipelines and infrastructure.

• Proven experience working with Big Data and tools used to process Big Data

• Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues.

• Solid understanding of data engineering principles and practices.

• Excellent communication and collaboration skills to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

• Ability to adapt to new technologies, tools, and methodologies in a dynamic and fast-paced environment.

• Ability to write clean, scalable, robust code using python or similar programming languages. Background in software engineering a plus.

DESIRABLE LANGUAGES/TOOLS

• Proficiency in programming languages such as Python, Java, Scala, or SQL for data manipulation and scripting.

• Experience of using XML in transformation pipelines

• Experience of major Data Base technologies e.g, Oracle, Snowflake, MS SQL Server

• Strong understanding of data modelling concepts and techniques, including relational and dimensional modelling.

• Experience in big data technologies and frameworks such as Databricks, Spark, Kafka, and MS Notebooks.

• Experience in using modern data architectures, such as lakehouse.

• Experience with CI/CD pipelines and version control systems like Git.

• Knowledge of ETL tools and technologies such as Apache Airflow, Informatica, or SSIS.

• Knowledge of data governance and best practices in data management.

• Familiarity with cloud platforms and services such as AWS, Azure, or GCP for deploying and managing data solutions.

• Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues.

• SQL (for database management and querying)

• Open Lineage

• Apache Spark Streaming, Kafka or similar (for real-time data streaming)

• Experience using data tools in at least one cloud service - AWS, Azure or GCP (e.g. S3, EMR, Redshift, Glue, Azure Data Factory/Fabric, Databricks, BigQuery, Dataflow, Dataproc

Key Responsibilities

• Implement robust data lineage solutions based upon
  Solidatus products that support business intelligence, analytics, and data governance initiatives.

• Collaborate with stakeholders to understand data lineage requirements and translate them into technical and business solutions.

• Develop and maintain
  lineage data models, semantic metadata systems, and data dictionaries.

• Ensure data quality, security, and compliance with relevant regulations.

• Understand Solidatus implementation and data lineage modelling best practice and ensure that it is followed at our clients.

• Stay abreast of emerging technologies and industry trends to continuously improve data lineage architecture practices.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.

• Proven experience in data architecture, with a focus on large-scale data systems with more than one company.

• Proficiency in data modelling, database design, and data warehousing concepts.

• Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark).

• Strong understanding of data governance, data quality, and data security principles.

• Excellent communication and interpersonal skills, with the ability to work effectively in a collaborative environment

Why Join Solidatus?

• Be part of an innovative company shaping the future of data management.

• Collaborate with a dynamic and talented team in a supportive work environment.

• Opportunities for professional growth and career advancement.

• Flexible working arrangements, including hybrid work options.

• Competitive compensation and benefits package.

Application Process:
If you're passionate about data architecture and eager to make a significant impact, we'd love to hear from you. Apply now to join our team at Solidatus.