About Solidatus
At Solidatus , we re changing how organisations understand their data. We re an award-winning, venture-backed software company often called the Git for Metadata. Our platform helps
businesses harvest, model, and visualise complex data lineage flows. Our unique lineage-first approach, combined with active AI development, provides organisations with unparalleled clarity and robust control over their data s journey and meaning. As a growing B2B SaaS business (
great, collaborative culture. Join us as we expand globally and define the future of data
understanding!
Role Overview
We are seeking an experienced Data
Pipeline Engine er
/ Data Lineage Engineer
to assist in the preparation of data lineage solution s
for our client s existing data pipelines . This role involves collaborating with cross-functional teams to ensure the integrity, accuracy and timeliness of their data lineage solution . You will be working directly with our clients helping them get the maximum value from our product and ensuring they achieve their contractual goals.
Experience
(4-10 years)
QUALIFICATIONS
- Proven experience as a Data Engineer, or in a similar role, with hands-on experience building and optimizing data pipelines and infrastructure.
- Proven experience working with Big Data and tools used to process Big Data
- Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues.
- Solid understanding of data engineering principles and practices.
- Excellent communication and collaboration skills to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
- Ability to adapt to new technologies , tools, and methodologies in a dynamic and fast-paced environment.
- Ability to write clean, scalable, robust code using python or similar programming languages. Background in software engineering a plus.
DESIRABLE LANGUAGES/TOOLS
- Proficiency in programming languages such as Python, Java, Scala, or SQL for data manipulation and scripting.
- Experience of using XML in transformation pipelines
- Experience of major Data Base technologies e.g , Oracle, Snowflake, MS SQL Server
- Strong understanding of data modelling concepts and techniques, including relational and d imensional modelling.
- Experience in big data technologies and frameworks such as Databricks, Spark, Kafka, and MS Notebooks .
- Experience in using modern data architectures, such as lakehouse .
- Experience with CI/CD pipelines and version control systems like Git.
- Knowledge of ETL tools and technologies such as Apache Airflow, Informatica, or SSIS .
- Knowledge of data governance and best practices in data management.
- Familiarity with cloud platforms and services such as AWS, Azure, or GCP for deploying and managing data solutions.
- Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues.
- SQL (for database management and querying)
- Apache Spark Streaming, Kafka or similar (for real-time data streaming)
- Experience using data tools in at least one cloud service - AWS, Azure or GCP (e.g. S3, EMR, Redshift, Glue, Azure Data Factory /Fabric , Databricks, BigQuery , Dataflow, Dataproc
Key Responsibilities
- I mplement robust data lineage solutions based upon
Solidatus products that support business intelligence, analytics, and data governance initiatives.
- Collaborate with stakeholders to understand data lineage requirements and translate them into technical and business solutions .
- Develop and maintain
lineage data models, semantic metadata systems, and data dictionaries.
- Ensure data quality, security, and compliance with relevant regulations.
- Understand Solidatus implementation and data lineage modelling best practice and ensure that it is followed at our clients.
- Stay abreast of emerging technologies and industry trends to continuously improve data lineage architecture practices.
Qualifications
- Bachelor's or Master's degree in Computer Science , Information Systems, or a related field.
- Proven experience in data architecture, with a focus on large-scale data systems with more than one company.
- Proficiency in data modelling, database design, and data warehousing concepts.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark).
- Strong understanding of data governance, data quality, and data security principles.
- Excellent communication and interpersonal skills, with the ability to work effectively in a collaborative environmen t
Why Join Solidatus ?
- Be part of an innovative company shaping the future of data management.
- Collaborate with a dynamic and talented team in a supportive work environment.
- Opportunities for professional growth and career advancement.
- Flexible working arrangements, including hybrid work options.
- Competitive compensation and benefits package.
Application Process:
If you're passionate about data architecture and eager to make a significant impact, we'd love to hear from you. Apply now to join our team at Solidatus .
