Implement data quality checks, validation rules, and monitoring to ensure data accuracy, integrity, and security. Contribute to data governance initiatives.

Continuously monitor and enhance database and query performance, identifying opportunities to streamline and improve data retrieval times.

Define and design frameworks for monitoring data quality and data pipelines

Monitor Google BigQuery consumption.

Evaluate, select, and integrate new tools and technologies to enhance data capabilities. Automate manual processes to improve efficiency and accuracy.

Mentor junior engineers, sharing best practices in data engineering and analysis, and helping to build a culture of technical excellence within the team.

Proactively lead streams of data engineering work, collaborating with stakeholders and other non-engineering roles to come up with creative solut ions to the problems your team is presented with.

Work with both data producers and consumers to optimise existing data products and the data within them to meet evolving business needs.

Work collaboratively with other engineers, u sing t echniques like pair and ensemble programming, to foster collective ownership and help upskill, reskill and learn from other team members.

Help guide technology choices, adopting company-standard tech stacks by default while responsibly investig ating alternative tools and services and looking for opportunities to innovate.

Skills & experience:

Technologies you will be working with:

SQL, Python, Google Cloud Platform (GCP), and Google BigQuery

Data pipeline tools such as Apache Airflow and DBT

Data modeling concepts, including dimensional and star schema design

Data visualization tools like Looker

Essential:

Several years of experience in D ata / Software eng ineering on a cloud platform.

An understanding of data and distributed systems concepts.

Several years of experience working with data from large ERP systems.

Knowledge of data quality concepts and experienc e using too ls to identify data quality problems and come up w ith strategies to tackle them.

Experience working with iterative software development principles:

Continuous Integration & Deployment (CI/CD)

Automated testing at different levels

Collaborative development techniques like pair and ensemble programming

Experience owning software systems and/or data pipelines end-to-end, having full responsibility for operating them in production a nd responding to problems that arise.

The ability to work with stakeholders and other non-technical roles to translate business requirements into technical work , and conversely to articulate necessary technical work to the same people for prioritisation.

High competence in SQL and deep experience of at least one programming language e.g. Python, Java

Desirable:

Experience with decentralised Data Mesh and Data Product architecture principles.

Experience building and testing data pipelines with DBT

Understanding and experience of User-Centric Design principles

What you will be doing:

1 month:

Actively contributing to the codebase in collaboration with other engineers and deploying changes into production

Familiarising yourself with our tech stack and processes

Starting to understand the data landscape in and around your team

Getting to know the various stakeholders and their general requirements

Collaborating effectively with each discipline on the team

Participating in technical discussions and sharing ideas

3 months:

Gaining an understanding of the team s context within the wider organisation

Leading a stream of work, working with both engineers and stakeholders

Triaging support queries and diagnosing issues in live data pipelines

Setting the technical direction of the work done by the team

Holding discussions w ithin the engine ering team in order to improve product architecture and code quality

Ensuring that data is stored securely and in compliance with GDPR

6 months:

Take ownership of key projects and drive initiatives to enhance data capabilities .

Switching context between multiple streams of work, providing guidance to both developers and stakeholders

Fostering a culture of continuous feedback, giving and rece iving constructive feedback within your team , and proactively improving ways of working

Mentoring others in the principles of data engineering and best practices and looking for opportunities to help other engineers on the team grow

Arbitrating disagreements within the team and not avoiding difficult conversations

Gauging the complexity and scope of a piece of work, breaking it into smaller pieces when appropriate with a focus on iteratively delivering value to end users

More Jobs at Biomed Central Ltd

Project Manager

new delhi, pune

3.0 - 9.0 yrs

INR 7 - 11 Lacs

HRIS Integrations Specialist

pune

2.0 - 6.0 yrs

INR 7 - 11 Lacs

Senior Data Engineer

pune

2.0 - 6.0 yrs

INR 4 - 8 Lacs

Senior UX Designer

pune

2.0 - 6.0 yrs

INR 4 - 8 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.