Senior Engineer, Data Engineering

About the Role

We are looking for a Senior Data Engineer

with experience in excellent analytical

abilities in GCP BigQuery, ETL/BI, Python,

Composer/Airflow, SQL, GCP Services

with the ability to operate in an agile

environment and keen to detail while

understanding the larger data warehouse.

Skills & Competencies

A minimum of 4.5+ years of

working experience as a hands-on

data engineering is a must

Advanced Degree in the field of

Computer Science, Data

Engineering, Data Analytics or

equivalent discipline

Strong programming experience

with Python, SQL, ETL and

efficiently querying big datasets

using SQL

Prior experience with CircleCI

CI/CD, Terraform and Github

version control is a must

Solid understanding of Data

Collection, Data Ingestion, Data

Integration, and Data Operations

& Maintenance

Implement data governance

practices, including data quality,

security, and compliance, in line

with organizational standards.

Domain knowledge on News,

Media & Communications is an

added advantage

R E S P O N S I B I L I T I E S

Design, build, and maintain scalable

ETL/ELT pipelines in Google Cloud, using

tools like Cloud Composer (Airflow), and

BigQuery.

Collaborate with cross-functional teams to

define data architecture and data

warehouse requirements

Automate data pipelines, ETL/ELT

processes, and data integration workflows

using infrastructure-as-code (IaC) and

configuration management tools

Deep understanding of BigQuery,

including SQL, optimization techniques,

partitioning, clustering, and performance

tuning.

Deliver production quality, modular,

reproducible code in Python, SQL

Implement continuous integration and

continuous deployment (CI/CD) pipelines

for data pipelines and data-related

applications

Keep abreast of the latest developments

in the field through continuous learning

and proactively champion promising new

methods relevant to the problems at hand.

Our Tech Stack

Google Cloud Platform is IaaS

BigQuery, GCS, Python, SQL

Composer / Airflow orchestration

tools

Terraform, CircleCI, CI/CD, GIthub,

Jira, Confluence

This job is posted with NTS Technology Services Pvt. Ltd.

Job Category:

News Corp is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content to consumers throughout the world. The company comprises businesses across a range of media, including: news and information services, book publishing, digital real estate services, cable network programming in Australia, and pay-tv distribution in Australia.

Headquartered in New York, the activities of News Corp are conducted primarily in the United States, Australia, and the United Kingdom.