Senior Engineer, Data Engineering

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, or disability status. EEO/Disabled/Vets

About The Role

We are looking for a Senior Data Engineerwith experience in excellent analyticalabilities in GCP BigQuery, ETL/BI, Python,Composer/Airflow, SQL, GCP Services -with the ability to operate in an agileenvironment and keen to detail whileunderstanding the larger data warehouse.Skills & Competencies? A minimum of 4.5+ years ofworking experience as a hands-ondata engineering is a must? Advanced Degree in the field ofComputer Science, DataEngineering, Data Analytics orequivalent discipline? Strong programming experiencewith Python, SQL, ETL andefficiently querying big datasetsusing SQL? Prior experience with CircleCICI/CD, Terraform and Githubversion control is a must? Solid understanding of DataCollection, Data Ingestion, DataIntegration, and Data Operations& Maintenance? Implement data governancepractices, including data quality,security, and compliance, in linewith organizational standards.? Domain knowledge on News,Media & Communications is anadded advantageR E S P O N S I B I L I T I E S? Design, build, and maintain scalableETL/ELT pipelines in Google Cloud, usingtools like Cloud Composer (Airflow), andBigQuery.? Collaborate with cross-functional teams todefine data architecture and datawarehouse requirements? Automate data pipelines, ETL/ELTprocesses, and data integration workflowsusing infrastructure-as-code (IaC) andconfiguration management tools? Deep understanding of BigQuery,including SQL, optimization techniques,partitioning, clustering, and performancetuning.? Deliver production quality, modular,reproducible code in Python, SQL? Implement continuous integration andcontinuous deployment (CI/CD) pipelinesfor data pipelines and data-relatedapplications? Keep abreast of the latest developmentsin the field through continuous learningand proactively champion promising newmethods relevant to the problems at hand.Our Tech Stack

• Google Cloud Platform is IaaS
• BigQuery, GCS, Python, SQL
• Composer / Airflow - orchestration
  

tools

• Terraform, CircleCI, CI/CD, GIthub,
  

Jira, Confluence
This job is posted with NTS Technology Services Pvt. Ltd.Job Category: