Weekday logo

GCP(Big query + SQL) Data Engineer

Weekday

5 years

14 - 20 Lacs

Chennai

Posted:2 days ago

Job Description

This role is for one of our clients
Industry: Artificial Intelligence
Company Name: Brillio
Seniority level: Mid-Senior Level

Min Experience: 5+ years
Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India JobType: full-time

Roles & Responsibilities:

  • Develop and maintain scalable, cloud-native data processing pipelines on GCP
  • Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
  • Automate infrastructure using Terraform and follow agile development practices
  • Implement data solutions for enterprise-scale data lakes and data warehouses
  • Write clean, efficient, and production-ready code using Python and SQL
  • Handle data quality issues including data duplication and debugging code failures
  • Collaborate with cross-functional teams to build resilient and reliable data platforms

Additional Screening Points:

  • Hands-on experience with debugging/analyzing production issues
  • Exposure to identifying and resolving data duplication or consistency issues
  • Should have worked on end-to-end data pipeline creation and monitoring
  • Experience in the data engineering field is preferred
  • Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
  • Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms.

Hands on Strong Experience in the below technology
1. GBQ Query

2.Python

3. Apache Airflow

4..SQL (BigQuery preferred)

5. Extensive hands-on experience working with data using SQL and Python

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Skills Required

GCP SQL Artificial Intelligence Cloud Native Data Processing Cloud Storage Terraform Agile Development Python Data Quality Debugging Screening

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Artificial Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Weekday logo
Weekday

RecommendedJobs for You