infinite Computer Solution logo

Technical Lead

infinite Computer Solution
Chennai

Posted:15 hours ago

Job Description

Skillset: (Senior Data Engineer)
    • Hands-on experience with GCP (BigQuery, Composer, Dataproc, Dataflow, Pub/Sub)
    • Working knowledge for data processing and pipelines
    • Strong programming skills in SQL and PySpark
    • Experience with Oracle and SQL Server databases
    • Understanding of data modelling (dimensional / medallion basics)
    • Experience in batch pipelines and exposure to streaming
    • Familiarity with data ingestion, ETL/ELT processes
    • Basic understanding of data quality and validation
    • Exposure to Airflow/Composer and scheduling
    • Working knowledge of Git and CI/CD
Detailed Responsibilities:
    • Develop and maintain batch and streaming data pipelines
    • Build SQL and PySpark transformations for large datasets
    • Ingest data from multiple sources into BigQuery/cloud platforms
    • Implement data transformation logic as per requirements
    • Work with teams to consume curated datasets
    • Develop workflows using Cloud Composer (Airflow)
    • Perform data validation and reconciliation
    • Optimise queries and pipelines for performance
    • Support migration of legacy ETL jobs to cloud
    • Troubleshoot pipeline and performance issues
    • Participate in testing, UAT, and deployment
    • Document pipelines, transformations, and sources
    • Collaborate with analytics and reporting teams.

Qualifications

Bachelor's

Range of Year Experience-Min Year

6

Range of Year Experience-Max Year

8

Technical Lead | Infinite Computer Solutions

Skills Required

GCP Data Processing SQL Pyspark Oracle SQL Server Data Modelling Data Ingestion ETL Data Quality GIT Ci/cd

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
infinite Computer Solution logo
infinite Computer Solution

RecommendedJobs for You

Congruent Solutions logo

Technical Lead

Congruent Solutions

Chennai

infinite Computer Solution logo

Technical Lead

infinite Computer Solution

Chennai

Intellect Design Arena logo

Technical Lead

Intellect Design Arena

Pune, Mumbai

Matrix Comsec logo

Technical Lead

Matrix Comsec

Vadodara

Naythra Applications logo

Technical Lead

Naythra Applications

Bengaluru

National e-Governance Division logo

Technical Lead

National e-Governance Division

Delhi

P

Technical Lead

ParentPay Group

Pune