666 Dataproc Jobs - Page 27

Job Title: Data Engineering Engineer II Location: Chennai Work Type: Hybrid Overview: TekWissen is a global workforce management provider throughout India and many other countries in the world. The below clientis a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the planet Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and a...

Role: Cloud Data Engineer Location: Sholinganallur, Chennai Fulltime Skills Required: Python, dataflow, Dataproc, GCP Cloud Run, DataForm, Agile Software Development, Big Query, TERRAFORM, Data Fusion, Cloud SQL, GCP, KAFKA Skills Preferred: Java Experience Required: 8+ years Position Description: Bachelor's Degree 2+Years in GCP Services - Biq Query, Data Flow, Dataproc, DataPlex, DataFusion, Terraform, Tekton, Cloud SQL, Redis Memory, Airflow, Cloud Storage 2+ Years in Data Transfer Utilities 2+ Years in Git / any other version control tool 2+ Years in Confluent Kafka 1+ Years of Experience in API Development 2+ Years in Agile Framework 4+ years of strong experience in python, Pyspark deve...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

Work Mode: Hybrid (3-5 Days from Office) Job Summary: Looking for a Senior Data Engineer to work on building and managing scalable data pipelines in a GCP environment. Responsibilities: Design, develop, and maintain scalable data pipelines. Manage ETL/ELT workflows from various data sources. Ensure data governance, quality, and transformation. Collaborate with stakeholders to meet data needs. Optimize for cost, scalability, and performance. Required Skill Set: Languages & Frameworks: Python, PySpark, SQL Orchestration Tools: Airflow / GCP Composer Streaming: Kafka Cloud Platform: Google Cloud Platform (Dataproc, BigQuery, Compute, Looker) Concepts: Data Modeling, Data Warehousing, CI/CD

Job Summary: Looking for a Senior Data Engineer to work on building and managing scalable data pipelines in a GCP environment. Responsibilities: Design, develop, and maintain scalable data pipelines. Manage ETL/ELT workflows from various data sources. Ensure data governance, quality, and transformation. Collaborate with stakeholders to meet data needs. Optimize for cost, scalability, and performance. Required Skill Set: Languages & Frameworks: Python, PySpark, SQL Orchestration Tools: Airflow / GCP Composer Streaming: Kafka Cloud Platform: Google Cloud Platform (Dataproc, BigQuery, Compute, Looker) Concepts: Data Modeling, Data Warehousing, CI/CD

Job Title: Software Engineer III - Core Engineer III Location: Chennai Work Type: Hybrid Overview: TekWissen is a global workforce management provider throughout India and many other countries in the world. The below clientis a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the planet Position Description: MUST HAVE: Performs DevSecOps and SRE adoption for existing/new SpringBoot/Angular/REACT based applications to deploy in CaaS/GCP CloudRun. 5+ years of experience in Java/SpringBoot/Angular based development projects Hands-on ...

Work Mode: Hybrid (35 Days from Office) Experience: 5+ Years Job Summary: Looking for a Senior Data Engineer to work on building and managing scalable data pipelines in a GCP environment. Responsibilities: Design, develop, and maintain scalable data pipelines. Manage ETL/ELT workflows from various data sources. Ensure data governance, quality, and transformation. Collaborate with stakeholders to meet data needs. Optimize for cost, scalability, and performance. Required Skill Set: Languages & Frameworks: Python, PySpark, SQL Orchestration Tools: Airflow / GCP Composer Streaming: Kafka Cloud Platform: Google Cloud Platform (Dataproc, BigQuery, Compute, Looker) Concepts: Data Modeling, Data War...

Roles and Responsibilities Experience - 10+ Years Design, develop, and maintain large-scale data pipelines using BigQuery, Dataproc, and GCP. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop complex SQL queries to extract insights from massive datasets stored in BigQuery.

Role & responsibilities 8+ years experience Should have experience in GCP BigQuery, DataProc(PySpark) Should have experience on Informatica Preferred candidate profile Job Description :Tech Lead Data Engineer Experience : 8+ Years Work location: Chennai, Bangalore, Hyderabad, Pune Shift Timing : 2 to 11 PM Interview process : L1, L2 & Client round

Were Hiring: Senior Data Engineer GCP | Databricks | E-commerce Domain Work Locations : Chennai | Bangalore | Hyderabad | Gurugram | Jaipur | Pune | Bhopal Experience : 7–8+ Years Shift Timing : 2 PM – 10 PM IST Work Mode : Hybrid – 3 days/week from office Only Immediate Joiners (0–15 Days Notice) Are you a seasoned Data Engineer passionate about building next-gen data platforms? We’re hiring for an offshore role supporting one of our top global e-commerce clients. You'll work on large-scale consumer data and cloud-native architectures, helping create impactful data products. Join Xebia and become part of a high-performance team working with the latest technologies in data engineering. Role ...

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets. - Grade Specific The role support the team in building and maintaining data infrastructure and systems within an organization. Skills (competencies) Ab Initio Agile (Software Development Framework) Apache Hadoop AWS Airflow AWS Athena AWS Code Pipeline AWS EFS AWS EMR AWS Redshift AWS S3 Azure ADLS Gen2 Azure Data Factory Azure Data Lake Storage Azure Databricks Azure Event Hub Azure Stream Analytics Azure Sunapse Bitbucket Change Management Client Centricity Collaboration Continu...

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Should have developed/Worked for atleast 1 Gen AI project. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Has good knowledge of cloud compute services and load balancing. Has good knowledg...

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets. - Grade Specific The role support the team in building and maintaining data infrastructure and systems within an organization. Skills (competencies) Ab Initio Agile (Software Development Framework) Apache Hadoop AWS Airflow AWS Athena AWS Code Pipeline AWS EFS AWS EMR AWS Redshift AWS S3 Azure ADLS Gen2 Azure Data Factory Azure Data Lake Storage Azure Databricks Azure Event Hub Azure Stream Analytics Azure Sunapse Bitbucket Change Management Client Centricity Collaboration Continu...

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Should have developed/Worked for atleast 1 Gen AI project. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Has good knowledge of cloud compute services and load balancing. Has good knowledg...

A GCP Data Engineering Architect designs, implements, and manages scalable data solutions on Google Cloud Platform (GCP). They are responsible for defining data architecture, ensuring data quality and security, and optimizing data pipelines for various use cases, including data warehousing, big data processing, and real-time analytics. This role involves collaborating with stakeholders, mentoring junior engineers, and staying up-to-date with the latest GCP technologies. Skills Required: 12~16 years' experience in IT or professional services experience in IT delivery or large-scale IT data engineering projects. Data Pipeline Development: Building and optimizing data pipelines using GCP servic...