665 Dataproc Jobs - Page 14

Sabre is a technology company that powers the global travel industry. Leveraging next-generation technology, we create global solutions that address significant opportunities and challenges within the travel sector. Positioned at the heart of the travel industry, we drive innovation by providing advancements that lead to a more connected and seamless ecosystem. Our technology powers various platforms including mobile apps, online travel sites, airline and hotel reservation networks, and more, ultimately connecting people with meaningful experiences. As a global leader in innovative technology within the travel industry, Sabre is constantly seeking talented individuals with a passion for tech...

We are looking for a Technical Lead with strong expertise in ETL development (Informatica) , SQL , and Google Cloud Platform (GCP) services. The ideal candidate will lead data integration initiatives , design scalable ETL workflows , and ensure the delivery of high-quality data solutions for analytics, reporting. Key Responsibilities: Lead and mentor a team of Data Engineers to design, develop, and optimize ETL workflows. Architect end-to-end ETL solutions using Informatica and GCP services (BigQuery, Dataflow, Cloud Storage). Define and enforce best practices , code standards, and review processes for ETL development. Collaborate with business stakeholders and data architects to translate r...

Educational Requirements MCA,MSc,MTech,Bachelor of Engineering,BCA,BSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight. • You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise. • You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements a...

About the Role We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams. Key Responsibilities: Design and develop...

Position Description: GCP AI Data Engineer Skills Required: TERRAFORM, Big Query, AIRFLOW, POSTGRES, Data Flow, Data Fusion, DataPro, Cloud Storage Experience Required: 3+ years experience Education Required: Bachelor's Degree Additional Information: Design and build GCP data driven solutions for enterprise data warehouse and data lakes • Design and implement scalable data architectures on GCP, including data lakes, warehouses, and real-time processing systems. • Utilize ML Services like Vertex AI. • Develop and optimize ETL/ELT pipelines using tools like Python, SQL, and streaming technologies (e.g., Kafka, Apache Airflow). • Architect Historical and Incremental Loads and Refine Architectur...

Candidates for this position are preferred to be based in Bangalore, India and will be expected to comply with their team's hybrid work schedule requirements. Wayfair's Advertising business is rapidly expanding, adding hundreds of millions of dollars in profits. The team is building Sponsored Products, Display & Video Ad offerings that cater to various Advertiser goals while delivering highly relevant and engaging Ads to millions of customers. The Ads Platform is being evolved to empower advertisers of all sophistication levels to grow their business on Wayfair with a strong, positive ROI by utilizing state-of-the-art Machine Learning techniques. The Advertising Optimization & Automation Sci...

You will be responsible for designing and implementing cloud-native and hybrid solutions using GCP services such as Compute Engine, Kubernetes (GKE), Cloud Functions, BigQuery, Pub/Sub, Cloud SQL, and Cloud Storage. Additionally, you will define cloud adoption strategies, migration plans, and best practices for performance, security, and scalability. You will also be required to implement and manage Terraform, Cloud Deployment Manager, or Ansible for automated infrastructure provisioning. The ideal candidate should have expertise as a GCP data architect with network domain skills in GCP (DataProc, cloud composer, data flow, BQ), python, spark Py spark, and hands-on experience in the network ...

Job Title : GCP Data Engineer Location State : Maharashtra,Telangana Location City : Pune, Hyderabad Experience Required : 6 to 8 Year(s) CTC Range : 7 to 11 LPA Shift: Day Shift Work Mode: Onsite Position Type: C2H Openings: 2 Company Name: VARITE INDIA PRIVATE LIMITED About The Client: Client is an Indian multinational technology company specializing in information technology services and consulting. Headquartered in Mumbai, it is a part of the Tata Group and operates in 150 locations across 46 countries. About The Job: - Big query / DataProc - handon 5yrs + - Google Cloud Storage - handon 5yrs + - Pub sub / Cloud Data flow - handon 5yrs + Essential Job Functions: - Big query / DataProc - ...

Job Summary We are looking for an experienced Data Engineer with a strong background in SQL and Python , and hands-on experience with at least one BI Tool. You will be responsible for designing and building scalable data pipelines, transforming complex datasets, and supporting analytics and reporting needs across the organization. Key Responsibilities: Design, develop, and maintain robust ETL/ELT pipelines using SQL and Python. Optimize and troubleshoot complex SQL queries to ensure high performance and scalability. Build and maintain data models and data marts to support business analytics and decision-making. Collaborate with data analysts, data scientists, and business stakeholders to und...

Salary: 20 to 35 LPA Exp: 5 to 8 years Location: Gurgaon (Hybrid) Notice: Immediate to 30 days..!! Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using GCP services such as BigQuery, Data Flow, PubSub, Dataproc, and Cloud Storage. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop complex SQL queries to extract insights from large datasets stored in Google Cloud SQL databases. Troubleshoot issues related to data processing workflows and provide timely resolutions. Desired Candidate Profile 5-9 years of experience in Data Engineering with expertise GCP & Biq query data...

Employment type: Contractual Job Description: GCP Data engineer with very strong Python skills and for Dollar General the person should also be well versed with streaming platforms like Kafka & Pubsub Mandatory Skills: GCP DE skills & Python Nice to have skills: Kubernettes,Containers Additional Information: NP: Immediate to 15 days

It is exciting to be part of a company where individuals genuinely believe in the purpose of their work. The commitment to infuse passion and customer-centricity into the business is unwavering. Fractal stands out as a key player in the field of Artificial Intelligence. The core mission of Fractal is to drive every human decision within the enterprise by integrating AI, engineering, and design to support the most esteemed Fortune 500 companies globally. Recognized as one of India's top workplaces by The Great Place to Work Institute, Fractal is at the forefront of innovation in Cloud, Data, and AI technologies, fueling digital transformation across enterprises at an unprecedented pace exceed...

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore). Location: Gurgaon/Pune/Hyderabad/Bengaluru/Chennai Work Mode: Hybrid (2-3 days office in a week) Job Description: 5-14 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming...

Description: 1. Data engineer with 6+ years of hands on experience working on Big Data Platforms 2. Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. 3. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing 4. Good experience in any one programming language -Scala/Python , Python preferred. 5. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc 6. Experience in using Kafka or any other message brokers 7. Configuring, monitoring and scheduling of jobs usin...

Design & optimize BigQuery, Dataflow, Dataproc, Pub/Sub, Composer; ETL/ELT, governance, security, migration, SQL/Python. 8+ years of experience in data engineering, data architecture, or analytics. At least 3 years data or solutions architect role.

If you are creating JD for an Associate program rolereplace word entry in the first sentence below with word Associate. For example -> As an entry level Software Developer.. will be changed to As an Associate Software Developer.. As an entry level Application Developer at IBM, you'll work with clients to co-create solutions to major real-world challenges by using best practice technologies, tools, techniques, and products to translate system requirements into the design and development of customized systems. In your role, you may be responsible for: Working across the entire system architecture to design, develop, and support high quality, scalable products and interfaces for our clients Col...

As a Data Architecture professional with 8-15 years of experience, your primary responsibility will be to design and implement data-centric solutions on Google Cloud Platform (GCP). You will utilize various GCP tools such as Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, and GCP APIs to create efficient and scalable solutions. Your role will involve building ETL pipelines to ingest data from diverse sources into our system and developing data processing pipelines using programming languages like Java and Python for data extraction, transformation, and loading (ETL). You will be responsible for creat...

The role of Cloud Architecture and Engineering at Deutsche Bank as a Director based in Pune, India involves leading the global cloud infrastructure architecture for Corporate Bank Technology. With a focus on domains like Cash Management, Securities Services, Trade Finance, and Trust & Agency Services, you will be responsible for creating domain-level architecture roadmaps, designing solutions for TAS business, and providing technical leadership to development teams across multiple TAS Tribes and Corporate Bank Domains. Key Responsibilities: - Leading the global cloud infrastructure architecture across Corporate Bank domains - Creating domain level architecture roadmaps to ensure long-term bu...

The role of a Technical-Specialist Big Data (PySpark) Developer based in Pune, India involves designing, developing, and unit testing software applications in an Agile development environment. As an Engineer, you are responsible for ensuring the delivery of high-quality, maintainable, scalable, and high-performing software applications. You are expected to have a strong technological background with good working experience in Python and Spark technology. The role requires hands-on experience and the ability to work independently with minimal guidance while also providing technical guidance and mentorship to junior team members. You will play a key role in enforcing design and development ski...

JD PR Executive Key Responsibilities Write and edit high-impact content including press releases and articles Build and manage strong relationships with social media team, editors and influencers Develop and maintain a strong network of contacts within prominent news publications to expand media outreach and drive consistent, high-quality coverage, Discuss and negotiate costs with news publications to optimize budgets and secure placements Monitor media trends, coverage opportunities, and industry movements Collaborate with internal teams to support brand communication strategies and campaign execution Track and report PR metrics and deliverables across multiple accounts Contribute to intern...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : Microsoft SQL Server, Google Cloud Data ServicesMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, e...

Overview: TekWissen is a global workforce management provider throughout India and many other countries in the world. The below clientis a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the planet Job Title: Software Engineer III - Core Engineer III Location: Chennai Work Type: Hybrid Position Description: GCP AI Data Engineer Skills Required: TERRAFORM, Big Query, AIRFLOW, POSTGRES, Data Flow, Data Fusion, Dataproc, Cloud Storage Experience Required: 2+ years' experience Education Required: Bachelor's Degree TekWissen Group is ...

8+ years of extensive experience in data engineering, data architecture, or analytics. GCP using BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer; expertise in SQL, Python, ETL/ELT, IaC, security, governance, and migration.

Role & responsibilities The Lead Data Engineer will build, optimize, and maintain high-throughput data pipelines on GCP, ensuring resilient imports, freshness monitoring, and automation-readiness. This role leads engineering teams to deliver scalable data solutions. Responsibilities Develop and maintain large-scale ingestion and transformation pipelines on GCP . Implement monitoring and alerting for data freshness and resiliency . Optimize ETL/ELT using BigQuery, Dataflow, Pub/Sub, Dataproc . Collaborate with AI teams to embed automation components. Drive best practices in DevOps, CI/CD, and testing. Mentor engineers and lead Agile delivery cycles. Technical Skills Proficiency in GCP data st...

Role Overview: Assess client needs and convert business requirements into business intelligence (BI) solutions roadmap relating to complex issues involving long-term or multi-work streams. Analyze technical issues and questions identifying data needs and delivery mechanisms Implement data structures using best practices in data modeling, ETL/ELT processes, Spark, Scala, SQL, database, and OLAP technologies Manage overall development cycle, driving best practices and ensuring development of high quality code for common assets and framework components Develop test-driven solutions and provide technical guidance and heavily contribute to a team of high caliber Data Engineers by developing test-...