665 Dataproc Jobs - Page 13

We are seeking a highly experienced and strategic Data Solutions Architect Google Cloud Platform (GCP) to join our technology team. This pivotal role will be responsible for leading the design, architecture, and implementation of highly scalable, secure, and performant data solutions on GCP. The ideal candidate will possess deep expertise in GCP's comprehensive suite of data services, modern cloud data architecture patterns, and best practices in data engineering. You will be instrumental in translating complex business requirements into robust technical solutions, collaborating extensively with cross-functional teams to drive innovation, ensure data reliability, and support advanced analyti...

Mandatory skill- Advance Python & SQL GCP Services- BigQuery, Dataflow, Dataproc and Pub/Sub. Key Responsibilities Design, develop and optimize scalable data pipelines and ETL workflows using Google Cloud Platform (GCP), particularly leveraging BigQuery, Dataflow, Dataproc and Pub/Sub. Design and manage secure, efficient data integrations involving Snowflake and BigQuery. Write, test and maintain high-quality Python code for data extraction, transformation and loading (ETL), analytics and automation tasks. Use Git for collaborative version control, code reviews and managing data engineering projects. Implement infrastructure-as-code practices using Pulumi for cloud resources management and a...

Strong expertise in Google Cloud Platform (GCP) Hands-on experience with BigQuery, Dataflow, Dataproc, Pub/Sub Proficiency in SQL & Python Experience with ETL pipelines, data modeling, and data warehousing

Job Title: GCP Data Engineer (3+ Years Experience) Location: Hyderabad & Chennai (Hybrid Mode) Experience: 3+ Years Employment Type: Full-Time Joining Preference: Immediate Joiners (Max 20 Days Notice Period) About the Company Random Trees is a leading Data & AI company, headquartered in Texas, USA, with development centers in Hyderabad and Chennai, India. With a strong team of 500+ professionals and growing 3X year-over-year, we specialize in AI product innovation and enterprise-scale strategic services. We are a proud strategic partner of many global clients across industries such as Pharma, Banking, Oil & Gas, Manufacturing, and Retail. Job Description We are looking for a GCP Data Engine...

Job Description: GCP Data Engineer We are looking for a highly skilled and experienced GCP Data Engineer as a Lead Programmer Analyst. Experience should have 4 to 7 years of data engineering. Should have strong development skills in GCP services like BigQuery, DataProc, Dataflow, Dataform. Should have good knowledge in SQL. Should have good knowledge in Python. Should have good knowledge in Pyspark. Good Experience on Airflow, Git, CI/CD pipelines. Good to have Knowledge in Cloud SQL, Dataplex. Understanding on the SDLC. Understanding on the Agile methodologies. Communication with customer and producing the Daily status report. Should have good oral and written communication. Should be a goo...

We are seeking Data Engineers (GCP) who can develop and maintain a high-performance streaming data platform for a leading healthcare CRM product. You will work across technologies like Python, PySpark, SQL, Continuous Integration/ Continuous Development, Kafka, GCP - BigQuery, Google cloud Compute, Looker, Data Modelling. Required Skill Set: Programming & Data Engineering: Python, PySpark, SQL, CICD Streaming & Orchestration: Kafka, GCP Composer/Airflow Cloud Tools: Google Cloud Platform (Dataproc, BigQuery, Looker) Data Architecture: Data Warehousing, Data Modeling Location : Manyata Tech Park, Bengaluru Roles and Responsibilities Responsibilities: Design, develop, and maintain scalable dat...

Salary: 20 to 35 LPA Exp: 5 to 8 years Location: Gurgaon /Pune/Bangalore Notice: Immediate to 30 days..!! Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using GCP services such as BigQuery, Data Flow, PubSub, Dataproc, and Cloud Storage. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop complex SQL queries to extract insights from large datasets stored in Google Cloud SQL databases. Troubleshoot issues related to data processing workflows and provide timely resolutions. Desired Candidate Profile 5-9 years of experience in Data Engineering with expertise GCP & Biq que...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

Job Title: GCP Data Engineer Location: Hyderabad & Chennai (Hybrid mode of working) Experience: 5+ Years Employment Type: Full Time Key Responsibilities Design, build, and optimize scalable data pipelines using GCP services ( Big Query, Dataflow, Airflow, Pub/Sub, Cloud Storage ). Develop and maintain ETL/ELT workflows leveraging Airflow and DBT for data modeling and transformations. Write and optimize complex SQL queries Big Query BigQuery . Implement data integration solutions to ingest structured, semi-structured, and unstructured data from multiple sources. Work closely with data analysts, data scientists, and business stakeholders to ensure reliable and timely data delivery. Apply Pytho...

The GCP Data Engineer will be responsible for designing, developing, and maintaining data pipelines and data infrastructure on Google Cloud Platform (GCP). This role requires expertise in data engineering best practices, cloud architecture, and big data technologies. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization. Key Responsibilities Data Pipeline Development Design, develop, and maintain scalable and efficient ETL/ELT pipelines on GCP. Implement data ingestion processes from various data sources (e.g., APIs, data...

This role is for a GCP Data Engineer who can build cloud analytics platforms to meet expanding business requirements with speed and quality using lean Agile practices. You will work on analysing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and Analytics in the GCP. You will be responsible for designing the transformation and modernization on GCP. Experience with large scale solutions and operationalizing of data warehouses, data lakes and analytics platforms on Google Cloud Platform or other cloud environment is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can de...

6+years of solid hands-on experience as a Data Engineer, Proven experience in designing and implementing data pipelines using GCP BigQuery or cloud platform. Strong SQL and scripting languages like Python Expert in data quality tools and techniques.

Overview: TekWissen is a global workforce management provider throughout India and many other countries in the world. The below clientis a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place one that benefits lives, communities and the planet Job Title: Data Engineering Engineer II Location: Chennai Work Type: Hybrid Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and a...

Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities: 1) Collaborate with business and technology stakeholders to understand current and future data requirements 2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow ...

Position Description: Representing the Ford Credit (FC) Data Engineering Organization as a Google Cloud Platform (GCP) Data Engineer, specializing in migration and transformation, you will be a developer part of a global team to build a complex Datawarehouse in the Google Cloud Platform. This role involves designing, implementing, and optimizing data pipelines, ensuring data integrity during migration, and leveraging GCP services to enhance data transformation processes for scalability and efficiency. This role is for a GCP Data Engineer who can build cloud analytics platforms to meet expanding business requirements with speed and quality using lean Agile practices. You will work on analyzin...

Qualifications: The candidate should have extensive production experience (3-4 Years) in GCP, Other cloud experience would be a strong bonus. Exposure to enterprise application development is a must. Roles & Responsibilities: 3-6 years of IT experience range is preferred. Able to effectively use GCP managed services e.g., Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services. Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function. Strong experience in Big Data technologies Hadoop, Sqoop, Hive and Spark including DevOPs. Good hands-on expertise on either Python or Java programming. Good Understanding of GCP core services like Googl...

About The Role Project Role : Cloud Services Engineer Project Role Description : Act as liaison between the client and Accenture operations teams for support and escalations. Communicate service delivery health to all stakeholders and explain any performance issues or risks. Ensure Cloud orchestration and automation capability is operating based on target SLAs with minimal downtime. Hold performance meetings to share performance and consumption data and trends. Must have skills : SUSE Linux Administration Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Cloud Services Engineer, you will act as a liaison...

As a Data Architect with over 10 years of experience, you will be responsible for leading data-related projects focused on Reporting and Analytics. Your tasks will include designing, building, and maintaining scalable data lakes and data warehouses in the cloud, specifically in GCP (Google Cloud Platform). Your expertise will be crucial in gathering business requirements, analyzing business needs, and defining the BI/DW architecture to support and deliver technical solutions to complex business and technical requirements. You will also play a key role in creating solution prototypes, participating in technology selection, performing Proof of Concepts (POCs), and delivering technical presenta...

The company StatusNeo is a global consulting firm that specializes in cutting-edge AI, automation, and cloud-first digital solutions. With a focus on product & platform engineering, the team at StatusNeo includes top-notch software engineers and product designers who are experts in their respective fields. Located in Gurugram, StatusNeo is a Great Place To Work certified organization that values innovation and collaboration. As a GCP Data Engineer at StatusNeo, your primary responsibility will be designing, developing, and maintaining scalable data pipelines and architectures on Google Cloud Platform. Working alongside data scientists, analysts, and other stakeholders, you will ensure that d...

As a Data Engineer at Aptiv, you will play a crucial role in designing, developing, and implementing a cost-effective, scalable, reusable, and secured Ingestion framework. Your primary responsibility will be to work closely with business leaders, stakeholders, and source system Subject Matter Experts (SMEs) to understand and define the business needs, translate them into technical specifications, and ingest data into Google Cloud Platform, specifically BigQuery. You will be involved in designing and implementing processes for data ingestion, transformation, storage, analysis, modeling, reporting, monitoring, availability, governance, and security of high volumes of structured and unstructure...

As a Full Stack Data Engineer at our company, you will collaborate with Data Scientists and Product Development business partners to create cutting-edge data products that align with our Company Objectives. Your responsibilities will include landing data, developing new data products, enhancing existing ones, and collaborating with Analytics & Business partners to validate solutions for production release. You should have a Bachelor's Degree and at least 2+ years of experience in GCP services such as Big Query, Dataproc, Data Plex, DataFusion, Terraform, Tekton, Airflow, Cloud Storage, and Pub/Sub. Proficiency in Git or any other version control tool is required. While API knowledge is consi...

As a Tech Anchor/Solution Architect within the Industrial System Analytics (ISA) team, you will play a crucial role in providing technical leadership and guidance to the development team, ensuring the design and implementation of cloud analytic solutions using GCP tools and techniques. Your responsibilities will include offering technical guidance, mentorship, and code-level support to the team, as well as collaborating to develop and implement solutions using GCP tools and APIs/Microservices. You will be accountable for driving adherence to security, legal, and Ford standard/policy compliance while focusing on efficient delivery and identifying and mitigating risks. In this role, you will l...

Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales. Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organiza...

You will be expected to have hands-on project experience with GCP core products and services, including GCP Networking, VPCs, VPCSC, and Google Artefact Registry. It is essential to have extensive experience in Infrastructure as Code, including TF custom Modules and TF module Registry. Moreover, you should possess hands-on experience with GCP Data products such as Bigquery, Dataproc, Dataflow, and Vertex AI. Familiarity with Kubernetes and managing container Infrastructure, specifically GKE, is also required for this role. The role involves automation using programming languages like Python, Groovy, etc. Additionally, having an understanding of Infrastructure security, threat modeling, and G...

Are you ready to contribute to Mondelz International's mission of leading the future of snacking with pride As a member of the analytics team, you will play a vital role in supporting the business by developing data models that uncover trends essential for driving long-term business results. In this role, you will work closely with analytics team leaders to execute the business analytics agenda, collaborate with external partners adept in leveraging analytics tools and processes, and utilize models/algorithms to identify signals, patterns, and trends that can enhance long-term business performance. Your methodical approach to executing the business analytics agenda will effectively communica...