86 Gcp Bigquery Jobs

As a Data Engineer, you will be responsible for managing and optimizing data pipelines for efficient data processing. Your role will involve working with a variety of technologies and platforms to ensure smooth data workflows. Key Responsibilities: - Utilize your 5+ years of experience in data engineering, including at least 2+ years of hands-on experience with Databricks. - Demonstrate strong expertise in Apache Spark using PySpark, Scala, and SQL for efficient distributed data processing. - Implement and maintain Delta Lake and Lakehouse architecture for effective data modeling. - Work with cloud platforms such as Azure Data Lake, AWS S3, or GCP BigQuery/Storage to manage data infrastructu...

If you are looking for a career at a dynamic company with a people-first mindset and a deep culture of growth and autonomy, ACV is the right place for you! Competitive compensation packages and learning and development opportunities, ACV has what you need to advance to the next level in your career. We will continue to raise the bar every day by investing in our people and technology to help our customers succeed. We hire people who share our passion, bring innovative ideas to the table, and enjoy a collaborative atmosphere. Who We Are ACV is a technology company that has revolutionized how dealers buy and sell cars online. We are transforming the automotive industry. ACV Auctions Inc. (ACV)...

Job Description Roles &Responsibilities: Design, build, and maintain data pipelines and ETL/ELT workflows for structured and unstructured data sources. Develop, train, validate, and deploy machine learning and AI models using frameworks such as TensorFlow, PyTorch, or Scikit-learn. Collaborate with data engineers, business analysts, and product managers to translate analytical requirements into production-grade models and APIs. Optimize data processing performance and model inference pipelines for scalability and cost-efficiency (preferably on cloud platforms such as AWS, Azure, or GCP). Work with data visualization and BI teams to enable analytics dashboards that surface insights from AI mo...

As a GCP Data Engineer at our company, you will play a crucial role in implementing data solutions using Google Cloud Platform (GCP) tools and programming languages like SQL and Python. Your responsibilities will include working on data pipelines, transformation logics, and data models for implementation projects. Here is a breakdown of the key aspects of this role: **Role Overview:** With over 5 years of experience in data projects, your main focus will be on GCP BigQuery, SQL, and Python dataflow skills. You will be involved in building data pipelines, transformation logics, and data models for implementation projects. **Key Responsibilities:** - Implement data solutions using GCP and be p...

Role Overview We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business logic, personalisation, user cohorting, CRM, product analytics, and Generative AI workloads. You'll work cross-functionally with analysts, engineers, and product teams to build high-throughput data pipelines, ensure reliability and cost-efficiency, and empower data-driven decisions across all touchpoints web, mobile (Android/iOS) and server. Key Responsibilities Data Platform & Pipeline Development Build and scale real-time and batch data pipelines capable of supporting high-volume ...

We are seeking skilled and motivated Spark & Databricks Developers to join our dynamic team for a long-term project. The ideal candidate will have strong hands-on experience in Apache Spark , Databricks , and GitHub-based development workflows . Key Responsibilities: Design, develop, and optimize big data pipelines using Apache Spark . Build and maintain scalable data solutions on Databricks . Collaborate with cross-functional teams for data integration and transformation. Manage version control and code collaboration using GitHub . Ensure data quality , performance tuning, and job optimization. Participate in code reviews , testing, and documentation activities. Must-Have Skills: 58 years o...

Position Overview Job Title: Business Functional Analyst Location: Bangalore, India Corporate Title: AVP Role Description Within the Securities Services division, the Fund Services product family has new opportunities for suitable candidates to be part of their data and digital transformation program. Business Functional Analyst will help us build and maintain cloud-based digital data analytics solutions including microservices. You will be responsible for designing, developing, testing and deploying web services and APIs; working in close collaboration with business, product and operations in an Agile culture. Successful candidates are expected to be experts in their fields and hands-on, an...

Position Overview Job Title: Data Governance - AVP Location: Pune, India Corporate Title: Assistant Vice President Role Description As one of the world's leading asset management firms, data is at the heart of our operations. To support our growing data governance initiatives, we're seeking a Data Governance Tooling Engineer to help design, implement, and maintain the tools and technologies that form the foundation of our data governance ecosystem. This position will require strong software engineering skills and a deep understanding of building and operating platform services in a complex enterprise environment. The role is part of DWS's Data Platform Engineering organization. Data Platform...

Responsibilities : Key Responsibilities Architecture & Strategy - Define TDM architecture aligned with enterprise data governance and testing needs. - Design modular, scalable TDM frameworks using tools like Broadcom TDM, Genrocket, Delphix, and K2. - Establish synthetic data generation strategies and subsetting/masking policies. - Integrate TDM into test automation and CI/CD pipelines. Tooling & Integration - Implement data provisioning workflows across environments (ephemeral, containerized). - Automate data refresh, rollback, and versioning using TDM tools. - Enable self-service data access for testers and developers. - Ensure compliance with data privacy regulations (GDPR, HIPAA, etc.). ...

Responsibilities : Key Responsibilities Architecture & Strategy - Define TDM architecture aligned with enterprise data governance and testing needs. - Design modular, scalable TDM frameworks using tools like Broadcom TDM, Genrocket, Delphix, and K2. - Establish synthetic data generation strategies and subsetting/masking policies. - Integrate TDM into test automation and CI/CD pipelines. Tooling & Integration - Implement data provisioning workflows across environments (ephemeral, containerized). - Automate data refresh, rollback, and versioning using TDM tools. - Enable self-service data access for testers and developers. - Ensure compliance with data privacy regulations (GDPR, HIPAA, etc.). ...

Key Responsibilities: Key Responsibilities Architecture Strategy Define TDM architecture aligned with enterprise data governance and testing needs Design modular scalable TDM frameworks using tools like Broadcom TDM Genrocket Delphix and K2 Establish synthetic data generation strategies and subsetting masking policies Integrate TDM into test automation and CI CD pipelines Tooling Integration Implement data provisioning workflows across environments ephemeral containerized Automate data refresh rollback and versioning using TDM tools Enable self service data access for testers and developers Ensure compliance with data privacy regulations GDPR HIPAA etc Collaboration Leadership Partner with Q...

Role: GCP Specialist Openings: 20 Location: Pan India (Remote) Experience Required: 5- 6 years relevant in GCP projects About the Role We are hiring experienced GCP Specialists to join our cloud data engineering team working on cutting-edge global projects. The ideal candidate will have strong expertise in Google Cloud Platform (GCP) , with experience in DataProc, BigQuery, Dataflow, and Cloud Composer . If youre passionate about cloud data engineering and eager to make an impact with a leading organization — we’d love to connect! Key Skills Must Have: GCP (DataProc, BigQuery, Dataflow, Cloud Composer) Good to Have: AWS Cloud exposure Experience building and optimizing cloud data pipelines a...

Role: GCP Specialist Openings: 20 Location: Pan India (Remote) Experience Required: 5- 6 years relevant in GCP projects About the Role We are hiring experienced GCP Specialists to join our cloud data engineering team working on cutting-edge global projects. The ideal candidate will have strong expertise in Google Cloud Platform (GCP) , with experience in DataProc, BigQuery, Dataflow, and Cloud Composer . If youre passionate about cloud data engineering and eager to make an impact with a leading organization — we’d love to connect! Key Skills Must Have: GCP (DataProc, BigQuery, Dataflow, Cloud Composer) Good to Have: AWS Cloud exposure Experience building and optimizing cloud data pipelines a...

Key Responsibilities: Key Responsibilities Architecture Strategy Define TDM architecture aligned with enterprise data governance and testing needs Design modular scalable TDM frameworks using tools like Broadcom TDM Genrocket Delphix and K2 Establish synthetic data generation strategies and subsetting masking policies Integrate TDM into test automation and CI CD pipelines Tooling Integration Implement data provisioning workflows across environments ephemeral containerized Automate data refresh rollback and versioning using TDM tools Enable self service data access for testers and developers Ensure compliance with data privacy regulations GDPR HIPAA etc Collaboration Leadership Partner with Q...

Business Functional Analyst, AS Position Overview Job Title: Business Functional Analyst Location: Bangalore, India Corporate Title: AS Role Description Within the Securities Services division, the Fund Services product family has new opportunities for suitable candidates to be part of their data and digital transformation program. Business Functional Analyst will help us build and maintain cloud-based digital data analytics solutions including microservices. You will be responsible for designing, developing, testing and deploying web services and APIs working in close collaboration with business, product and operations in an Agile culture. Successful candidates are expected to be experts in...

About Gap Inc. Our past is full of iconic moments but our future is going to spark many more. Our brands Gap, Banana Republic, Old Navy and Athleta have dressed people from all walks of life and all kinds of families, all over the world, for every occasion for more than 50 years. But we're more than the clothes that we make. We know that business can and should be a force for good, and it's why we work hard to make product that makes people feel good, inside and out. It's why we're committed to giving back to the communities where we live and work. If you're one of the super-talented who thrive on change, aren't afraid to take risks and love to make a difference, come grow with us. About The...

• Handson experience in objectoriented programming using Python, PySpark, APIs, SQL, BigQuery, GCP • Building data pipelines for huge volume of data • Dataflow DataPro and Big Query • Deep understanding of ETL concepts GCP Cloud Composer

As a Senior Manager Data Solution Architect at our company, you will play a crucial role in supporting data strategy and architecture for industrial clients. Your focus will be on designing scalable data platforms, defining data governance frameworks, and leading cloud data migrations. Collaboration with both business and technical teams will be essential to align data strategy and drive advanced analytics initiatives. - Design scalable data platforms for industrial analytics and IoT - Define data governance, quality, and integration frameworks - Collaborate with business and technical teams to align data strategy - Lead cloud data migrations and real-time analytics initiatives - Mentor data...

As an experienced IT professional with over 5 years of expertise, you possess the skills required to excel in the role of building data pipelines using Apache Airflow. Your proficiency in developing a codebase for generating data pipelines, specifically in Apache Airflow, showcases your strong technical background. Key Responsibilities: - Developed and orchestrated scalable data pipelines in Apache Airflow using Python - Processed records from APIs and loaded them to GCP BigQuery - Demonstrated understanding and ability to leverage scalable pipelines effectively - Utilized Python programming language for data pipeline development - Exposure to ML is preferred, although not mandatory - Utiliz...

Position Title : Data Architect. Location : Hyderabad. Employment Type : Full-Time. Mode : Work from Office. Working Shift : UK but might change based on business need. About The Role We are looking for a hands-on Data Architect who can own the end-to-end data architecture strategy while also actively engage in the design, development, and optimization of our data ecosystem. This role demands deep technical expertise in data modeling, databases, cloud platforms, and integration frameworks, combined with the ability to mentor engineers and partner with stakeholders to ensure our data foundation supports business growth and innovation. Key Responsibilities Technical (70%) : Design and build sc...

About The Role We are seeking a highly analytical and technically skilled Business Intelligence (BI) Specialist to design and implement enterprise-wide data visualization, reporting, and analytics solutions. You will play a key role in enabling data-driven decision-making by transforming raw data into actionable insights through interactive dashboards, performance metrics, and scalable data models. Responsibilities This role will involve close collaboration with cross-functional business and technical teams to ensure robust, high-performance BI systems that meet both operational and strategic Responsibilities : Design and deliver interactive, visually compelling, and insightful dashboards us...

GCP Data Engineer Work Location: Noida/Chandigarh/Remote Salary:25-30 LPA We are seeking an experienced GCP Data Engineer to join our team. The ideal candidate will work closely with business, IT, analysts, and data science groups to collect requirements and build high-performance data pipelines. This role involves designing scalable data solutions, ensuring data quality, and supporting real-time data ingestion using Google Cloud Platform services. Key Responsibilities: • Work closely with various business, IT, analyst, and data science groups to collect business requirements. • Design, develop, deploy, and support high-performance data pipelines (inbound and outbound). • Model data platform...

As a Data Scientist / AI Consultant at Wipro, your role will involve working in the Artificial Intelligence Advisory function within the Digital Consulting (DC) unit. You will act as a Data Scientist for organizations, analyzing vast amounts of data using cognitive and science-based techniques to manage data, predict scenarios, prescribe actions, and solve complex problems. Your responsibilities will include advising business teams to drive operational efficiency by maintaining data ecosystems, sourcing analytics expertise, and providing continuous insights and improvements through As-a-Service offerings. Additionally, you will lead a team of junior data scientists, data engineers, and other...

Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We're growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative environment. Role Summary We are looking for a PySpark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured dat...

Requirements: • 5+ years of hands-on experience as a Teradata Developer . • Strong knowledge of Teradata SQL, performance tuning, and query optimization . • Experience with Google Cloud Platform (GCP) services, particularly BigQuery . • Exposure to MicroStrategy (dashboard/report development, integration with data sources). • Strong understanding of data warehousing, ETL processes, and dimensional modeling . • Experience in data migration, cloud modernization, or hybrid architectures . • Proficiency in scripting languages (Python, Shell, or similar) is a plus. • Excellent problem-solving skills and ability to work in cross-functional teams.