4186 Bigquery Jobs - Page 30

We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profile Candidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

As a Product Manager for the Benchmarking Platform, your role will involve the following: - Own, define, and manage the product roadmap, ensuring alignment with stakeholders, compliance, and security measures to meet business expectations. - Manage the product roadmap, backlog, and delivery milestones effectively. - Translate business requirements into user stories, functional specifications, and acceptance criteria. - Collaborate with engineering and data teams on ETL pipelines, APIs, and orchestration tools like Airflow and Step Functions. - Advocate for AI/ML integration, predictive benchmarking, and workflow automation features. - Supervise dashboards, automate reports in formats like PP...

Role Overview: You will support system activities in a specific process area, including analysis, design, and overseeing the implementation of system changes to increase effectiveness and efficiency aligned with corporate strategies. Key Responsibilities: - Define the technical strategy and architectural roadmap for the Marketing GenAI ecosystem, ensuring it scales to meet the future needs of the global marketing organization. - Guide and oversee the technical development and architectural design of the agentic GenAI platform at a global level, focusing on creative production, scalability, and seamless integration. - Partner with senior business stakeholders and product manager to translate ...

Job Title: Senior Data Quality & Validation Engineer (AI-Integrated Data Systems) Experience Level: 5–8 Years Location: Bangalore About the Role We are seeking a highly skilled Senior Data Quality & Validation Engineer with strong expertise in data testing, orchestration, and AI-assisted development tools . The ideal candidate will bring hands-on experience validating batch and streaming data pipelines , implementing data quality frameworks , and leveraging AI productivity tools such as GitHub Copilot, Codex, or Cursor . You will collaborate with cross-functional data, analytics, and AI teams to ensure the integrity, accuracy, and reliability of enterprise-grade data systems across cloud-bas...

Job Title: Senior Data Quality & Validation Engineer (AI-Integrated Data Systems) Experience Level: 5–8 Years Location: Bangalore About the Role We are seeking a highly skilled Senior Data Quality & Validation Engineer with strong expertise in data testing, orchestration, and AI-assisted development tools . The ideal candidate will bring hands-on experience validating batch and streaming data pipelines , implementing data quality frameworks , and leveraging AI productivity tools such as GitHub Copilot, Codex, or Cursor . You will collaborate with cross-functional data, analytics, and AI teams to ensure the integrity, accuracy, and reliability of enterprise-grade data systems across cloud-bas...

Job Title: Senior Data Quality & Validation Engineer (AI-Integrated Data Systems) Experience Level: 5–8 Years Location: Bangalore About the Role We are seeking a highly skilled Senior Data Quality & Validation Engineer with strong expertise in data testing, orchestration, and AI-assisted development tools . The ideal candidate will bring hands-on experience validating batch and streaming data pipelines , implementing data quality frameworks , and leveraging AI productivity tools such as GitHub Copilot, Codex, or Cursor . You will collaborate with cross-functional data, analytics, and AI teams to ensure the integrity, accuracy, and reliability of enterprise-grade data systems across cloud-bas...

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Bengaluru, Karnataka, India; Pune, Maharashtra, India Minimum qualifications: Bachelors degree in Science, Technology, Engineering, Mathematics, or equivalent practical experience, 3 years of experience with two or more of the following: Web Tech, Data/Big Data, SQL, BigQuery, Systems Admin, Machine Learning, Networking, Kubernetes, Oracle, SAP, Experience with coding in a general purpose coding language (e g , Java, C, C++, Python, Shell, Go or JavaScript, etc,) and in virtualization and orchestration frameworks, Experience with Linux/Unix or other operating systems (...

As a Data Scientist at RBHU ETG Pvt. Ltd., you will play a crucial role in solving complex business problems through advanced analytics and machine learning techniques. Your responsibilities will include: - Analyzing large and diverse datasets to derive actionable insights for strategic decision-making. - Developing and implementing machine learning models such as classification, regression, and clustering with a focus on scalability and performance. - Conducting feature engineering, data cleaning, preprocessing, and exploratory data analysis. - Collaborating with cross-functional teams to understand business requirements and translate them into analytical and machine learning solutions. - B...

Overview GCP, Big Query, Python, Pyspark, Dataproc, Airflow, SQL Responsibilities GCP, Big Query, Python, Pyspark, Dataproc, Airflow, SQL Requirements GCP, Big Query, Python, Pyspark, Dataproc, Airflow, SQL

As a Data Engineer at Codvo, you will play a crucial role in designing and maintaining scalable data pipelines on Google Cloud Platform (GCP). Your responsibilities will include: - Designing, implementing, and maintaining scalable data pipelines on GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. - Ingesting and processing real-time data from connected vehicles and IoT devices. - Developing and maintaining ETL/ELT workflows using Python, SQL, and Apache Beam/Spark. - Ensuring data quality, lineage, and governance in the data lake. - Acting as a bridge between data engineering and analytics teams, performing data wrangling, feature engineering, and ML model prototyping. - ...

Job description Hiring for Gcp developer Mandatory Skills: GCP, Bigquery Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed functional design...

Salary: 20 to 35 LPA Exp: 5 to 8 years Location: Gurgaon /Pune/Bangalore Notice: Immediate to 30 days..!! Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using GCP services such as BigQuery, Data Flow, PubSub, Dataproc, and Cloud Storage. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop complex SQL queries to extract insights from large datasets stored in Google Cloud SQL databases. Troubleshoot issues related to data processing workflows and provide timely resolutions. Desired Candidate Profile 5-9 years of experience in Data Engineering with expertise GCP & Biq que...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Role & responsibilities Design, build, and maintain robust data ingestion and transformation pipelines using Python, SQL, and dbt . Orchestrate workflows using Airflow / Prefect / Dagster for automation, scheduling, and dependency management. Manage data pipelines across environments ensuring reliability, scalability, and version control ( GitOps best practices ). Collaborate with analysts, ML engineers, and backend teams to design high-quality data models supporting analytics and AI use cases. Implement data validation, lineage, and observability frameworks (Great Expectations, OpenMetadata, DataHub). Champion data quality, lineage, and observability as first-class citizens in every pipelin...

GCP Cloud Data EngineerLocation: Kochi Design and Develop Data Pipelines: Build, optimize, and maintain scalable ETL/ELT pipelines using GCP tools such as Cloud Dataflow, Data Fusion, Pub/Sub, Dataproc, and Composer (Airflow) Data Modeling & Warehousing: Design and implement efficient data models and schemas for BigQuery or other GCP data stores that support analytical and operational needs Data Integration: Ingest structured and unstructured data from multiple internal and external sources into GCP-based data lakes and warehouses Performance Optimization: Monitor and optimize data pipeline performance, query efficiency, and cost-effectiveness within GCP Automation & CI/CD: Implement infrast...

Roles & responsibilities: : The candidate must be able to independently manage his/ her own workstream and effectively collaborate with other regional teams. Develop and deploy machine learning models to support key business areas such as Credit Risk, Fraud Detection, Customer Segmentation, Marketing Optimization, and Collections Strategy. Collaborate with cross-functional teams (Data Engineers, Product Managers, Engineers) across Chennai, Manila, and Singapore to deliver production-grade ML solutions aligned with business goals. End-to-End Ownership: Drive the full lifecycle of ML solutionsfrom data exploration, feature engineering, and algorithm selection to deployment and performance moni...

Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code Big Data Engineering: Experience in Big Data Engineering projects Good to Have (Added Advantage): Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) GCP Cloud, Big Data, Bigquery

About Lumen Technologies Lumen Technologies is a global communications and technology company delivering networking, edge cloud, and cybersecurity solutions. With one of the world’s largest fiber networks, Lumen empowers businesses to thrive in the digital era through its integrated platform and customer-centric innovation. Main Responsibilities Data Warehouse Management Maintain and optimize schemas in Oracle and Google BigQuery. Monitor and troubleshoot scheduled procedures and ETL processes. Perform validations and audits to ensure data accuracy and governance. Transition Oracle schemas to GCP with performance and reliability in mind. Create and maintain data dictionaries and warehouse do...

Must be aware of ETL development and various stages of ETL pipeline. Must be very good with SQL, able to write complex queries, stored procedures. Must be good with database and should be able to do data analysis. You must have hands-on programming experience and should be good with the use of Java or Python. Understanding and experience on BigQuery, Looker. Understanding and experience on DBT (Database build tool). Secondary Skills Familiarity & hands-on experience with git, CI/CD tools such as Azure DevOps. Good understanding of GCP, ETL integration with GCP or Azure/AWS or other cloud provider.

Experience: 5 to 10 years Skills Must Have: ETL, Python, AWS, SQL, Validations/QA In data engineering Location: JP Nagar, Bangalore

Immd Joinee Python automation using Robot framework, AWS API Testing Java, C/C++, Python, Java script, HTML, CSS node.js, XML, and DB a must. Experience in data warehousing is a must Face to Face interview Required Candidate profile Immediate Joinee in Bangalore

Role & responsibilities Design, create, code, and support a variety of GCP, ETL & SQL solutions. Experience with agile techniques or methods Work effectively in a distributed global team environment. Effective technical & business communication with good influencing skills Analyze existing processes and user development requirements to ensure maximum efficiency Ability to manage multiple stakeholders, tasks and navigate through ambiguity & complexity Turn information into insight by consulting with architects, solution managers, and analysts to understand the business needs & deliver solutions Maintain strong technical skills and share knowledge with team members Work with system users, othe...

Have at least 2 years of experience in Google Cloud platform (especially Big Query ) Experience with Java and Python and Google Cloud SDK & API Scripting Experience of Finance/Revenue domain will be an added advantage Experience with GCP Migration activities will be an added advantage. Experience in interpreting customer business needs and translate those needs into requirements Experience in delivering artifacts such as scripts (Java or Python), dataflow components Experience in dealing with senior member of the business units (within the organization) and product owners Experience in SDLC with emphasis on specifying, building, and testing mission critical business applications Working know...

At least 8 + years of experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc . At least 3 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines . Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc . Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools ) Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineering efficiencies . Design should help embed standard pr...

We need a GCP Big data engineer. who has experience into GCP Technologies. like GCP, Pyspark, Bigdata, Big Querry, Spark, and must have GCP, SQL, Pyspark, ETL process experience and who can handle a leadership role.