5523 Bigquery Jobs - Page 4

About The Role We are seeking an experienced Site Reliability Engineer (SRE) with strong expertise in GCP Cloud Engineering and DevOps practices. The role involves designing, building, and maintaining reliable, scalable, and secure cloud infrastructure, with additional exposure to GCP data products. Location - Bangalore / Experience - 6 - 10 Years Core Expertise o GCP Cloud, Terraform (IaC), Jenkins, GitHub, Harness o CI/CD pipeline design and automation o Kubernetes (GKE/OpenShift) o Python scripting for automation ?¢ Good to Have o Familiarity with IDE platforms (e.g., Backstage IDP) o Understanding of GCP Data ProductsCloud SQL, GCS, Pub/Sub, Dataflow, BigQuery, Vertex AI Experience ?¢ 5+...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you??d like, where you??ll be supported and inspired by?a collaborative community of colleagues around the world, and where you??ll be able to reimagine what??s possible. Join us and help the world??s leading organizations?unlock the value of technology and build a more sustainable, more inclusive world. Your Role Should have 4+ years of experience in GCP Data Engineer with strong project track record Very good Understanding of current work and the tools and technologies being used Comprehensive knowledge and clarity on Bigquery,ETL, GCS,Airflow,Composer, SQL,Python. Dataflow or DataProc o...

Design and execute test plans for ETL processes, ensuring data accuracy, completeness, and integrity. Develop automated test scripts using Python or R for data validation and reconciliation. Perform source-to-target data verification, transformation logic testing, and regression testing. Collaborate with data engineers and analysts to understand business requirements and data flows. Identify data anomalies and work with development teams to resolve issues. Maintain test documentation, including test cases, test results, and defect logs. Participate in performance testing and optimization of data pipelines. Required Skills & Qualifications: Strong experience in ETL testing across various data...

3+ years of experience in a data engineering or related role, managing complex data workflows and large-scale datasets. Expertise in SQL, with the ability to write, optimize, Required Candidate profile Proficiency in Python, including libraries like Pandas, PySpark, and others used for data manipulation and processing. Experience with big data tools such as Apache Spark,

Your future duties and responsibilities: Lead end-to-end data and ETL testing efforts for large-scale data platforms and pipelines Develop and maintain automated test frameworks and test scripts using Python for data validation and quality assurance Perform data integrity, reconciliation, and regression testing across multiple systems and environments Validate ETL workflows, mappings, and transformations in tools such as Informatica, Talend, DataStage, or PySpark-based pipelines Work closely with data engineering teams to understand business logic, data flows, and transformation rules Design and implement data quality metrics, monitoring dashboards, and issue tracking processes Conduct root ...

About us: Working at Tech Holding isnt just a job, its an opportunity to be a part of something bigger We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients Our founders and team members have industry experience and have held senior positions in a wide variety of companies- from emerging startups to large Fortune 50 firms- and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability We are looking for talented Data Engineer to join our team As a Data Engineer, you will be responsible for de...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : API Testing Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are seeking a Tester to support the API development workstream. The role requires strong software testing experience, hands-on expertise in REST API testing, and familiarity with Agile SDLC practices. The tester will ...

About The Role Project Role : Cloud Advisor Project Role Description : Advise stakeholders on best practices to shape cloud transformations. Deliver consulting services focused on agile, scalable cloud architectures and solutions. Must have skills : AI & Data Strategy Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We require a Prompt Engineer to support two critical workstreams, working with multiple Large Language Models (LLMs). The role focuses on designing, defining, and optimizing prompts to enable intelligent automation and data extraction. Roles & Responsibilities:?¢Design and develop APIs/service...

We are looking for a passionate and skilled Fullstack Developer to join our growing team. Youll work on building intuitive, responsive web applications and scalable backend services using modern frameworks and cloud technologies. Responsibilities : Front End : - Design and develop responsive UIs using React.js, HTML, CSS, and JavaScript - Create wireframes and mockups using tools like Figma or Canva - Implement dynamic components and visualizations using Highcharts, Material UI, and Tailwind CSS - Ensure seamless REST API integration Middleware : - Develop and maintain middleware logic using FastAPI (or similar frameworks) - Work with Python for API logic and data processing - Containerize a...

We are looking for a passionate and skilled Fullstack Developer to join our growing team. Youll work on building intuitive, responsive web applications and scalable backend services using modern frameworks and cloud technologies. Responsibilities : Front End : - Design and develop responsive UIs using React.js, HTML, CSS, and JavaScript - Create wireframes and mockups using tools like Figma or Canva - Implement dynamic components and visualizations using Highcharts, Material UI, and Tailwind CSS - Ensure seamless REST API integration Middleware : - Develop and maintain middleware logic using FastAPI (or similar frameworks) - Work with Python for API logic and data processing - Containerize a...

We are looking for a passionate and skilled Fullstack Developer to join our growing team. Youll work on building intuitive, responsive web applications and scalable backend services using modern frameworks and cloud technologies. Responsibilities : Front End : - Design and develop responsive UIs using React.js, HTML, CSS, and JavaScript - Create wireframes and mockups using tools like Figma or Canva - Implement dynamic components and visualizations using Highcharts, Material UI, and Tailwind CSS - Ensure seamless REST API integration Middleware : - Develop and maintain middleware logic using FastAPI (or similar frameworks) - Work with Python for API logic and data processing - Containerize a...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Platform & System Reliability (SRE) Build and maintain highly available, scalable, and fault-tolerant systems in GCP and other cloud environments. Design and implement automated solutions to eliminate toil and improve operational efficiency. Develop, refine, and maintain monitoring, observability, and alerting systems across infrastructure and services. Instrument platforms with OpenTelemetry for metrics, logs, and traces. Own incident response processes, including on-call participation, root-cause analysis, and post-incident improvement actions. Build and support CI/CD pipelines, GitOps workflows, and infrastructure-as-code deployments (e.g., Terraform). Data Reliability Engineering (DRE) E...

Overview : Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at scale. Responsibilities Overall experience of 10+ years with proven track recordof over-achieving engineering, platform delivery and scaling targets in highvolume, innovativeand fast-paced high-pressureenvironment; proven results in delivery on platform products. Solid proficiency in programming languages such as Python, Go and Java Experience with cloud platforms (e.g., GCP, AWS, Azure) and con...

Title and Summary We are seeking a Director-Level Agentic AI Architect who sits at the intersection of massive-scale data engineering and advanced agentic intelligence You will architect the data fabric, the real-time reasoning loops, and the distributed infrastructure required to run AI systems at scalefar beyond prompt engineering This role begins as a hands-on Principal Architect/IC responsible for delivering Phase 0 (PoC) and Phase 1 (MVP) After successful delivery, the role evolves into product engineering leadership, where you will hire and lead a high-impact cross-functional team (AI, Data, Backend, QA) to collaborate with engineering team to scale the platform Core Responsibilities 1...

Key Responsibilities • Lead complex initiatives across product and platform teams, aligning with business and technical objectives. • Own decision-making within a significant area of work including technical, financial, and quality aspects. • Work independently with minimal supervision; manage and meet allocated team and/or technical goals. • Provide leadership in organizational and platform management by applying a wide range of technical and management principles. • Make high-impact decisions that influence milestones, delivery timelines, budget, quality, and performance. • Proactively assess and mitigate technical and operational risks. • Drive and execute highly complex activities across...

Job Title : Big Data Engineer Position : Senior Software Engineer / Lead Analyst Experience : 5-10 Years Category : Software Development/ Engineering Employment Type : Full Time Your future duties and responsibilities: Design and develop scalable data engineering solutions using Google Cloud Platform (GCP) and PySpark. Optimize Spark jobs for performance, scalability, and efficient resource utilization. Develop, maintain, and enhance ETL pipelines using BigQuery, Apache Airflow, and Cloud Composer. Collaborate with data scientists, analysts, and DevOps teams to translate business requirements into technical solutions. Ensure data integrity and security by implementing data governance, compli...

As an experienced architect with over 15 years of overall experience and 6+ years in building cloud applications in production, your role will involve leading global cloud infrastructure architecture in Corporate Bank Technology. You will be responsible for creating domain level architecture roadmaps, ensuring long-term business strategy success, reducing complexity, and managing costs effectively. Additionally, you will build solutions and deliver to production as needed for TAS business, playing a critical role in designing blueprints for GenAI and cloud infrastructure and migration projects. Key Responsibilities: - Lead global cloud infrastructure architecture across domains in Corporate ...

As a Data Engineer at UST, your role involves designing, developing, and optimizing ETL pipelines using PySpark on Google Cloud Platform (GCP). You will work with various GCP services such as BigQuery, Cloud Dataflow, Cloud Composer (Apache Airflow), and Cloud Storage for data transformation and orchestration. Your responsibilities will include: - Developing and optimizing Spark-based ETL processes for large-scale data processing. - Implementing best practices for data governance, security, and monitoring in a cloud environment. - Collaborating with data engineers, analysts, and business stakeholders to understand data requirements. - Troubleshooting performance bottlenecks and optimizing Sp...

As a Data Platform / Database Architect specializing in Postgres and Kafka, you will play a crucial role in designing and optimizing a high-throughput, audit-friendly data platform supporting a SaaS for financial data automation and reconciliation. Your responsibilities will encompass owning the end-to-end design and performance of the data platform, including multitenant Postgres schemas, CDC pipelines, and analytics stores. Additionally, you will be instrumental in laying the groundwork for AI-powered product features. Key Responsibilities: - Design multitenant Postgres schemas with a focus on partitioning, indexing, normalization, and RLS, while defining retention and archival strategies....

As a Vice President, Big Data Scala Engineer, you will be responsible for leading the design, development, and implementation of next-generation big data platforms and applications. Your role will involve technical leadership, engineering and development, team leadership and mentorship, collaboration and stakeholder management, as well as contributing to strategy and innovation. Key Responsibilities: - **Technical Leadership:** - Lead the architecture, design, and development of high-performance big data processing systems using Scala and Apache Spark. - Drive technical vision and strategy for big data initiatives, ensuring alignment with company goals and industry best practices. - Evaluate...

Role Overview: As a Practice Head in Data & AI at Focaloids, you will play a key role in defining and executing the strategic direction of the Data & AI practice. Your responsibilities will involve leading a multidisciplinary team, engaging with clients to design tailored solutions, ensuring delivery excellence, driving innovation in emerging technologies, and identifying new business opportunities to drive revenue growth. Key Responsibilities: - Define and execute the Data & AI practice strategy, covering data engineering, analytics, AI/ML, GenAI, MLOps, and data governance. - Track industry trends and competitive landscapes to enhance Focaloids' positioning. - Expand the service portfolio ...

As a Lead Data Engineer at Indxx, you will be responsible for driving the development of data warehouse, data pipelines, ETL processes, and data integrations to support the organization's data analytics and business intelligence needs. Your role will involve designing, building, and maintaining efficient and reliable data pipelines to transform raw data into actionable insights. You will collaborate closely with developers, analysts, and business stakeholders to optimize data flow and ensure data accessibility across various platforms. Key Responsibilities: - Strong proficiency in writing and optimizing large, complicated SQL queries, and SQL Server Stored Procedures. - Develop, optimize, an...

As an experienced Director AI SEO Expert, you will be responsible for leading the SEO strategy with a strong focus on AI-driven optimization. Your role will involve combining traditional SEO fundamentals with modern AI tools to drive sustainable organic growth. - Develop and lead the overall AI-powered SEO strategy across all digital platforms. - Integrate AI/ML tools to automate keyword research, content planning, clustering, and SERP optimization. - Identify AI-based opportunities to scale SEO through predictive analytics and automated insights. - Conduct advanced technical SEO audits, site speed improvements, schema implementation, and crawl optimization. - Work closely with engineering t...