4186 Bigquery Jobs - Page 40

Data Engineer : You will be responsible for designing building and maintaining our data infrastructure ensuring data quality and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data engineering excellent problem-solving skills and a passion for working with data. Responsibilities: Design build and maintain our data infrastructure including data pipelines warehouses and databases Ensure data quality and integrity by implementing data validation testing and monitoring processes Collaborate with cross-functional teams to understand data needs and translate them into technical requirements Develop and implement data security and ...

JD GCP Data Engineer Responsibilities: Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. Use Pub/Sub for real time data ingestion and streaming analytics. Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. Optimize data storage and retrieval processes to enhance performance and reduce costs. Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. Ensure data quality and integrity through robust testing and validation processes...

Responsibilities: Analyzing and translating business requirements into solution data models. Evaluating existing Data Systems. Knowledge on SSIS is preferrable Knowledge on Banking and Credit card is preferrable Working with development team to create conceptual data model and data flows Implementing data strategies and physical data models Updating and optimizing metadata models Evaluating implemented data system for variances, discrepancies and efficiency Required Skill Set: Hadoop Hive Spark

.Net Full Stack Lead Application Developer - .Net, GCP, Cloud, Microservices Job Summary This position provides leadership in full systems life cycle management (e.g., analyses, technical requirements, design, coding, testing, implementation of systems and applications software, etc.) to ensure delivery is on time and within budget. He/She directs component and data architecture design, technology planning, and testing for Applications Development (AD) initiatives to meet business requirements and ensure compliance. This position develops and leads AD project activities and integrations. He/She guides teams to ensure effective communication and achievement of objectives. This position resear...

Roles and Responsibility Collaborate with cross-functional teams to design and implement AI solutions using Gen AI. Develop and maintain large-scale network architectures for seamless data flow and communication. Provide technical expertise in software development and platform implementation. Analyze complex problems and develop innovative solutions using AI technologies. Work closely with clients to understand their requirements and provide tailored solutions. Stay updated with industry trends and emerging technologies in AI and software platforms. Job Requirements Strong understanding of AI concepts, including machine learning and natural language processing. Experience with software devel...

Industry: Information Technology & Services Experience: 15+ years of overall IT experience , including 8-10 years of deep expertise in Cloud Data Architecture, Artificial Intelligence, and advanced analytics , with hands-on leadership in designing and implementing end-to-end cloud-native AI solutions . The Role CriticalRiver is seeking an experienced and forward-thinking Cloud Data & AI Architect to lead the design and implementation of our scalable, end-to-end data ecosystem. You will be the mastermind behind our data infrastructure, responsible for architecting robust systems that support everything from advanced analytics to cutting-edge artificial intelligence applications. This is a cri...

Work Location: ~CHENNAI, TN. Skill Required: Digital : Google Data Engineering Experience Range in Required Skills: 4-6 years Job Description: Develops and maintain scalable data pipelines using GCP cloud Infrastructure. Work closely with Business teams to help build complex Data migration pipelines to seamlessly onboard Data products. Help, streamline Data migration workflows, adding value to Client Data Hubs. Work on agile software development processes to onboard various data products of Client to GCP Cloud. Build and document scalable data pipelines that cleanse, transform and curate the data to insights. Build reusable frameworks to ingest different data patterns.

Responsibilities: * Design, develop & maintain data pipelines using Python, Kafka, Airflow & BigQuery. * Optimize performance through Spark & SQL queries with Docker containers.

As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. Your primary responsibilities includeComprehensive Feature Development and Issue ResolutionWorking on the end to end feature development and solving challenges faced in the implementation. Stakeholder Collaboration and Issue ResolutionCollaborate with key stakeholders, internal and external, to understand the problems, issues with the product and features and solve the issues as per SLAs defined. Continuous Learning and Technology IntegrationBeing eager to ...

As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact! IBM’s Cloud Services are focused on supporting clients on their cloud journey across any platform to achieve their business goals. It en...

As an Associate Software Developer.. As an entry level Application Developer at IBM, you'll work with clients to co-create solutions to major real-world challenges by using best practice technologies, tools, techniques, and products to translate system requirements into the design and development of customized systems. In your role, you may be responsible for: Working across the entire system architecture to design, develop, and support high quality, scalable products and interfaces for our clients Collaborate with cross-functional teams to understand requirements and define technical specifications for generative AI projects Employing IBM's Design Thinking to create products that provide a ...

Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities: 1) Collaborate with business and technology stakeholders to understand current and future data requirements 2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow ...

Job Title: GCP Data Engineer Work Mode: Onsite Base Location: Bangalore Experience Required: 3+ Years Employment Type: Direct Payroll with Client Job Summary: We are seeking a skilled GCP Data Engineer with strong expertise in Python and hands-on experience in designing and developing scalable data pipelines on Google Cloud Platform (GCP) . The ideal candidate should have a solid understanding of BigQuery , ETL/ELT processes , and data modeling , along with exposure to core GCP data services such as Dataflow , Pub/Sub , and Dataproc . Key Responsibilities: Design, develop, and maintain scalable data pipelines using Python, BigQuery, and GCP Dataflow. Implement efficient data models, partitio...

Role Overview: As a candidate with over 12 years of experience, you should have a strong understanding of solution application design and development integration migration. Specifically, you should possess at least 5 years of experience in GCP (Google Cloud Platform) or Similar Cloud Technologies. Your expertise should include knowledge of Google Cloud Platform technologies such as BigQuery, pubsub, Dataflow, Data Catalog, Composer, DAG, Airflow, Complex SQL, Stored Procedures. Additionally, you should have experience in delivering data architect solutions using BigQuery, Google Dataflow, Google pubsub, Google Cloud SQL, Google Compute Engine, and Bigtable. Your role will require a solid und...

Job Description: As a member of the Analytics Team at the company, you will partner with marketing, product, and IT to influence business strategy through web/app analytics. Your role will involve providing support in platform utilization and adoption, serving as the subject matter expert for customer data and analytics platforms. Your success will be measured by your ability to provide actionable recommendations from business questions delivered from analytics platforms. Collaboration with analytics counterparts across data science, business intelligence, and insights will be crucial in conceptualizing and translating questions into actions and outcomes. Key Responsibilities: - Be the Subje...

As a GCP Data Engineer, you will be responsible for designing and implementing solutions on Google Cloud Platform (GCP) utilizing various GCP components. Key Responsibilities: - Implementing and architecting solutions on GCP using components such as BigQuery, SQL, Cloud Composer/Python, Cloud Functions, Dataproc with PySpark, Python Injection, Dataflow with PUB/SUB. - Experience with Apache Beam, Google Dataflow, and Apache Spark in creating end-to-end data pipelines. - Proficiency in Python, Hadoop, Spark, SQL, BigQuery, BigTable, Cloud Storage, Datastore, Spanner, Cloud SQL, and Machine Learning. - Programming expertise in Java, Python, and other relevant technologies. - Certified in Googl...

As a Data Modeller, your role will involve hands-on data modelling for OLTP and OLAP systems. You should have proficiency in GCP, Data Modelling (OLTP, OLAP), indexing, DBSchema, CloudSQL, and BigQuery. It is crucial to have a strong understanding of Conceptual, Logical, and Physical data modelling. Your responsibilities will include: - Hands-on data modelling for OLTP and OLAP systems - In-depth understanding of Conceptual, Logical, and Physical data modelling - Strong grasp of Indexing, partitioning, and data sharding - Solid understanding of variables impacting database performance for near-real-time reporting and application interaction Experience with at least one data modelling tool, p...

As the Technology Operations Lead at Deutsche Bank in Bangalore, India, you will play a crucial role in partnering with stakeholders globally to optimize processes and platforms across production. You will lead a team focused on driving continual improvement through automation, monitoring enhancements, and ensuring platform hygiene. Additionally, you will provide thought leadership in resolving IT failings, improving efficiencies, and enhancing system availability by proactively addressing emerging trends. Your responsibilities will include technical analysis, business workflow enhancements, strategic goal tracking, and fostering a culture of innovation within the organization. - Partner wit...

You will be responsible for designing, deploying, and managing infrastructure using Google Cloud Platform (GCP) services, including Compute Engine, Cloud Storage, IAM, and VPC networking. Additionally, you will manage and optimize Google Kubernetes Engine (GKE) clusters for containerized workloads, build and maintain robust CI/CD pipelines, integrate security and compliance checks into the deployment lifecycle, orchestrate and automate data workflows using GCP Composer, support GCP Dataflow pipelines, integrate with BigQuery, develop and deploy Cloud Functions, manage Cloud Storage buckets, and implement observability solutions using Cloud Monitoring and Cloud Logging. - Design, deploy, and ...

As a Data Engineer with 5-10 years of experience, your role will involve the following responsibilities: - Build and maintain robust, scalable data pipelines and systems. - Design and implement ETL processes to support analytics and reporting. - Optimize data workflows for performance and scalability. - Collaborate with data scientists, analysts, and engineering teams. - Ensure data quality, governance, and security compliance. You are required to have the following skills: - Strong experience with Python/Scala, SQL, and ETL tools. - Hands-on experience with Big Data technologies such as Hadoop, Spark, Kafka, and Hive. - Proficiency in Cloud Platforms like AWS, GCP, or Azure. - Experience wi...

As a Software Engineer Practitioner at TekWissen in Chennai, you will be a crucial part of the team responsible for developing and maintaining the Enterprise Data Platform. Your main focus will be on designing, constructing, and enhancing scalable data pipelines within the Google Cloud Platform (GCP) ecosystem. By leveraging GCP Native technologies such as BigQuery, Dataform, Dataflow, and Pub/Sub, you will ensure data governance, security, and optimal performance. This role provides you with the opportunity to apply your full-stack expertise, collaborate with talented teams, and establish best practices for data engineering at the client. Key Responsibilities: - Design, build, and optimize ...

As a Data Modeling Engineer specializing in Near Real-time Reporting at our company, your role will involve creating robust and optimized schemas to facilitate near real-time data flows for operational and analytical purposes within Google Cloud environments. Your primary focus will be on designing models that ensure agility, speed, and scalability to support high-throughput, low-latency data access needs. - Design data models that align with streaming pipelines - Develop logical and physical models tailored for near real-time reporting - Implement strategies such as caching, indexing, and materialized views to enhance performance - Ensure data integrity, consistency, and schema quality duri...

You will be a Staff, Software Engineer based in Bangalore with 10-15 years of experience. The Enterprise Business Services team at IDC Bangalore and Chennai is dedicated to data-driven, highly optimized products and implementations in Finance, Procurement, Human Resources, and Retail business functions for multiple Walmart markets using open stack technologies and ERP tools. - **Architectural Leadership:** - Lead the adoption of modern architectural patterns for application modernization. - Analyze gaps between current systems and emerging business needs to deliver cutting-edge, scalable designs. - **Drive Technical Excellence:** - Provide technical leadership in conducting impact analyses a...

You will be an experienced Senior Data Engineer utilizing Big Data & Google Cloud technologies to develop large-scale, on-cloud data processing pipelines and data warehouses. As part of your role, you will consult customers across the world on their data engineering needs around Adobe's Customer Data Platform. Additionally, you will support pre-sales discussions around complex and large-scale cloud data engineering solutions, design custom solutions on the cloud integrating Adobe's solutions in a scalable and performant manner, and deliver complex, large-scale, enterprise-grade on-cloud data engineering and integration solutions in a hands-on manner. Key Responsibilities: - Consult customers...

About The Role Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets. About The Role - Grade Specific The role support the team in building and maintaining data infrastructure and systems within an organization. Skills (competencies) Ab Initio Agile (Software Development Framework) Apache Hadoop AWS Airflow AWS Athena AWS Code Pipeline AWS EFS AWS EMR AWS Redshift AWS S3 Azure ADLS Gen2 Azure Data Factory Azure Data Lake Storage Azure Databricks Azure Event Hub Azure Stream Analytics Azure Sunapse Bitbucket Change Management Client Ce...