5583 Bigquery Jobs - Page 47

As a Data Engineer at Codvo, you will be responsible for designing, implementing, and maintaining scalable data pipelines on Google Cloud Platform (GCP) including BigQuery, Dataflow, Pub/Sub, and Cloud Storage. You will ingest and process real-time data from connected vehicles and IoT devices. Additionally, your role will involve developing and maintaining ETL/ELT workflows using Python, SQL, and Apache Beam/Spark. Ensuring data quality, lineage, and governance in the data lake will be a key part of your responsibilities. You will act as a bridge between data engineering and analytics teams, performing data wrangling, feature engineering, and ML model prototyping. Supporting pipeline automat...

You will be responsible for providing strategic leadership and thought leadership by developing and communicating a long-term vision and strategy for Data Sciences, Analytics, AI, and BI aligned with Aramex's business strategy and growth objectives. Additionally, you will drive innovation in analytics and AI to enhance business decision-making and operational efficiency. Your role will involve actively engaging with business stakeholders to understand complex requirements, desired outcomes, and strategic priorities. You will design and deliver fit-for-purpose analytics and AI solutions that optimize operations, improve customer satisfaction, and drive revenue. Furthermore, you will use insig...

Job Application Link:https://app.fabrichq.ai/jobs/2a67ae57-0ab2-4f16-a20b-4393c419c58d Job Summary: Senior Data Engineer responsible for designing, developing, and managing data infrastructure and pipelines. Leads technical aspects of data workflows includin,g ETL processes, storage optimization, and API development using Databricks, AWS, Azure, GCP and various databases. Provides technical leadership and mentorship while ensuring data quality, security, and compliance. Key Responsibilities Lead the design, development, and maintenance of data pipelines and ETL processes Architect and implement scalable data solutions using Databricks and AWS Optimize data storage and retrieval systems using...

As a Data Engineer at DXFactor, a US-based tech company with a global customer base, you will play a crucial role in designing, developing, and maintaining scalable data pipelines for both batch and streaming workflows. Your expertise in SnowFlake, AWS, and Python will be essential for implementing robust ETL/ELT processes to extract data from various sources and load them into data warehouses. Your responsibilities will also include optimizing database schemas, creating documentation for data flows, collaborating with cross-functional teams, monitoring data pipelines for performance, and implementing data quality checks and validation processes. Additionally, you will build and maintain CI/...

As a Senior Data Engineer at Infogain, you will be responsible for leading the design and execution of the Dataproc to Databricks PySpark migration roadmap. Your role will involve defining a modernization strategy encompassing data ingestion, transformation, orchestration, and governance. Additionally, you will architect scalable solutions using Delta Lake and Unity Catalog, ensuring optimal performance and cost efficiency. Key Responsibilities: - Lead the design and execution of Dataproc to Databricks PySpark migration roadmap. - Define a modernization strategy for data ingestion, transformation, orchestration, and governance. - Architect scalable Delta Lake and Unity Catalog-based solution...

Role Overview: As a Senior Salesforce Administrator at our company, you will play a crucial role in leading the operational health, scalability, and governance of our Salesforce platform. Your responsibilities will include serving as the technical owner of configuration, automation, and release management to ensure Salesforce operates as a reliable, high-performing system supporting various workflows. Additionally, you will provide mentorship to junior Salesforce administrators and act as a trusted advisor to product and development teams. Key Responsibilities: - Own day-to-day administration of Salesforce, including user management, profiles, roles, permission sets, and security controls. -...

As a Data Pipeline Engineer/ Data Lineage Engineer at Solidatus, your primary responsibility will be to prepare data lineage solutions for clients" existing data pipelines. You will collaborate with cross-functional teams to ensure the integrity, accuracy, and timeliness of data lineage solutions, directly impacting the value clients gain from the product. Your role will involve working closely with clients to help them achieve their contractual goals. **Experience:** - Proven experience as a Data Engineer or in a similar role, with hands-on experience in building and optimizing data pipelines and infrastructure. - Strong problem-solving and analytical skills to diagnose and resolve complex ...

Role Overview: As a Data Engineering Lead, you will provide technical leadership and mentorship to a team of data engineers. Your primary responsibility will be to design, architect, and implement highly scalable, resilient, and performant data pipelines. Your expertise in GCP technologies like Dataproc, Cloud Composer, Pub/Sub, and BigQuery will be highly beneficial in this role. Key Responsibilities: - Guide the team in adopting best practices for data engineering, including CI/CD, infrastructure-as-code, and automated testing. - Conduct code reviews, design reviews, and provide constructive feedback to team members. - Develop and maintain robust data pipelines to ingest, process, and tran...

As a Data Engineer, your role will involve: - Conducting tests on data pipelines and evaluating results against data quality and performance specifications. - Applying and optimizing data models for efficient storage, retrieval, and processing of large datasets. - Communicating and explaining design/development aspects to customers. - Estimating time and resource requirements for developing/debugging features/components. - Participating in RFP responses and solutioning. - Mentoring team members and guiding them in relevant upskilling and certification. Qualifications required: - Bachelors or masters degree The company also values strong development experience in Snowflake, Cloud (AWS, GCP), ...

Role Overview: As a Group Manager based in Noida, with 11 years of experience in India, your main responsibility will be to lead the technical aspects of creating proposals and responding to Requests for Proposals (RFPs) or Requests for Information (RFIs). You will collaborate with sales teams and prospective clients, including technical staff and C-level executives, to understand their business objectives, technical requirements, pain points, and existing infrastructure. Additionally, you will design and architect solutions on Google Cloud Platform (GCP) incorporating various services. Your role will require you to develop and deliver technical presentations, whiteboard sessions, product de...

As a Data & AI Telecom Analytics Consultant at Accenture Strategy & Consulting Global Network - Data & AI practice, you will play a crucial role in helping clients grow their business through analytics. Your responsibilities will include designing and delivering AI solutions, working with large datasets, proposing solutions based on gap analysis, and understanding customer needs to translate them into business requirements. You will also be expected to establish a collaborative presence with clients, act as the primary point of contact, and crunch data to craft compelling stories for senior client stakeholders. Moreover, you should have the ability to travel or relocate to Japan as per busin...

Candidate Specification: 8+ year experience with Data Engineer Job Description Strong expertise in GCP (BigQuery, Cloud Storage, Cloud Functions, Pub/Sub, Dataflow, Composer) Advanced proficiency in SQL and hands-on experience with BigQuery Strong Python development skills for data processing and automation Experience with ETL/ELT pipeline design, data modeling, and performance tuning Familiarity with Git, CI/CD tools, and containerization (Dockernice to have)

You will be responsible for designing, deploying, and managing Tableau Server/Cloud environments across development, test, and production tiers. Your key responsibilities will include: - Defining and implementing architecture for high availability (HA), disaster recovery (DR), and load balancing. - Managing Tableau Server installations, upgrades, migrations, and patches in both Windows and Linux environments. - Configuring Active Directory integration, SSL, and SAML/SSO authentication mechanisms such as Okta, Azure AD, and Ping. - Administering licenses, user roles, and group permissions according to organizational security policies. - Establishing governance frameworks for content publishin...

Job Description:- Key Responsibilities Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark. Implement data ingestion and transformation pipelines using Delta Lake best practices. Apply conversion rules and templates for automated code migration and testing. Conduct data validation between legacy and migrated environments (schema, count, and data-level checks). Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. Ensure best practices for code versioning, error handling, and performance optimization. Participate in UAT, troubleshooting, and post-migration validation activities. T...

Job description, Hiring for GCP Data Engineer with experience range 5 years & above Mandatory Skills: Google Big query, GCP, Bigdata Education: BE/B.Tech/MCA/M.Tech/MSc./MS Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requireme...

Job Description Responsibilities: Infrastructure as Code (IaC): Design, implement, and manage infrastructure as code using Terraform for GCP environments. Ensure infrastructure configurations are scalable, reliable, and follow best practices. GCP Platform Management: Architect and manage GCP environments, including compute, storage, and networking components. Collaborate with cross-functional teams to understand requirements and provide scalable infrastructure solutions. Vertex AI Integration: Work closely with data scientists and AI specialists to integrate and optimize solutions using Vertex AI on GCP. Implement and manage machine learning pipelines and models within the Vertex AI environm...

Maintain architecture principles, guidelines and standards Data Warehousing Programming Language: Python/Java Big Data Data Analytics GCP Services Relevant technology domains: Experience in designing & implementing solution in mentioned areas: Strong Google Cloud Platform Data Components BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion, Etc Technical Data Engineer who is strong on Data Warehousing, Big Data, Data Analytics Experience with developing software code in one or more languages such as Java and Python. Strong Google Cloud Platform Data Components BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion, Etc Demonstrate extensive skills and success in the impleme...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Educational Requirements Bachelor of Engineering,BTech,BSc,BCA,MCA,MSc,MTech Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your t...

Educational Requirements Bachelor of Engineering,BTech,BSc,BCA,MTech,MCA,MSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to provide best fit architectural solutions for one or more projects. You would also provide technology consultation and assist in defining scope and sizing of work You would implement solutions, create technology differentiation and leverage partner technologies. Additionally, you would participate in competency development with the objective of ensuring the best-fit and high quality technical solutions. You would be a key contributor in creating thought leadership w...

Educational Requirements Bachelor of Engineering,BTech,BSc,BCA Service Line Cloud & Infrastructure Services Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability Good knowledge on software configuration management systems Awareness of latest technologies and Industry trends Logical thinking and problem solving skills along with an ability to collaborate Understanding of the financial processes for various types of projects and the various pricing models available Ability to assess the current processes, identify improvement areas and suggest the technology solutions One or two industry domain knowledge Client ...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Knowledge of design principles and fundamentals of architecture Understanding of performance engineering Knowledge of quality processes and estimation techniques Basic understanding of project domain Ability to translate functional / nonfunctional requirements to systems requirements Ability to design and code complex programs Ability to write test cases and scenarios based on the specifications Good understanding of SDLC and agile methodologies Awareness of latest technologies and trends Logical thinking and problem-solving skills along with an ability to collaborate Technical and Profession...

About The Role As a Senior Analyst, you will be a Subject Matter Expert (SME) on Chatbot Strategy driving long-term growth and working on incorporating the newest technologies like LLM. In this role, you will drive tangible business impact by delivering high-quality insights and recommendations that are grounded in your ability to combine strategic thinking and problem-solving with detailed analysis. This position offers a unique opportunity to collaborate closely with Product Managers and cross-functional teams, uncovering valuable business insights, devising optimization strategies, and validating them through experiments. What Youll Do Collaborate with Product and Analytics leadership to ...

Responsibilities: Infrastructure as Code (IaC): Design, implement, and manage infrastructure as code using Terraform for GCP environments. Ensure infrastructure configurations are scalable, reliable, and follow best practices. GCP Platform Management: Architect and manage GCP environments, including compute, storage, and networking components. Collaborate with cross-functional teams to understand requirements and provide scalable infrastructure solutions. Vertex AI Integration: Work closely with data scientists and AI specialists to integrate and optimize solutions using Vertex AI on GCP. Implement and manage machine learning pipelines and models within the Vertex AI environment. BigQuery St...