6547 Big Data Jobs - Page 33

Develop and maintain SQL and NoSQL databases in Azure, including schema design, stored procedures and data integrity Continuous improvement of data pipelines using Azure Data Factory As a foundation Developing insightful and interactive business.

Job Title Python/Pyspark Lead Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowle...

We build AI solutions to solve real-world retail problems, and were looking for brilliant minds to join us. Our team is focused on revolutionizing the retail industry through AI-driven innovations that enhance customer experiences, optimize operations, and drive business growth. We are seeking a talented and motivated AI Researcher to join our AI team. In this role, you will design, develop, and implement advanced AI models and algorithms tailored to the unique challenges of the retail domain. Work on projects ranging from personalized recommendation systems to work force optimization, demand sensing, multi agent systems, Digital Humans, Personified AI, Embodied AI etc. Research and develop ...

Locations:Pune Indore Ahmedabad Hyderabad Bangalore We are seeking an experienced Database & Cloud Advisory Specialist with strong expertise in SQL Server and Oracle , along with working knowledge of MongoDB (optional) . The role is primarily advisory in nature , focusing on Google Cloud Platform (GCP) services such as Compute Engine, Cloud SQL, Observability, Backup & Disaster Recovery (DR), and GCVE (Google Cloud VMware Engine) . The candidate will play a key role in guiding teams and clients through cloud migration planning and ensuring best practices in database management and cloud adoption. Key Responsibilities Database Advisory: Provide expert guidance on SQL Server and Oracle databas...

Lead the design, development, and deployment of machine learning and NLP-driven solutions. Fine-tune & productionize Large Language Models (LLMs) and other deep learning solutions. Build robust ML-powered web apps, chatbots, & scalable microservices. Required Candidate profile Proficient in Python &relevant libraries. Exp in NLP, LLM fine-tuning. Exp of deep learning concepts (word embeddings, CNN, RNN, LSTM). Exp working with both structured and unstructured data.

Job Summary Member of a software engineering team involved in development & design of AI Data Platform built on NetApp’s flagship storage operating ONTAP. ONTAP is a feature rich stack with its rich data management capabilities that has tremendous value to our customers and are used in mission critical applications across the world. You will work as part of a team responsible for the development, testing and debugging of distributed software that drives NetApp cloud, hybrid-cloud and on-premises solutions. As part of the Research and Development function, the overall focus of the group is on competitive market and customer requirements, supportability, technology advances, product quality, p...

Job Summary Member of a software engineering team involved in development & design of AI Data Platform built on NetApp’s flagship storage operating ONTAP. ONTAP is a feature rich stack with its rich data management capabilities that has tremendous value to our customers and are used in mission critical applications across the world. You will work as part of a team responsible for the development, testing and debugging of distributed software that drives NetApp cloud, hybrid-cloud and on-premises solutions. As part of the Research and Development function, the overall focus of the group is on competitive market and customer requirements, supportability, technology advances, product quality, p...

About the role PubMatic is seeking Data Analytics focused Senior Software Engineers with expertise in building and optimizing AI agents, including strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, with proficiency in programming languages such as Scala and Python. You will be responsible for developing advanced AI agents that enhance our data analytics capabilities, enabling our platform to handle complex information retrieval, contextual understanding, and adaptive interactions, ultimately improving our data-driven insights and analytical workflows What You’ll Do Build, design, and implement our highly scalable, fault-tolerant big data platform to pro...

Your Role Design, develop, and optimize data pipelines and ETL processes on Snowflake Cloud Data Warehouse. Implement best practices for performance tuning, query optimization, and data modeling in Snowflake. Manage integrations with various data sources and ensure secure, scalable data flow. Azure data factory , Data Bricks, Python, Spark, Pyspark , SQL , ETL process Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications.1. Applies scientific methods to analyse and solve software engineering problems.2. He/she is responsible for the development and application of software engineering practice and knowledg...

Your Role Gen AI ,Computer vision, Cloud exp , Azure Need to understand how the products are developed and even more important, as big data touches the privacy of consumers, they need to have a set of ethical Need to have a natural desire to go beneath the surface of a problem. Confident and self-secure as they more often than not will have to deal with situations where there is a lot of unknown. Good knowledge & experience in Artificial Neural Network ( ANN ), AI conversational Chatbot & Needs to be able to write the required Algorithm and coding programming. Preferably in different programming languages such as Python, Tensor Flow, Keras, AWS (ML and DL), Numpy, and Pytorch. Works in the a...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Job Role Very good Understanding of current work and the tools and technologies being used. Comprehensive knowledge and clarity on Bigquery, ETL, GCS, Airflow/Composer, SQL, Python. Experience working with Fact and Dimension tables, SCD. Minimum 3 years" experience in GCP Data Engineering. Java/ Pytho...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role As a senior software engineer with Capgemini, you should have 4 + years of experience in AWS Data Engineer with strong project track record In this role you will play a key role in AWS S3, Glue, API Gateway, Crawler, Athena, , Lambda, Dynamic DB, Redshift is an advantage Experience/knowledge...

Google Cloud Platform o GCS, DataProc, Big Query, Data Flow Programming Languages o Java, Scripting Languages like Python, Shell Script, SQL Google Cloud Platform o GCS, DataProc, Big Query, Data Flow 5+ years of experience in IT application delivery with proven experience in agile development methodologies 1 to 2 years of experience in Google Cloud Platform (GCS, DataProc, Big Query, Composer, Data Processing like Data Flow) Mandatory Key SkillsAgile Development Methodology,Bigquery,Python,Dataproc,Sql,Data Flow,Java,Shell Scripting,Agile,Google,Gen,Data Processing,Spark,Hadoop,Hive,Sqoop,Big Data,Scala,Aws,Javascript,Kafka,Airflow,Html,Mysql,Linux,Microsoft Azure,Unix,Jenkins,Gcp*

Key Responsibilities : As an Enterprise Data Architect, you will : - Lead Data Architecture : Design, develop, and implement comprehensive enterprise data architectures, primarily leveraging Azure and Snowflake platforms. - Data Transformation & ETL : Oversee and guide complex data transformation and ETL processes for large and diverse datasets, ensuring data integrity, quality, and performance. - Customer-Centric Data Design : Specialize in designing and optimizing customer-centric datasets from various sources, including CRM, Call Center, Marketing, Offline, and Point of Sale systems. - Data Modeling : Drive the creation and maintenance of advanced data models, including Relational, Dimens...

helps employees unleash their potential while creating value for themselves and the company. Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.

We are seeking a highly skilled Data Engineer with strong expertise in Databricks, ETL processes, Azure Cloud, and Python to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures to support our data-driven initiatives. Key Responsibilities: Design and Develop Data Pipelines: Create and optimize scalable data pipelines on Databricks to process and analyze large datasets. ETL Processes: Implement and manage ETL processes to ensure data is accurately extracted, transformed, and loaded from various sources ,DLT Framework: Utilize the Delta Live Tables (DLT) framework to build reliable, maintainable, and...

Google Cloud Platform o GCS, DataProc, Big Query, Data Flow Programming Languages o Java, Scripting Languages like Python, Shell Script, SQL Google Cloud Platform o GCS, DataProc, Big Query, Data Flow 5+ years of experience in IT application delivery with proven experience in agile development methodologies 1 to 2 years of experience in Google Cloud Platform (GCS, DataProc, Big Query, Composer, Data Processing like Data Flow) Mandatory Key Skills sql,data flow,java,shell scripting,agile,google,gen,data processing,spark,hadoop,hive,sqoop,big data,scala,aws,javascript,kafka,airflow,html,mysql,linux,microsoft azure,unix,jenkins,gcp*,agile development methodology*,bigquery*,python*,dataproc*

5-10 years of experience in database development or a related field. Proven experience with database design, development, and management. Experience working with large-scale databases and complex data environments Experience with data modelling and database design. Knowledge of database performance tuning and optimization. Architect, Develop and maintain tables, views, procedures, functions and packages in Database MUST HAVE Performing complex relational databases queries using SQL (AWS RDS for PostgreSQL) and Oracle PLSQL MUST HAVE Familiarity with ETL processes and tools (AWS Batch, AWS Glue etc) MUST HAVE Familiarity with CI/CD Pipelines, Jenkins Deployment, Git Repository MUST HAVE Perfo...

Google Cloud Platform o GCS, DataProc, Big Query, Data Flow Programming Languages o Java, Scripting Languages like Python, Shell Script, SQL Google Cloud Platform o GCS, DataProc, Big Query, Data Flow 5+ years of experience in IT application delivery with proven experience in agile development methodologies 1 to 2 years of experience in Google Cloud Platform (GCS, DataProc, Big Query, Composer, Data Processing like Data Flow) Mandatory Key Skillssql,data flow,java,shell scripting,agile,google,gen,data processing,spark,hadoop,hive,sqoop,big data,scala,aws,javascript,kafka,airflow,html,mysql,linux,microsoft azure,unix,jenkins,gcp*,agile development methodology*,bigquery*,python*,dataproc*

3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Cloud Storage, Terraform, Tekton , Cloudrun , Cloud scheduler, Astronomer/Airflow, Pub/sub, Kafka, Cloud Spanner streaming etc) 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc) 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)KeywordsPython Development,Python,Bigquery,Pandas,Dataproc,Pyspark,Data Flow,Kafka,Cloud Storage,Terraform,Oops,Cloud Spanner,Hadoop,Java,Hive,Spark,Mapreduce,Big Data,Gcp,Aws,Javascript,Mysql,Postgresql,Sql Server,Oracl...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role 12 – 15 Years of relevant experience on Big Data Platforms / Databricks / Data Fabric. Hands on experience in the area of Data Platforms (DwH / Datalake) like Cloudera / Databricks / MS Data Fabric / Teradata / Apache Hadoop / BigQuery / AWS Big Data Solutions (EMR, Redshift, Kinesis) / Qlik etc. Strong understanding of data modelling and datab...

3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Cloud Storage, Terraform, Tekton , Cloudrun , Cloud scheduler, Astronomer/Airflow, Pub/sub, Kafka, Cloud Spanner streaming etc) 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc) 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)Keywordsdataproc,pyspark,data flow,kafka,cloud storage,terraform,oops,cloud spanner,hadoop,java,hive,spark,mapreduce,big data,gcp,aws,javascript,mysql,postgresql,sql server,oracle,bigtable,software development,sql*,pytho...

As an AWS Senior Developer at PwC Advisory Acceleration Center, your role involves interacting with Offshore Manager/ Onsite Business Analyst to understand requirements and taking responsibility for end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your strong experience in AWS cloud technology, planning, organization skills, and ability to work as a cloud developer/lead on an agile team to provide automated cloud solutions will be crucial for success. **Key Responsibilities:** - Architect and deliver highly scalable, distributed, cloud-based enterprise data solutions - Implement Cloud data engineering solutions like Enterprise Data ...

As a Lead AI & Cloud Architect at Texas Instruments, your primary responsibility will be to design and implement highly scalable data & AI systems, optimize MLOps pipelines, and drive cloud modernization initiatives. You will collaborate with cross-functional teams to develop and scale enterprise AI solutions across on-premise, private cloud, and secure public cloud platforms. Key Responsibilities: - Define and implement AI and Data apps & Agents in a hybrid cloud architecture strategy aligned with business objectives. - Develop automation and abstractions for various Infrastructure, applications, data & AI governance frameworks, and automated AI workflows. - Lead cloud transformation projec...

As a Data Scientist at the leading data technology company, your main responsibilities will include: - Create and manage reliable data pipelines for effective data extraction, transformation, and loading (ETL) procedures. - Apply cutting-edge analytics approaches to derive valuable insights from huge datasets. - Work together with cross-functional groups to comprehend company needs and convert them into analytical answers. - Usage of Tableau to create and execute data visualizations that effectively convey insights to stakeholders. - Analyze data to find trends, patterns, and chances for business improvement and process optimization. - Create machine learning algorithms and prediction models...