12278 Big Data Jobs - Page 6

As a senior member of the Engineering team in Pune, your role will involve leveraging advanced data technologies to drive business outcomes in the media and advertising sector. Your primary focus will be on scalability and performance optimization, collaborating across teams to implement comprehensive data strategies and ensure robust, secure data management. - Design and implement an overall data strategy based on business requirements, including data model designs, database development standards, and management of data warehouses and analytics systems. - Identify internal and external data sources and define a plan for data management in alignment with the business data strategy. - Collabo...

Position- Staff Software Engineer (Big Data, GenAI): Experience - 8 Years+ Location- Remote Shift Time- 1PM -10 PM IST Notice Period - (Immediate Joiners are required) Employment Type- FTE Are you energized by the idea of innovating with Generative AI? Do you want to create global impact while tackling challenges at the forefront of Artificial Intelligence? Do you dream of building ground-breaking products that define the future of AI-driven network management? Then come, advance with us . This is a greenfield opportunity to shape next-gen networking experiences at the cutting edge of Generative AI, Machine Learning, Big Data, and Cloud Computing. Youll help define every aspect of the user j...

Position- Senior Software Engineer (Generative AI) Experience - 8 Years+ Location- Remote Shift Time- 1PM -10 PM IST Notice Period - (Immediate Joiners are required) Employment Type- FTE Job Responsibilities : Serve as a thought leader and forward thinkerdriving innovative vision across products and platforms, designing and launching strategic ML solutions, and delivering business-wide innovation Lead the full software development lifecycle (design, testing, deployment, and operations), guide technical discussions and strategy, and actively participate in design reviews, code reviews, and implementation Develop high-performance, production-ready ML code for next-generation real-time ML platf...

As a Big Data Engineer focusing on the Hadoop ecosystem in an IT services and enterprise data engineering sector, your primary role will involve designing, deploying, and maintaining Hadoop ecosystem clusters (HDFS, YARN) to ensure stability, scalability, and security for production workloads. You will be responsible for developing and optimizing batch ETL pipelines using tools like Spark, Hive, and Sqoop to ingest, transform, and store large datasets. Additionally, building and operating streaming data pipelines using Kafka to ensure low-latency delivery and fault tolerance will be a key part of your responsibilities. Performance tuning, capacity planning, and cluster troubleshooting will a...

You should have experience in giving training on Tableau, Excel, SQL, Python, R Programming, and Statistics. It is important to have good knowledge of Data Analysis concepts, Machine Learning, Big Data, and Business Intelligence Tools. Additionally, you should have rich experience in providing classroom training. **Key Responsibilities:** - Provide training on Tableau, Excel, SQL, Python, R Programming, and Statistics - Ensure a good understanding of Data Analysis concepts, Machine Learning, Big Data, and Business Intelligence Tools - Conduct classroom training sessions effectively **Qualifications Required:** - Minimum 5 years of experience in software training (Preferred) You should have e...

Infosys Hirings for PYSPARK Developer Experience: 5-10 years Mandatory Skills: Pyspark, Spark, Python Education: B.Tech/BE/M.Tech/ME/BSC/MSC/BCA/MCA Location: PAN INDIA

Job Description Summary The Sr Data Scientist Engineer delivers end-to-end Data Science and Machine Learning solutions for industrial operations with a focus ontime-series forecasting, anomaly detection, and predictive maintenance. You will lead assigned workstreams as an individual contributor,translate business goals into technical requirements, and productionize models on cloud platforms in partnership with data/platformengineering. The emphasis is on rigorous model development, validation, and lifecycle execution to achieve measurable outcomes (reliability,availability, efficiency, emissions, cost). Candidates should have a minimum of 4 years experience in operations within at least one ...

We are seeking a highly experienced Azure Data Engineer with expertise in Microsoft Azure data services and extensive experience in designing, implementing, and optimizing enterprise-grade data solutions. The ideal candidate will lead data architecture initiatives, ensure high performance, reliability, and security Key Responsibilities: Architect, develop, and optimize scalable, high-performance data solutions using Azure Data Services. Lead the design and implementation of Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and Cosmos DB. Optimize and manage Azure databases including Cosmos DB, SQL Managed Instance, PostgreSQL, MySQL, ensuring...

Position Description: Azure data bricks developer with 3-6 years of experience We are seeking a skilled Azure Databricks Developer to design, develop, and optimize big data pipelines using Databricks on Azure. The ideal candidate will have strong expertise in PySpark, Azure Data Lake, and data engineering best practices in a cloud environment. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Databricks and PySpark Work with structured and unstructured data from diverse sources (e g , ADLS Gen2, SQL DBs, APIs) Optimize Spark jobs for performance and cost-efficiency Collaborate with data analysts, architects, and business stakeholders to understand data needs Develop re...

DBT responsibilities include designing, developing, and handling technical architecture, data pipelines, and performance scaling using tools to integrate Talend data and ensure data quality in a big data environment The candidate must be very strong in PL/SQL, including queries, procedures, and JOINs Experience in Snowflake SQL, writing SQL queries against Snowflake, and developing scripts using Unix, Python, etc , to perform Extract, Load, and Transform operations is essential It is good to have knowledge and hands-on experience with Fivetran Candidates who have worked in production support would be preferred Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Ta...

Job description Hiring for Hadoop Developer Mandatory Skills: Hadoop, bigdata, spark Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed funct...

We are on the lookout for a dynamic and experienced Senior Data Scientist to lead our data science initiatives in India. This pivotal role requires a visionary leader with extensive proficiency in applied mathematics, statistics, and data science techniques. You will set the strategic direction, define best practices, and champion the role of data science in driving our business priorities. TASKS AND RESPONSIBILITIES: Data Science Innovation: Drive the strategic vision for data science, leading cross functional teams in designing and implementing advanced statistical models and machine learning algorithms to solve complex business challenges. Oversee the development and deployment of scalabl...

We are looking for a data engineer with 2-5 years of expertise. Design and develop the database schemas as well as scripts for importing and exporting data utilizing AWS Glue tasks. In an agile environment, the data engineer will work closely with the development team. About You experience, education, skills, and accomplishments Minimum of 2+ years industry experience in data engineering. Bachelors or masters degree in computer science (or similar) Extensive experience in Pyspark/SQL, postgres Experience with AWS services like Glue, s3, Lambda Experience with data modelling and data warehouse. Experience of working within an Agile delivery environment. Good knowledge and understanding of Ver...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

As an experienced Software Engineer working for our leading client, you serve as member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way Depending on the team that you join, you could be developing mobile features that give our customers and clients more control over how they bank with the client, strategizing on how big data can make client''s trading systems quicker, creating the next innovation in payments for merchants, or supporting the integration of client''s private and public cloud platforms Resources should have 1 to 3 experience in handling Low /No Code BPM toolsResources should have 1 to 5 experience in handli...

About The Role Do Research, design, develop, and modify computer vision and machine learning. algorithms and models, leveraging experience with technologies such as Caffe, Torch, or TensorFlow. Shape product strategy for highly contextualized applied ML/AI solutions by engaging with customers, solution teams, discovery workshops and prototyping initiatives. Help build a high-impact ML/AI team by supporting recruitment, training and development of team members. Serve as evangelist by engaging in the broader ML/AI community through research, speaking/teaching, formal collaborations and/or other channels. Knowledge & Abilities- Designing integrations of and tuning machine learning & computer vi...

We are looking for a skilled Data Engineering Manager with 8 to 13 years of experience to lead our team in designing, developing, and optimizing scalable data pipelines and infrastructure. This position is based in Hyderabad. Roles and Responsibility Lead a team of data engineers to design, develop, and optimize scalable data pipelines and infrastructure. Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines for efficient data processing and integration. Build and maintain scalable, fault-tolerant data architectures ensuring efficient data storage, retrieval, and processing across cloud and on-premises environments. Oversee the design, implementation, and performanc...

As an experienced Software Engineer working for our leading client, you serve as member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way Depending on the team that you join, you could be developing features that give our customers and clients more control over how they bank with the client, strategizing on how big data can make client''s trading systems quicker, creating the next innovation in payments, or supporting the integration Strong proficiency in Java 11+, FullStack including JMS MQ, Java, Springboot, Oracle, SQL, Unix Scripting, Git, Jira, Dev Ops, CI /CD, Cucumber/TestNG, Design and develop scalable Front End so...

Purpose/Objective To establish a robust analytics-driven decision-making capability for NMDPL, enabling the business to achieve its strategic objectives in both short and long term. The role involves developing Analytics and AI roadmaps for each business vertical, aligned with overall business and digital strategies. It includes designing, building, and optimizing data infrastructure and systems for efficient data storage, organization, and access, while ensuring seamless integration of AI solutions. The position provides a strategic and technical foundation for data management, driving operational efficiency, and delivering AI-driven solutions that enhance key value drivers and business out...

At Allstate, great things happen when our people work together to protect families and their belongings from life??s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers?? evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description The Sr. Engineering Manager is the direct leader of more critical groups with significant responsibilities. These groups may sometimes be more heavily resourced with more senior staff or more staff in general or be responsible for more technically complex...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models with a focus on...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorp...

About this role: Wells Fargo is seeking a Senior Systems Operations Engineer In this role, you will: Lead or participate in managing all installed systems and infrastructure within the Systems Operations functional area Contribute in increasing system efficiencies and lowering the human intervention time on related tasks Review and analyze moderately complex operational support systems, application software, and system management tools to ensure the highest levels of systems and infrastructure availability Work with vendors and other technical personnel for problem resolution Lead team to meet technical deliverables while leveraging solid understanding of technical process controls or standa...

Education Qualification: Bachelors degree in computer science or related field or higher with minimum 11 years of relevant experience. Position Description: As a Cognitive SON Architect, you will be responsible for designing, developing, and implementing AI-driven solutions to enhance the performance, scalability, and self-management of telecommunications networks. You will work in close collaboration with cross-functional teams to build and deploy intelligent network automation tools leveraging machine learning, artificial intelligence, and advanced analytics. The goal is to deliver innovative solutions to optimize the operation and evolution of modern mobile networks, particularly focusing...