9747 Big Data Jobs - Page 31

Key Responsibilities: Design, develop, and implement big data solutions using Apache Spark and Hadoop . Develop high-performance distributed applications using Java . Optimize and manage large-scale data processing workflows . Work with HDFS, Hive, HBase, and other Hadoop ecosystem components . Implement real-time and batch processing solutions using Spark Streaming . Troubleshoot and optimize Spark jobs for better performance and efficiency. Collaborate with data engineers, analysts, and business teams to meet project requirements. Ensure data security, reliability, and scalability across distributed systems. Write efficient SQL queries for data extraction and transformation. Participate in...

We are looking for a dynamic professional who brings a unique blend of software development expertise and business analysis acumen. The ideal candidate will have hands-on experience in coding and system design, coupled with a strong understanding of business processes and stakeholder management. Key Responsibilities: Collaborate with stakeholders to gather and analyze business requirements. Translate business needs into technical specifications and solutions. Participate in system design, development, and testing phases. Work closely with development teams to ensure business requirements are met. Create and maintain documentation including BRDs, FRDs, and user stories. Conduct gap analysis a...

Job description Hiring for Ab Initio Specialist Mandatory Skills: Ab Initio Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed functional des...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will ...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : AWS BigData Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with vario...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : Apache Hadoop Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are op...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Business Requirements Analysis Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application requirements are met, facilitating discussions to gather insights, and guiding the development process to align wit...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application requirements are met, overseeing the development process, and providing guidance to team members. You will also engage in problem...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : Python (Programming Language), Amazon Web Services (AWS) Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions that align with business objectives, and ensuring that applic...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your day will involve overseeing the application development process, collaborating with teams, and making key decisions to ensure project success. Roles & Responsibilities: Expected to be an SME Collaborate and manage th...

Role & responsibility Type of profiles we are looking for - 10+ years of experience in driving large data programs in Banking. 8-10 years of Experience in implementing Data Governance frameworks. In depth understanding of RDAR, BCBS 239, Financial & Non-Financial risks. Experience in data engineering and good understanding of ETL & data platforms. Experience in Risk Regulatory & Data programs. Experience of creating data architectures in GCP. Working knowledge of databrics. BFS domain experience is a must Knowledge and POC experience of AI and Automation to be able discuss and provide POV Knowledge and POC experience of AI and Automation to be able discuss and provide POV Good Communication ...

Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team. Design and implement data pipelines Develop ETL jobs to ingest and move data within the AWS environment using tools like AWS Glue Data storage and pr...

Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

Data Engineer Must have 5+ years of experience in below mentioned skills Must Have Big Data Concepts , Python(Core Python- Able to write code), SQL, Shell Scripting, AWS S3 Good to Have Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora

We have taken SQL & HIVE from secondary skillset to Primary requirement as per informed by client recently. Job description / - 5-7 years of experience in Big Data stacks Spark/Scala/Hive/Impala/Hadoop Strong Expertise in Scala The resource should have good hands-on experience in Scala programming language . Should be able to model the given problem statement using Object Oriented programming concepts. Should have the basic understanding of the Spark in-memory processing framework and the concept of map tasks and reduce tasks. Should have hands-on experience on data processing projects. Should be able to frame sqls and analyze data based on the given requirements Advanced SQL knowledge Git h...

Requirements Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

Requirements Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team. Design and implement data pipelines Develop ETL jobs to ingest and move data within the AWS environment using tools like AWS Glue Data s...

We are looking for a highly skilled Automation QA Engineer with hands-on experience in AWS and Big Data ecosystems to join our Quality Engineering team. The ideal candidate will be responsible for developing automated test frameworks and validating large-scale data processing pipelines in cloud-based environments. This role requires strong analytical skills, attention to detail, and the ability to collaborate effectively across teams. and implement automated test frameworks for APIs, data pipelines, and backend systems in AWS. Validate data ingestion, transformation, and processing in Big Data platforms (e.g., Hadoop, Spark, Hive). Develop, maintain, and execute end-to-end test cases coverin...

Requirements Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team. Design and implement data pipelines Develop ETL jobs to ingest and move data within the AWS environment using tools like AWS Glue Data s...

Job Candidate should have data modeling experience, Erwin data modelling tool Experience with AWS and Redshift database models is a plus Designing L2 Layer experience for Large Data Transformation Program Experience of working as a Lead Data Modeler and working with senior stakeholders Knowledge of relational databases and data architecture computer systems, including SQL Experience of ER modeling, big data, enterprise data, and physical data models Experience of working with large data sets. Banking experience is a must. Finance data experience, Anaplan experience is a plus. Familiarity with data modeling software such as SAP PowerDesigner, Microsoft Visio, or erwin DataModeler Excellent pr...

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives

Strong SQL Proficiency Proficiency in developing websites using HTML, CSS, JavaScript, and jQuery Design complex reports that include charts, images, subreports, crosstabs, and more using the Business Intelligence Tool Work on creating dashboards with visualizations Proficiency in HTML, CSS, and JavaScript for rapid prototyping Nice to have Java Comfortable working with Linux Good written and verbal communication Skills and Qualifications: BE, B.Tech, or MS Degree in Computer Science, Engineering, or a related subject Good problem-solving skills, scalable solution development, and a rapid prototyping mindset

Responsibilities: * Design, develop, and maintain big data solutions using Hadoop technologies. * Collaborate with cross-functional teams on project delivery and optimization.

Enroll N Pro is looking for Hadoop to join our dynamic team and embark on a rewarding career journey Collaborate with cross-functional teams to achieve strategic outcomes Apply subject expertise to support operations, planning, and decision-making Utilize tools, analytics, or platforms relevant to the job domain Ensure compliance with policies while improving efficiency and outcomes Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before