132 Bigdata Jobs

• Maintain architecture principles, guidelines • Data Ware • Programming Language: Python/Java • Big Data • Data Analytics • GCP Services Strong Google Cloud Platform Data Components BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion

As a Software Engineer at Wells Fargo, your role involves participating in low to moderately complex initiatives and projects within the technology domain. You will be responsible for tasks such as installation, upgrades, and deployment efforts. Additionally, you will identify opportunities for service quality and availability improvements, design, code, test, debug, and document projects associated with the technology domain. Your responsibilities also include reviewing and analyzing technical assignments related to low to medium risk deliverables, providing recommendations for issue resolution, and collaborating with technology colleagues, internal partners, and stakeholders. Key Responsib...

Role Overview: You are seeking an experienced Senior Big Data Cloud Quality Assurance Engineer to join a dynamic team. Your role involves ensuring the quality and performance of big data applications and services deployed in cloud environments. You will collaborate with developers, product managers, and stakeholders to define testing strategies, develop test plans, and execute comprehensive testing processes. Key Responsibilities: - Design and implement test plans and test cases for big data applications in cloud environments. - Perform functional, performance, and scalability testing on large datasets. - Identify, record, and track defects using bug tracking tools. - Collaborate with develo...

Desired Skills and Experience: Experience with architecting, designing and implementing end-to-end cloud infrastructure solutions across leading Cloud platforms with a special focus on Azure and Google Cloud Platform Proven experience in architecting private cloud/data center solutions using virtualization technologies like VMware, with strong expertise in implementing DevOps/DevSecOps practices and automation strategies Hands-on experience of leading cloud and infrastructure strategy / current state assessment workshops with client stakeholders and defining target operating model (TOM) / Cloud Center of Excellence driving large-scale cloud migration planning including infrastructure right s...

You're ready to gain the skills and experience needed to grow within your role and advance your career and JPMorgan Chase has the perfect software engineering opportunity for you. As a Software Engineer II - Big Data/Java/Scala at JPMorgan Chase within the Liquidity Risk (LRI) team, you will be instrumental in designing and implementing the next generation buildout of a cloud native liquidity risk management platform. Our technology organization is committed to providing comprehensive solutions for managing the firm's liquidity risk and fulfilling our regulatory reporting obligations across more than 50 markets. The program will involve strategic development of advanced liquidity calculation...

Role Overview: Transport is at the core of modern society and the Electromobility organization within Volvo Group is seeking a Group Manager for Data Analytics to play a key role in developing the team and building capability & capacity to deliver various programs within Electromobility. As the Group Manager, you will lead a talented team of engineers to develop cutting-edge technologies and solutions that propel Electromobility forward. Key Responsibilities: - Contribute to the data life cycle during the product development journey to create world-class solutions for electromobility systems - Provide insights for product development, uptime, and continuous improvement by understanding custo...

Job Overview : We are seeking an experienced ETL Tester to validate data extraction, transformation, and loading processes across various data platforms The ideal candidate will have strong hands-on experience in ETL processes, SQL, Data Warehousing, and will work closely with developers, analysts, and data engineering teams to ensure data accuracy, quality, and reliability Key Responsibilities : Understand business and data requirements to design test scenarios and test cases for ETL processes Perform data validation and data integrity testing across multiple source and target systems Validate data transformations, mappings, and business logic applied during ETL Execute SQL queries for data...

This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

Overall experience 7+ years with minimum 5+ years experience in Spark, Python Proficient in Python, PySpark, and Object-oriented programming concepts. Proven experience as a Senior Data Engineer or similar role. Strong problem-solving techniques with an ability to troubleshoot complex software issues. Excellent communication skills, both written and verbal. Self-motivated and able to work independently with minimal supervision.

Revised JD: Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code Big Data Engineering: Experience in Big Data Engineering projects Good to Have (Added Advantage): Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) F2F interviews only - Bangalore/Chennai/Pune/Noida/Bhubaneshwar

As a candidate for the position, you should have 4 to 7 years of experience in Bigdata and GCP. Your key responsibilities will include: - Utilizing your expertise in Bigdata and GCP to contribute to the team's projects and initiatives. The qualifications required for this role are: - Must have experience in Bigdata and GCP. Please note that the company did not provide any additional details in the job description.,

As a Lead Software Engineer / Associate Architect, your role will involve designing and implementing scalable and robust data engineering solutions. You should have 8 to 12 years of experience and possess the following skills: - In-depth understanding of Big data concepts and distributed systems - Proficiency in Python and writing code in PySpark - Good understanding of SQL concepts and ability to write complex SQL queries - Knowledge of optimization and performance improvement for Spark based workloads - Experience with at least one Cloud platform is preferred - Conceptual knowledge of Data Structures & Algorithms - Familiarity with various Data Processing Patterns (Batch/NRT/RT processing)...

As a Sr. Engineering Manager at Target, you will lead an engineering team to build solutions for the AdTech platform in an agile environment. Your success in this role will depend on your strong problem-solving skills, innovative approach, technical leadership, and effective communication. You will collaborate with cross-functional teams to deliver AdTech capabilities such as DSP, SSP, and Ad Servers for self-service advertising needs. Your responsibilities will include: - Managing the overall software development cycle, ensuring high-quality code for common assets and framework components - Building and leading a team of high-caliber software development engineers - Architecting and develop...

As an Applications Development Senior Programmer Analyst at Citigroup, your role involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your primary objective is to contribute to applications systems analysis and programming activities. **Key Responsibilities:** - Conduct feasibility studies, time and cost estimates, IT planning, risk technology, and model development - Establish and implement new or revised applications systems and programs to meet specific business needs - Monitor and control all phases of development process including analysis, design, testing, and implementation - Provide...

In this role, you will be responsible for: - Demonstrating in-depth knowledge in databases, with a preference for individuals with 3-5 years of experience in RDBMS / NoSQL. - Utilizing experience in Bigdata tools such as Hadoop / Spark, which will be considered an additional advantage. - Showcasing your ability to handle Cloud environments like AWS setup / Google Cloud setup effectively. - Utilizing your educational background, where a Bachelor's degree with a focus in Mathematics, Computer Science, Statistics, or any other analytical field is preferred. - Applying your experience in data models and reporting packages, along with strong clustering experience. - Demonstrating your ability to ...

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Dataproc, Data Flow, Bigtable, and other GCP services. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop automated testing frameworks to ensure high-quality code delivery. Troubleshoot complex issues related to big data processing and storage on Google Cloud Platforms. Participate in code reviews to improve overall quality of the software development process. SKill Required: GCP, Data engineer Location - Chennai Preferred Work Mode: 4 days work from office Permanent Parent Payroll with V2 soft (client ford motors) ...

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Dataproc, Data Flow, Bigtable, and other GCP services. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop automated testing frameworks to ensure high-quality code delivery. Troubleshoot complex issues related to big data processing and storage on Google Cloud Platforms. Participate in code reviews to improve overall quality of the software development process. Work Mode: 4 days work from office Permanent Parent Payroll with V2 soft (client ford motors) POC: Kavinila Interested Candidate can send your updated resume ...

Job Description: As a senior Applications Development Technology Lead Analyst at the company, your role involves establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main objective is to lead applications systems analysis and programming activities. Partner with multiple management teams to ensure appropriate integration of functions and identify necessary system enhancements for deploying new products and process improvements. Resolve high-impact problems/projects by evaluating complex business processes, system processes, and industry standards. Provide expertise in applications programming, ensuring application design...

As a Bid Manager and Presales Specialist, your role involves managing the bid management process and presales ecosystem. You will independently handle large scale RFPs and drive them to completion. Collaboration with diverse teams to develop compelling storylines for collaterals and proposals will be crucial. Your creativity and ability to generate innovative ideas for proposal responses will be highly valued. Understanding tools/technologies/platforms such as ServiceNow, SalesForce, Korber, GenAI, Cloud, Bigdata at a business and functional level is essential. Experience in sectors like Supply Chain, Fintech, Healthcare & Life Sciences is advantageous. Proficiency in commercial models like ...

As a Senior Spark SQL/SQL Developer, you will be responsible for designing, developing, and optimizing complex database systems to meet business requirements and support critical applications. Your key responsibilities will include: - Designing, developing, and optimizing complex Spark SQL / SQL queries, stored procedures, views, and triggers for high-performance systems. - Leading the design and implementation of scalable database architectures to meet business needs. - Performing advanced query optimization and troubleshooting to ensure database performance, efficiency, and reliability. - Mentoring junior developers and providing guidance on best practices for SQL development, performance ...

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data