172 Bigdata Jobs - Page 3

Overall experience 7+ years with minimum 5+ years experience in Spark, Python Proficient in Python, PySpark, and Object-oriented programming concepts. Proven experience as a Senior Data Engineer or similar role. Strong problem-solving techniques with an ability to troubleshoot complex software issues. Excellent communication skills, both written and verbal. Self-motivated and able to work independently with minimal supervision.

Revised JD: Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code Big Data Engineering: Experience in Big Data Engineering projects Good to Have (Added Advantage): Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) F2F interviews only - Bangalore/Chennai/Pune/Noida/Bhubaneshwar

As a candidate for the position, you should have 4 to 7 years of experience in Bigdata and GCP. Your key responsibilities will include: - Utilizing your expertise in Bigdata and GCP to contribute to the team's projects and initiatives. The qualifications required for this role are: - Must have experience in Bigdata and GCP. Please note that the company did not provide any additional details in the job description.,

As a Lead Software Engineer / Associate Architect, your role will involve designing and implementing scalable and robust data engineering solutions. You should have 8 to 12 years of experience and possess the following skills: - In-depth understanding of Big data concepts and distributed systems - Proficiency in Python and writing code in PySpark - Good understanding of SQL concepts and ability to write complex SQL queries - Knowledge of optimization and performance improvement for Spark based workloads - Experience with at least one Cloud platform is preferred - Conceptual knowledge of Data Structures & Algorithms - Familiarity with various Data Processing Patterns (Batch/NRT/RT processing)...

As a Sr. Engineering Manager at Target, you will lead an engineering team to build solutions for the AdTech platform in an agile environment. Your success in this role will depend on your strong problem-solving skills, innovative approach, technical leadership, and effective communication. You will collaborate with cross-functional teams to deliver AdTech capabilities such as DSP, SSP, and Ad Servers for self-service advertising needs. Your responsibilities will include: - Managing the overall software development cycle, ensuring high-quality code for common assets and framework components - Building and leading a team of high-caliber software development engineers - Architecting and develop...

As an Applications Development Senior Programmer Analyst at Citigroup, your role involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your primary objective is to contribute to applications systems analysis and programming activities. **Key Responsibilities:** - Conduct feasibility studies, time and cost estimates, IT planning, risk technology, and model development - Establish and implement new or revised applications systems and programs to meet specific business needs - Monitor and control all phases of development process including analysis, design, testing, and implementation - Provide...

In this role, you will be responsible for: - Demonstrating in-depth knowledge in databases, with a preference for individuals with 3-5 years of experience in RDBMS / NoSQL. - Utilizing experience in Bigdata tools such as Hadoop / Spark, which will be considered an additional advantage. - Showcasing your ability to handle Cloud environments like AWS setup / Google Cloud setup effectively. - Utilizing your educational background, where a Bachelor's degree with a focus in Mathematics, Computer Science, Statistics, or any other analytical field is preferred. - Applying your experience in data models and reporting packages, along with strong clustering experience. - Demonstrating your ability to ...

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Dataproc, Data Flow, Bigtable, and other GCP services. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop automated testing frameworks to ensure high-quality code delivery. Troubleshoot complex issues related to big data processing and storage on Google Cloud Platforms. Participate in code reviews to improve overall quality of the software development process. SKill Required: GCP, Data engineer Location - Chennai Preferred Work Mode: 4 days work from office Permanent Parent Payroll with V2 soft (client ford motors) ...

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Dataproc, Data Flow, Bigtable, and other GCP services. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop automated testing frameworks to ensure high-quality code delivery. Troubleshoot complex issues related to big data processing and storage on Google Cloud Platforms. Participate in code reviews to improve overall quality of the software development process. Work Mode: 4 days work from office Permanent Parent Payroll with V2 soft (client ford motors) POC: Kavinila Interested Candidate can send your updated resume ...

Job Description: As a senior Applications Development Technology Lead Analyst at the company, your role involves establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main objective is to lead applications systems analysis and programming activities. Partner with multiple management teams to ensure appropriate integration of functions and identify necessary system enhancements for deploying new products and process improvements. Resolve high-impact problems/projects by evaluating complex business processes, system processes, and industry standards. Provide expertise in applications programming, ensuring application design...

As a Bid Manager and Presales Specialist, your role involves managing the bid management process and presales ecosystem. You will independently handle large scale RFPs and drive them to completion. Collaboration with diverse teams to develop compelling storylines for collaterals and proposals will be crucial. Your creativity and ability to generate innovative ideas for proposal responses will be highly valued. Understanding tools/technologies/platforms such as ServiceNow, SalesForce, Korber, GenAI, Cloud, Bigdata at a business and functional level is essential. Experience in sectors like Supply Chain, Fintech, Healthcare & Life Sciences is advantageous. Proficiency in commercial models like ...

As a Senior Spark SQL/SQL Developer, you will be responsible for designing, developing, and optimizing complex database systems to meet business requirements and support critical applications. Your key responsibilities will include: - Designing, developing, and optimizing complex Spark SQL / SQL queries, stored procedures, views, and triggers for high-performance systems. - Leading the design and implementation of scalable database architectures to meet business needs. - Performing advanced query optimization and troubleshooting to ensure database performance, efficiency, and reliability. - Mentoring junior developers and providing guidance on best practices for SQL development, performance ...

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data

Key Responsibilities Work on Network Management tools and applications such as HPNA, Broadcom DX NetOps, DX O2, Arista CVaaS, Fortinet Cloud, Aruba UXI, Arista Awake, Netscout, and Arista DMF (experience in at least two or more is required). Perform Linux system administration with at least 3 years of hands-on experience. Support and maintain network management systems (Performance, Fault, or Configuration Management tools). Develop and automate using Perl, Python, Shell scripting , or equivalent scripting languages. Work with Big Data monitoring and visualization tools like Elastic Search, Grafana, Kibana, Prometheus, and Splunk. Participate in Agile delivery environments and contribute to ...

As a Software Engineer II at JPMorgan Chase within the Corporate Technology, you will be part of an agile team working to enhance, design, and deliver software components in a secure, stable, and scalable way. You will execute software solutions through design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and experience needed to grow within your role. You will also contribute to the team culture of diversity, equity, inclusion, and respect. - Executes standard software solutions, design, development, and technical troubleshooting - Writes secure and high-quality code using the syntax of at leas...

As a PySpark Data Reconciliation Engineer, you will have the following responsibilities: - Utilize your 7+ years of relevant experience in technology and development. - Use either Java or Python as your primary programming language. - Work with BigData, Hadoop, Spark, and Kafka technologies. - Implement APIs and microservices architecture. - Have experience in UI development and integration. To excel in this role, you will need the following qualifications: - Prior experience in the capital market domain. - Knowledge of Regulatory reporting or reconciliations (tech) is highly desirable. - Proven track record of successfully delivering large scale projects with globally distributed teams. - S...

3+ yrs of exp in Python development Proficiency in web development frameworks like Django, Flask, or FastAPI Proven exp with E-commerce projects Must have exp with Microservices Proven exp with AI/ML frameworks and libraries such as TensorFlow etc Provident fund Annual bonus Health insurance

Job roles and responsibilities: Understand Customer challenges and propose solutions based on latest Esri GIS technology trends. Design and Present Solution Architecture based on customer needs. Execute, Deliver and Demonstrate PoC based on Customer Needs Prepare Approach Notes and guide team for Enterprise Deployment Work as Consultant / Advisor to customer organizations and help them in driving their vision. Engage in business development and design compelling solution-based value propositions by identifying clients challenges and needs and developing solutions which meet those needs. Consistently conduct research and pursue professional development to ensure competitive knowledge and tran...

We are seeking a highly experienced Sr. Architect with 16+ years of experience to join our team. The ideal candidate will have expertise in Python, Splunk, Spark, Hadoop, Data & Solution Architect, Integration Architect, and Solution Design & Architecture. This hybrid role requires a deep understanding of technical architecture and the ability to design and implement robust solutions. The position operates during day shifts and should have prior experience in architecting & designing large, highly scalable and complex ETL solution, capable of managing largen volume (300+ TB) of data and should be capable to implement performance improvement, data quality checking and data security measures. ...

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

As a Python and PySpark Developer at this intermediate level position, your role involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your overall objective is to contribute to applications systems analysis and programming activities. Key Responsibilities: - Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code - Consult with users, clients, and other technology groups on issues, and recommend programming solutions, ...