133 Bigdata Jobs - Page 2

2 yrs of exp in Data Science, NLP & Python Exp in Gen AI+ MLOps Exp in Text data analysis, Prompt Eng, Cloud Vector DB ,Azure OpenAI models API, Graph QL Exp in LLMs, LLM frameworks Exp in Java ,C++,libraries(NLTK, SpaCy, TensorFlow) Exp in big data

Key Responsibilities Work on Network Management tools and applications such as HPNA, Broadcom DX NetOps, DX O2, Arista CVaaS, Fortinet Cloud, Aruba UXI, Arista Awake, Netscout, and Arista DMF (experience in at least two or more is required). Perform Linux system administration with at least 3 years of hands-on experience. Support and maintain network management systems (Performance, Fault, or Configuration Management tools). Develop and automate using Perl, Python, Shell scripting , or equivalent scripting languages. Work with Big Data monitoring and visualization tools like Elastic Search, Grafana, Kibana, Prometheus, and Splunk. Participate in Agile delivery environments and contribute to ...

As a Software Engineer II at JPMorgan Chase within the Corporate Technology, you will be part of an agile team working to enhance, design, and deliver software components in a secure, stable, and scalable way. You will execute software solutions through design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and experience needed to grow within your role. You will also contribute to the team culture of diversity, equity, inclusion, and respect. - Executes standard software solutions, design, development, and technical troubleshooting - Writes secure and high-quality code using the syntax of at leas...

As a PySpark Data Reconciliation Engineer, you will have the following responsibilities: - Utilize your 7+ years of relevant experience in technology and development. - Use either Java or Python as your primary programming language. - Work with BigData, Hadoop, Spark, and Kafka technologies. - Implement APIs and microservices architecture. - Have experience in UI development and integration. To excel in this role, you will need the following qualifications: - Prior experience in the capital market domain. - Knowledge of Regulatory reporting or reconciliations (tech) is highly desirable. - Proven track record of successfully delivering large scale projects with globally distributed teams. - S...

3+ yrs of exp in Python development Proficiency in web development frameworks like Django, Flask, or FastAPI Proven exp with E-commerce projects Must have exp with Microservices Proven exp with AI/ML frameworks and libraries such as TensorFlow etc Provident fund Annual bonus Health insurance

Job roles and responsibilities: Understand Customer challenges and propose solutions based on latest Esri GIS technology trends. Design and Present Solution Architecture based on customer needs. Execute, Deliver and Demonstrate PoC based on Customer Needs Prepare Approach Notes and guide team for Enterprise Deployment Work as Consultant / Advisor to customer organizations and help them in driving their vision. Engage in business development and design compelling solution-based value propositions by identifying clients challenges and needs and developing solutions which meet those needs. Consistently conduct research and pursue professional development to ensure competitive knowledge and tran...

We are seeking a highly experienced Sr. Architect with 16+ years of experience to join our team. The ideal candidate will have expertise in Python, Splunk, Spark, Hadoop, Data & Solution Architect, Integration Architect, and Solution Design & Architecture. This hybrid role requires a deep understanding of technical architecture and the ability to design and implement robust solutions. The position operates during day shifts and should have prior experience in architecting & designing large, highly scalable and complex ETL solution, capable of managing largen volume (300+ TB) of data and should be capable to implement performance improvement, data quality checking and data security measures. ...

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

As a Python and PySpark Developer at this intermediate level position, your role involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your overall objective is to contribute to applications systems analysis and programming activities. Key Responsibilities: - Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code - Consult with users, clients, and other technology groups on issues, and recommend programming solutions, ...

As a seasoned Developer passionate about writing clean and efficient code, building scalable systems, and driving engineering excellence in a fast-paced, Agile environment, you will have the following responsibilities: - Perform detailed impact analysis for code changes with an understanding of dependencies across the application components - Design and develop scalable, high-performance code using Java and Bigdata / Java Spark - Write high-quality, maintainable code that is modular, testable, and adheres to SOLID principles and industry-standard design patterns - Write robust unit tests using JUnit, focusing on code coverage, business logic, readability, and reusability - Conduct code revie...

Dear, Hope you are doing well. Please find the Job description. Kindly share the resume with expected salary and send it to manju@nam-it.com Confirm your availability for IN- PERSON or Face-to-Face interview availability as on 1st Oct at Madivala, Bengaluru. YES OR NO? Candidates need to Join 15-20 days max notice. YES OR NO? LOCALS TO BENGALURU ONLY. Role : Lead Data Engineers Location : Madivala, Bengaluru (1st Oct F-2-F Direct is a must) Duration : FTE Skills SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python applicat...

Key Skills: AWS Cloud, Bigdata, Python, Data Engineer, Data Modelling, Design Patterns Roles and Responsibilities: Utilize in-depth knowledge and hands-on experience using Python (PySpark) on real-time data streaming technologies such as Kafka, Spark, and Lambda. Build data processing pipelines on AWS using AWS MSK, EMR (Spark Streaming), DynamoDB, Lambda, Glue, and Athena. Manage device data ingestion and processing using AWS IoT Core, IoT rules, and EventBridge. Design, implement, and optimize Kafka and Spark-based NRT data processing pipelines. Develop reusable, cloud-native, scalable, and reliable frameworks and tools. Create and implement cost-effective solutions to meet functional and ...

• Strong experience in Python, Pandas, Flask or Fast API • Experience in Bigdata technologies such as BigQuery, SQL • Experience in deploying ML Models in production using Seldon, Triton, Jenkin CI/CD • Exp in Java is nice to have

Job Title: Big Data Architect GCP Experience: 10–12 Years Location: Pune Role We are looking for a Big Data Architect with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP , modernizing on-premise workloads, and guiding technical teams to deliver robust and scalable solutions. Key Responsibilities Architect modern data platforms on GCP using BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Composer, GCS . Lead data modernization and migration programs from on-premise systems (Teradata, Netezza, Exadata, Hadoop) to GCP. Define end-to-end solution arch...

We are seeking an experienced Data Architect to design and deliver scalable, high-performance Data Platforms that meet the evolving needs of our business. You will be responsible for leading data architecture design, integration, and optimization across cloud environments while ensuring data governance, security, and scalability. Key Responsibilities: Data Platform Architecture: Design and architect high-performing, scalable, and secure data platforms (Data Warehouses, Data Lakes, Lakehouses) to support analytics and reporting needs. Data Modeling: Design and implement conceptual, logical, and physical data models to meet business requirements and adhere to data governance standards. Data In...

Role: Senior Member of Technical Staff Experience: 4 to 9 years Location: Manyata Tech Park, Bangalore Work mode: Hybrid Skills: Design Data Analytics, Data Engineering, Data Warehouse, Java, SQL, Spark & Spark-SQL, Autonomous Data Warehouse, Object Store, Data Flow/DIS (or similar tech stack), exposure to cloud Short description : Looking for a Software Developer (Data Engineer) who are willing to perform Data Engineering tasks with skills sets like SQL, Spark, Big Data Development, Java & Cloud experience. Job description: Design, develop, troubleshoot and debug software programs for databases, applications etc. Strong knowledge of SQL is required. You should be having programming experien...

As a PySpark Data Reconciliation Engineer, you should have at least 7 years of relevant experience in technology and development. Your technical skillset should include proficiency in Java or Python, along with hands-on experience in BigData, Hadoop, Spark, and Kafka. Additionally, familiarity with APIs and microservices architecture is essential. If you have UI development and integration experience, it would be considered a strong advantage. Key Responsibilities: - Possess domain expertise in the capital market domain, with a preference for experience in Regulatory reporting or reconciliations within a technological context. - Demonstrate a proven track record of successfully delivering la...

As an employee at Impetus Technologies, a digital engineering company, you will be part of a team dedicated to providing expert services and products to help enterprises achieve their transformation goals. Specializing in solving challenges related to analytics, AI, and cloud technologies, we empower businesses to drive innovation and growth. Your role will involve: - Working with technologies such as Bigdata, Pyspark, Hive, and Spark Optimization to develop cutting-edge solutions for our clients. Qualifications required for this position include: - Proficiency in Bigdata, Pyspark, Hive, and Spark Optimization. - Experience in working with GCP would be beneficial. About Impetus Technologies:...

As a Senior Backend Software Engineer at Salesforce, you will have the opportunity to work on building new and exciting components in a rapidly evolving market technology landscape. Your role will involve developing high-quality, production-ready code that millions of users on our cloud platform can utilize. You will be responsible for designing, implementing, and optimizing robust APIs and API framework-related features to ensure performance and scalability in a multi-tenant environment. Additionally, you will contribute to all phases of the Software Development Life Cycle (SDLC) and play a key role in mentoring junior engineers and providing technical guidance to the team. **Key Responsibi...

Work Location: Pan India Experience: 12+yrs Responsibility: Provide top-quality solution design and execution Provide support in defining the scope and sizing of work Align the organizations big data solutions with their Client initiatives as requested Engage with clients to understand strategic requirements Responsible for translating business requirements into technology solutions Work with domain experts to put together a delivery plan with and stay on track Utilize Big Data technologies to design, develop, and evolve scalable and fault-tolerant distributed components Organize all meetings with customers and ensure prompt resolution of gaps and roadblocks Stay current on latest technology...

As a Senior Backend Software Engineer at Salesforce, you will have the opportunity to work with a group of world-class engineers to build breakthrough features that our customers will love, adopt, and use while maintaining the stability and scalability of our trusted CRM platform. Your responsibilities will include: - Building new and exciting components in a growing market technology to provide scale and efficiency. - Developing high-quality, production-ready code for millions of users on our cloud platform. - Designing, implementing, and tuning robust APIs and API framework-related features for a multi-tenant environment. - Contributing to all phases of the software development life cycle ...

Role Overview: At American Express, you will be part of a culture with a 175-year history of innovation, shared values, and Leadership Behaviors. As a member of Team Amex, you will receive comprehensive support for your holistic well-being and numerous opportunities to learn new skills, develop as a leader, and advance your career. Your voice and ideas will be valued, your work will have an impact, and together, we will shape the future of American Express. Key Responsibilities: - Product Development: Develop next-generation software products and solutions to address complex business challenges using the latest tools and technologies. Collaborate with various stakeholders to build and enhanc...

Job Title: Developer Work Location: ~CHENNAI~BANGALORE~ Skill Required: Digital : BigData and Hadoop Ecosystems~Digital : Python ~Digital : PySpark Experience Range in Required Skills:5 - 7Yrs Specific activities required: - Lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies based on previous research on trends in public cloud environments. - Integrate and automate the delivery of standardised Azure deployments, in conjunction with orchestration products such as Azure DevOps with Terraform, Azure ARM templates and other modern deployment technologies. - Act as the escalation point...