172 Bigdata Jobs - Page 4

As a seasoned Developer passionate about writing clean and efficient code, building scalable systems, and driving engineering excellence in a fast-paced, Agile environment, you will have the following responsibilities: - Perform detailed impact analysis for code changes with an understanding of dependencies across the application components - Design and develop scalable, high-performance code using Java and Bigdata / Java Spark - Write high-quality, maintainable code that is modular, testable, and adheres to SOLID principles and industry-standard design patterns - Write robust unit tests using JUnit, focusing on code coverage, business logic, readability, and reusability - Conduct code revie...

Dear, Hope you are doing well. Please find the Job description. Kindly share the resume with expected salary and send it to manju@nam-it.com Confirm your availability for IN- PERSON or Face-to-Face interview availability as on 1st Oct at Madivala, Bengaluru. YES OR NO? Candidates need to Join 15-20 days max notice. YES OR NO? LOCALS TO BENGALURU ONLY. Role : Lead Data Engineers Location : Madivala, Bengaluru (1st Oct F-2-F Direct is a must) Duration : FTE Skills SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python applicat...

Key Skills: AWS Cloud, Bigdata, Python, Data Engineer, Data Modelling, Design Patterns Roles and Responsibilities: Utilize in-depth knowledge and hands-on experience using Python (PySpark) on real-time data streaming technologies such as Kafka, Spark, and Lambda. Build data processing pipelines on AWS using AWS MSK, EMR (Spark Streaming), DynamoDB, Lambda, Glue, and Athena. Manage device data ingestion and processing using AWS IoT Core, IoT rules, and EventBridge. Design, implement, and optimize Kafka and Spark-based NRT data processing pipelines. Develop reusable, cloud-native, scalable, and reliable frameworks and tools. Create and implement cost-effective solutions to meet functional and ...

• Strong experience in Python, Pandas, Flask or Fast API • Experience in Bigdata technologies such as BigQuery, SQL • Experience in deploying ML Models in production using Seldon, Triton, Jenkin CI/CD • Exp in Java is nice to have

Job Title: Big Data Architect GCP Experience: 10–12 Years Location: Pune Role We are looking for a Big Data Architect with deep GCP expertise to define, design, and lead cloud-native data platforms for enterprise clients. You will be responsible for architecting large-scale data lakes, warehouses, and pipelines on GCP , modernizing on-premise workloads, and guiding technical teams to deliver robust and scalable solutions. Key Responsibilities Architect modern data platforms on GCP using BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Composer, GCS . Lead data modernization and migration programs from on-premise systems (Teradata, Netezza, Exadata, Hadoop) to GCP. Define end-to-end solution arch...

We are seeking an experienced Data Architect to design and deliver scalable, high-performance Data Platforms that meet the evolving needs of our business. You will be responsible for leading data architecture design, integration, and optimization across cloud environments while ensuring data governance, security, and scalability. Key Responsibilities: Data Platform Architecture: Design and architect high-performing, scalable, and secure data platforms (Data Warehouses, Data Lakes, Lakehouses) to support analytics and reporting needs. Data Modeling: Design and implement conceptual, logical, and physical data models to meet business requirements and adhere to data governance standards. Data In...

Role: Senior Member of Technical Staff Experience: 4 to 9 years Location: Manyata Tech Park, Bangalore Work mode: Hybrid Skills: Design Data Analytics, Data Engineering, Data Warehouse, Java, SQL, Spark & Spark-SQL, Autonomous Data Warehouse, Object Store, Data Flow/DIS (or similar tech stack), exposure to cloud Short description : Looking for a Software Developer (Data Engineer) who are willing to perform Data Engineering tasks with skills sets like SQL, Spark, Big Data Development, Java & Cloud experience. Job description: Design, develop, troubleshoot and debug software programs for databases, applications etc. Strong knowledge of SQL is required. You should be having programming experien...

As a PySpark Data Reconciliation Engineer, you should have at least 7 years of relevant experience in technology and development. Your technical skillset should include proficiency in Java or Python, along with hands-on experience in BigData, Hadoop, Spark, and Kafka. Additionally, familiarity with APIs and microservices architecture is essential. If you have UI development and integration experience, it would be considered a strong advantage. Key Responsibilities: - Possess domain expertise in the capital market domain, with a preference for experience in Regulatory reporting or reconciliations within a technological context. - Demonstrate a proven track record of successfully delivering la...

As an employee at Impetus Technologies, a digital engineering company, you will be part of a team dedicated to providing expert services and products to help enterprises achieve their transformation goals. Specializing in solving challenges related to analytics, AI, and cloud technologies, we empower businesses to drive innovation and growth. Your role will involve: - Working with technologies such as Bigdata, Pyspark, Hive, and Spark Optimization to develop cutting-edge solutions for our clients. Qualifications required for this position include: - Proficiency in Bigdata, Pyspark, Hive, and Spark Optimization. - Experience in working with GCP would be beneficial. About Impetus Technologies:...

As a Senior Backend Software Engineer at Salesforce, you will have the opportunity to work on building new and exciting components in a rapidly evolving market technology landscape. Your role will involve developing high-quality, production-ready code that millions of users on our cloud platform can utilize. You will be responsible for designing, implementing, and optimizing robust APIs and API framework-related features to ensure performance and scalability in a multi-tenant environment. Additionally, you will contribute to all phases of the Software Development Life Cycle (SDLC) and play a key role in mentoring junior engineers and providing technical guidance to the team. **Key Responsibi...

Work Location: Pan India Experience: 12+yrs Responsibility: Provide top-quality solution design and execution Provide support in defining the scope and sizing of work Align the organizations big data solutions with their Client initiatives as requested Engage with clients to understand strategic requirements Responsible for translating business requirements into technology solutions Work with domain experts to put together a delivery plan with and stay on track Utilize Big Data technologies to design, develop, and evolve scalable and fault-tolerant distributed components Organize all meetings with customers and ensure prompt resolution of gaps and roadblocks Stay current on latest technology...

As a Senior Backend Software Engineer at Salesforce, you will have the opportunity to work with a group of world-class engineers to build breakthrough features that our customers will love, adopt, and use while maintaining the stability and scalability of our trusted CRM platform. Your responsibilities will include: - Building new and exciting components in a growing market technology to provide scale and efficiency. - Developing high-quality, production-ready code for millions of users on our cloud platform. - Designing, implementing, and tuning robust APIs and API framework-related features for a multi-tenant environment. - Contributing to all phases of the software development life cycle ...

Role Overview: At American Express, you will be part of a culture with a 175-year history of innovation, shared values, and Leadership Behaviors. As a member of Team Amex, you will receive comprehensive support for your holistic well-being and numerous opportunities to learn new skills, develop as a leader, and advance your career. Your voice and ideas will be valued, your work will have an impact, and together, we will shape the future of American Express. Key Responsibilities: - Product Development: Develop next-generation software products and solutions to address complex business challenges using the latest tools and technologies. Collaborate with various stakeholders to build and enhanc...

Job Title: Developer Work Location: ~CHENNAI~BANGALORE~ Skill Required: Digital : BigData and Hadoop Ecosystems~Digital : Python ~Digital : PySpark Experience Range in Required Skills:5 - 7Yrs Specific activities required: - Lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies based on previous research on trends in public cloud environments. - Integrate and automate the delivery of standardised Azure deployments, in conjunction with orchestration products such as Azure DevOps with Terraform, Azure ARM templates and other modern deployment technologies. - Act as the escalation point...

As a candidate for the position, you should possess the following qualifications and skills: - Experience: 4 to 7 years - Proficiency in Bigdata, Pyspark, Hive, and Spark Optimization - Good to have: GCP Please note the Job Reference Number for this position is 13159.,

Dear Candidate, We have a Job Opening for Lead Software Engineer - Bigdata in Banking Based Product Company at Bangalore. Requirement Details: Location : Bangalore Designation: Specialist Software Engineer - Genesys Experience: 8 to 10 Years Expected Notice Period : Immediate Profile Required: At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake Proven experience with cloud platforms preferable Azure particularly on data services Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc Perform Analysis on existing data storage systems Big Data & development of data solutions in Snowflake High ...

You are being recruited by ANSR on behalf of their client, American Airlines, a company that aims to Care for People on Life's Journey by providing thousands of flights daily to over 350 destinations in more than 60 countries. American Airlines is undergoing a transformation in the way it delivers technology to its customers and team members globally. American's Tech Hub in Hyderabad, India, is a key technology office location where team members drive technical innovation and engineer digital products to enhance the customer and team member experience. By leveraging cutting-edge technology, American Airlines is focused on solving business problems and delivering industry-leading technology s...

As an experienced professional with 7-12 years of experience in the Data and Analytics domain, you will be responsible for leading multiple development projects from end to end. Your expertise in SDLC/Agile methodologies, proficiency in ETL and analytical tools, along with a strong command of SQL will be essential for the successful execution of projects. In this role, you will manage multiple teams comprising 25 to 30 members each, driving them towards timely deliverables. Your proficiency in project management activities, coupled with a proactive and go-getter attitude, will enable you to effectively prioritize tasks and ensure their completion. A key aspect of your responsibilities will i...

Role & responsibilities Minimum of 6 years of software development experience in a professional environment and/or comparable experience such as: o Familiar with Agile or other rapid application development methods o Experience with design and coding in Java and across one or more platforms and additional languages as appropriate o Experience with Big Data processing and Batch/streaming technologies such as Apache Spark, Kafka, Flink, Beam and Scala as a programming language preferred o Experience with RxJava and functional programming is preferred o Experience in Full Stack development using Java with React, Node preferred o Experience with AWS or GCP cloud is preferred o Experience with AW...

You are ready to gain the skills and experience necessary to advance within your role and further develop your career. At JPMorgan Chase, within the Liquidity Risk (LRI) team, the position of Software Engineer II - Big Data/Java/Scala offers you an exciting opportunity. In this role, you will play a crucial part in designing and implementing the next generation buildout of a cloud-native liquidity risk management platform. The primary focus of our technology organization is to provide comprehensive solutions for managing the firm's liquidity risk and meeting regulatory reporting obligations in over 50 markets. The project entails the strategic development of advanced liquidity calculation en...

Candidates Specification : Must have 6+ years of experience in ETL Testing Expert in Python + SQL Python Strong Python programming skills for writing automation scripts and integrating with ETL processes Azure Experience with Azure Data Factory, Azure SQL, Azure Blob Storage, and other Azure data services.(good to have) Automation Tools: Familiarity with test automation tools and frameworks (e.g., Pytest, Selenium) Data Warehousing: Experience working with data warehousing concepts and technologies Contact Person- Sheena Rakesh Email id- sheena@gojobs.biz

You will be joining one of the elite units of Infosys Strategic Technology Group (STG) led by the Unit Technology Officer (CTO) as a full stack architect. As part of the Power Programmer initiative in Global Delivery, your primary responsibility will be to build a team of Full Stack Developers. This team will focus on executing complex engineering projects, developing platforms, and creating marketplaces for clients by leveraging cutting-edge technologies. Your role as a full stack architect will require you to stay ahead of the technology curve and continuously enhance your skills to become a Polyglot developer. You will be expected to proactively address end customer challenges by dedicati...

As an intern at Login2Xplore, you will have the opportunity to work on various tasks related to software development and technology exploration. Your day-to-day responsibilities may include: - Working on the development of software/modules, coding, and exploring new technologies. - Creating technical design documents and manuals. - Handling software installation, execution, testing automation, and providing training & support. - Engaging in research & development activities on upcoming technologies such as AI, ML, Big Data, etc. Please note that there are opportunities for both longer duration and part-time internships in this profile. Login2Xplore is a software product startup dedicated to ...

We are seeking a skilled Senior Developer & Tech Lead who is dedicated to producing clean and effective code, constructing scalable systems, fostering engineering excellence, and overseeing a team of proficient developers in a dynamic Agile setting. This position is well-suited for individuals with extensive practical experience in Java and Apache Spark, coupled with a solid understanding of object-oriented design principles. Your responsibilities will include conducting thorough impact analyses for code modifications while considering dependencies across various application components, designing and implementing scalable, high-performance code utilizing Java and Bigdata/Apache Spark, crafti...

You are a highly skilled and experienced Data Architect with expertise in cloud-based solutions. You will be responsible for designing, implementing, and optimizing data architecture to meet the organization's current and future needs. Your role will involve data modeling, transformation, governance, and hands-on experience with modern cloud platforms and tools such as Snowflake, Spark, Data Lakes, and Data Warehouses. Collaboration with cross-functional teams and stakeholders is crucial, and you will establish and enforce standards and guidelines across data platforms to ensure consistency, scalability, and best practices. You will be accountable for architecting and implementing scalable, ...