25 Bigdata Technologies Jobs

7 Plus years of strong SnapLogic development experience Ability to engage with multiple technical teams with a supportive attitude to achieve a shared goal Ability to communicate effectively with technical and non-technical individuals. Should understand the overall system landscape, upstream and downstream systems Should be able understand ETL tech specifications and develop the code efficiently Ability to leverage Snaplogic features/functions to the achieve best results Should have good Redshift or Oracle (or comparable database) experience with BI/DW deployments Exposure to Other ETL tools, SAP, Oracle ERP connectivity with Snaplogic, Connectivity with API Development experience in minimu...

You will be part of a dynamic team at SpectraMedix, committed to driving innovation and reshaping the healthcare industry. Your role as a Senior Java Full-stack developer will involve collaborating closely with lead developers, architects, and data/business analysts to implement, test, and document as required. You will also have the opportunity to engage directly with clients, presenting and explaining technical configurations to ensure the SpectraMedix product exceeds customer expectations. As a key member of the team, you will develop code based on the Sprint scope or Project Plan, following the High-Level Design document. Adhering to security and coding standards, you will create unit an...

We are seeking an experienced Data Architect to become a valuable member of our diverse team. In this role, your primary focus will be on delivering top-notch, scalable solutions by utilizing your expertise in Gen AI solutions, cloud technologies, and system design to exceed customer expectations. Your responsibilities will include designing and developing architectural concepts, creating technical roadmaps, and ensuring that software architecture aligns with business requirements. You will be responsible for setting up Continuous Integration, analyzing large databases on scalable cloud infrastructures, and developing prototypes using big-data technologies. As a Data Architect, you will also...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Sr Data Engg : Very Strong Python knowledge Experience with pyspark, bigdata technologies Proficiency in Databricks Knowledge of cloud AWS Prefered Strong debugging skills Good SQL and higher-level programming languages with solid knowledge of data mining, machine learning algorithms and tools. Curiosity, creativity, and excitement for technology and innovation. Demonstrated quantitative and problem-solving abilities. Expert proficiency in using Python, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data Comfortable in developing shell scripts for automation. Proficient in standard software development, such as version control, testing, and deployment. Extensive data warehousing/dat...

Sr Data Engg : Very Strong Python knowledge Experience with pyspark, bigdata technologies Proficiency in Databricks Knowledge of cloud AWS Prefered Strong debugging skills Good SQL and higher-level programming languages with solid knowledge of data mining, machine learning algorithms and tools. Curiosity, creativity, and excitement for technology and innovation. Demonstrated quantitative and problem-solving abilities. Expert proficiency in using Python, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data Comfortable in developing shell scripts for automation. Proficient in standard software development, such as version control, testing, and deployment. Extensive data warehousing/dat...

Experience in designing and architecting distributed data systems • Code, test, and document new or modified data systems to create robust and scalable applications for data analytics. • Work with other Bigdata developers to make sure that all data solutions are consistent. • Partner with business community to understand requirements, determine training needs and deliver user training sessions • Perform technology and product research to better define requirements, resolve important issues and improve the overall capability of the analytics technology stack. • Evaluate and provides feedback on future technologies and new releases/upgrades. Job Specific Knowledge: • Supports Big Data and batc...

Join us as an ETL Developer at Barclays, where you will be responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality, and governance standards. Spearheading the evolution of our digital landscape, you will drive innovation and excellence using cutting-edge technology to revolutionize our digital offerings and ensure unparalleled customer experiences. To be successful in this role, you should have experience with: - Good knowledge of Python - Extensive hands-on PySpark - Understanding of Data Warehousing concepts - Strong SQL knowledge - Proficiency in Bigdata technologies (HDFS) - Exposure to AWS working environment Additionally, highly ...

Greetings, We have an opening for one of our clients " Mphasis " for " Scala Developer " position. Role & responsibilities Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field. Minimum 5 years of professional experience in Data Engineering, with a strong focus on big data technologies. Proficiency in Scala for developing big data applications and transformations, especially with Apache Spark. Expert-level proficiency in SQL; ability to write complex queries, optimize performance, and understand database internals. Extensive hands-on experience with Apache Spark (Spark SQL, DataFrames, RDDs) for large-scale data processing and analytics. Solid unders...

Are you passionate about developing mission-critical, high-quality software solutions using cutting-edge technology in a dynamic environment Join Compliance Engineering, a global team of over 300 engineers and scientists working on the most complex, mission-critical problems. You will build and operate platforms and applications to prevent, detect, and mitigate regulatory and reputational risks, leveraging the latest technology and vast amounts of data. As part of a significant uplift and rebuild of the Compliance application portfolio, Compliance Engineering is seeking Systems Engineers. As a member of the team, you will partner with users, development teams, and colleagues globally to onbo...

Are you passionate about developing mission-critical, high-quality software solutions, using cutting-edge technology in a dynamic environment Compliance Engineering, a global team of over 300 engineers and scientists, is dedicated to working on the most complex, mission-critical problems. The team builds and operates a suite of platforms and applications that prevent, detect, and mitigate regulatory and reputational risk across the firm. Leveraging the latest technology and vast amounts of structured and unstructured data, we use modern frameworks to build responsive and intuitive front-end and Big Data applications. As the firm invests significantly in uplifting and rebuilding the Complianc...

The Applications Development Group Manager is a senior management level position responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to drive applications systems analysis and programming activities. Manage multiple teams of professionals to accomplish established goals and conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions). Provide strategic influence and exercise control over resources, budget management and planning while monitoring end results....

Job Description We are seeking a Sr. Data Engineer who has strong design, developments skills and upkeeps scalability, availability and excellence when building the next generation of our data pipelines and platform. You are an expert in various data processing technologies and data stores, appreciate the value of clear communication and collaboration, and devote to continual capacity planning and performance fine-tuning for emerging business growth. As the Senior Data Engineer, you will be mentoring Junior engineers in the team. Good to have: Experience in Web Services, API integration, Data exchanges with third parties is preferred. Experience in Snowflake is a big plus. Experience in NoSQ...

We are seeking a highly skilled ETL/Data Engineer with expertise in Informatica DEI BDM to design and implement robust data pipelines handling medium to large-scale datasets. The role involves building efficient ETL frameworks that support batch .

Description - External Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities: Analyzes and investigates Provides explanations and interp...

Qualifications we are looking for Master/Bachelor degree in Computer Science, Electrical Engineering, Information Systems or other technical discipline; advanced degree preferred. Minimum of 7+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies. Minimum 4+ years of experience in Hadoop using Core Java Programming, Spark, Scala, Hive and Go lang Expertise in Object Oriented Programming Language Java Experience using CI/CD Process, version control and bug tracking tools. Experience in handling very large data volume in Real Time and batch mode. Experience with au...

Job description Hiring for Bigdata Developer with experience range 5 to 15 years. Mandatory Skills: Bigdata, Scala, Spark, Hive, Kafka Education: BE/B.Tech/MCA/M.Tech/MSc./MSts

5-12 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience with messaging systems, such as Kafka or RabbitMQ Good understanding of Big Data querying tools, such as Hive, and Impala Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files Good understanding of SQL queries, joins, stored procedures, relational schemas E...

2-5 Yrs in Exp Big Data testing, focusing on both automated and manual testing. Strong understanding of Hadoop. Proficient in SQL, Unix, Linux with hands-on experience. also Exp in ETL .

Open & Direct Walk-in Drive event | Hexaware technologies - Azure Data Engineer/Architect in Chennai, Tamilnadu on 10th May [Saturday] 2025 - Azure Databricks/ Data factory/ SQL & Pyspark Dear Candidate, I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an Azure Data Engineer. We are hosting an Open Walk-in Drive in Chennai, Tamilnadu on 10th May [Saturday] 2025, and we believe your skills in Databricks, Data Factory, SQL, and Pyspark align perfectly with what we are seeking. Details of the Walk-in Drive: Date: 10th May [Saturday] 2025 Experience: 5 years to 12 years Time: 9.00 AM to 5 PM Venue: ...

Warm Greetings from SP Staffing!! Role: Pyspark Developer Experience Required :4 to 6 yrs Work Location :Pune/Hyderbad/Chennai/Bangalore Required Skills, Pyspark Python Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Warm Greetings from SP Staffing!! Role: Big Data Developer Experience Required :4 to 8 yrs Work Location : Bangalore/Chennai/Pune/Delhi/Hyderabad/Kochi Required Skills, Spark and Scala Interested candidates can send resumes to nandhini.s@spstaffing.in

Software developer with hands-on experience on BigData technologies (Spark, Scala and hadoop) 1)Strong understanding and hands-on experience of Scala programming 2)Hands-on experience on Spark and Hadoop 3)Good working knowledge of GIT, Jenkins and Airflow 4)Good to have working knowledge of AWS / Azure 5) Good to have basic knowledge of Python 6)Strong interest for good coding practices (clean code, TDD, ....) 7)Experience of working in Agile methodology 8)Strong problem-solving skill 9)Strong verbal and written communication skills Desirable Skills: Should have been part of teams that did multiple Cloud migration.a. 5 plus years of relevant experience in cloud Infrastructure principles , m...

Bigdata Developer Domain Skills: 1. KYC / AML expertise Technical Skills: Data Pipeline Development (scalable ETL/ELT pipelines) Big Data Infrastructure (Spark, Flink, Hadoop, Kafka) Programming (Python or Scala) Data Processing Frameworks (Spark, Hadoop, or Flink, Iceberg) Cloud Data Platforms (AWS, Azure, or GCP) SQL and database technologies (e.g., Oracle, PostgreSQL) NoSQL database technologies (e.g., Mongo, Couch) Data Orchestration (Airflow or Prefect) Technical Skills (Plus): Containerization (Docker, Kubernetes) Technical Skills (Good to Have): Large-scale document processing (Deep learning, Spacy, NLTK, LLMs, Embedding Technique) Agentic RAG framework (LangChain, CrewAI, Google ADK,...

Hello Connections , Exciting Opportunity Alert !! We're on the hunt for passionate individuals to join our dynamic team as Data Engineer Job Profile : Bigdata SCALA Spark Architect Experience : Minimum 12 to Maximum 16 Yrs of exp Location : Bangalore / Pune Mandatory Skills : Bigdata | SCALA | Spark | Architect Secondary Skills : AWS Cloud Qualification : B.TECH / B.E / MCA / Computer Science Background - Any Specification How to Apply? Send your CV to: sipriyar@sightspectrum.in Contact Number - 6383476138 Don't miss out on this amazing opportunity to accelerate your professional career! #bigdata #dataengineer #hadoop #spark #python #hive #pysaprk