9690 Big Data Jobs - Page 17

Description Proficiency in Apache NiFi, including developing, deploying, and managing NiFi data flows.(Primary) Strong knowledge of data integration and ETL processes.(Primary) DatabasesProficient in working with MySQL, Oracle, HBase, and MongoDB.(primary) Languages FrameworksExpertise in Scripting z. Experience with developing RESTful web services and integrating Apache Kafka.(Secondary) Development OperationsKnowledge of CI/CD pipelines, Jenkins, Docker, Kubernetes, and Git.( Secondary) Required Skills: Big Data TechnologiesExperience with Apache NiFi, HDFS, and Hive. (Primary) Cloud TechnologiesHands-on experience with AWS services, including EC2, S3, Elastic Beanstalk, DynamoDB, RDS, Lam...

Data engineer Skills Required: Strong proficiency in Pyspark , Scala , and Python Experience with AWS Glue Experience Required: Minimum 5 years of relevant experience Location: Available across all UST locations Notice Period: Immediate joiners (Candidates available to join by 31st January 2025 ) SO - 22978624 Location - Chandigarh,Dadra & Nagar Haveli,Daman,Diu,Goa,Haveli,Jammu,Lakshadweep,Nagar,New Delhi,Puducherry,Sikkim

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

Data Support Engineer Location: Bangalore Experience 6+yrs Rate 30 LPA AMVikas POC:Swati Patil Key Responsibilities: Database Development & Support: Write and optimize SQL queries, stored procedures, and views for data retrieval and transformation. Develop and maintain data pipelines to support business intelligence and analytics requirements. Support SQL Server and Amazon Redshift environments for data storage, transformation, and analytics. Ensure data integrity, security, and quality across all database solutions. Operational Support: Monitor ETL logs and troubleshoot data pipeline issues to minimize downtime. Perform data validation and reconciliation to ensure data accuracy. Maintain Ex...

Databricks and Bigdata Client persistent Role; C2H AMVikas Exp8+ years Budget:30 LPA Location POC:Swathi Patil About The Role 1.Mandatory Skills - Big Data, Data Bricks, SQL, Python, Databricks Sr Data Engineer JD as below-Must have 8+ years of total experience. Hands-on experience in SQL, Python, Pyspark, AWS Databricks. Good knowledge of Big Data, Data Warehousing concepts. Good knowledge of GIT, CI/CD Customer-focused, react well to changes, work with teams and able to multi-task. Must be a proven performer and team player that enjoy challenging assignments in a high-energy, fast growing and start-up workplace. Must be a self-starter who can work well with minimal guidance and in fluid en...

JR REQ --Azure Data Bricks, Pyspark--- 3-6years -- All persis locations---Vaishali Rai Location - Chandigarh,Dadra & Nagar Haveli,Daman,Diu,Goa,Haveli,Jammu,Lakshadweep,Nagar,New Delhi,Puducherry,Sikkim

JR REQ -BigData Engineer --4to8year---HYD----Karuppiah Mg --- TCS C2H ---900000

Client expectation apart from JD Longer AWS data engineering experience (glue, spark, ECR ECS docker), python, pyspark, hudi/iceberg/Terraform, Kafka. Java in early career would be a great addition but not a prio. (for the OOP part and java connectors).

JPC REQ- JPC REQ- SR.AWS DATA ENGINEER--- BANGALORE, CHENNAI, HYDERABAD, pune--5 + years----40 LPA------ imm-60 days---Arun Dharne -----congnizant----sharvin--Perm

JPC REQ--data engineer --4+ YEARS--9.2 LPA--TCS---CTOH---kruppiah mg- SHARVIN

AppBank Specialist TEAM/ROLE:AppBank Operations/AppBank Specialist TEAM OVERVIEW: AppBank Operations is a 24x7, two city model unified production management team supporting the business application of the firm using cutting-edge systems and processes that form the core of our key business, sharing best practices while providing a critical mass to help drive transformation. The team also adopts various tools developed by AppBank Engineering team to automate failures using machine learning techniques, notify discrepancies in the health of production and automation of health-restoration, with a focus on continuous measurement of risk and cost. Team members have the opportunity to work at the fo...

JD: Overview We are initiating a new observability project and are looking for an experienced Consultant with knowledge of Cribl Edge and Cribl Stream or similar . This role will focus on rapidly designing, implementing, and optimizing observability pipelines, while transferring knowledge to internal teams for long-term success. Scope of Work Lead the implementation and configuration of Cribl Edge and Cribl Stream. Architect efficient, scalable pipelines for ingesting, transforming, and routing logs, metrics, and traces. Integrate Cribl with existing observability platforms and data sources. Provide hands-on troubleshooting and performance tuning . Recommend best practices for observability ...

This role is eligible for our hybrid work model: Two days in-office. Our Technology team is the backbone of our company: constantly creating, testing, learning and iterating to better meet the needs of our customers. If you thrive in a fast-paced, ideas-led environment, you re in the right place. Why this job s a big deal: Join an Agile team of professionals that are instrumental in building the next generation of travel applications. We constantly explore new technologies and engineer better solutions for ever demanding business needs. Our team of engineers, at all levels, work with the business leaders in defining the product roadmap and come up with innovative solutions to grow the future...

As a world leading provider of integrated solutions for the alternative investment industry, Alter Domus (meaning The Other House in Latin) is proud to be home to 90% of the top 30 asset managers in the private markets, and more than 6,000 professionals across 24 jurisdictions. With a deep understanding of what it takes to succeed in alternatives, we believe in being different - in what we do, in how we work and most importantly in how we enable and develop our people. Invest yourself in the alternative, and join an organization where you progress on merit, where you can speak openly with whoever you are speaking to, and where you will be supported along whichever path you choose to take. Fi...

We’re looking for a talented Business Intelligence Developer with 3 to 4 years of experience in Power BI . The ideal candidate will design data pipelines using Power BI Dataflows, develop and maintain dynamic dashboards and reports. A strong analytical mindset and the ability to turn raw data into actionable insights are essential.

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Talend Big Data Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to your team members to foster a productive work environm...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also e...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Spark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeholders to drive...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Python (Programming Language), Microsoft Azure Analytics Services Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processi...

Title and Summary Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Overview: The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role: Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner. Successfully lead definition, development and delivery of major...

About the role Software Engineers at Mastercard design and code a variety of applications covering transaction processing, analytics, user interfaces, and APIs using a blend of cutting-edge technologies across big data, distributed systems, machine learning, and more. As a Software Engineer, you will deliver these products and solutions with speed and agility as part of a small team. This will involve developing high-performing, highly scalable software solutions and products for some of the worlds top brands. Specific tasks vary depending on the project and the business unit that you join in. All staff at Mastercard are expected to demonstrate 'Mastercard Way' cultural values every day - ow...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :In this role, you will work to increase the domain data coverage and adoption of the Data Platform by promoting a connected user experience through data. You will increase data literacy and trust by leading our Data Gove...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Data Engineering Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating wit...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work, contributing to the overall success of the projects. Roles & Responsibili...