12395 Big Data Jobs - Page 47

About the Role: Senior Business Intelligence Analyst The BusinessIntelligence Analyst is responsible for collecting and analyzing data frommultiple sources systems, to help organization make better business decisions.This role is crucial in maintaining data quality, compliance, and accessibilitywhile driving data-driven decision-making and reporting for Mind sprintclients. The role requires a combination of OLAM business domain expertise,problem-solving skills, and business acumen. Create,review, validate and manage data as it collected. The person will act ascustodian of data getting generated. Developpolicies and procedures for the collection and analysis of data. Possessanalytical skills ...

What You''ll Do You will be part of our Data Platform & Product Insights data engineering team. As part of this agile team, you will work in our cloud native environment to Build & support data ingestion and processing pipelines in cloud. This will entail extraction, load and transformation of big data from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies Partner with product team to assemble large, complex data sets that meet functional and non-functional business requirements, ensure build out of Data Dictionaries/Data Catalogue and detailed documentation and knowledge around these data assets, metrics and KPIs. Warehouse this data, build dat...

Strong experience in NodeJS, MongoDB, Redis Strong understanding of test-driven development and unit testing. Excellent problem-solving skills and attention to detail. Ability to work independently and as part of a team. Strong communication skills and ability to collaborate effectively with stakeholders. Mandatory Competencies Beh - Communication User Interface - node.JS - node.JS Big Data - Big Data - Mongo DB Programming Language - Java - Java Caching (Redis/Memcache/Hazlecast).

Role Description : As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big ...

Project description We are looking for a confident, creative and curious team player to join as a Business Analyst in Bangalore, as part of the team working with one of the largest retail Companies in UK. They will support multiple projects for our Client in Agile environment. Responsibilities Role & Responsibilities : Working as an extended team of Product Managers, actively participate in delivering the outcomes set out for the product area. Own source system discovery and data analysis to validate for accuracy and completeness of the source system data. Collaboration with other technology teams to understand the tech initiatives of the domain area and understand the impact to the domain d...

Overall 5+ years of experience with software development. Excellent on Scala/Spark cloudera development. Experience in writing SQL queries. Excellent problem solving Nice to have : Python Mandatory Competencies Programming Language - Scala - Scala Big Data - Big Data - SPARK Beh - Communication Database - Database Programming - SQL Big Data - Big Data - Cloudera

Title and Summary The Software Engineer II will contribute to the design, development, and maintenance of big data solutions within the Hadoop ecosystem The role involves working with distributed data processing frameworks and supporting the creation of reliable, high-performance data pipelines The engineer will be responsible for hands-on development and troubleshooting using the Cloudera distribution, along with related ecosystem tools such as Apache Ozone, Apache Iceberg, Apache Airflow, and Apache NiFi The position requires hands on experience in Apache Spark to support large-scale, massively parallel data processing tasks The Software Engineer II will collaborate closely with senior tea...

Title and Summary Data Engineer II-2Who is Mastercard? Overview Technical Implementation team is part of MasterCard Data & Services group and one of the most rapidly growing organization in the space D&S Technology Teams provides analytic software tools that enable large, consumer-focused businesses to seize the Big Data analytics opportunity by triangulating between business strategy, algorithmic math, and large databases to improve decisions The Delivery Engineering Platform team is a core component to consulting services, managing the data acquisition, integration and transformation of client provided data within the Test & Learn platform for global engagements Role The Data Engineer will...

Support cyber incident response actions to ensureproper assessment, containment, mitigation and documentation Perform in-depth analysis and investigative effortswhen events are escalated and determine next appropriatecontainment/remediation/eradication efforts. Research and Evaluate new technologies like Anti APTsolutions, SOAR, ,Deception technologies, Big Data forensic analytic tools, andassist in implementation of the same. Assist with defining and updating incident responseplaybooks to ensure tasks align with best practice Identify and propose areas for improvement within theSecurity Operations Centre. Responsible for driving execution of daily, weekly,and monthly metrics for statistical...

Role & responsibilities An impressive understanding of Management Information/Business Intelligence/Analytics Earlier experience of delivering Data orientated projects (data integration/ETL/Data Warehouse/Analytics) An understanding of Data Warehousing and Big Data architecture principles. Experience in building a data platform in the Microsoft Azure cloud Preferred candidate profile

Design,architect, and implement scalable data solutions on Google Cloud Platform (GCP)to meet the strategic data needs of the organization. Leadthe integration of diverse data sources into a unified data platform, ensuringseamless data flow and accessibility across the organization. Developand enforce robust data governance, security, and compliance frameworkstailored to GCP's architecture. Collaboratewith cross-functional teams, including data engineers, data scientists, andbusiness stakeholders, to translate business requirements into technical datasolutions. Optimizedata storage, processing, and analytics solutions using GCP services such asBigQuery, Dataflow, and Cloud Storage. Drivethe ...

Responsibilities: * Design, develop, test and maintain PySpark applications using Python and Spark technologies. * Collaborate with cross-functional teams on Big Data projects utilizing Hive, Hadoop and HDFS. Office cab/shuttle Health insurance Food allowance Provident fund Annual bonus

Core skills required for the role : Databricks Level: Advanced SQL (MSSQL Server) Joins, SQ optimization, basic knowledge of StoredProcedure, Functions PySpark Level: Advanced Azure Delta lake Python Basic Mandatory Competencies Big Data - Big Data - Pyspark Data Science and Machine Learning - Data Science and Machine Learning - Databricks Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Database - Sql Server - DBA Data Science and Machine Learning - Data Science and Machine Learning - Python

Engineer, Software Engineering (SQL Server, Oracle, MySQL, Postgres, GCP, Azure, AWS) Grade Level (for internal use): 09 The Team: Join a forward-thinking team that is at the forefront of data engineering within the S&P Global Market Intelligence Division. Our diverse and inclusive group of professionals is dedicated to transforming how our organization harnesses and interprets divisional data. We utilize state-of-the-art analytics and data platforms, following industry-leading practices to convert raw data into valuable insights. Impact: This role is crucial for enhancing the value we deliver to our customers. By participating in backend database development, creating tools for metadata-dri...

Overall 5+ years of experience with software development. Excellent on Scala/Spark Cloudera development. Experience in writing SQL queries. Excellent problem solving Nice to have : Python Mandatory Competencies Programming Language - Scala - Scala Big Data - Big Data - SPARK Beh - Communication Database - Database Programming - SQL Big Data - Big Data - Cloudera

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Job Description Lead who can manage deliverables from offshore, ensures adequate design/technical support is provided PySpark, Python, Data bricks PySpark, Python/Scala, Data bricks, Understanding on Streaming Pipeline, Docker & Kubernetes Problem solving and technical troubleshooting skills Scala (Good to have) Mandatory Competencies Big Data - Big Data - Pyspark Beh - Communication Data Science and Machine Learning - Data Science and Machine Learning - Databricks Data Science and Machine Learning - Data Science and Machine Learning - Python DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Co...

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Job Description Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment. Proven experience in data modelling, analysis, and profiling. Experience of working in diverse data domains. Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity. Proven consulting and mentoring experience. Experience in working within an Agile environment. Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pip...

Roles and Responsibilities : Manage big data projects from initiation to delivery, ensuring timely completion and quality results. Collaborate with cross-functional teams to design and implement data architectures, ETL processes, and data warehousing solutions. Oversee the development of complex data pipelines using technologies such as Spark, Hadoop, AWS/Azure/GCP. Ensure effective project management practices are followed throughout the project lifecycle. Job Requirements : 14-18 years of experience in Big Data Analytics with expertise in DW (Data Warehousing) and ETL (Extract Transform Load). Strong understanding of Data Bricks, Data Architecture, and Project Management principles. Profic...

Strong experience in NodeJS, MongoDB, Redis Strong understanding of test-driven development and unit testing. Excellent problem-solving skills and attention to detail. Ability to work independently and as part of a team. Strong communication skills and ability to collaborate effectively with stakeholders. Mandatory Competencies Beh - Communication User Interface - node.JS - node.JS Programming Language - Java - Java Caching (Redis/Memcache/Hazlecast) Big Data - Big Data - Mongo DB

Responsibilities and Duties: The candidate must have, An overall 10+ years of experience in IT Expert level development exp on SCALA and Apache Spark is a must [5+ yrs] Very good knowledge and work experience on AWS Services like EMR, Kinesis, S3, Lambda, API GW, Advanced IAM etc [2 yrs of exp] Scripting experience with Python/NodeJS [2 yrs of exp] Strong debugging skills on JAVA Develop scripts and manage databases like PostgreSQL/MySQL/DynamoDB Version Control: Working experience with one or more version control platforms like GitLab, GitHub or Bitbucket Demonstrate successful experience learning new technologies quickly Nice to have:- Hands-on exp with monitoring tools like AWSCloudWatch/...

Key Responsibilities Lead and deliver data-related product implementation. Lead and execute business data projects. Lead and mentor Teams. Direct the implementation of Data Cloud technologies (Azure/Snowflake/Data Bricks/ Data Science S/w Hub) using industry best practices. Develop, document, maintain and support elegant data solutions Develop documentation of the data architecture, flow, and warehouse models. Provide resolution to complex data pipeline-related problems. Deploy Snowflake features such as data sharing, events, and lake-house patterns. Leverage Snowflake utilities such as SnowSQL, SnowPipe, and Big Data modeling techniques using Python. Manage Azure services such as ADLS, Azur...

What youll do : Collaborate with ZS internal teams and client teams to shape and implement high quality technology solutions that address critical business problems Understand and analyze business problems thoroughly, and translate them into technical designs effectively Design and implement technical features using best practices for the specific technology stack being used Assist in the development phase of implementing technology solutions for client engagements, ensuring effective problem-solving Apply appropriate development methodologies (e.g., agile, waterfall, system integrated testing, mid-development client reviews, embedded QA procedures, unit testing) to ensure successful and tim...

Looking for a talented and enthusiastic individual to join our team as a Trainee - Software in SLK Digital Private Limited. The ideal candidate should have a strong foundation in AI/ML and be eager to learn and grow with our company. Roles and Responsibility Collaborate with cross-functional teams to design, develop, and deploy software applications using AI/ML techniques. Participate in code reviews and contribute to improving the overall quality of the codebase. Develop and maintain large-scale data pipelines and architectures using AI/ML tools and technologies. Work closely with senior developers to identify and prioritize project requirements. Design and implement automated testing frame...

We are looking for a highly skilled and experienced Specialist Data Science to join our team in Bengaluru. The ideal candidate will have 1-3 years of relevant work experience in Data Engineering, Data Visualization, and/or Data Analytics. Roles and Responsibility Set up, build, deploy, and maintain scalable and reliable data assets and reporting/dashboarding solutions. Improve the speed and quality of data provisioning and usage by effectively combining data from different sources across platforms and formats. Ensure scalability, robustness, and sustainable usage of developed solutions. Collaborate with domain, IT, and methods experts to capture the full value of our data. Translate complex ...

We are looking for a highly skilled and experienced Technical Content Developer & Writer with 2 to 5 years of experience to work closely with Technology Experts across Engineering, Product development, Consulting & deployment services. The ideal candidate will have a strong background in technical writing and a good understanding of Enterprise platforms and Emerging Technologies. Roles and Responsibility Develop structured GTM market, Solution One-Pagers, Presentations, Implementation and User guides. Collaborate with cross-functional teams to create accurate and timely documentation. Conduct research, analyze, and present solutions that solve customer problems. Translate complex solutions i...