6547 Big Data Jobs - Page 15

Hi all, We are hiring for the role GCP DATA ENGINEER Experience: 5+ Years Location: Pune Notice Period: Immediate - 15 days Budget: 18 LPA only Skills: Ideally you will have a background in software engineering along with experience in working in a complex cloud environment ( Google Cloud Platform) Ideally you will have experience working with Python and SQL. You have experience building data pipelines and ETL frameworks both batch and real time using Python and any of the GCP capabilities such Apache Beam, Data Flow, Data Fusion You have Experience with using Terraform to build Infrastructure-as-a-code Experience working with Big Data Technologies (Spark, Cloud SQL, Big Query ) preferably i...

Primary Responsibilities: Analyzes and investigates Provides explanations and interpretations within area of expertise Participate in scrum process and deliver stories/features according to the schedule Collaborate with team, architects and product stakeholders to understand the scope and design of a deliverable Participate in product support activities as needed by the team. Understand product architecture, features being built and come up with product improvement ideas and POCs Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, c...

We are a passionate team working to build a best-in-class healthcare product designed to make high-quality healthcare easy to access. We are looking for a Data Engineer who can build new engineering solutions with a motivated team that will delight our customers. The problem space is well-defined but the solution space is not and strong technical acumen and the ability to spot problems at architecture stage are important. This role requires deep technical expertise, and gives you the opportunity to engineer systems and build reliable and secure services for healthcare. You have an eye towards quality, and insist on the highest standards. You are motivated to tackle ambiguous situations with ...

5+ years of experience in BI and analytics, with specific expertise in Google Looker

develop and manage applications involved with Search Systems. Maintain and upgrade search indices for large document repositories, as well as optimizing indexing/queries and supporting analytics Analyze website metrics and customer behaviour data

develop and manage applications involved with Search Systems. Maintain and upgrade search indices for large document repositories, as well as optimizing indexing/queries and supporting analytics Analyze website metrics and customer behaviour data

Job Overview: We are looking for a Module Lead Azure Databricks to lead the design, development, and deployment of data engineering and analytics solutions on the Azure platform. The role involves guiding a team, ensuring high-quality deliverables, and collaborating with business and technology stakeholders to drive data-driven transformation. Key Responsibilities: Lead end-to-end design and development of scalable data pipelines and analytics solutions using Azure Databricks, Azure Data Lake, Synapse, and related services . Translate business requirements into technical specifications and data solutions. Oversee ETL/ELT design, data ingestion, transformation, and integration with multiple s...

1.8+Years of Experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure Storage Services, Azure SQL, ETL, Azure Cosmos DB, Event HUB, Azure Data Catalog, Azure Functions, Azure Purview 2. Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs 3. Extract Transformation and Load Data from source system and processing the data in Azure Databricks 4. Prepare DB Design Documents for the user story based on the client requirement 5. Work with the development team to create database structure, queries and used triggers 6. Extensive experience in Microsoft Cloud solutions, i.e., Designing, Developing, and Testing Technologies...

Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow,Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skillsCommon Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Data Engineer - Knows HR Knowledge , all other requirement from Functional Area given by UBER

Job Title: Senior Data Engineer, ED&A ICC Location: Mumbai, IN Responsibilities: Design and build reusable components, frameworks and libraries at scale to support analytics products Design and implement product features in collaboration with business and Technology stakeholders Anticipate, identify and solve issues concerning data management to improve data quality Clean, prepare and optimize data at scale for ingestion and consumption Drive the implementation of new data management projects and re-structure of the current data architecture Implement complex automated workflows and routines using workflow scheduling tools Build continuous integration, test-driven development and production ...

Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Overview MasterCard Advisors is helping to shape the future of data insights by leveraging billions of anonymized, aggregated transactions in a 10 petabyte data warehouse to help financial institutions, merchants, media, and governments manage their businesses more effectively Advanced Analytics is charged with servicing clients by centralizing and optimizing the world-class analytical, modeling, software coding, data sourcing, product development, product management, econometrics, and associated delivery capabilities of the MasterCard Advisors organization Use broad Banking, Retail, Travel, Technology, Digi...

We are looking for talented software engineers to develop advanced technologies and applications that are revolutionizing payments - Are you passionate about software engineering? - Do you enjoy seeing the impact your code has on a wide range of customers which improves their experience? - Do you want to work for a company that offers above and beyond benefits including paid parental leave, flexible work hours, gift matching, and even volunteer incentives while encouraging your professional learning and development? - Do you thrive in a place where you are continuously learning more while growing your skills and career? - Do you want to join a Company that offers a competitive benefits -and ...

Role As an Analyst, Data Quality you will: Govern the data of regional and global prioritized data assets (by merchants, industries, markets, and other dimensions) to ensure the highest quality of Mastercard data possible for products and services, as directed by Data Quality team management. Protect the integrity of the Mastercard network by monitoring data quality trends and establishing dashboards and alerts for remediation via technical platforms and compliance programs. Actively work the queue and approval of user-submitted data corrections. Support and develop dashboards to monitor data quality Analyze new data assets to provide new data types, coverage, and better data quality for end...

About Cybage: Founded in 1995, Cybage Software Pvt. Ltd is a technology consulting organization specialized in outsourced product engineering services. As a leader in the Technology and product engineering space, Cybage works with some of the worlds best independent software vendors. Our solutions are focused on modern technologies and are enabled by a scientific, data driven system called Decision Mines for Digital Excellence. This unique model de-risks our approach, provides better predictability, and ensures a better value per unit cost for our clients. Apart from Pune, we have our operations hub in GNR and Hyderabad as well and we have also marked our presence in North America, Canada, U...

Role Description Should have hands on experience in Machine Learning Model and deep learning development using python Data Quality Analysis and Data preparation. Exploratory Data Analysis and visualization of data. Defining validation strategies Defining the preprocessing or feature engineering to be done on a given dataset Defining data augmentation pipelines Text processing using Machine Learning and NLP for processing documents. Training models and tuning their hyperparameters Analyzing the errors of the model and designing strategies to overcome them Experience in python packages like Numpy, Scipy, Scikit-learn, Theano, TensorFlow, Keras, PyTorch, Pandas, Matplotlib. Experience in workin...

8+ years of extensive experience in data engineering, data architecture, or analytics. 3 years in a dedicated data architect or solutions architect role. 5 years of hands-on experience data solutions specifically on Google Cloud Platform.

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

Resource should have 5-7 years of experience. Sound knowledge of Python and should know how to use the ML related services. Proficient in Python with focus on Data Analytics Packages. Strategy Analyse large, complex data sets and provide actionable insights to inform business decisions. Strategy Design and implementing data models that help in identifying patterns and trends. Collaboration Work with data engineers to optimize and maintain data pipelines. Perform quantitative analyses that translate data into actionable insights and provide analytical, data-driven decision-making. Identify and recommend process improvements to enhance the efficiency of the data platform. Develop and maintain ...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Your primary responsibilities include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques Designing and implementing various enterprise seach applications such as Elasticsearch and Splunk for client requirements Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviors. Build teams or writing programs to cleanse and integrate data in an efficient and reus...

As an Associate Data Scientist at IBM, you will work to solve business problems using leading edge and open-source tools such as Python, R, and TensorFlow, combined with IBM tools and our AI application suites. You will prepare, analyze, and understand data to deliver insight, predict emerging trends, and provide recommendations to stakeholders. In your role, you may be responsible for: Implementing and validating predictive and prescriptive models and creating and maintaining statistical models with a focus on big data & incorporating machine learning. techniques in your projects Writing programs to cleanse and integrate data in an efficient and reusable manner Working in an Agile, collabor...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpora...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

Design, develop, and optimize ETL workflows to extract, transform, and load data from various sources into the data warehouse. Write efficient and complex SQL queries to support data extraction, transformation, and reporting needs. Manage and maintain database systems ensuring performance, reliability, and security. Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver scalable solutions. Monitor and troubleshoot ETL processes and database performance issues. Implement data quality checks and validation mechanisms to ensure data accuracy and consistency. Document data pipelines, workflows, and best practices. Stay updated with the...

Apply styles and images to document design. Use output comparison tools to compare different outputs Should have experience working with Exstream Design Manager & Exstream Designer Tool. Should have prior knowledge on working with Exstream Web Service. Designing Templates, Objects, Rules, Variables and creation of Documents based on Templates. Understand current SmartCOMM Templates and create templates based on that Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Intuitive individual with an ability to manage change and proven time management Proven interpersonal skills while contributing to team effort by accomplishing r...