1515 Data Lake Jobs - Page 16

Role Overview: As the Deputy General Manager - Finance Master Data Lead at Bunge, you will be responsible for leading and supporting enterprise master data programs to drive Bunge's strategic initiatives in areas such as Digital programs, Data Integration, and S4 Hana implementation for Finance data domain. Your role will involve collaborating with multiple stakeholders globally to define and achieve mutually agreed outcomes in the master data domains. Key Responsibilities: - Gather business requirements and translate them into functional specifications for end-to-end business solutions, including S4 HANA Data Management. - Engage with business stakeholders to prioritize requirements, negoti...

Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks, and data quality assurance across various financial data sources. ETL Testing: Conduct thorough testing of ETL (Extract, Transform, Load) processes, ensuring data is accurately extracted, transformed according to business rules, and loaded correctly into target systems. Data Quality Assurance: Implement and monitor data quality checks, identify data discrepancie...

Job Summary: We are seeking a talented Python Developer / Data Engineer to join our dynamic team The ideal candidate will have strong proficiency in Python, experience working with public cloud platforms such as AWS or Microsoft Azure, and a solid foundation in computer science principles. What Youll Do: Design, develop, test, document, deploy, maintain, and enhance software applications for a quantitative product that conducts complex mathematical calculations to accurately derive and analyze the various S&P index. Manage individual project priorities, deadlines, and deliverables. Collaborate with key stakeholders to develop system architectures, API specifications, and implementation requi...

Very Urgent: Data Engineer / Sr.Data Engineer Company: AurumData Solutions Client: MNC Experience: 7+years Location: Jubilee Hills Hyderabad (Customer Location) Job Mode: C2H Duration: 1year + Ext Work Type: Hybrid Mode Note: The selected candidates will be required to work at the customer's location. Key skills: Data Engineer, Python, PySpark, SQL, Databricks, Airflow, Data lake, merging of data, data ingestion, ETL Process, API, FastAPI, AWS (S3, IAM, ECR, Lambda), Rockset, Clickhouse, CrateDB, Avro, Parquet, ORC etc.. Job Summary: A Data Engineer is responsible for overseeing the design, development, and management of data infrastructure and pipelines within an organization. This role inv...

As an experienced Data Engineer, your role will involve designing, implementing, and optimizing a global data handling and synchronization solution across multiple regions. You will work with cloud-based databases, data lakes, and distributed systems, ensuring compliance with data residency and privacy requirements such as GDPR. Key Responsibilities: - Design and implement data pipelines for global and regional data synchronization using Azure SQL, Data Lake, Data Factory, PySpark, etc. - Develop solutions for secure handling of PII and non-PII data, ensuring compliance with GDPR and other regulations. - Build and optimize ETL processes for anonymization, transformation, global synchronizati...

We are seeking an experienced and highly skilled Senior Data Engineer to drive data-driven decision-making and innovation. In this role, you will leverage your expertise in advanced analytics, machine learning, and big data technologies to solve complex business challenges. You will be responsible for designing predictive models, building scalable data pipelines, and uncovering actionable insights from structured and unstructured datasets. Collaborating with cross-functional teams, your work will empower strategic decision-making and foster a data-driven culture across the organization. Role & responsibilities 1 Position Overview: We are seeking an experienced and highly skilled Senior Data ...

Were Hiring – Data Architect | Data Engineer Location: Bangalore | CTC: Up to 35 LPA Interview: F2F | Experience: 12+ Years Key Skills: Data Architecture & Modelling (Star & Snowflake schemas) AWS: S3, RedShift, Glue Big Data: Spark, Hive, Presto SQL (Strong query writing & procedures) | Python | GitHub Data Lakes, ETL (Informatica preferred) DevSecOps, CI/CD, Data Pipeline Automation Responsibilities: Design & deliver scalable data engineering solutions on AWS Build & optimize ingestion pipelines (Spark, Presto, RedShift) Ensure data quality, governance & security best practices Collaborate with Data Modelers & BI/Analytics teams Troubleshoot, monitor & enhance performance of data systems D...

Job Responsibilities Technology Leadership – Independently he/she should be able to design, implement deliver complex Data Warehousing/Data Lake, Cloud Data Management and Data Integration project assignments. Technical Design and Development – Expertise in any of the following skills. Any of the ETL tools (Informatica, IICS, Matillion, Data Stage), andhosting technologies like the AWS stack (Redshift, EC2) is mandatory. Any of the BI toolsamong Tablau, Qlik & Power BI and MSTR. Informatica MDM, Customer Data Management. Expert knowledge of SQL with the capability to performance tune complex SQL queries in tradition and distributed RDDMS systems is must. Experience across Python, PySpark and...

About Us Diligent is the AI leader in governance, risk and compliance (GRC) SaaS solutions, helping more than 1 million users and 700,000 board members to clarify risk and elevate governance. The Diligent One Platform gives practitioners, the C-Suite and the board a consolidated view of their entire GRC practice so they can more effectively manage risk, build greater resilience and make better decisions, faster. At Diligent, we're building the future with people who think boldly and move fast. Whether you're designing systems that leverage large language models or part of a team reimaging workflows with AI, you'll help us unlock entirely new ways of working and thinking. Curiosity is in our ...

Roles & Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various sources and storage systems. Creating innovative data validation methods and data analysis tools. Ensuring compliance with data governance and security policies. Conducting complex data analysis and presenting results effectively. Continuously exploring opportunities to enhance data quality and reliability. Data Modeling: oCreate and maintain data models that support business requirements and data analytics. oEnsure data structures are optimized for p...

To enhance our Data Solutions team, we are seeking a skilled Data Analyst BI & Visualization to build high-impact dashboards, optimize data models, and support data-driven decision-making across clients and internal functions. Position Summary As a Data Analyst BI & Visualization, you will be responsible for designing and developing dashboards, performing data analysis, building optimized data models, and delivering business insights. This role requires hands-on expertise in Power BI, Tableau, SQL, Python, and related tools. You will collaborate with cross-functional teams to understand business needs, translate them into data requirements, and deliver intuitive reporting solutions. The idea...

As an individual with comprehensive exposure to Cloud technologies, you will be responsible for the following key responsibilities: - Having comprehensive expertise in BigQuery development - Possessing comprehensive expertise in GCP Data flow development - Demonstrating expert level in GCP DAG development, scheduling, and monitoring - Showcasing good skills in cloud ETL development using Azure Data Factory, Data Bricks, AWS Red-Shift, SSIS, etc - Showcasing good exposure in writing scripts to upload/download data from GCP/Azure/AWS - Utilizing excellent Python scripting skills - Preferably having decent Looker studio development skills - Demonstrating a clear understanding of Queries, joins,...

As a Senior Data Scientist, your role involves designing, developing, and deploying advanced AI/Data Science solutions with a focus on scalability and ethical AI. You will apply your expertise in machine learning frameworks and advanced techniques such as LLM fine-tuning, RAG implementations, and evaluation methods. Conducting applied research in areas like fraud detection, risk modeling, and automation will be part of your responsibilities. Additionally, you will perform data analysis and profiling on large datasets using SQL/KQL, collaborate with data engineers, and create Power BI dashboards aligned with business use cases. Your role will also require translating business needs into techn...

Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : SAP BW/4HANA Data Modeling & Development Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. A typical day involves collaborating with cross-functional teams to gather insights, analyzing user needs, and translating them into functional specifications. You will engage in...

Job Title: Data Engineer Azure Data Engineering & Databricks Experience: 4–7 Years Role Summary: We are looking for a skilled Data Engineer with solid experience in the Azure data ecosystem and hands-on expertise in Azure Databricks. The ideal candidate will have worked on designing and developing scalable, cloud-native data pipelines and solutions using Azure data services. You will contribute to building and optimizing data lakehouse and warehouse architectures, enabling efficient data ingestion, transformation, and analytics in a collaborative team environment. Roles and Responsibilities: Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory, Azure D...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : PTC Windchill Good to have skills : NAMinimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with var...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Microsoft Fabric Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will develop and configure software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with various teams to ensure t...

Job Summary: We are seeking a skilled GCP Data Engineer to design, develop, and manage large-scale data pipelines and cloud-based data solutions on Google Cloud Platform (GCP) . The role requires expertise in data engineering, ETL/ELT processes, and GCP services to deliver scalable, reliable, and high-performance data platforms that support analytics and business intelligence. Key Responsibilities: Design, build, and maintain data pipelines and ETL/ELT workflows using GCP services. Develop scalable data architectures leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, and Cloud Storage . Collaborate with data analysts, data scientists, and business teams to understand requirements and deliver ...

We are looking for a skilled Senior Data Engineer with 5 to 10 years of experience to join our team at Cyclsys Software, working on Microsoft Fabric and DataLake solutions. The ideal candidate will have a strong background in data engineering and excellent problem-solving skills. Roles and Responsibility Design, develop, and implement data pipelines using Microsoft Fabric and DataLake. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring scalability and reliability. Troubleshoot complex data-related issues and provide timely resolutions. Implement data quality checks and ensure data integrity. Stay up...

We are looking for a skilled Senior Data Engineer with 7 to 10 years of experience to join our team at Cylsys Software, responsible for designing and implementing large-scale data pipelines using Microsoft Fabric and DataLake. The ideal candidate will have a strong background in data engineering and excellent problem-solving skills. Roles and Responsibility Design and implement scalable data pipelines using Microsoft Fabric and DataLake. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data architectures and workflows. Ensure high-quality data processing and analysis. Troubleshoot and resolve technical issues efficiently. I...

We are seeking a talented and experienced Lead Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will design, develop, and maintain scalable data pipelines and systems to support the ingestion, transformation, and analysis of large datasets. The role requires a deep understanding of data workflows, cloud platforms (Azure), and strong problem-solving skills to ensure efficient and reliable data delivery. Key Responsibilities Data Ingestion an...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you ready to embark on an exhilarating journey as a Data Consultant? Join Kyndryl and become a driving force behind the transformative power of data! We're seeking an exceptionally talented individual to accelerate the competitive performance of our customers worldwide, establishing us as their unrivaled business and technology consulting p...

Design, develop, optimize scalable data pipelines using Azure Data Factory (ADF) Build maintain ETL/ELT workflows for structured and unstructured data Leverage Azure Databricks for big data processing, analytics, and machine learning integration Required Candidate profile Work with Azure Synapse Analytics, Cosmos DB, Azure Data Lake Storage to deliver high-performing data solutions Apply data warehousing concepts, dimensional modeling, best practices for performance Perks and benefits Perks and Benefits

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly experienced and technically proficient Generative AI Data Architect (AWS) with deep expertise in data architecture principles, data modeling techniques and methodologies, and enterprise-scale AI/ML systems. The ideal candidate should have 10-13 years of experience in designing...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Data Engineering Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly experienced and technically proficient Generative AI Data Architect (AWS) with deep expertise in data architecture principles, data modeling techniques and methodologies, and enterprise-scale AI/ML systems. The ideal candidate should have 10-13 years of experience in designing and managin...