1515 Data Lake Jobs - Page 13

1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search) 7 Evaluating the performance and applicability of multiple tools against customer requirem...

At GKM IT , were passionate about building seamless digital experiences powered by robust and intelligent data systems. We’re on the lookout for a Data Engineer - Senior II to architect and maintain high-performance data platforms that fuel decision-making and innovation. If you enjoy designing scalable pipelines, optimising data systems, and leading with technical excellence, you’ll thrive in our fast-paced, outcome-driven culture. You’ll take ownership of building reliable, secure, and scalable data infrastructure—from streaming pipelines to data lakes. Working closely with engineers, analysts, and business teams, you’ll ensure that data is not just available, but meaningful and impactful ...

We are seeking skilled and motivated Spark & Databricks Developers to join our dynamic team for a long-term project. The ideal candidate will have strong hands-on experience in Apache Spark, Databricks, and GitHub-based development workflows.

Job Requirements Mandatory Skills Proficient Experience on designing, building and operationalizing large-scale enterprise data solutions using at least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) Excellent communicator (written and verbal formal and informal) Experience using software version control tools (Git/Bitbucket/code commit). Flexible and proactive/self...

Job Requirements Mandatory Skills Proficient Experience on designing, building and operationalizing large-scale enterprise data solutions using at least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) Excellent communicator (written and verbal formal and informal) Experience using software version control tools (Git/Bitbucket/code commit). Flexible and proactive/self...

About The Role Project Role : Technology Platform Engineer Project Role Description : Creates production and non-production cloud environments using the proper software tools such as a platform for a project or product. Deploys the automation pipeline and automates environment creation and configuration. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :This position is responsible for managing the analytical and reporting tools and data sets to produce valuable insights from our data that help improve the quality of the division's business; gaini...

Your opportunity to make a real impact and shape the future of financial services is waiting for you. Let's push the boundaries of what's possible together. As a Senior Director of Software Engineering at JPMorgan Chase within the Consumer and Community Banking division, you will be responsible for leading various technical domains, overseeing the activities of multiple departments, and fostering cross-functional collaboration. Your technical expertise will be utilized across different teams to promote the adoption and implementation of advanced technical methods, helping the firm stay ahead of industry trends, best practices, and technological advancements. **Role Overview:** In this role, ...

Role & responsibilities Implement the data architecture for the enterprise and its business units Implementation of data management systems including data warehouses, data lakes and data integration processes with other transaction systems Collaborate with IT teams to ensure the availability, scalability and performance of data infrastructure & systems Implement data lifecycle management processes to optimize data storage, retention and archival Design, develop, and maintain scalable data pipelines and ETL processes to support data integration from various sources. Implement data models and schemas to support analytics and reporting needs Handle large volumes of structured and unstructured d...

We are currently seeking a Data Engineer to join our team in Remote, Karntaka (IN-KA), India (IN). "Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and ...

Name of Position: Databricks Lead No. of Positions : 1 Company Name: Whiteblue Cloud Services Location: Chennai, Tamil Nadu Job Description Role Overview: We are looking for an experienced Databricks Lead to design, develop, and optimize large-scale data solutions leveraging Azure Databricks, Azure Data Factory, and PySpark . The ideal candidate will have strong leadership skills, hands-on technical expertise, and a passion for driving cloud-based data modernization initiatives. Key Responsibilities Lead end-to-end data engineering and modernization projects using Azure Databricks and related technologies. Design, develop, and maintain scalable data pipelines and workflows using Azure Data F...

Employment Type: Contract - 6 months About the Role: We are looking for an experienced Informatica MDM Developer to design, implement, and optimize enterprise Master Data Management (MDM) solutions. The ideal candidate will have deep hands-on experience with Informatica MDM (Multi-Domain Edition) , including match & merge, survivorship, ActiveVOS workflows, and system integration . You will work closely with cross-functional teams to ensure data consistency, governance, and accuracy across business domains. Key Responsibilities: Configure and implement Informatica MDM Hub , including subject areas, base objects, landing tables, and relationships. Develop and optimize match/merge rules, trust...

About The Role Key Responsibilities: Provide expert-level support for Azure Machine Learning, OpenAI, Cognitive Services, Synapse, and Data Factory . Troubleshoot real-time data integration pipelines, model deployments, inference performance, and security configurations. Guide customers in implementing Responsible AI , security governance, and model versioning best practices. Collaborate with engineering teams to resolve service issues and release platform updates. Proactively identify patterns in customer challenges and build reusable diagnostics or automations. Work with cross-functional teams (Product, Engineering, Customer Success) to improve support processes and tooling. Skillset: Stro...

Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations. Collaborate seamlessly across diverse technical stacks, including Cloudera...

The Red Hat Experience Engineering (XE) team is looking for a skilled and well-rounded Data Engineer with excellent programming skills and the ability to partner with internal stakeholders to join our team in Pune, India. This team manages data created by the XE organization making it available to internal users for planning, reporting, business intelligence, and AI initiatives. To be successful in this role, you should have an established set of foundational skills and the ability to learn new skills quickly as we modernize platforms and tooling. You must also be able to work with minimal supervision in a fast-paced and ambiguous environment. You will be accountable for translating and mani...

Key Responsibilities: Operate: Responsible for the operation of the system and record any problems that occur. Resolve: Ensure rapid problem resolution in close cooperation with participating third parties. Follow: Proactively follow the solution progress of incidents. Monitor: Responsible for the monitoring and analysis of possible sources of error. Update: Keep stakeholders up-to-date on system-relevant incidents. Process: Follow established processes such as Incident Management and Change Request Management. Evangelize: Promote best practices and methodologies. Automate: Identify opportunities to automate processes and procedures. Cultivate: Build relationships with developers, engineers,...

JD : Strong programming experience with Python , including Pandas and PySpark Experience in data engineering and workflow optimization Hands-on experience working with Delta Tables and Parquet file formats Good-to-Have Skills: Experience with Databricks platform Knowledge of Apache Spark , DBT , and Airflow Expertise in advanced Pandas optimizations Familiarity with PyTest or DBT testing frameworks

SUMMARY Wissen Technology is Hiring for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge techno...

Essential for this role: Education and Qualifications: • Bachelor’s degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent. • Minimum seven plus years of experience in data analytics field • Experience with Azure/AWS Databricks • Experience in building and optimizing data pipelines, architectures and data sets • Excellent experience in Scala or Python, PySpark and SQL • Ability to troubleshoot and optimize complex queries on the Spark platform • Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques • Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS • Hands on...

Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers. We bring exceptional experiences using cutting-edge analytics, data proficiency, technology, and digital excellence. Data Modeler Azure Data Engineering Location: Hyderabad Experience Level: 8-13 Years 12+ years of experience in data management and data architecture, including 5+ years focused on data modeling . Expertise in dimensional modeling (Star/Snowflake) , normalized models , and data vault / data lake modeling . Strong experience with SQL and Azure Cloud ecosystem Azure Synapse, Data Factory, Data Lake, SQL DB, Databricks. Proven experience designing data model...

You will be joining a leading Digital Engineering, Cloud, and Data & AI services provider that focuses on delivering robust digital transformation initiatives to Global 2000 customers in industries such as banking, financial services, insurance, technology, media and telecom, healthcare, and logistics. With a team of 3,000 professionals worldwide, Accolite has a global presence across the United States, Canada, Mexico, Europe, and India. Key Responsibilities: - Strong Database SQL skills, Cloud DB knowledge, and experience with Snowflake - Proficiency in Data modeling, Database design, and optimization, especially in MPP Architecture - Familiarity with technologies related to Data Lake, part...

As a skilled Data Engineer with expertise in Microsoft Fabric, ERP system integration, and Power BI, you will play a crucial role in developing and maintaining data pipelines, integrating data from ERP systems, and designing interactive Power BI dashboards to facilitate data-driven decision-making. **Key Responsibilities:** - **Data Pipeline Development:** Design, develop, and maintain robust, scalable data pipelines using Microsoft Fabric to collect, process, and store large volumes of structured and unstructured data. - **ERP Data Integration:** Integrate data from various ERP systems (e.g., SAP, Oracle, Microsoft Dynamics 365) to ensure accurate, consistent data across platforms. - **Powe...

About the Role We are looking for an experienced Data Modeler to join our data engineering team for a leading banking project . The ideal candidate will have hands-on experience in data modeling using Erwin , a deep understanding of Medallion architecture , and strong analytical skills to translate business requirements into scalable, high-quality data models. Key Responsibilities Design, develop, and maintain conceptual, logical, and physical data models using Erwin Data Modeler . Implement and optimize Medallion architecture (Bronze, Silver, Gold layers) for data pipelines and analytical systems. Collaborate with data engineers, business analysts, and architects to define data modeling sta...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

About The Role Skill required: Delivery - Marketing Analytics and Reporting Designation: I&F Decision Sci Practitioner Sr Analyst Qualifications: Any Graduation Years of Experience: 5 to 8 years About Accenture Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song all powered by the worlds largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 countries. Visit us at www.accenture.com What would you do Data & AIAnalytical processes and ...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Manufacturing Engineering MES Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with v...