1507 Data Lake Jobs - Page 2

AWS Data Engineer Experience: 4 - 8 Years Exp. Salary : Competitive Preferred Notice Period : Within 7 Days Shift : 12:00 PM to 9:00 PM IST Opportunity Type: Hybrid , Hyderabad, Telangana Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : AWS Services, Cloud analytics, Data Integration, Data lake, ETL, Data Modelling, Python, Redshift Clovertex (One of Uplers' Clients) is Looking for: AWS Data Engineer who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you....

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. ...

About The Role Job Title:Procurement+ External Talent Strategic Programs Lead (Services) Management Level:L8 Associate Manager Consultant Location:Bengaluru (as a priority)/ Mumbai Must have skills: Advanced in analytics and the ability to analyze specifications and explain the data Strong project management eexperience Action oriented and solution minded team player with high degree of self-management Ability to break down complex scenarios into executable tasks Strong communicator in both spoken and written with confidence in communication to senior stakeholders and broader community Strong understanding of Procurement processes & External talent Industry Procurement and Talent experience ...

About the Role As a Data & AI Consultant in the Public Services domain , you will play a key role in designing, developing, and delivering data-driven and AI-enabled solutions for government and public sector organizations. You will collaborate with cross-functional teams to help clients leverage data, analytics, and automation to improve service delivery, enhance operational efficiency, and enable data-informed policy decisions. This is a client-facing role within Accentures Global Network Delivery team, working on large-scale transformation projects across global markets. Key Responsibilities Solution Design & Delivery: Design and implement data and AI solutions that address client busines...

Role Proficiency: Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others' developmental activities; assisting Project Manager in day to day project execution. Outcomes: Interpret the application feature and component designs to develop the same in accordance with specifications. Code debug test document and communicate product component and feature development stages. Validate results with user representatives integrating and commissions the overall solution. Select and create appropriate technical options for development such...

About QX: The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights, businesses will continue to face challenges to better understand their customers and even lose them; Secondly, without insights businesses won't be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization. Job Summary: We are seeking a...

About the Role Process Analysis & Opportunity Identification: Conduct in-depth analysis of existing business processes to identify pain points, inefficiencies, and strategic opportunities for leveraging AI/ML. AI Solution Design: Design innovative, AI-driven solutions that directly address identified business challenges and define new AI-driven business processes. Rapid Prototyping & Development: Lead the rapid development of proof-of-concepts (POCs) and minimum viable products (MVPs) using programming languages and AI frameworks to quickly validate and demonstrate AI solutions. Implement Scaled Solutions with ROI: Based on successful POCs, design approaches to implement the solution at scal...

The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed Required Candidate profile Minimum requirement of 5 years of relevant work experience. Typically reflects 7 years or more of relevant experience. Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.

Job Description: We are seeking a highly skilled Data Engineering specialist with 8+ years of experience with below mentioned Primary Skills to join our dynamic team. The ideal candidate should be passionate about working on Data Engineering on Azure cloud with strong focus on DevOps practices in building product for our customers. Effectively Communicate and Collaborate with internal teams and customer to build code leveraging or building low level design documents aligning to standard coding principles and guidelines. Key Technical Skills: 5+ years of experience in Azure Databricks with PySpark. 4+ years of experience in Databricks workflow & Unity catalog. 4+ years of experience in ADF (A...

6 years relevant in Data Engineering & Data Architecture Good understanding of Data Architecture. Experience in AWS mandatory Experience in Python & pyspark. Required Candidate profile Experience in ETL Development, ETL pipeline. Experience in Data Modelling & Data Pipeline & Data Lake. Experience in SQL. Experience in working as Individual Contributor + Lead.

Primary Responsibilities: Responsible for large and more complex components, while influencing overall Data architecture and patterns Implements component design in line with pre-defined team architectural patterns Creates design documents, for larger component work to gain alignment Delivers designs aligning to appropriate componentized architectures and integration patterns Can work autonomously Influences the team designs and solutions. Mentors software engineers through code reviews, and hands-on design sessions Code reviews are appropriately broken down in to reviewable chunks Contributes meaningfully to code reviews of teams work, providing collaborative guidance in areas of strength C...

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

6 + years of overall IT experience in Telecom OSS especially in Assurance domain Solution, design, and Implementation - Strong Knowledge of Telecom OSS domain, with excellent experience Service Now for Assuance - Knowledge and experience on Big Data,Data lake solution, KAFKA , Hadoop/Hive. - Experience on Python (pyspark) is essential. - Implementation experience in continuous integration and delivery philosophies and practices specifically on Docker, Git, JenKins - Self driven and highly motivated candidate for a client facing role in a challenging environment

Role & responsibilities Design and build a scalable data platform that can ingest, store, manage and stream massive amounts of data while simplifying its analysis and processing to enable rapid development of high-quality data products and services. •Implement and test robust low latency data pipelines for preparing/curating data that will support various data as a service product. •You will work with various cross functional teams to explore data and figure out all the data wrangling needed to clean, curate the data and build the end-to-end data pipeline per requirements. •You will design necessary privacy and security preventive and detective controls into the CICD pipelines of each data p...

Job Title: Principal Engineer - Cloud Architect Location: Bengaluru Position Description: Coming up with technical solution leveraging the cloud infrastructure Design solutions that are scalable, cloud architecture compliant Technically lead the team to ensure on time delivery with good quality Inculcate effective coding practices and improve performance of team through coaching and guidance Collaborate with product management to understand the user needs and contribute to the design of application Collaborate with department architecture team to propose and review architectural solutions/designs created by self What you will do: Design and implement cloud-based applications and services rel...

Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Big query, dataproc, dataflow, composor). Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good to have Knowledge of AI/ML skills, ML En...

The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large. Required Candidate profile DATA FORMATS: Examines and resolves appropriate data formats to improve data usability and accessibility across the organization.

Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Bigquery, dataproc, dataflow, composor) Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good to have Knowledge of AI/ML skills, ML Engi...

Responsibilities: Job Accountabilities - Hands on Experience in GCP Data Components (BigQuery / Data fusion / Cloud sql etc) - Data Lake and Data Warehouse Understanding - Manage DevOps lifecycle of project (Code Repository, Build, Release) - Good to have - end to end BI Landscape knowledge - Participate in unit and integration testing - Interaction with business users for Requirement understanding and UAT - Understanding of Data Security and Data Compliance - Agile Understanding - Project Documentation Understanding - Good SQL Knowledge - Certification (Good to have) - Domain Knowledge of Different Industry Sector Mandatory skill sets: GCP, Data Lake & Data Warehouse Preferred skill sets:GC...

Novartis PharmaCountry: IndiaROLE PROFILE General (organization chart to be attached) Job Title: Department: Reports to (Job Title): ED, Core Data Enablement Insights and Decision Science (IDS) Head, Data Enablement and Operations Job Purpose The Insights and Decision Science (IDS) team is dedicated to enabling improved decision-making at Novartis by leveraging data and advanced analytics capabilities to generate actionable insights that drive business growth. We collaborate closely with the US business, bringing insights and challenging ideas to empower smarter, data-driven decision-making. The ED of Core Data Enablement will be responsible for overseeing the direction, management, and exec...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Roles and Responsibilities Provide technical guidance on best practices for data operations, warehousing, and analytics. Ensure high-quality data processing by implementing robust testing frameworks and monitoring dashboards. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop and maintain ETL processes for extracting, transforming, and loading (ETL) data from various sources into the data lake.

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, ETL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and det...

As an experienced Data Engineer, your role will involve building and optimizing scalable data pipelines, designing modular transformations, ensuring data governance, and enabling analytics across lakehouse and warehouse architectures. You will need to operate in multi-cloud environments, apply engineering best practices, and collaborate with cross-functional teams to deliver high-quality, governed, and production-ready data solutions. **Key Responsibilities:** - Design and implement ETL/ELT pipelines using Azure Databricks (PySpark, SQL, Delta Lake) or Snowflake (SQL, dbt). - Build metadata-driven ingestion frameworks to integrate data from relational databases, APIs, and flat files (CSV, JS...