999 Data Lake Jobs - Page 3

Overview of 66degrees 66degrees is a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands transform their business challenges into opportunities and shape the future of work. At 66degrees, we believe in embracing the challenge and winning together. These values not only guide us in achieving our goals as a company but also for our people. We are dedicated to creating a significant impact for our employees by fostering a culture that sparks innovation and supports professio...

Position Overview: The Microsoft Cloud Data Engineer role is ideal for a highly capable and motivated Microsoft Cloud Data Engineer to design, build, and maintain cloud-based data solutions using Microsoft Azure technologies. This role is key for developing robust, scalable, and secure data pipelines and supporting analytics workloads that power business insights and data-driven decision-making. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Develop and manage data integration workflows to ingest data from multiple sources including APIs, on-prem systems, and cloud services. Optimi...

Introduction to the Role: Are you passionate about unlocking the power of data to drive innovation and transform business outcomes? Join our cutting-edge Data Engineering team and be a key player in delivering scalable, secure, and high-performing data solutions across the enterprise. As aData Engineer, you will play a central role in designing and developing modern data pipelines and platforms that support data-driven decision-making and AI-powered products. With a focus onPython,SQL,AWS,PySpark, andDatabricks, you'll enable the transformation of raw data into valuable insights by applying engineering best practices in a cloud-first environment. We are looking for a highly motivated profess...

Overview OMPD is an MSCI Climate “future go to” internal platform and critical data provider for client facing platform used which will be used by: MSCI Sustainability researchers develop the Sustainability model as per the latest regulations, industry and market specific needs MSCI data operations team manages the with Sustainability specific data MSCI analysts to work with the mode and data to create, validate and refine Sustainability reports External Clients. Responsibilities Delivering new functionality by writing and shipping high quality code for the OMDP meeting the MSCI requirements. Design, build, and maintain efficient, reusable, and reliable code. Design and implementation of con...

Overview As an Analyst, Data Modeler, your focus would be to partner with D&A Data Foundation team members to create data models for Global projects. This would include independently analysing project data needs, identifying data storage and integration needs/issues, and driving opportunities for data model reuse, satisfying project requirements. Role will advocate Enterprise Architecture, Data Design, and D&A standards, and best practices. You will be performing all aspects of Data Modeling working closely with Data Governance, Data Engineering and Data Architects teams. As a member of the data Modeling team, you will create data models for very large and complex data applications in public...

Role Overview We are seeking a highly skilled Senior Data Engineer to architect, develop, and manage robust, scalable data solutions in a cloud-first environment. This role requires deep expertise in the AWS ecosystem, ETL/ELT frameworks, and data warehousing, along with strong leadership and collaboration capabilities. You will work closely with cross-functional teams to deliver high-performance data infrastructure that drives business insights and operational excellence. Key Responsibilities Design, architect, and manage scalable, secure, and reliable data platforms leveraging AWS services (e.g., Redshift, S3, Glue, Lambda) Build and maintain real-time and batch data pipelines for seamless...

Solid understanding of GCP ETL framework. Data lake and Datawarehouse . Strong Bigquery SQL and Pyspark/Python Solid knowledge about Bigquery architecture (Mainly Dataproc, dataflow, Fusion, Cloud Composer, pub sub, Cloud Function, kubernetes).

As an Azure Platform Engineer, you will be responsible for the design, development, and maintenance of cloud solutions using various cloud services and tools. This role is part of a highly focused squad that uses several agile methodologies and techniques to deliver across multiple facets of the cloud simultaneously. What you will deliver Develop scripts and code to automate infrastructure provisioning and configuration using Infrastructure-as-Code (IaC) principles and best practices. Optimize the capacity, performance, and cost of cloud resources based on business needs and budget constraints. Manage and ingest persistent data for logging and audit purposes while ensuring data security and ...

Experience: Relevant field with 4-6 years in IT with minimum 2 years hands-on experience on AWS Cloud platform Knowledge in python (Fast API), microservices, angular > v15 (State management - NgRx) is must & good to have knowledge on java, oops Experience in creating reusable and shared components in Angular Experience in designing and implementing APIs (fast API -is must ) Experience is implementing authentication & authorization in backend (SAML & SSO) and front end Experience in database design (SQL). Experience with the core AWS Services and setting up AWS Data Platform AWS OpenSearch, AWS Glue Catalog, ECS, API Gateway Background in Data Model Engineering Data Warehouse or Data Lake exp...

Job TitleSenior DataLake Implementation Specialist Experience: 1012+ Years Location: Bangalore Type: Full-time / Contract Notice Period: Immediate Job Summary: We are looking for a highly experienced and sharp DataLake Implementation Specialist to lead and execute scalable data lake projects using technologies such as Apache Hudi, Hive, Python, Spark, Flink , and cloud-native tools on AWS or Azure . The ideal candidate must have deep expertise in designing and optimizing modern data lake architectures with strong programming skills and data engineering capabilities. Key Responsibilities: Design, develop, and implement robust data lake architectures on cloud platforms (AWS/Azure). Implement s...

About The Role Project Role : Technology Support Engineer Project Role Description : Resolve incidents and problems across multiple business system components and ensure operational stability. Create and implement Requests for Change (RFC) and update knowledge base articles to support effective troubleshooting. Collaborate with vendors and help service management teams with issue analysis and resolution. Must have skills : TIBCO Administration Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Technology Support Engineer, you will engage in resolving incidents and problems across various business syste...

SUMMARY About the Role: We are looking for a Senior Data Engineer to lead the design and implementation of scalable data infrastructure and engineering practices. This role will be critical in laying down the architectural foundations for advanced analytics and AI/ML use cases across global business units. You’ll work closely with the Data Science Lead, Product Manager, and other cross-functional stakeholders to ensure data systems are robust, secure, and future-ready. Key Responsibilities: Architect and implement end-to-end data infrastructure including ingestion, transformation, storage, and access layers to support enterprise-scale analytics and machine learning. Define and enforce data e...

As a Data Engineering Senior Associate at Microsoft, Fabric, Azure (Databricks & ADF), PySpark, your role will involve: - Requirement gathering and analysis - Designing and implementing data pipelines using Microsoft Fabric & Databricks - Extracting, transforming, and loading (ETL) data from various sources into Azure Data Lake Storage - Implementing data security and governance measures - Monitoring and optimizing data pipelines for performance and efficiency - Troubleshooting and resolving data engineering issues - Providing optimized solutions for any problem related to data engineering - Working with a variety of sources like Relational DB, API, File System, Realtime streams, CDC, etc. -...

As a leader in supporting AWM LFO Predictive Analytics Ameriprise India team, you will be responsible for leading advanced data science work and collaborating with cross-functional teams to recommend and implement analytical solutions for the Advise & Wealth Management business. **Key Responsibilities:** - Analyze, design, develop, and implement decision support models and data visualizations using tools like Python, Microsoft Excel/PowerBI. - Develop innovative analytical solutions such as segmentation, predictive modeling, simulation modeling, and optimization. - Maintain infrastructure systems connecting internal data sets and create new data collection frameworks. - Interact with busines...

Hiring!!!!!!!! C2H!!!!!!! PaloAlto Certfiacte is Mandatory!!!!!!! Loaction : Chennai, Mumbai, Hyderabad, Kolkata, Noida,Bangalore, Pune Key Responsibilities Monitor, analyze, and respond to security events and incidents using Palo Alto XSIAM, XDR, Data Lake, and SIEM solutions. Perform threat hunting, triage, and investigation of security alerts. Create and fine-tune detection rules, correlation policies, and playbooks in Palo Alto platforms. Work with XDR and SIEM data sources for advanced analytics and incident detection. Conduct root cause analysis of security incidents and recommend remediation actions. Collaborate with cross-functional teams to contain and mitigate security threats. Gen...

Experience in developing modern Data platform, data lake Experience in development of large-scale enterprise data warehouse and data lake solution. Maintain robust data catalogue Manage Azure cloud platform for Data and Analytics Immediate to 15 Days

Educational Requirements Bachelor of Engineering,BSc,BCA,MCA,MSc,MTech Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. • You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. • You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Techno...

Position summary: A Specialist shall work with the development team and responsible for development task as individual contribution. He/she should be able to mentor team and able to help in resolving issues. He/she should be technical sound and able to communicate with client perfectly. Key duties & responsibilities Work as Lead Developer Data engineering project for E2E Analytics. Ensure Project delivery on time. Mentor other team mates and guide them. Will take the requirement from client and communicate as well. Ensure Timely documents creation for knowledge base, user guides, and other various communications systems. Ensures delivery against Business needs, team goals and objectives, i.e...

Position summary: A user shall work with the development team and responsible for development task as individual contribution .He/she should be technical sound and able to communicate with client perfectly . Key duties & responsibilities: Work as Specialist Data engineering project for E2E Analytics. Ensure Project delivery on time. Mentor other team mates and guide them. Will take the requirement from client and communicate as well. Ensure Timely documents creation for knowledge base, user guides, and other various communications systems. Ensures delivery against Business needs, team goals and objectives, i.e., meeting commitments and coordinating overall schedule. Works with large datasets...

The Thomson Reuters Financial transformation team instrumenting on implementing and delivering solution relating to digital finance strategies, enterprise performance strategies and technologies solutions. This position will play a key role as part of Performance Management projects, including tech driven transformation with tools like OneStream. About the Role: In this opportunity as EPM Architect (OneStream), you will: 10 -15 years working experience with Enterprise Performance Management Solutions implementation and delivery. Hands on experience in EPM tools: OneStream, Hyperion Experience of involvement in end-to-end implementation of OneStream platform with significant exposure to manag...

Role & responsibilities : Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery. Construct automation, frameworks, and enhanced tools to streamline data engineering workflows. Collaborate across teams to facilitate smooth data flow and integration. Enforce best practices in observability, data governance, security, and regulatory compliance Preferred candi...

Greetings from NAM Info Inc!!! Please go through the job description. If you are interested in this opportunity, please reply with the following information: Full Name (as in Adhar): Expected CTC: Present CTC: Least Notice Period(Last Working Day If any): Current Location: Job Title: Data Engineer Location: Bangalore, India Mode: Full-time Experience: 6+ years Work Schedule: 5 days a week Work Mode: Work from Office (WFO) Work Timings: 12 PM to 9.00 PM Company address: NAM Info Pvt Ltd, 29/2B-01, 1st Floor, K.R. Road, Banashankari 2nd Stage, Bangalore - 560070. Interview Process: 2 - 3 Rounds Mode of Interview: 1-round Virtual and 2nd round F2F Required Skills and Experience: 7+ years of exp...

Prior experience with writing and debugging python Prior experience with building data pipelines. Prior experience Data lakes in an aws environment Prior experience with Data warehouse technologies in an aws environment

Job Role - Lead Data Architect Location - Bangalore / Navi Mumbai / Gurugram and Noida Actionable: Responsible for building data lake, data foundation and analytical solution with standard design and modern cloud/hybrid architecture pattern Work with cross functional teams to make the data usable for functional users and applications to enable delivery of business values to customers Provide architectural leadership and vision for Bank's Next Gen Data Platform and Data Lakehouse Develop and maintain architectural roadmap for data products and data services plus ensuring alignment with the business and enterprise architecture strategies and standards Drive design and architecture for Data Tra...

Data Engineer Experience: 3 - 4 Years Exp Salary : Competitive Preferred Notice Period : Within 30 Days Opportunity Type: Hybrid (Bengaluru) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : PostgreSQL OR MongoDB OR Airflow OR Kafka OR Python OR Spark OR SQL OR ETL , Azure OR Data Lakehouse, Data Mesh architectures. Living Things (One of Uplers' Clients) is Looking for: Data Engineer who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you. Role Overview Des...