1515 Data Lake Jobs - Page 18

Job Summary As a Data Lake Engineer at NetApp India’s R&D division, you will be responsible for the design, development, and support of multi petabytes scale Datalakes for both on-prem and soon to be cloud environments. You will be part of a highly skilled technical team named NetApp Active IQ. The Active IQ DataHub platform processes over 10 trillion data points per month that feeds a multi-Petabyte DataLake. The platform is built using Kafka, a serverless platform running on Kubernetes, Spark and various NoSQL databases. This platform enables the use of advanced AI and ML techniques to uncover opportunities to proactively protect and optimize NetApp storage, and then provides the insights ...

We are looking for a skilled Business System Analyst/Data Analyst with 7-10 years of experience to join our team in Pune, Bangalore, and Chennai. The ideal candidate will have expertise in Azure Data Factory, SQL, and data analytics. Roles and Responsibility Design and implement data models using Azure Data Bricks and Synapse/SQL Server. Develop and maintain data pipelines using Azure Data Factory and DataBricks. Collaborate with cross-functional teams to identify business requirements and develop solutions. Analyze and interpret complex data sets to inform business decisions. Develop and maintain data visualizations using Tableau and Power BI. Ensure data quality and integrity through data ...

We are looking for a skilled professional with 10-15 years of experience to join our team as a GCP expert in Pune, Bengaluru, and Chennai. Roles and Responsibility Design and implement data warehouse solutions using GCP BigQuery, GCP BigData, Dataflow, Teradata, and other relevant tools. Develop and maintain large-scale data pipelines and architectures on the GCP cloud platform. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing robust testing and validation procedures. Provide technical guidance and support to junior team members on GCP best practices. Stay up-to-date with the latest GCP features and tec...

Position Summary: Perform DataLake(Azure Databricks) operations on healthcare data from multiple sources. To succeed in this role, the candidate should be analytical and excellent communicator. Experience in the healthcare industry is a plus. Experience integrating data from disparate sources in MS SQL and DataLake Environment. You will be responsible towards working with different stakeholders to accomplish business and operation goals. Key Duties & Responsibilities: Data processing (ETL) using MSSQL, DataLake (Azure Databricks), Python, Scala, GitHub with T-SQL stored procedures, views, and other various database objects; import and export processing; data conversions; business process wor...

We are looking for a skilled Senior Data Engineer with 5 to 10 years of experience to join our team in Gurugram. The ideal candidate will have expertise in building Data Lakes, Data Warehouses using Big data & cloud stack, and data modeling. Roles and Responsibility Design and develop scalable data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and databases. Ensure data quality and integrity through data validation and testing procedures. Implement Agile development methodologies to ensure timely delivery of projects. Optimize data storage and retrieval processes for improved...

We are looking for a skilled Data Engineer with 5-6 years of experience to join our team in Gurgaon. The ideal candidate will have expertise in data engineering, software development, and cloud services. Roles and Responsibility Design and develop data ingestion services using various tools and technologies. Develop and maintain large-scale data warehouses and data lakes. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing robust testing and validation procedures. Participate in Agile development methodologies to deliver high-quality products. Troubleshoot and resolve complex technical issues related to da...

8 yrs. in software development background, with major experience in intense: Business requirements analysis and data modelling Data querying, particularly with SQL query engines Big data analytics data processing, data lake / lakehouse architecture Required Candidate profile Hands-on experience of Big Data opensource technologies : Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake or Apache Iceberg AWS Athena, Trino MongoDB AWS S3, MinIO S3

Strong knowledge and experience with Azure Databricks Proficiency in programming languages such as Python or SQL Experience with data engineering, data processing, and data analytics Understanding of cloud computing and infrastructure Ability to analyze complex problems and provide efficient solutions Excellent communication and collaboration skills Bachelor's degree or higher in a relevant field Relevant certifications in Azure Databricks are a plus Prior experience with big data technologies and frameworks is a plusRole & responsibilities

Strong knowledge and experience with Azure Databricks Proficiency in programming languages such as Python or SQL Experience with data engineering, data processing, and data analytics Understanding of cloud computing and infrastructure Ability to analyze complex problems and provide efficient solutions Excellent communication and collaboration skills Bachelor's degree or higher in a relevant field Relevant certifications in Azure Databricks are a plus Prior experience with big data technologies and frameworks is a plusRole & responsibilities

Strong knowledge and experience with Azure Databricks Proficiency in programming languages such as Python or SQL Experience with data engineering, data processing, and data analytics Understanding of cloud computing and infrastructure Ability to analyze complex problems and provide efficient solutions Excellent communication and collaboration skills Bachelor's degree or higher in a relevant field Relevant certifications in Azure Databricks are a plus Prior experience with big data technologies and frameworks is a plusRole & responsibilities

Degree in Computer Science (or similar), alternatively well-founded professional experience in the desired field Roles Responsibilities: As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You are responsible for the implementation of the IT governance guidelines. Collaborate with the Spokes Data Scientists, Data Analysts, and Business Analysts, when relevant. Tasks Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation Experience working with and creating cloud data solutions Assemble large, complex data sets that meet functional/non-functional business requirements Implem...

Responsibilities: * Design, develop & maintain data pipelines using Python & AWS. * Collaborate with cross-functional teams on data lake strategy & implementation. * Ensure data quality, security & compliance standards met.

Position summary: A user shall work with the development team and responsible for development task as individual contribution .He/she should be technical sound and able to communicate with client perfectly . Key duties & responsibilities: Work as Specialist Data engineering project for E2E Analytics. Ensure Project delivery on time. Mentor other team mates and guide them. Will take the requirement from client and communicate as well. Ensure Timely documents creation for knowledge base, user guides, and other various communications systems. Ensures delivery against Business needs, team goals and objectives, i.e., meeting commitments and coordinating overall schedule. Works with large datasets...

Position summary: A Specialist shall work with the development team and responsible for development task as individual contribution. He/she should be able to mentor team and able to help in resolving issues. He/she should be technical sound and able to communicate with client perfectly. Key duties & responsibilities Work as Lead Developer Data engineering project for E2E Analytics. Ensure Project delivery on time. Mentor other team mates and guide them. Will take the requirement from client and communicate as well. Ensure Timely documents creation for knowledge base, user guides, and other various communications systems. Ensures delivery against Business needs, team goals and objectives, i.e...

Position Summary: Perform DataLake(Azure Databricks) operations on healthcare data from multiple sources. To succeed in this role, the candidate should be analytical and excellent communicator. Experience in the healthcare industry is a plus. Experience integrating data from disparate sources in MS SQL and DataLake Environment. You will be responsible towards working with different stakeholders to accomplish business and operation goals. Key Duties & Responsibilities: Data processing (ETL) using MSSQL, DataLake (Azure Databricks), Python, Scala, GitHub with T-SQL stored procedures, views, and other various database objects; import and export processing; data conversions; business process wor...

Job Role - Sr. Tech Analyst (Azure Cloud) Experience - 8 to 11 years Location - Airoli, Navi Mumbai Note - 70% Incident Management & 30 % Development Job Purpose: To work as Data Engineering / Data Platform Support for Data lakehouse project. Establish an understanding of the business, develop a deep understanding of business needs, and build and shape delivery plans. Prepare and deliver presentations and facilitate decisions among senior stakeholders. Represent the role in line with the Banks culture, ensuring full transparency, auditability and value for money objectives are met/upheld. Understand data requirements projects of various internal department and regulators i.e. RBI, Compliance...

Skills : Data Engineer, DataBricks/Kafka/Snowflake, Datalake, SSIS,Talend, T-SQL Experience: Total Experience: 7 to 10 years, Relevant Experience: 1-2 projects if candidates have done it is sufficient, In Kafka is mandatory Snowflake and in Kafka, more than 2 years will work Specific Domain / Industry :Healthcare Experience is required . Notice Period: 0-30 days Education BE, ME, BTECH, MTECH, MCA Location - Bengaluru,Chennai,Hyderabad,Pune

Role & responsibilities Lead digital transformation for the engineering function Manage full lifecycle of digital products (vision development adoption) Design, develop, and implement digital tools. First-line support for digital/software issues. Lead, mentor, and manage developer team. Define product vision, roadmap, and adoption strategy. Collaborate with Engineering, IT, and Business teams. Introduce AI/ML, Data Science, analytics, automation, computer vision. Integrate open-source APIs/software (YOLO, NLP, etc.). Oversee Data Lake, pipelines, and enterprise analytics. Track KPIs and measure product impact. Stay updated with digital trends and drive innovation. Promote digital-first cultu...

Candidate should have experience in Data Engineering with AWS Databricks Please don't require Azure Databricks

Lead Data Engineer Data Management Job description Company Overview Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology. Accordion works at the intersection of Private Equity sponsors and portfolio companies' management teams across every stage of the investment lifecycle. We provide hands-on, execution-oriented support, driving value through the office of the CFO by building data and analytics capabilities and identifying and implementing strategic work, rooted in data and analytics. Accordion is headquartered in New York City with 10 offices worldwide. Join us and...

Responsibilities: * Design, develop, and maintain data pipelines using AWS and Python. * Collaborate with cross-functional teams on data lake projects. * Optimize data processing performance and ensure data accuracy.

We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team in Chennai. The ideal candidate will have strong expertise in building, maintaining, and optimizing scalable data pipelines and architectures on Azure. You will collaborate with cross-functional stakeholders to deliver enterprise-grade data solutions that enable advanced analytics and business intelligence. Key Responsibilities Design, develop, and optimize scalable and reliable data pipelines using Azure Data Factory (ADF), Databricks, PySpark, and SQL. Implement data ingestion, transformation, cleansing, and integration solutions from multiple structured and unstructured data sources. Design and im...

Critical Skills to Possess: 3–6 years of experience in data engineering, with a strong focus on Azure data services. Proven experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Functions, and Data Lake (Gen2). Strong SQL and Python skills for data processing and transformation. Experience working with structured and unstructured data. Familiarity with CDP use cases like identity resolution, customer 360, real-time personalization, and consent management. Hands-on experience with data orchestration, monitoring, and logging frameworks. Knowledge of data governance, data lineage, and security best practices. Good understanding of cloud architecture, DevOps, and C...

TITLE: Lead Engineer Key Skills: SQL, Python, Pyspark, Azure, Data Bricks, Team Leading Work Schedule: Full-time, on-site in Gurgaon, 5 days a week. Job Summary: We are seeking a skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have hands-on experience in Azure Data Engineering, strong expertise in Databricks, PySpark, and SQL, along with proven leadership capabilities managing data engineering teams. This role requires excellent communication skills and the ability to work collaboratively in an on-site environment. Key Responsibilities: Develop and maintain Azure Data Engineering solutions to support business requirements. Lead and mentor a team of 5+ d...

Design, develop, and maintain interactive Power BI reports and dashboards tailored to business requirements Translate business requirements into sustainable and efficient KPI and reporting. Craft and execute complex DAX and Power Query queries within Power BI. Integrate Power BI reports into other applications using embedded analytics like Power BI service (Saas), or by API automation. Optimise Power BI dashboards with a focus on usability, performance, flexibility, testability and standardization. Troubleshoot data and report issues and implement bug fixes. Create and manage data models, including data transformations, relationships, and calculations, to ensure accurate and efficient data r...