10166 Data Engineering Jobs - Page 39

Responsibilities include: Mandatory Skills: Snowflake experience, Data Architecture experience, ETL process experience, Large Data migration solutioning experience Lead the design and architecture of data solutions leveraging Snowflake, ensuring scalability, performance, and reliability. Oversee the implementation of data pipelines, ETL processes, and data governance frameworks within Snowflake environments. Ensure efficient data extraction from SAP BW/ECC systems Collaborate with stakeholders to understand business requirements and translate them into technical specifications and data models. Develop and maintain data architecture standards, guidelines, and best practices, including data go...

Overview Prodapt is lookig for Lead data engineers having 5+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL. Responsibilities Understanding the requirements Performing in-depth analysis on data Setting up secure data pipelines from ingestion to delivery Individual contributor Requirements 5- 10 years of experience in Data Engineering with strong ability to work independently, communicate effectively, and deliver high-quality solutions. Should have strong SQL programming skills. Experience in cloud-based systems (GCP, BQ) is must. Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Expertise i...

Overview Join the Prodapt team in building a unified, enterprise-scale solution for model, data, and service management across the AI/ML model development. Responsibilities Proficiency in Python and experience with pyspark and ML/AI model development (TensorFlow, scikit-learn, MLflow). Experience in building applications with Java, including the use of Spring for backend development. Hands-on experience with core GCP services, including GKE, Dataproc, BigQuery, and Google Cloud Storage (GCS). Strong understanding of data storage and management (Oracle Exadata, HDFS, Hive, GCS, key-value stores). Experience with CI/CD tools and automation for ML/data workflows. Knowledge of security best prac...

Key Responsibilities: Optimize scalable data pipelines for ingestion, transformation, and loading of large datasets from diverse sources. Utilize Azure Data Factory for orchestration and automation of ETL/ELT processes, ensuring efficient data flow. Work extensively with Azure services such as Azure Blob Storage and Azure Data Lake Storage (ADLS Gen2) for efficient data storage and management. Integrate and manage data flows using Azure Logic Apps for event-driven automation and workflow orchestration. Develop and maintain robust SQL queries, stored procedures, and data models to support reporting and analytical requirements. Implement and enforce data governance, quality, and security best ...

Skills- AWS Data Engineer Experience: 9 to 13 years Location: AIA-Pune We are seeking skilled and dynamic Cloud Data Engineers specializing in AWS, Databricks. The ideal candidate will have a strong background in data engineering, with a focus on data ingestion, transformation, and warehousing. They should also possess excellent knowledge of PySpark or Spark, and a proven ability to optimize performance in Spark job executions. Key Responsibilities: - Design, build, and maintain scalable data pipelines for a variety of cloud platforms including AWS. - Implement data ingestion and transformation processes to facilitate efficient data warehousing. - Utilize cloud services to enhance data proce...

Your role and responsibilities As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need...

Your Role Excellent Communication Skills. Experience working with Fact and Dimension tables, SCD. Proven analytical skills and Problem-solving attitude. Any other GCP services or databases like Datastore, Bigtable, Spanner, Cloud Run, Cloud Functions etc. Should have worked on handling big data. experience in Agile methodologies ETL, ELT skills, Data movement skills, Data processing skills. Certification on Professional Google Cloud Data engineer will be an added advantage. Ability to effectively function in a cross-teams environment Your Profile Require 5+ years experience and relevant is minimum 3 years' experience in GCP Data Engineering. Strong experience in GCP Services, data engineerin...

Cloud Platforms ( AWS, MS Azure, GC etc.)Containerization and Orchestration ( Docker, Kubernetes etc..)APIs - Change APIs to APIs developmentData Pipeline construction using languages like Python, PySpark, and SQLData Streaming (Kafka and Azure Event Hub etc..)Data Parsing ( Akka and MinIO etc..)Database Management ( SQL and NoSQL, including Clickhouse, PostgreSQL etc..)Agile Methodology ( Git, Jenkins, or Azure DevOps etc..)JS like Connectors/ framework for frontend/backendCollaboration and Communication

Your role and responsibilities As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. Youll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, youll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, youll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include * Implementing and validating predictive models as well as creating and maintain statistical models with a fo...

Your role and responsibilities Develop, test and support future-ready data solutions for customers across industry verticals Develop, test, and support end-to-end batch and near real-time data flows/pipelines Demonstrate understanding in data architectures, modern data platforms, big data, analytics, cloud platforms, data governance and information management and associated technologies Communicates risks and ensures understanding of these risks. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Minimum of 15+ years of related experience required Experience in Production grade Power BI dashboards with optimized data modelin...

Your role and responsibilities * Analyze existing reports and dashboards built in IBM Cognos and design equivalent solutions in Qlik Sense. * Work closely with business stakeholders to understand reporting requirements and ensure seamless transition. * Optimize Qlik Sense reports for performance, scalability, and user experience. * Provide technical guidance to junior developers and support them on best practices in performance tuning and visual design. * Ensure data accuracy, consistency, and quality across migrated reports. * Collaborate with data engineering teams to ensure proper data sourcing and modeling. * Leverage knowledge of Power BI and Tableau to support cross-platform initiative...

Role & responsibilities Good in Snowflake core, knowledge on Cortex, ADF and Data Mesh Concepts Snowflake core, ADF and Data Mesh Concepts Architect, design, develop,and support Snowflake servicesand warehouse Educational qualification : Bachelors in Tech/ Masters in Tech Locations : Pune/Chennai/Bangalore/Hyderabad - Hybrid

Must to Have Skill Python, Apache (Beem developer) templates to be built by scratch, knowledge on cloud composed and SQL Good to Have Skill Healthcare projects and GCP Healthcare API

About The Role Talent & Organization – Intelligence & Insights Data Scientist (Consultant) Looking for a rewarding career with global impact? Then consider Accenture's rapidly expanding Capability Network with approximately 3,000 Management Consulting and Strategy professionals (we like to call them rock stars!) based in a network of prominent locations around the world. Capability Network Professionals". Thrive in a fast-paced, inclusive environment with countless opportunities to learn and grow Collaborate with diverse organizations on groundbreaking projects Enjoy the camaraderie of working together towards a common goal and forming lasting friendships If this sounds like the right team f...

About The Role Skill required: Network Billing Operations - Problem Management Designation: Network & Svcs Operation Specialist Qualifications: Any Graduation Years of Experience: 7 to 11 years What would you do? A data analyst is responsible for collecting, storing, and organizing data related to how Wireless Telecommunication products and services are built and bill. They bring technical expertise to ensure the quality and accuracy of that data, they also need to have experience with Finance for Telecommunication Mobility services. Knowledge of AT&T Data Sources for Wireless services & knowledge of client tools is advantage. Developing and implementing Data Analysis to identity data anomal...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Oracle Data Integrator (ODI) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You...

Skills- Databricks+ Pyspark Experience: 4 to 13 years Location: AIA-Pune We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets. Key Responsibilities: Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks. Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models. Performance & Cost Optimization: Fine-tune Spark configurations, optimize Databricks clusters, and reduce compute/storage costs. Collaboration: Work closely with Data Scientists, Analysts, and DevOps tea...

Notice Period : Immediate to 15 Days. Job Description : - 6+ years of overall Data Analytics and BI experience - Experience in Spark, Hive, Scala. - Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs - Python scripting with focus on data transformation and manipulation libraries such as Pandas and numpy - Strong knowledge and hands-on experience of SQL (should be able to write advance level SQL queries) - Good hands-on experience on data visualization tools such as Power BI, Tableau, Looker - Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow - Good Communication skills.

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : Data Analysis Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand projec...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly skilled and experienced ETL Lead with a strong background in Data Warehousing, ETL processes, and Big Data technologies. The ideal candidate should have hands-on experience with Cloudera tools, excellent SQL/PLSQL skills, and the ability to lead a team while working closely with clients in the Banking/Insurance domain. Role...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Building Tool, Apache Kafka Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementi...

Role Overview: We are seeking a VP Analytics to lead the AI/ML & Analytics function, driving the companys data strategy and building production-grade machine learning models that power decision intelligence across BFSI and fintech ecosystems. The role requires collaboration with CXOs and regulatory stakeholders to ensure ethical, explainable, and scalable AI solutions. Key Responsibilities: Strategic Leadership: Lead the AI/ML & Analytics Center of Excellence Define and execute the analytics roadmap aligned with business strategy Translate business challenges into scalable analytical solutions Technical Excellence: Build and deploy ML/DL models for fraud detection, credit underwriting, risk ...