6525 Data Engineering Jobs - Page 45

Role Overview: We are seeking a highly experienced Palantir Developer/ Architect with over 5+ years of IT experience and deep expertise in architecting and delivering Palantir Foundry or Gotham solutions for large-scale enterprises. The ideal candidate will have a strong background in data engineering, solution design, cloud platforms, and enterprise integration , with the ability to engage senior stakeholders and lead end-to-end Palantir engagements from strategy through implementation. Key Responsibilities: Solution Architecture & Design Architect and design scalable Palantir Foundry/Gotham solutions tailored to client business needs. Define data pipelines, ontologies, object models, and i...

*Min 5 years of experience in data engineering, specifically working with *Apache Airflow and AWS technologies. *AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda. *Proficiency in Python, PySpark and SQL *Snowflake Data Lake is reqd.

Qualification: Degree in Computer Science (or similar), alternatively well-founded professional experience in the desired field Experience Range: 3 to 5 Years Roles & Responsibilities: As a Senior Data Engineer, you manage and develop the solutions in close alignment with various business and Spoke stakeholders. You are responsible for the implementation of the IT governance guidelines. Collaborate with the Spokes Data Scientists, Data Analysts, and Business Analysts, when relevant. Tasks Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation Experience working with and creating cloud data solutions Assemble large, complex data sets that meet functi...

Roles & Responsibilities: Collect, preprocess, and analyze large structured and unstructured datasets. Develop, train, and optimize machine learning and deep learning models. Build predictive models for classification, regression, recommendation, and NLP/vision tasks. Design and implement scalable ML pipelines and deploy them into production environments. Conduct feature engineering, model selection, hyperparameter tuning, and validation. Monitor model performance, detect drift, and improve accuracy over time. Collaborate with product, engineering, and business teams to translate business problems into data-driven solutions. Document methodologies, maintain reproducibility, and ensure ethica...

You will be part of the core team at GE Vernova Electrification Software (GEV ESW) Business that is using software to enable de-carbonized future of energy for the planet by designing, building, delivering, and maintaining software applications & services for next generation Grid Software that orchestrates 40% of the worlds power today. GridOS is a new software portfolio of GEV ESW that helps utilities manage and orchestrate the sustainable Energy Grid. As Sr. Manager in GridOS Platform and Shared Services organization, you will be responsible for leading teams to design, build, deliver and maintain software products and shared services. You will work with global set of leaders to provide in...

We are hiring an ML Engineer/ML Ops Engineer with 5+ years’ experience to design scalable ML pipelines, deploy production-ready models, and implement CI/CD for enterprise AI systems. Strong skills in ML algorithms, MLOps, & data engineering required. Required Candidate profile Experienced ML/MLOps Engineer with expertise in ML pipelines,scalable model deployment,CI/CD,automation, & advanced machine learning algorithms.Strong background in software engineering &data systems.

Day to day involvement in designing, building, and maintaining data pipelines, systems, and platforms that enable data-driven decision-making and analytics. Required Candidate profile 9+ years of proven experience as a Technical Project Manager successfully delivering complex technical projects in Data Engineering technologies.

You should have at least 3+ years of experience working as a Full Stack Developer. Your primary focus will be on backend development using Python, specifically Django, FastAPI, or Flask. In addition, you should have a strong proficiency in frontend development using React.js and JavaScript/TypeScript. It is essential that you have experience with AI scripting, ML model integration, or working with AI APIs such as OpenAI, TensorFlow, PyTorch, etc. You should also possess knowledge of RESTful API design and implementation, as well as database management with both SQL and NoSQL databases. Familiarity with Docker, Kubernetes, and CI/CD pipelines is required for this role. A strong understanding ...

You are a Bigdata Engineer with over 5 years of experience, located in Hyderabad, currently working on a contract basis with the ability to join immediately. Your expertise lies in Spark, Scala, and Python, with a strong proficiency in Apache Spark and Scala programming language. You possess extensive knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL, enabling you to write optimized and scalable Spark applications. In addition to Spark and Scala, you are familiar with big data technologies and have a strong understanding of distributed computing concepts. You have hands-on experience in handling large-scale data processing and are well-versed in Kafka messaging, with the ab...

As Vice President of Enterprise Technology at Macquarie, you will play a pivotal role in driving strategic direction and operational excellence within our global operations. Leading a team of talented engineers, your focus will be on fostering a culture of innovation and collaboration to achieve our business objectives. Your responsibilities will include mentoring and managing the engineering team, ensuring continuous improvement in enterprise data platforms. Developing and executing strategic roadmaps, you will prioritize timely project delivery while maintaining technical excellence. Collaborating with cross-functional teams, you will drive the delivery of effective data solutions by adopt...

You are an experienced professional with a total of 5+ years of experience in Data engineering. You have hands-on working experience in SQL, Python or Scala and a deep understanding of Cloud Design Patterns and their implementation. You also possess experience working with Snowflake as a data warehouse solution and Power BI data integration. Your role will involve designing, developing, and maintaining scalable data pipelines and ETL processes, working with structured and unstructured data from multiple sources, and having a strong understanding of data modelling, warehousing, and relational database systems. Additionally, you have hands-on experience with ETL tools such as Apache Airflow, T...

We are looking for a strategic, hands-on, and visionary Tech Head - Data Products to take charge of leading the design, development, and delivery of data-driven products and platforms. In this role, you will be operating at the intersection of data engineering, product management, and business strategy, shaping our data product vision, overseeing technical execution, and steering business impact. Your responsibilities will include defining and steering the roadmap for data products in alignment with business objectives and user requirements. You will also be tasked with supervising the design and development of scalable data platforms and APIs. Collaboration across various departments such a...

Design Databases & Data Warehouses, Power BI Solutions, Support Enterprise Business Intelligence, Strong Team Player & Contributor, Continuous Improvement Experience in SQL, Oracle, SSIS/SSRS, Azure, ADF, CI/CD, Power BI, DAX, Microsoft Fabric Required Candidate profile Source system data structures, data extraction, data transformation, warehousing, DB administration, query development, and Power BI. Develop WORK FROM HOME

Job Description: Data Engineer 6+yrs Hybrid mode of work in Hyderabad/Pune Common Skils - SQL, GCP BQ, ETL pipelines using Python/Airflow, Experience on Spark/Hive/HDFS, Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Refer and earn rewards up to 50,000 INR. Please visit and login our job portal www.iitjobs.com for better future opportunities Download our job portal app on Android and iOS app stores.

As a member of the Enterprise Data Platform team and Enterprise Technology organization within Technology & Engineering at PitchBook, you will be part of a team of big thinkers, innovators, and problem solvers who strive to deepen the positive impact we have on our customers and our company every day. We value curiosity and drive to find better ways of doing things. We thrive on customer empathy, which remains our focus when creating excellent customer experiences through product innovation. We know that greatness is achieved through collaboration and diverse points of view, so we work closely with partners around the globe. As a team, we assume positive intent in each others words and actio...

As a member of the Enterprise Data Platform team and Enterprise Technology organization within Technology & Engineering at PitchBook, you will be part of a team of big thinkers, innovators, and problem solvers who strive to deepen the positive impact we have on our customers and our company every day. We value curiosity and drive to find better ways of doing things. We thrive on customer empathy, which remains our focus when creating excellent customer experiences through product innovation. We know that greatness is achieved through collaboration and diverse points of view, so we work closely with partners around the globe. As a team, we assume positive intent in each other’s words and acti...

As a Senior Data Engineer with Adobe experience at Zendesk Marketing, you will play a crucial role in our Enterprise Data & Analytics (EDA) team by supporting the curation engineering team. Your primary responsibility will be to enable the Zendesk Marketing organization to utilize data and marketing tools effectively for engaging with customers. Working in an Agile environment, you will be involved in all aspects of the software development lifecycle, following the latest engineering best practices. Your key tasks will involve crafting and developing curated data products, implementing standard architectural and data modeling practices to maintain the foundational data layer serving as a sin...

As a skilled engineer, you will play a crucial role in designing robust and scalable data platforms and microservices. Your primary responsibility will be ensuring that architectural and coding best practices are adhered to in order to deliver secure, reliable, and maintainable systems. You will actively engage in debugging complex system issues and work collaboratively with cross-functional teams to define project scope, goals, and deliverables. In this role, you will be tasked with managing priorities, effectively allocating resources, and ensuring the timely delivery of projects. Additionally, you will have the opportunity to lead, mentor, and cultivate a team of 10-15 engineers, fosterin...

You will be responsible for working on Data Vault projects and should have expertise in data engineering, DBT based data modeling concepts, Data Vault 2.0, Python, EW Data, Data Warehousing, SQL, MDM, SQL programming, and Scripting. The desired candidate should have a notice period of 0-30 days and possess educational qualifications of BE, B.Tech, ME, or M.Tech. The job locations available for this role include Bangalore, Pune, Mumbai, Hyderabad, Chennai, Gurgaon, and Noida. If you meet the requirements mentioned above, please send your resume to career@krazymantra.com.,

You will be working as a Semarchy Support Data Engineer at Vichara Technologies, a specialized technology services firm focusing on solving intricate challenges in the Capital Markets domain. Your role will encompass tasks related to data engineering, data modeling, ETL processes, data warehousing, and data analytics. While some onsite work in Gurugram is necessary, remote work is also accepted. Your responsibilities will revolve around leveraging your expertise in Data Engineering, Data Modeling, ETL skills, Data Warehousing, and Data Analytics to support Vichara's operations. Proficiency in Semarchy software will be advantageous. You should possess strong problem-solving and analytical cap...

As a Dataiku Developer, you will be a valuable member of our data engineering team, contributing to the management and enhancement of complex data workflows using Dataiku. Your role will involve building, automating, and maintaining robust data pipelines, performing advanced data preparation and transformation, writing efficient SQL queries, and creating stakeholder-ready Excel reports in a fast-paced environment, particularly in banking or financial services. Key Responsibilities - Build, automate, and maintain robust data pipelines and workflows using Dataiku. - Perform advanced data preparation, transformation, and calculations within Dataiku for large datasets. - Write efficient SQL quer...

As a Data Engineering Manager, you will be responsible for leading and overseeing a team of data engineers. Your role will involve defining the overall data architecture strategy, building scalable data pipelines, ensuring data quality and governance, collaborating with cross-functional teams to drive data-driven decision making, and managing the technical roadmap for data engineering initiatives within the organization. To excel in this role, you will need extensive experience in data engineering technologies, strong leadership skills, and a deep understanding of business needs to translate them into technical solutions. Your key responsibilities will include: Strategic Leadership: - Develo...

Genpact is a global professional services and solutions firm with over 125,000 employees in 30+ countries, driven by curiosity, agility, and the desire to create lasting value for clients. We serve leading enterprises, including the Fortune Global 500, with deep business knowledge, digital operations services, and expertise in data, technology, and AI. We are inviting applications for the position of Vice President, Databricks Squad Delivery Lead. The successful candidate will be responsible for overseeing the end-to-end delivery of Databricks-based solutions for clients, ensuring successful implementation, optimization, and scaling of big data and analytics solutions. This role involves dri...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. The Senior Data Engineer at EY is responsible for ingesting, building, and supporting large-scale data architectures that serve multiple downstream systems and business users. This individual collaborates with Data Engineer Leads and partners with Visualization on data quality and troubleshooting needs. Your key responsibilities include: - C...

We are seeking a Senior Data Architect with over 7 years of experience in the field, specifically in data architecture roles. As a Senior Data Architect, your responsibilities will involve designing and implementing scalable, secure, and cost-effective data architectures utilizing Google Cloud Platform (GCP). You will play a key role in leading the design and development of data pipelines using tools such as BigQuery, Dataflow, and Cloud Storage. Additionally, you will be responsible for architecting and implementing data lakes, data warehouses, and real-time data processing solutions on GCP. It will be your duty to ensure that the data architecture is aligned with business objectives, gover...