661 Data Engineer Jobs - Page 3

Hiring Senior Data Engineer Required Experience: 5-8 years Job Summary: The Senior Data Engineer will lead the design and development of our data pipelines and architecture. This role is central to building and maintaining a robust data infrastructure that enables analytics and business intelligence within the financial domain. Key Responsibilities: Lead the design, construction, and maintenance of scalable and reliable data pipelines. Build and optimize ETL/ELT processes to move and transform large datasets. Architect and manage data warehouses and data lakes. Ensure data quality and integrity across all data systems. Collaborate with data scientists and analysts to understand their data ne...

Role & responsibilities The Data Engineer is responsible for acquisition and analysing of data during the rig operations, preparing logs and reports for the well site geologist, company man. The Data Engineer must have strong communicative skills, as they liaise directly with client representative on-site. As team leaders, Data Engineers are responsible for the wellbeing and cohesion of the surface logging team. Responsibilities include: Installation and maintenance of GEOLOG software and hardware for acquiring and measuring drilling parameters. Real-time monitoring of drilling activity supporting data analysis and interpretation. First point of contact for the client onsite technical suppor...

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a strong background in designing, developing, and managing data pipelines, working with cloud technologies, and optimizing data workflows. Note: Only apply if you are willing to attend one round of F2F interview. We are looking for November joiners only. Experience: 7 to 10 Years Work: Hybrid If interested, please refer to the JD below and share the resume with required details. Total Exp: Exp as a Data Engineer: Relevant Exp in AWS Services: Relevant Exp in Python: Relevant Exp in Pyspark: Notice period: Must have skills are: 1. Data Engineer with a strong foundation in data w...

Jasper Infotech Pvt Ltd. is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will i...

Experience Level 4-8 years Role Overview We are seeking a skilled Data Engineer with extensive experience in building scalable data pipelines, ETL processes, and data infrastructure. The ideal candidate will have strong expertise in Python, modern ETL tools, and AWS services, combined with the ability to work with frontend technologies for data visualization and reporting interfaces. Should have Clinical trial /Pharma/Health care domain experience Required Skills Data Engineering & ETL Python Development: Strong proficiency in Python for data engineering Experience with data processing libraries (Pandas, NumPy) Knowledge of PySpark for large-scale data processing Modern ETL Tools & Framework...

Role Overview: As a Data Engineer or ML Engineer in the Tech Services- Group Chief Technology Office team at UBS, you will play a key role in driving the delivery of an innovative ecosystem of tools and services to support the bank's global AI Strategy. Your main focus will be on developing an SDK for Data Producers to build high-quality autonomous Data Products and enabling Data Consumers to easily access data and build AI use-cases. Key Responsibilities: - Lead the country team of other Senior Engineers - Engage directly with product owners and internal users to gather requirements, develop technical solutions, and execute projects - Develop an SDK (Software Development Kit) to capture dat...

Role Overview: You will be responsible for managing and monitoring the Snowflake platform performance and usage. This includes implementing security policies, access controls, and data governance. Additionally, you will optimize queries and storage for performance and cost efficiency. Collaboration with engineering teams to support data pipelines and analytics will also be a key part of your role. Moving forward, you will oversee Cognite platform configurations and integrations, ensuring platform reliability, scalability, and compliance. Supporting the onboarding of new data sources and users will also fall under your responsibilities. There is also a future scope to participate in data mode...

As a member of the N. Harris Computer Corporation family, Altera delivers health IT solutions globally, including Sunrise, Paragon, Altera TouchWorks, Altera Opal, STAR, HealthQuest, and dbMotion solutions. Altera Digital Health is at the forefront of healthcare technology, driving innovation and expertise to elevate care delivery and inspire healthier communities worldwide. Experience: - 2-4 or more years in related responsibilities, depending on education level. Technical Qualifications: - Hands-on experience with SQL and Programming (C# or Java). - Knowledge of XML and JSON formats. - Willingness to learn and work as an HL7 Analyst/Data engineer. - Must have good communication skills. Res...

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 5 - 15 Yrs Location: Pan India Job Description: Minimum 2 years hands on experience in GCP Development ( Data Engineering ) Position : Developer / Tech Lead / Architect Interested can share your resume to sankar@spstaffing.in with below inline details. Over All Exp : Relevant Exp : Current CTC : Expected CTC : Notice Period :

more extensive experience in Data Warehousing / Data Engineering on SQL Server Our ETL scripts are developed in both R and Python , and we aim with your support to standardize these processes while further enhancing our Data Model, including adding indexes and enhancing data quality controls. As requested, our database size is approximately 9.5 GB . Please let us know if you need any further information I am sharing below a high-level list of topics we hope to work on together over the next couple of months: Review and optimisation of our current SQL Database (tables, views) Enhancing the documentation of our data warehouse (data dictionary, logical data model) Review of the ETL scripts (dev...

Job Summary We are seeking a highly skilled and experienced Senior Data Scraping Engineer to design, develop, and orchestrate robust web scraping frameworks. The ideal candidate will have 8-10 years of experience in ethical web scraping, including navigating login-protected websites, solving CAPTCHAs, and managing proxies or third-party services. You will be responsible for building scalable, efficient, and compliant scraping pipelines using industry-standard programming languages and tools, ensuring data integrity and adherence to legal and ethical guidelines. Key Responsibilities Framework Development: Design and implement end-to-end web scraping frameworks to extract structured data from ...

As a Data Engineer with over 6 years of experience, you will be responsible for designing and implementing scalable data solutions. Your deep expertise in cloud data warehousing, ETL/ELT processes, data modeling, and business intelligence will play a crucial role in this position. Key Responsibilities: - Support the design and implementation of end-to-end data solutions by leveraging technologies such as AWS Redshift, Apache Airflow, dbt, and other modern data tools including DataBricks. - Develop data models and implement data pipelines to ingest, transform, and load data from various sources into the data warehouse. - Create and maintain Apache Airflow DAGs to orchestrate complex data work...

Role Overview: On Team Xbox, you will be part of the Xbox Platform Data Intelligence Team, aiming to empower the world's 3 billion gamers by shaping the next generation of data and analytics capabilities for Xbox. Your role will involve working closely with engineering and product management to design, implement, and evolve innovative capabilities that will drive analytics and insights on engineering features. You will play a crucial part in influencing data-driven decision-making across Xbox Leadership, Finance, Business Planning, and Engineering teams. Key Responsibilities: - Work within and across teams to solve complex technical challenges. - Develop engineering best practices by continu...

We are seeking a skilled Data Engineer with hands-on experience in building, optimizing, and maintaining large-scale data pipelines and cloud-based data solutions. The ideal candidate will have strong expertise in AWS services , DBT , and Power BI , with a deep understanding of data modeling, transformation, and analytics for manufacturing data systems. Roles and Responsibilities Design, develop, and maintain ETL/ELT pipelines for data ingestion, transformation, and integration. Work extensively with AWS Glue , Athena , and S3 to manage and optimize data workflows. Develop and maintain SQL transformation code in DBT (Data Build Tool) . Ensure data quality, reliability, and performance optimi...

Job Summary: We are looking for a skilled Data Engineer with strong experience in PySpark and Azure Databricks to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have hands-on expertise in big data processing, Azure data services, and automation for data-driven decision-making. Key Responsibilities: Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory and Databricks. Build and optimize PySpark scripts and Databricks notebooks for large-scale data processing. Perform data ingestion, transformation, and aggregation from multiple sources (SQL, APIs, ADLS, Blob, SFTP, etc.). Implement Delta Lake architecture for data ...

Data Engineer Azure with Scala

Design,develop,andmaintainPython-based applications for handling large data sets and ensuring high performance. SKills :- Data Engineer Asynchronous Programming ETL Python Pandas Numphy Polars SQL NOSql Required Candidate profile WFO/Hybrid/WFH all options are available

Work closely with clients to understand business needs, design data solutions, and deliver insights through end-to-end data management. Lead project execution, handle communication, documentation, and guide team members throughout. Required Candidate profile Must have hands-on experience with Python, ETL tools (Fivetran, StitchData), databases, and cloud platforms (AWS, GCP, Azure, Snowflake, Databricks). Familiarity with REST/SOAP APIs is essential.

What youll do Model & map data design canonical schemas that unify three disparate NM apps; maintain versioning and backward compatibility. Design high-throughput pipelines choose/implement brokers and stream processors to land NM events in our SEAL 2.0 layer. Interface with SNMP ecosystems ingest, normalize, and enrich SNMP v2/v3 traps, polls, and MIB objects; advise on best practices for NOC tooling. Prototype network-edge agents outline requirements (Go/Python/C) for lightweight collectors should device-side deployment become feasible. Performance & reliability engineering load-test 24/7 flows, implement retries/back-pressure, and instrument everything with Prometheus. Collaborate cross-f...

20+ years of progressive experience in data engineering, with a significant portion in leadership roles Proven expertise in designing, building, and managing large-scale data platforms in cloud environments (AWS, Azure, or GCP) Deep hands-on experience with Apache Spark for distributed data processing.Strong proficiency in Java and other relevant programming languages (Scala, Python). Extensive experience with AWS services for data engineering (e.g., S3, Redshift, Kinesis, Glue, Lambda). Demonstrated experience in leading and mentoring high-performing data engineering teams Strong understanding of data architecture principles, data modeling, ETL/ELT processes, and data warehousing concepts.

we're looking for a Data Engineer whos passionate about delivering tangible results, who has a positive attitude, and who enjoys solving problems. Requirements Technical Skills : 4+years of experience in a Data Engineer role, Experience with object-oriented/object function scriptinglanguages: Python, Scala, Golang, Java,etc Experiencewith Big data tools such as Spark, Hadoop/ Kafka/ Airflow/Hive Experiencewith Streaming data: Spark / Kinesis / Kafka / Pubsub / Event Hub Experience with GCP/Azure data factory/AWS Strongin SQL Scripting Experiencewith ETL tools Knowledge of Snowflake Data Warehouse Knowledgeof Orchestration frameworks: Airflow/Luig Goodto have knowledge of Data Quality Managem...

•Exp of unified data platform,Data lifecycle starting from Data Ingestion, Transformation, Serve and consumption. • Must have excellent coding skills in Pyspark,Spark sql. • Must be strong in SQL and sprak-sql. Expin Data Engineering domain. •

Deep understanding of Kafka architecture, concepts (topics, partitions, clustering, brokers), and related tools (Kafka Connect, Kafka Streams, Schema Registry). Strong experience with relevant AWS services for data streaming and infrastructure management (e.g., MSK, EC2, S3, Lambda, IAM, VPC). Expertise in one or more programming languages commonly used with Kafka, such as Java, Scala, or Python. Qualification - BE, Btech, BCA, MCA. Mtech, BCS, Bsc or equivalent preferred Contact Number - 9987334349

Required Skills: Must have: Proven experience as a Data Engineer with Assistant Manager designation or equivalent. Strong hands-on experience in Databricks (PySpark / Spark SQL). Proficiency in at least one cloud platform AWS, Azure, or GCP. Advanced SQL and Python programming skills. Experience in data lake / data warehouse solutions (Snowflake, Delta Lake, etc.). Good understanding of data modeling, ETL processes, and orchestration tools (Airflow, ADF, etc.). Domain experience in Pharma, Life Sciences

Experience : 4~6 years in ML/NLP, preferably in document-heavy domains (finance, legal, policy) Key Responsibilities: Data Ingestion and Preprocessing : Ability to build and maintain data pipelines to ingest unstructured data from PDFs, gazettes, HTML circulars etc. and process data extraction, parsing, and normalization NLP & LLM Modeling : Ability to fine-tune or prompt-tune LLMs for summarization, classification, and change detection in regulations. Ability to develop embeddings for semantic similarity. Knowledge Graph Engineering : Ability to design entity relationships (regulation, control, policy) and implement retrieval over Neo4j or similar graph DBs. Information Retrieval (RAG) : Ab...