10148 Data Engineering Jobs - Page 2

Role Description: As a Senior Data Engineer at Amgen, you will be responsible for managing and optimizing the company's data infrastructure and architecture. You will design and implement data pipelines, develop data models, perform data integration, and ensure data quality and governance. Your expertise in data engineering, big data technologies, and data manipulation will contribute to the effective storage, processing, and utilization of large-scale data sets. Key Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledg...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects in a collaborative and fast-paced environment. Key Responsibilities : - Design and implement scalable and efficient data pipelines, ETL/ELT processes, and data integration solutions using Databricks. - Work with large-scale structured and unstructured datasets using Python, PySpark, SQL, and NoSQL technologies. - Collaborate with cross-fun...

If interested, please fill below details and share me your updated cv to ashiq.s@technogenindia.com Total years of experience: Relevant years of experience: CTC (Including Variable): ECTC: Notice Period: Reason for change: Current location: Willingness to relocate (If other than Hyderabad ): Yes Availability for a teams call (two slots): Brief write up on how you could be a great fit for the role :

Were looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here. Bachelor’s degree in computer science, Engineering, or a related field 5+ years of experience in software/data engineerin...

The role is responsible for designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Analyze complex datasets (pricing, rebates, provider contracting, market access) using Excel, SQL, and Databricks to create reports, dashboards, and analytic...

Job Description: We are looking for a motivated Jr. AI Engineer to join our dynamic AI & Analytics team. The ideal candidate will collaborate with the Head of AI in developing and deploying intelligent, data-driven applications. This role involves backend development using Python, FastAPI, and SQL , integrating AI models, and building scalable systems. Candidates should demonstrate problem-solving ability, curiosity to learn, and a passion for applied AI. Key Responsibilities: Design, build, and deploy AI-powered applications and features Develop backend APIs using Python & FastAPI Write optimized SQL queries and manage data pipelines Integrate AI/ML models (LLMs, ML libraries, etc.) into pr...

Proficient in writing queries in postGreSQL, Performance tuning activities in the project Write complex sql queries for reporting purpose. Customize the application using PL SQL techniques. Support the users of application with using multiple SQL and PL SQL techniques. Assist in developing and implementing new technologies. Additional Details Global Grade : C Remote work possibility : Yes Local Skills : PostgreSQL;PLSQL;PySpark Languages Required: : ENGLISH.

Description: Objective:Build and maintain data pipelines and infrastructure to support data storage and processing. Key Responsibilities: -Design develop and optimize data pipelines using Azure Databricks. -Ensure data reliability scalability and quality. -Integrate data sources into a unified platform. -Monitor and troubleshoot data workflows. Skills Required: -Expertise in Azure Databricks Spark and big data tools. -Strong programming skills (e.g. Python Scala SQL). -Knowledge of ETL processes and cloud technologies. -Familiarity with CI/CD practices for data pipelines Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named J...

Description: Skill Set : Proficiency in SQL programming and T-SQL Strong knowledge on Database Design Data Modeling Query Optimization and Data Analysis SSIS - Packages Development and Deployment Debugging and troubleshooting packages. Experience in creating Power BI reports using PowerBI Desktop Report Builder. Primary SSIS for ETL Jobs SSAS for Cube processing Database - SQL and MDX queries Versioning Tool TFS Roles and Responsibilities : Develops advanced BI applications using the MS BI stack including SSAS SSIS. Designing building and maintaining complex ETL packages . Creating and support OLAP / SSAS Cubes for reporting needs. Building Stored Procedures Function and Packages as well as ...

Scala Data Engineer Location :Bangalore/ Chennai / Delhi / Pune CompanyName :Persistence Experience :5-8Years NoticePeriod:Imm- 15 Days About The Role : :Scala Data Engineer Must Have :Spark,Data Bricks,Azure,Azure Data,SQL,Services,Databricks, Data Migration,Azure Data Catalog,Azure DevOps,Data Catalog,DevOps,Scala Sr. Data Engineer - Scala Summary Analyzes, designs, develops, tests, and modifies new and existing applications in areas such as Database or analytics development, and data integrations. Provides system support, testing, and training for Enterprise Data Lake clinical data. Proven 4-6 years work experience as an Azure Data engineer/Developer or similar role. Strong knowledge in S...

AWS Data Engineer with 4+ yrs experience in S3, Glue, Redshift, Athena, Lambda, EMR, Step Functions. Skilled in ETL/ELT, SQL, Python, PySpark, data modeling, CI/CD, Databricks, Kinesis, Kafka, governance, and Agile.

Python Developer Exp- 5-9yrs Max salary 25lpa-28lpa Pune and Hyd (Hybrid -WFO) Fixed rate - FTE Python Data Integration Engineer :Are you a seasoned data engineer with a passion for both hands-on technical work? Do you thrive in an environment that values innovation, collaboration, and cutting-edge technologies? We are seeking an experienced Data Integration engineer to spearhead our data integration strategies and initiatives. The ideal candidate will possess deep technical expertise in Python programming, Snowflake data warehousing, AWS cloud services, Kubernetes (EKS), CI/CD methodologies, Apache Airflow, dbt, Kafka for real-time data streaming, and API development. This role is pivotal i...

Description Job Summary Role Value Proposition MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights and value to its customers. The team is the center of excellence in data engineering in MetLife and plays a key role in data enablement through multiple data stores supporting different kind of analytical use cases to be able to derive predictive prescriptive and descriptive insights. The Azure Data Engineer III serves as big data development expert within the data analytics engineering organization of MetLife Data & Analytics. This p...

Description Key Responsibilities Analyse raw data from various source files (e.g. EXCEL CSV JSON XML Parquet etc.) to identify formatting issues inconsistencies missing values and discrepancies. Use PySpark to transform clean and restructure source data to match the expected format for further processing and analysis. Apply data validation rules and data quality checks to correct issues related to data integrity including handling null values duplicate records and data type mismatches. Develop PySpark jobs to transform raw data into standardized formats (e.g. converting date formats normalizing text fields correcting encoding issues). Ensure that data transformations meet the required schema...

Description The position involves working within our CX Program Implementation team with a focus on building the surveys and reporting. Your day would include working with the business analyst to understand CX requirements shared by the stakeholders and work with the implementation team to develop solutions. The role requires a creative thinker who can solve problems through innovative technology solutions while supporting the development of customer experience programs. Responsibilities ? Configure the Medallia surveys and reporting setup as per the requirements shared by the Business Analyst. ? Build Auto Importers for the new survey programs. ? Conduct file inflow reviews to understand th...

GCP Data Engineer with 2+ yrs experience in BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer. Skilled in SQL, Python, PySpark, ETL/ELT, CI/CD, data modeling, streaming (Kafka), lakehouse tools, and Agile delivery.

Description Role Responsibilities Work with clients to understand their business goals and needs, creating tailored solutions using Adobe Experience Platform (AEP). Design and deploy AEP solutions like RTCDP, configuring features such as data ingestion, modeling, segmentation, personalization, and integration with other systems. Help clients establish their data strategy, covering data collection, management, and governance. Create and manage audience segments in AEP, enhancing targeted marketing efforts and improving campaign effectiveness. Create data models and configure data schemas in AEP, ensuring accurate mapping of classes, field groups, identities, and attributes. Implement and vali...

Python +SQL developer Python Data Integration Engineer Role and Responsibilities:As the Data Integration Engineer, you will play a pivotal role in shaping the future of our data integration engineering initiatives. You will remain actively involved in the technical aspects of the projects. Your responsibilities will includeHands-On ContributionContinue to be hands-on with data integration engineering tasks, including data pipeline development, EL processes, and data integration. Be the go-to expert for complex technical challenges. Integrations ArchitectureDesign and implement scalable and efficient data integration architectures that meet business requirements. Ensure data integrity, qualit...

JR REQ---Data Engineer(Pyspark, Big mailto:data)--4to8year---hyd----hemanth.karanam@tcs.com----TCS C2H ---900000

Data engineer Skills Required: Strong proficiency in Pyspark , Scala , and Python Experience with AWS Glue Experience Required: Minimum 5 years of relevant experience Location: Available across all UST locations Notice Period: Immediate joiners (Candidates available to join by 31st January 2025 ) SO - 22978624 Location - Chandigarh,Dadra & Nagar Haveli,Daman,Diu,Goa,Haveli,Jammu,Lakshadweep,Nagar,New Delhi,Puducherry,Sikkim

Data Support Engineer Location: Bangalore Experience 6+yrs Rate 30 LPA AMVikas POC:Swati Patil Key Responsibilities: Database Development & Support: Write and optimize SQL queries, stored procedures, and views for data retrieval and transformation. Develop and maintain data pipelines to support business intelligence and analytics requirements. Support SQL Server and Amazon Redshift environments for data storage, transformation, and analytics. Ensure data integrity, security, and quality across all database solutions. Operational Support: Monitor ETL logs and troubleshoot data pipeline issues to minimize downtime. Perform data validation and reconciliation to ensure data accuracy. Maintain Ex...