1564 Glue Jobs - Page 17

Hello !!! Love Scalable Systems? Lets Build the Next Big Thing! If Solving Hard Tech Problems’ Excites You, Read On! Firstly I really want to appreciate you for the amazing work you have been doing so far. Are you interested to explore an opportunity with us at Epsilon ? We are seeking extraordinary talent like you for our Product Engineering team. Your profile stood out to us for the Lead / Staff Software Engineer (Data Engineer) position at Epsilon—let’s discuss how your experience aligns with our innovative projects! What you will do: Be responsible for development and maintenance of applications with technologies involving Enterprise Python and Distributed technologies. Lead the team for...

Key Responsibilities: 1. Design and implement data pipelines for seamless data ingestion. 2. Utilize AWS technologies, including S3, Glue, and Lambda, for effective data management. 3. Collaborate with cross-functional teams to enhance data processes using Python, PySpark, and SQL. 4. Implement CI/CD deployments for streamlined development processes. 5. Understand Data Warehouse concepts to ensure efficient data storage and retrieval. 6. Orchestrate data workflows using AWS Step Functions and Apache Airflow. 7. Able to create data pipeline using AWS services and Snowflake with DBT. 8. Able to utilize Snowflake concepts to streamline data processing and reduce bottlenecks of time and variable...

The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities: Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3. Use Spark on AWS for data transformation and processing across large datasets. Develop and maintain efficient data workflows with SQS for task queueing and orchestration. Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration. Ensure high-performance data storage, retrieval, and analytics across Redshift, DynamoDB, and Ath...

Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment. Proven experience in data modelling, analysis, and profiling. Experience of working in diverse data domains. Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity. Proven consulting and mentoring experience. Experience in working within an Agile environment. Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pipelines and deployment. Other capabilities Hands on in SQL and its Big Data variants (Hive-QL, Databricks) Pyt...

Expert inPython(5+ years) Expert in Django or any similar frameworks (5+ years) Experience (2+ years) inTypeScript, JavaScript and JS frameworks (Angular > 2 with Angular Material) Good knowledge of RDMS (preferably Postgres) Experience and sound knowledge of AWS services (ECS, lambda, deployment pipelines etc). Excellent written and verbal communication skills. Very good analytical and problem-solving skills. Ability to pick up new technologies. Write clean, maintainable and efficient code. Willingness to learn and understand the business domain. Mandatory Competencies Programming Language - Python - Django Beh - Communication User Interface - Typescript - Typescript User Interface - JavaSc...

Key Responsibilities: - Design and develop scalable ETL processes and real-time/offline analytics tools. - Integrate and transform data from diverse sources (APIs, cloud, on-prem). - Build and optimize AWS cloud architecture (Glue, EMR, Redshift, Lambda, etc.). - Develop Spark applications using Python/PySpark. - Create dashboards using Tableau and Splunk. - Ensure data quality, consistency, and performance. - Support CI/CD pipelines (Bamboo, Bitbucket, GitHub) and infrastructure automation (Terraform). - Collaborate with stakeholders to understand data needs and deliver solutions. - Conduct testing, regression analysis, and provide tool/data support. Skills & Tools: - AWS (Glue, EMR, Redshi...

Secondary Skills CI/CD Pipelines Docker/Kubernetes Scripting knowledge - Python and Node JS Primary Skills AWS Formation IAC, IAM, ECS, Lambada, Dynamo DB, Glue, Cloudwatch, Cloudfront Python SQL,Postgress About The Job Role Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications. 1. Applies scientific methods to analyse and solve software engineering problems. 2. He/she is responsible for the development and application of software engineering practice and knowledge, in research, design, development and maintenance. 3. His/her work requires the exercise of original thought and judgement and the ability to ...

Join us as a Software Engineer, PySpark and AWS This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority Its a chance to hone your existing technical skills and advance your career We're offering this role at associate vice president level What you'll do In your new role, youll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. Youll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects an...

You will be a Senior Data Engineer at Beige Bananas, a rapidly growing pure play AI consulting firm focusing on building hyper custom AI products for Fortune 500 Retail, CPG, and Media companies. With an outcome-driven mindset, you will accelerate value realization from clients" analytics investments. **Key Responsibilities:** - Design and implement scalable data architectures - Build and maintain real-time and batch processing pipelines - Optimize data pipeline performance and costs - Ensure data quality, governance, and security - Collaborate with ML teams on feature stores and model pipelines **Qualifications Required:** - Data Engineering and Data Modeling skills - Experience in Extract ...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer you should have experience with: Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL Hands on Experience in developing, testing and maintaining applications on AWS Cloud. Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake for...

Job Title: AWS Data Architect Skills: Python, Airflow, AWS Services S3, Spark(Glue, EMR), Kafka (SQS, Event Bridge), Integration (AppFlow, APIs), DW Concepts & Data Modeling experience Experience Required: 12 - 15 years Job Location: Hyderabad Only We at Coforge are hiring AWS Data Architects with following skillset: Lead Data Architect with a strong background in AWS, Python, and data engineering. Lead a team of data engineers and architects, providing technical guidance and mentorship. Your expertise will shape our data strategy, ensuring efficient data processing, storage, and analytics. Lead a team of data engineers and architects, providing technical guidance and mentorship. Develop and...

Job Title: AWS Data Architect Skills: Python, Airflow, AWS Services S3, Spark(Glue, EMR), Kafka (SQS, Event Bridge), Integration (AppFlow, APIs), DW Concepts & Data Modeling experience Experience Required: 12 - 15 years Job Location: Hyderabad Only We at Coforge are hiring AWS Data Architects with following skillset: Lead Data Architect with a strong background in AWS, Python, and data engineering. Lead a team of data engineers and architects, providing technical guidance and mentorship. Your expertise will shape our data strategy, ensuring efficient data processing, storage, and analytics. Lead a team of data engineers and architects, providing technical guidance and mentorship. Develop and...

Join us as a Solution Designer (Cloud Data Integration) at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Solution Designer (Cloud Data Integration) you should have experience with: Hands on experience to work with large scale data platforms & developing cloud solutions in AWS data platform with proven track record in driving business succ...

Join us as a Data Engineer - Pyspark,SQL at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. To be successful as a Data Engineer - Pyspark,SQL you should have experience with: Hands on experience in Pyspark and strong knowledge on Dataframes, RDD and SparkSQL Hands on experience in Pyspark performance optimization techniques ....

Data Engineering experience Strong expertise in Apache Spark (Scala) Hands-on experience with AWS EMR and AWS Glue (must-have) Proficiency in SQL and working knowledge of NoSQL databases Strong understanding of ETL pipelines and data warehousing Exposure to AWS cloud ecosystem and related data services Good to have: Oracle ERP migration experience

Job Description Job Description Sr Data Engineer in the Data & Analytics area designs, builds, and maintains cloud-based data pipelines, and data solutions to support data analysis and business intelligence initiatives. Key responsibilities include integrating cloud services, creating scalable data pipelines (ETL/ELT), ensuring data quality and security, and collaborating with data analysts to meet data needs using technologies like AWS Services, SQL, Python,PySpark and big data frameworks. Key Responsibilities : Design, build, and manage scalable data pipelines (ETL/ELT) to ingest, transform, and load data from various sources into cloud data warehouses or data lakes. Integrate data from di...

Role:AWS Data Engineer & Sr. AWS Data Engineers Experience: 5 to 10 Years (6+ years exp. will be considered for Seniors and 8+ will be considered for Lead roles) Location:Pune, Gurgaon, Hyderabad, Bangalore (Hybrid) Our Values: Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, Reliability Job Summary: We are seeking a highly motivated and experienced AWS Engineer to join our MarTech team in the NFL. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to seek out requirements and create best-in-class cloud-native solutions. The e...

Role: AWS Data Engineering Manager Experience: 10+ Years Location: Pune, Gurgaon, Hyderabad, Bangalore (Hybrid) Our Values: Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, Reliability Job Summary: We are seeking a highly motivated and experienced AWS Engineer to join our MarTech team in the NFL. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development. The successful candidate must be able to seek out requirements and create best-in-class cloud-native solutions. The engineer must always create solutions that are repeatable, scalable and well-governed. They will deploy a...

Role Overview: As a Data Engineer in the AI Accelerator Group at LeadVenture India, your main responsibility will be to build and maintain the data engine that powers the AI strategy of the organization. Your work will involve leveraging vast amounts of data in the data lake and platforms to enable AI functionality and support data-driven decision-making. Key Responsibilities: - Architect and build data pipelines to load structured and semi-structured data into the AWS data lake. - Design end-to-end data solutions for critical business functions, owning projects from inception to operation. - Utilize expertise in SQL and Python to transform and prepare data for machine learning and analytics...

Job Summary: We are looking for an experienced and highly skilled Senior Data Engineer to lead the design and development of our data infrastructure and pipelines. As a key member of the Data & Analytics team, you will play a pivotal role in scaling our data ecosystem, driving data engineering best practices, and mentoring junior engineers. This role is ideal for someone who thrives on solving complex data challenges and building systems that power business intelligence, analytics, and advanced data products. Key Responsibilities: Design and build robust, scalable, and secure data pipelines and models. Lead the complete lifecycle of ETL/ELT processes, encompassing data intake, transformation...

Job Title - + + Management Level: Location:Kochi, Coimbatore, Trivandrum Must have skills:Python/Scala, Pyspark/Pytorch Good to have skills:Redshift Job Summary Youll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured unstructured) from various touchpoints, format and organize them into an analyzable format. Creating data produc...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...