1547 Glue Jobs - Page 11

Data Engineer + Level Sr.Analyst + Entity ACS/Accenture Song Management Level: Level 10- Sr. Analyst Location:Kochi, Coimbatore, Trivandrum Must have skills:Python/Scala, Pyspark/Pytorch Good to have skills:Redshift Job Summary Youll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured unstructured) from various touchpoints, forma...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill: AWS Data Engineer Exp range: 5 yrs to 10 yrs location : Hyderabad Notice period 30 – 45 days Pls find the Job Description below. Hands-on experience in Pyspark, Glue Experience on EMR, S3, IAM, Lambda, Cloud formation, Python AMI Rehydration, Python, ELB and other AWS components knowledge AWS monitoring setup and building the traffic dashboard and SNOW incidents for AWS related traffic and services CI/CD build and deployment support Ensure reliability of data pipelines, ETL processes, data transformations Identify areas of improvement in data quality processes, propose solutions to enhance data reliability, ac...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless architectures (AWS Lambda, API Gateway, Step Functions). Experience of AWS networking (VPC, Route 53, ELB, Security Groups, etc.). Experience with AWS CloudFormation for automating infrastructure. Proficiency in scripting languages such as Python or Bash. Experience with automation tools (AWS Systems Manager, AWS Lambda) Experience of containerization (Docker, Kubernetes...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Primary Responsibilities: Lead all phases of data engineering, including requirements analysis, data modeling, pipeline design, development, and testing Design and implement performance and operational enhancements for scalable data systems Develop reusable data components, frameworks, and patterns to accelerate team productivity and innovation Conduct code reviews and provide feedback aligned with data engineering best practices and performance optimization Ensure data solutions meet standards for quality, scalability, security, and maintainability through rigorous design and code reviews Actively participate in Agile/Scrum ceremonies to deliver high-quality data solutions Collaborate with ...

Project description As an Engineer within the Public Markets Technology Department, you will play a pivotal role in developing and enhancing best-in-class applications that support global investment and co-investment strategies. This role involves close collaboration with both technology and business teams to modernize and evolve the technology landscape, enabling strategic and operational excellence. Responsibilities PMWB/CosmosoProvide operational support for PMs in London and Hongkong for Order Entry and Position Management. Currently in scope is EPM, SSG, and AE. Future expansion for LRA in London and Australia. EPM ValidatoroOnboard, Enhance and Maintain Fund Performance data for users ...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. Responsibilities ?Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. ?AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to ?StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), R...

Position Overview We are seeking an expert Senior Data & AI Architect to design and implement SaaS capabilities (independent and modular services) for addressing needs from various products which can be desktop application or single tenant application or multi-tenant application. The ideal candidate will have extensive experience architecting scalable, resilient & secured Data & AI solutions and working with cloud-native technologies in high-volume environments. Key ResponsibilitiesDesign and architect integration patterns for multi-tenant data and AI platform with IAM and API Gateway solutions Build scalable, resilient data architectures leveraging AWS cloud services (AWS cloud ismandatory;...

Job Title: Data/ML/AI/GenAI Practice Leader Experience: 10+ years Location: Hyderabad At the forefront of data-driven innovation, our team empowers organizations to unlock strategic value through advanced analytics, AI/ML, and next-gen GenAI solutions built on cloud-native platforms and optionally deploying AI/ML in data centers. As a technology Lead he/she will work with enterprises, startup founders, and government agencies to build robust data capabilities across Data Engineering, Analytics, Machine Learning, Generative AI, and emerging agentic architectures. Primary responsibility will be to craft future-ready, fail-proof strategies for clients by leading presales and post sales efforts,...

Role & responsibilities We are looking for Senior Developer and Architect level role with strong solutioning skill set for backend - leveraging Python ( Flask API) and should have strong SQL knowledge. Should understand the modular and microservice based architecture, framework to capture the user activities login / log out and other audit related activities. Should be a good team lead to understand the requirement break them for technical implementation and work with team members to drive the delivery. Should have good knowledge of documentation and processes across SDLC phases. Technical Desing, Unit Testing, Code management tool Git/Bitbucket, deployment procedures etc Good understanding ...

Requirements for the candidate: Data Engineer with a minimum of 7+ years of experience of data engineering experience. The role will require deep knowledge of data engineering techniques to create data pipelines and build data assets. At least 4+ years of Strong hands on programming experience with Pyspark / Python / Boto3 including Python Frameworks, libraries according to python best practices. Strong experience in code optimization using spark SQL and pyspark. Understanding of Code versioning, Git repository, JFrog Artifactory. AWS Architecture knowledge specially on S3, EC2, Lambda, Redshift, CloudFormation etc and able to explain benefits of each Code Refactorization of Legacy Codebase:...

Skills Required: Should have a minimum 3+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements. Should be involved in Requirements Gathering and transforming them to into Functionally and technical design. Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources. Design, build and maintain batch or real-time data pipelines in production. Develop ETL/ELT Data pipeline (extract, transform, load) processes to help extract and manipulate d...

Description Are you a highly skilled data engineer and project leaderDo you think big, enjoy complexity and building solutions that scaleAre you curious to know what you could achieve in a company that pushes the boundaries of modern technologyIf you answered yes and you have a background in FinTech youll love this role and Amazons data obsessed culture, Amazon Devices and Services Fintech is the global team that designs and builds the ficial planning and analysis tools for wide variety of Amazons new and established organizations From Kindle to Ring and even new and exciting companies like Kuiper (our new interstellar satellite play) this team enjoys a wide variety of complex and interestin...

At Barclays, we dont just adapt to the future we shape it Embark on a transformative journey as Senior AWS Data Engineer Vice President, where you'll spearhead the evolution of our Reference Data Services function You will be part of a team of engineers with accountability and responsibility for the engineering (strategy, architecture, design, build, documentation, and testing) of the software components You will work closely with your colleagues in the wider cloud and middleware organization to bring their products to life as part of a modern developer-focused experience Additionally, your role requires effective stakeholder management, leadership, and decision-making to support business st...

As a Data Engineer with over 7 years of experience in Data Engineering & Cloud Solutions, you specialize in data warehouse implementation, particularly with a focus on AWS services including S3, Glue, Redshift, Athena, and Lake Formation. Your skill set includes proficiency in SQL, NoSQL databases such as DynamoDB, MongoDB, Cassandra, and programming languages like Python, Spark, and Scala. Hands-on experience in real-time streaming technologies like Kafka, Kinesis, or Spark Streaming would be advantageous for this role. Possessing the AWS Certified Solutions Architect Associate certification is preferred. - Strong experience in Data Engineering & Cloud Solutions - Expertise in AWS services:...

Job Summary: We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines using Snowflake, AWS services, and Apache Spark. You will be responsible for real-time and batch data ingestion, transformation, and orchestration across cloud platforms. Key Responsibilities: Develop and maintain data pipelines using AWS Glue , Lambda , EMR , and Snowflake . Implement real-time ingestion using Snowpipe and Streams for CDC (Change Data Capture). Write efficient PySpark or Scala Spark jobs for large-scale data processing. Automate workflows and orchestrate jobs using AWS Step Functions , Airflow , or similar tools. Optimize Snowflake queries and warehouse performa...

Job Title: AWS Data Engineer Company Name: NCSi Job Description: NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with data scientists, analysts, and other stakeholders to ensure data accuracy, reliability, and accessibility across the organization. Your role will also involve implementing best practices in data governance and security, as well as leveraging AWS services to support data analytics and reporting needs. Key Responsibilities: - Design, develop,...

Role Overview: At EY, you have the opportunity to build a unique career with global support, inclusive culture, and advanced technology to help you become the best version of yourself. Your unique voice and perspective are valued to contribute to making EY even better. Join EY to create an exceptional experience for yourself and contribute to building a better working world for all. Key Responsibilities: - Experience with Kafka, Flume, and AWS tool stack such as Redshift and Kinesis are preferred. - Build on AWS using S3, EC2, Redshift, Glue, EMR, DynamoDB, Lambda, QuickSight, etc. - Proficiency in Pyspark/Spark/Scala. - Utilize software version control tools like Git, Jenkins, Apache Subver...

Project-Based Data Platform Engineer (AWS + GCP / S3 + BigQuery) About Kikeke Vortexium Technologies Kikeke Vortexium Technologies Private Limited is a technology company based in Indore, India , developing high-performance data and gaming platforms for the Casino Elite Group (Belgium) . We are currently expanding our data infrastructure to enable advanced analytics, business intelligence, and financial reporting across multiple business entities in Europe and Asia. Our next milestone is to build a hybrid data platform combining AWS and Google Cloud technologies keeping Amazon S3 as our data lake and BigQuery as our analytics warehouse. Project Overview We are seeking an experienced Data Pla...

Join us as a Developer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. You'll be working on complex technical problems that will involve detailed analytical skills and analysis. This will be done in conjunction with fellow engineers, business analysts and business stakeholders. To be successful as a Developer you should have expe...

Senior Data Engineer Cochin / Trivandrum / Experience: 7+ years total (5+ years relevant) Location: Cochin / Trivandrum /(candidates willing to relocate) Onboarding: Immediate Core Responsibilities Architect & design scalable data solutions using AWS (EMR, Glue, Lambda, S3, EC2). Build and manage data pipelines with PySpark and Scala for batch and streaming workloads. Develop & optimize data stores using Cassandra (OLTP) and Elasticsearch (analytics). Implement streaming solutions with Kafka , SNS/SES for real-time and asynchronous data. Orchestrate workflows via Apache Airflow for complex data dependencies. Collaborate with product and app teams to convert requirements into data models. Mon...

Ingram Micro is a leading technology company for the global information technology ecosystem. With the ability to reach nearly 90% of the global population, we play a vital role in the worldwide IT sales channel, bringing products and services from technology manufacturers and cloud providers to business-to-business technology experts. Our market reach, diverse solutions and services portfolio, and digital platform Ingram Micro Xvantage set us apart Position Summary: Key Duties and Responsibilities Working in close collaboration with the local (in-country) AWS sales and technical team, along with the local Regional Service Centre, the core responsibilities of the role include, but not limite...

Job description Hiring: Data Engineer (AWS ) Location: Remote | Shift: 6 PM 3 AM IST Join Natlov Technologies Pvt. Ltd. and be part of a dynamic data engineering team! What You'll Do Build and optimize scalable data pipelines & models Ensure data quality, security, and performance Collaborate across teams & mentor juniors Work with modern tools like AWS, BigQuery, Snowflake, Airflow What We're Looking For Strong in Python/Java, SQL, ETL/ELT, and data warehousing Hands-on experience with AWS (EC2,S3,Glue,Athena,Lambda,Cloud Watch) Familiarity with orchestration tools (Airflow, Composer) Problem-solving mindset & strong communication skills Responsible for migrating existing, fully functional ...

Data Architecture Design & Strategy: ? Lead engagements with the internal stakeholders to understand their data needs and design solutions ensuring data quality and governance. ? Design the right pipeline architecture to handle data and support various use cases, including analytical reporting and machine learning. ? Design and evolve scalable and modular enterprise data architecture (including data lakes, data warehouses, real-time streaming, and operational data stores) to support current and future data needs. ? Lead end-to-end architecture for data platforms including ingestion, storage, modeling, access, and integration. ? Define and enforce data modeling standards and practices (e.g., ...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill : Python Developer ( Python, Pyspark, Glue) Exp range: 5 yrs to 10 yrs Location: Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneswar, Kolkata Notice period 30 days Pls find the Job Description below. 1.experience as Python Developer / Designer with ETL. 2. Performance Improvement understanding and able to write effective, scalable code 3. security and data protection solutions 4. Expertise in at least one popular Python framework (like Django, Flask or Pyramid) 5. Knowledge of object-relational mapping (ORM) 6. Familiarity with front-end technologies (like JavaScript and HTML5 Must-Have Skills - Python If y...