1333 Aws Glue Jobs - Page 27

You will be responsible for designing, building, and maintaining scalable and efficient data pipelines to facilitate the movement of data between cloud-native databases (e.g., Snowflake) and SaaS providers using AWS Glue and Python. Your role will involve implementing and managing ETL/ELT processes to ensure seamless data integration and transformation while adhering to information security and compliance with data governance standards. Additionally, you will be tasked with maintaining and enhancing data environments, including data lakes, warehouses, and distributed processing systems. It is crucial to utilize version control systems (e.g., GitHub) effectively to manage code and collaborate...

***We are looking for immediate joiners for our Bangalore Location*** Role & responsibilities Hands on experience in Admin activities on Snowflake, DBT, Matillion & AWS-Glue , with exposure in Development & Support environments. Experience in real time CDC tools - IBM Infosphere and Qlik Replicate. Willingness to quickly learn/adapt other ETL/BI cloud tools if & as needed. Possess strong Snowflake SQL & Database skills. Strong written and oral communication skills. Should be able to understand business users, their issues and ability to take them to closure. Should possess the ability to learn & adapt, understand business requirements, data models and mapping documents. Independently design ...

As a Data Architect, you will be responsible for leading Data related projects in the field of Reporting and Analytics. With over 10 years of relevant work experience, you will design, build, and maintain scalable data lake and data warehouse in the cloud, particularly on Google Cloud Platform (GCP). Your expertise will be crucial in gathering business requirements, analyzing business needs, and defining the BI/DW architecture to deliver technical solutions for complex business and technical requirements. You will create solution prototypes, participate in technology selection, and perform POCs and technical presentations. In this role, you will architect, develop, and test scalable data war...

As an Associate/Architect - Data (AbInitio) at Quantiphi, you will play a crucial role in migrating ETL jobs from existing Ab Initio to AWS Cloud. Your responsibilities will include designing and implementing a migration strategy, interpreting complex graphs and jobs in Ab Initio, and assisting the Data Engineering team in understanding business logic and data sources. You will be expected to create high-level block diagrams and flows of jobs, assist in validating output data generated through Spark code, and serve as a technical point of contact between clients and the offshore technical team. Strong communication skills to convey technical roadmaps, challenges, and mitigation strategies ar...

You have over 10 years of hands-on experience within a data engineering organization, with a specific focus on Informatica IICS (Informatica Intelligent Cloud Services) for at least 5 years. Additionally, you have a minimum of 5 years of experience working with Cloud Data Warehouse Platforms such as Snowflake. Your expertise includes utilizing tools like Spark, Athena, AWS Glue, Python/PySpark, etc. Your role involves developing architectures to transition from legacy to modern data platforms. Previous exposure to ETL/ELT tools, particularly Informatica Power Center in Data Warehouse environments, is essential. You are well-versed in agile software development processes and are familiar with...

Design, build, and maintain data pipelines on the AWS platform. Work with AWS services like S3, Glue, EMR, and Redshift. Process and analyze large datasets to support business insights. Ensure data quality, integrity, and security in the data lake. Location - Pan India.

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Skills AWS Glue or Databricks Python Pyspark

Role & responsibilities: AWS Glue Python Pyspark

About Markovate: At Markovate, you don't just follow trends, we drive them. We transform businesses through innovative AI and digital solutions that turn vision into reality. Our team harnesses breakthrough technologies to craft bespoke strategies that align seamlessly with our clients" ambitions. From AI Consulting And Gen AI Development To Pioneering AI Agents And Agentic AI, We Empower Our Partners To Lead Their Industries With Forward-thinking Precision And Unmatched Overview. We are seeking a highly experienced and innovative Senior Data Engineer with a strong background in hybrid cloud data integration, pipeline orchestration, and AI-driven data modelling. Requirements: - 9+ years of e...

Role & responsibilities Data Ingestion Framework: Design & Development: Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources. Framework Optimization: Use AWS services such as AWS Glue, Lambda, EMR, ECS , EC2 and Step Functions to build highly scalable, resilient, and automated data pipelines. Data Quality & Validation: Validation Processes: Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data. Monitoring & Reporting: Establish comprehensive monitoring, logging, and alerting systems to proactively...

Perficient is the global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the worlds most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of our AI-First strategy, we empower every employee to build AI fluency and actively engage with AI tools to drive innovation and efficiency. We break boundaries, obsess over outcomes, and shape the future for our clients. Join a company where bold ideas and brilliant minds converge to redefine whats possible - while building a career filled with growth, balance, and purpose AWS Glue Data Engineer Location: Chennai | Bangalore | Hy...

Strong experience with: AWS Glue - Python, Big Data Pyspark, Control-M – ETL Batch job implementation stack Kinesis, Kafka, SNS – Real time message processing AWS Aurora, Dynamo, S3 – Data Storage AWS IAM, Cloud formation, Bamboo – Infra as code and CI/CD Lambda, Step function – Orchestration Secondary Skills: CloudWatch, Event Bridge, Amazon EKS, Honeycomb, Redshift, AWS ALB Good to have knowledge on: Design patterns/solid principles, Architectural patterns around microservices, Batch and Real time, Database decision, Memory management, Performance Tuning, Cost Optimization Prior experience with Database administration & migration & modernization in AWS Cloud Data Modelling and designing Ex...

Mandatory Skill - AWS Glue , S3 , Docker , Python, Databricks Good to have - Kubernetes , SQL, EC2, CFT (Cloud Formation Templates), Atacama , Data Ingestion Framework, Python modules - Pandas, SQLAlchemy, NumPY Experience - 7 years - 10 years Location - Pune / Mumbai / Chennai / Bangalore Define and maintain the overall data lake architecture and design principles Lead the design and review of ETL/ELT pipelines and data workflows Establish coding standards, best practices, and development guidelines Conduct code reviews and provide technical mentorship to data engineers Prioritize and assign tasks to team members based on sprint goals Collaborate with product owners, data scientists, and an...

Senior Data Engineer: We are seeking a talented Senior Developer to lead our development team in creating software solutions that meet our clients' needs. Work youll do/Responsibilities: You will play a pivotal role within the Information Technology (IT) team, analyze technical/business problems, and recommend strategies to implement technology or improve processes to enable improved IT productivity. You will drive large scale modernization from legacy to cloud based solutions. You will be responsible for communicating with clients to determine their requirements, creating comprehensive solution plans, and provide technical guidance to application development teams. When you join us, you’ll ...

You will be responsible for leading the end-to-end implementation of a data cataloging solution within AWS, with a preference for tools like AWS Glue Data Catalog or third-party options such as Apache Atlas, Alation, or Collibra. Your role will involve establishing and managing metadata frameworks for both structured and unstructured data assets in data lake and data warehouse environments. It will also require you to integrate the data catalog with various AWS-based storage solutions like S3, Redshift, Athena, Glue, and EMR. Collaboration with data Governance/BPRG/IT projects teams is essential to define metadata standards, data classifications, and stewardship processes. You will need to d...

As a Software Developer at FIS, you will have the opportunity to work on challenging and relevant issues in financial services and technology. Our team values curiosity, motivation, and forward-thinking, fostering an environment that is open, collaborative, entrepreneurial, passionate, and fun. In today's competitive private equity market, firms are under pressure to deliver superior returns while meeting stringent reporting requirements and increasing demands for information. As part of our team, you will play a crucial role in developing core versions of software applications for external clients. This includes identifying client purchasing requirements and technical specifications, collab...

As a professional services firm affiliated with KPMG International Limited, KPMG entities in India have been serving national and international clients since August 1993. With offices located across India in cities like Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, our team of professionals leverages a global network of firms while maintaining expertise in local laws, regulations, markets, and competition. We are committed to delivering rapid, performance-based, industry-focused, and technology-enabled services that showcase our extensive knowledge of global and local industries, as well as our deep unde...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Redshift Good to have skills : PySparkMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for team decisions- Engage with multiple teams ...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

JD: AWS Good understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation , etc. Programming skills in Python Good analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization. Experience with version control systems like Git, promoting code integrity and collaboration in a cloud-based environment. Experience on the latest AWS services, features, and best practices. Ability to work in fast paced environment. Strong communication and collaboration skills

JD: AWS Good understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation , etc. Programming skills in Python Good analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization. Experience with version control systems like Git, promoting code integrity and collaboration in a cloud-based environment. Experience on the latest AWS services, features, and best practices. Ability to work in fast paced environment. Strong communication and collaboration skills

JD: AWS Good understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation , etc. Programming skills in Python Good analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization. Experience with version control systems like Git, promoting code integrity and collaboration in a cloud-based environment. Experience on the latest AWS services, features, and best practices. Ability to work in fast paced environment. Strong communication and collaboration skills

Role & responsibilities java AWS Developer Preferred candidate profile