1847 Aws Glue Jobs - Page 48

Perficient is the global AI-first consultancy. Our team of strategists, designers, technologists, and engineers partners with the worlds most innovative enterprises and admired brands to deliver real business results through the transformative power of AI. As part of our AI-First strategy, we empower every employee to build AI fluency and actively engage with AI tools to drive innovation and efficiency. We break boundaries, obsess over outcomes, and shape the future for our clients. Join a company where bold ideas and brilliant minds converge to redefine whats possible - while building a career filled with growth, balance, and purpose AWS Glue Data Engineer Location: Chennai | Bangalore | Hy...

Strong experience with: AWS Glue - Python, Big Data Pyspark, Control-M – ETL Batch job implementation stack Kinesis, Kafka, SNS – Real time message processing AWS Aurora, Dynamo, S3 – Data Storage AWS IAM, Cloud formation, Bamboo – Infra as code and CI/CD Lambda, Step function – Orchestration Secondary Skills: CloudWatch, Event Bridge, Amazon EKS, Honeycomb, Redshift, AWS ALB Good to have knowledge on: Design patterns/solid principles, Architectural patterns around microservices, Batch and Real time, Database decision, Memory management, Performance Tuning, Cost Optimization Prior experience with Database administration & migration & modernization in AWS Cloud Data Modelling and designing Ex...

Mandatory Skill - AWS Glue , S3 , Docker , Python, Databricks Good to have - Kubernetes , SQL, EC2, CFT (Cloud Formation Templates), Atacama , Data Ingestion Framework, Python modules - Pandas, SQLAlchemy, NumPY Experience - 7 years - 10 years Location - Pune / Mumbai / Chennai / Bangalore Define and maintain the overall data lake architecture and design principles Lead the design and review of ETL/ELT pipelines and data workflows Establish coding standards, best practices, and development guidelines Conduct code reviews and provide technical mentorship to data engineers Prioritize and assign tasks to team members based on sprint goals Collaborate with product owners, data scientists, and an...

Senior Data Engineer: We are seeking a talented Senior Developer to lead our development team in creating software solutions that meet our clients' needs. Work youll do/Responsibilities: You will play a pivotal role within the Information Technology (IT) team, analyze technical/business problems, and recommend strategies to implement technology or improve processes to enable improved IT productivity. You will drive large scale modernization from legacy to cloud based solutions. You will be responsible for communicating with clients to determine their requirements, creating comprehensive solution plans, and provide technical guidance to application development teams. When you join us, you’ll ...

You will be responsible for leading the end-to-end implementation of a data cataloging solution within AWS, with a preference for tools like AWS Glue Data Catalog or third-party options such as Apache Atlas, Alation, or Collibra. Your role will involve establishing and managing metadata frameworks for both structured and unstructured data assets in data lake and data warehouse environments. It will also require you to integrate the data catalog with various AWS-based storage solutions like S3, Redshift, Athena, Glue, and EMR. Collaboration with data Governance/BPRG/IT projects teams is essential to define metadata standards, data classifications, and stewardship processes. You will need to d...

As a Software Developer at FIS, you will have the opportunity to work on challenging and relevant issues in financial services and technology. Our team values curiosity, motivation, and forward-thinking, fostering an environment that is open, collaborative, entrepreneurial, passionate, and fun. In today's competitive private equity market, firms are under pressure to deliver superior returns while meeting stringent reporting requirements and increasing demands for information. As part of our team, you will play a crucial role in developing core versions of software applications for external clients. This includes identifying client purchasing requirements and technical specifications, collab...

As a professional services firm affiliated with KPMG International Limited, KPMG entities in India have been serving national and international clients since August 1993. With offices located across India in cities like Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, our team of professionals leverages a global network of firms while maintaining expertise in local laws, regulations, markets, and competition. We are committed to delivering rapid, performance-based, industry-focused, and technology-enabled services that showcase our extensive knowledge of global and local industries, as well as our deep unde...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Redshift Good to have skills : PySparkMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for team decisions- Engage with multiple teams ...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

JD: AWS Good understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation , etc. Programming skills in Python Good analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization. Experience with version control systems like Git, promoting code integrity and collaboration in a cloud-based environment. Experience on the latest AWS services, features, and best practices. Ability to work in fast paced environment. Strong communication and collaboration skills

JD: AWS Good understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation , etc. Programming skills in Python Good analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization. Experience with version control systems like Git, promoting code integrity and collaboration in a cloud-based environment. Experience on the latest AWS services, features, and best practices. Ability to work in fast paced environment. Strong communication and collaboration skills

JD: AWS Good understanding of AWS Services & architecture such as EC2, S3, RDS, Lambda, Glue, Athena, Redshift, API Gateway, CloudFormation , etc. Programming skills in Python Good analytical and problem-solving skills, essential for debugging and optimizing AWS resource utilization. Experience with version control systems like Git, promoting code integrity and collaboration in a cloud-based environment. Experience on the latest AWS services, features, and best practices. Ability to work in fast paced environment. Strong communication and collaboration skills

Role & responsibilities java AWS Developer Preferred candidate profile

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, LambdaMinimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inno...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, LambdaMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inno...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, LambdaMinimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inno...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : DevOps, Data Engineering, AWS Glue, REST API, LambdaMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing inno...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions that align with business objectives, and ensuring that applications are optimized for performance and usability. You will al...

Job Description : Data Engineer / Analytics Developer Location : Remote Experience: 5 - 7 years Employment Type : Contractual (long-term) Job Summary: We are seeking a highly skilled and hands-on Data Engineer / Analytics Developer who excels at transforming complex business needs into robust data pipelines, analytical datasets, and insightful dashboards. The ideal candidate will have strong expertise in SQL , AWS services, and BI tools , along with the ability to understand business goals and translate them into data-driven outcomes. Key Responsibilities: Write and optimize complex SQL queries to support data transformation, aggregation, and analysis. Design and build scalable data pipeline...

We are seeking an experienced Amazon Redshift Developer / Data Engineer to design, develop, and optimize cloud-based data warehousing solutions. The ideal candidate should have expertise in Amazon Redshift, ETL processes, SQL optimization, and cloud-based data lake architectures. This role involves working with large-scale datasets, performance tuning, and building scalable data pipelines. Key Responsibilities: Design, develop, and maintain data models, schemas, and stored procedures in Amazon Redshift. Optimize Redshift performance using distribution styles, sort keys, and compression techniques. Build and maintain ETL/ELT data pipelines using AWS Glue, AWS Lambda, Apache Airflow, and dbt. ...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...

We are looking for an experienced AWS Data Pipeline Developer to design, develop, and maintain data integration solutions on AWS. The ideal candidate should have expertise in AWS Data Pipeline, AWS Glue, AWS Lambda, and other AWS data services. They should be proficient in ETL processes, data warehousing, and big data solutions while ensuring efficient and scalable data workflows. Key Responsibilities: Design, build, and optimize AWS Data Pipelines for data ingestion, transformation, and processing. Work with AWS Glue, AWS Lambda, S3, Redshift, Kinesis, and DynamoDB to develop scalable data solutions. Develop ETL jobs using Glue (PySpark, Spark, or Python scripts) for data transformation. Op...

About Company: Avisoft (https://avisoft.io/) is a Technology and IT services company based in Mohali and Jammu serving clients globally. We offer Product Engineering, IT Consultancy, Project Outsourcing and Staff Augmentation services. We partner with businesses to design and build Tech platforms from scratch, or to re-engineer and modernize their legacy systems. Our teams have expertise in Full Stack Technologies, REST API Servers, Blockchain, DevOps, Cloud Technologies, Data Engineering, and Test Automation. We are building next gen SaaS platforms for e-commerce and health-tech domains. About the Role: We are seeking a highly skilled Python Developer with a minimum of 4+ years of experienc...

Key Responsibilities: Lead the end-to-end implementation of a data cataloging solution within AWS (preferably AWS Glue Data Catalog or third-party tools like Apache Atlas, Alation, Collibra, etc.). Establish and manage metadata frameworks for structured and unstructured data assets in the data lake and data warehouse environments. Integrate the data catalog with AWS-based storage solutions such as S3, Redshift, Athena, Glue, and EMR. Collaborate with data Governance/BPRG/IT projects teams to define metadata standards, data classifications, and stewardship processes. Develop automation scripts for catalog ingestion, lineage tracking, and metadata updates using Python, Lambda, Pyspark or Glue/...