1330 Aws Glue Jobs - Page 4

Key responsibilities: Design, develop, and maintain scalable and efficient data pipelines and ETL processes to extract, transform, and load data from various sources into our data lake or warehouse Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements, define data models, and implement solutions that meet business needs Ensure the security, integrity, and quality of data throughout the data lifecycle, implementing best practices for data governance, encryption, and access control Develop and maintain data infrastructure components such as data warehouses, data lakes, and data processing frameworks, leveraging cloud...

Experian is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. In this role, you will be responsible for developing robust data software applications, scalable data platforms, and innovative data products. You will collaborate closely with cross-functional teamsincluding application engineers, data scientists, and product stakeholdersto design, build, and implement high-impact solutions that drive business value. Key Responsibilities: Lead the design, development, testing, and deployment of data solutions and pipelines. Collaborate with stakeholders to ensure technology solutions meet business requirements and optimize resource costs. Contribute to engineer...

Analyze and interpret complex data trends across consumer, commercial, housing, and alternative credit data to create insights that inform strategic decisions. Design, develop and deploy analytical workflows, scalable data pipelines, data science solutions, and machine learning models to enhance data quality and operational efficiency. Translate high-level requirements into clear technical specifications, data models, and process flow diagrams that support solution development. Communicate analytical findings through compelling storytelling, data visualizations, and executive-level presentations to guide partner decision-making. Collaborate with internal clients to assess and resolve data qu...

Requirement : - 3-4 years hands-on experience on AWS, ideally SaaS in the cloud - 1-2 years of experience in working with AWS Connect, Lex Bots. - Experience developing solutions with code/scripting language must have Python experience (e.g, python, Node.js) - Experience in building, troubleshooting contact centre solutions and getting hands on. - Experience in creating and configuring AWS resources like VPC, API Gateway, CloudWatch, Athena, Glue, Cloud-Formation, EC2, Lambda, Connect, SNS, etc. - Designing highly available applications with responsibility for infrastructure robustness, including networking, communications, EC2 and storage - Application, server, and/or network security - Wor...

We are seeking an experienced Snowflake Developer with hands-on expertise in AWS Glue to join our growing team. This role will operate remotely from India, supporting a US-based client.. The candidate will work primarily in the afternoon shift to align with US business hours. The ideal professional will have strong technical skills, excellent communication abilities, and the capacity to collaborate effectively with globally located client team.. Key Responsibilities. Design, develop, and maintain Snowflake data warehouse solutions to meet business and technical requirements.. Utilize AWS Glue to build, orchestrate, and optimize ETL pipelines for seamless data ingestion, transformation, and i...

About The Role Project Role : Quality Engineering Lead (Test Lead) Project Role Description : Leads a team of quality engineers through multi-disciplinary team planning and ecosystem integration to accelerate delivery and drive quality across the application lifecycle. Applies business and functional knowledge to develop end-to-end testing strategies through the use of quality processes and methodologies. Applies testing methodologies, principles and processes to define and implement key metrics to manage and assess the testing process including test execution and defect resolution. Must have skills : AWS Lambda Administration Good to have skills : AWS Glue Minimum 7.5 year of experience is ...

Mandatory Skills - AWS ,Python , PySpark, Databricks, Terraform Desired Skills - ETL, SQL , Angular Experience - 3 years - 5 years Shift Timings - 2:30 PM -11: 30 PM Location - Pune / Mumbai / Chennai / Bangalore Strong experience in Python, PySpark, and SQL Angular for front-end development Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda) Terraform knowledge Experience with Git, Octopus, and Azure DevOps for CI/CD. Develop and manage ETL processes using Python, PySpark, and SQL. Work with Databricks for data processing. Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda. Familiarity with Terraform for infrastructure management. Work with Angular for front-end inte...

Mandatory Skills - AWS , Python , PySpark, Databricks, Terraform Desired Skills - ETL, SQL , Angular Experience - 3 years - 5 years Shift Timings - 2:30 PM -11: 30 PM Location - Pune / Mumbai / Chennai / Bangalore Strong experience in Python, PySpark, and SQL Angular for front-end development Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda) Terraform knowledge Experience with Git, Octopus, and Azure DevOps for CI/CD. Develop and manage ETL processes using Python, PySpark, and SQL. Work with Databricks for data processing. Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda. Familiarity with Terraform for infrastructure management. Work with Angular for front-end int...

Requirement : - 3-4 years hands-on experience on AWS, ideally SaaS in the cloud - 1-2 years of experience in working with AWS Connect, Lex Bots. - Experience developing solutions with code/scripting language must have Python experience (e.g, python, Node.js) - Experience in building, troubleshooting contact centre solutions and getting hands on. - Experience in creating and configuring AWS resources like VPC, API Gateway, CloudWatch, Athena, Glue, Cloud-Formation, EC2, Lambda, Connect, SNS, etc. - Designing highly available applications with responsibility for infrastructure robustness, including networking, communications, EC2 and storage - Application, server, and/or network security - Wor...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As part of a Data Transformation programme you will be part of the Data Marketplace team. In this team you will be responsible for the design and implementation of dashboard for assessing compliance to controls and policies at various stages of the data product lifecycle, with centralised compliance scoring.Preferable having experience with data product lifecycle.Example sk...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow.

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently. Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL.

Job Description: Strong knowledge in SQL, Spark and Python and AWS data integration and processing technologies (Glue, Athena , Redshift). Proficient in data analysis and data pipeline development. Well versed with functional and automated testing of data pipelines. Has good understanding about performance tuning and debugging of data pipelines. Some Understanding in Lake house development.

About The Role Project Role : Software Configuration Engineer Project Role Description : Implement the configuration management plan as directed by the Configuration Lead. Assist in the design of software configuration and customization to meet the business process design and application requirements. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs,...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementin...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in proble...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : Data Analysis Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand projec...

JD : 1) AWS Glue + Spark architecture + Handling OOM issues. 2) Lambda development (Real time ETL development). 3) PySpark and Python coding. 4) AWS services - Terraform, CloudFormation templates, RDS, Redshift, IAM and CloudWatch. 5) SQL 6) Strong understanding of Database and Datawarehouse concepts, Relational Data models

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in proble...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in proble...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in proble...