1330 Aws Glue Jobs - Page 2

Responsibilities: * Design, develop & maintain data pipelines using Python, AWS Glue & Redshift * Ensure data accuracy, security & compliance standards met * Collaborate with cross-functional teams on project delivery

Hi, Greetings from HR Central !! Job Role - Data Engineer Location: Airoli, Navi Mumbai. Notice Period: Immediate /30 days Education / Qualification BE / B. Tech Certification in Cloud Platforms, AWS or GCP Qualifications & Skills Total Experience: 4 to 8 years in Data Engineering. Mandatory: Strong hands-on coding experience in Python . Experience with Big Data tools and cloud platforms (AWS preferred). Work extensively with Big Data cloud platforms such as AWS (Redshift, Glue, Lambda). Proficiency in SQL , Spark , and PySpark . Exposure to data pipeline orchestration tools like Airflow , Luigi , or Azkaban . Strong problem-solving and analytical skills. Excellent communication and teamwork...

Job Title : AWS Data Engineer Location : Bangalore Experience : 5-10 Years Description: We are seeking a talented and experienced AWS Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, particularly within the AWS ecosystem, and will be responsible for designing, developing, and maintaining scalable data pipelines and systems. Key Responsibilities: Design and Development: Design and implement data pipelines and ETL processes using AWS services such as Glue, Redshift, Lambda, and S3. Develop and maintain scalable data storage solutions using AWS services like RDS, DynamoDB, and Redshift. Optimize and tune data processing and storage systems f...

Experienced developer using Python Experience in building integration solutions using various integration techniques, e g APIs, file-based integration, web services Experience in factoring code to run in containerized environments or native cloud services: Event Bridge, Step Function, Lambda Function, AWS Glue, SNS, SQS, SPARK Broad knowledge of AWS native services (compute, database, serverless) Experienced developer using Java Experience in factoring code to run in containerized environments or microservices on ROSA platform Location: Bengaluru,Chennai,Hyderabad,Pune Contact Number : 8097548621

Role & responsibilities Outcome/Deliverable/Timetable/Project Plan Engagement duration 3 months + 6 months optional to renew Skillset : AWS Quicksight , AWS Sakemaker, AWS Glue, AWS S3

Data Engineering and Data Warehousing Strong experience in SQL and MySQL Expertise in Azure Data Factory ADF and Snowflake Understanding of Medallion Architecture Hands on with ETL and ELT pipeline testing Cloud Computing and Fundamentals Knowledge of Microsoft Azure Fundamentals Data Quality and Testing Experience with automated testing and validation frameworks Python and SODA Skills in data profiling cleansing and anomaly detection Ability to perform root cause analysis and data reconciliation

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

As a Senior Data Analyst at Arcgate, you will be a key player in delivering high-quality data analysis and reporting to drive decision-making across clients" product, operations, strategy, and leadership teams. Responsibilities: - Conduct deep-dive analysis on internal datasets to uncover trends, patterns, and actionable insights. - Build, maintain, and enhance internal dashboards and reports using data visualization tools (e.g., Metabase, Amplitude). - Collaborate with cross-functional stakeholders to understand data needs, define analysis requirements, and deliver clear, timely outputs. - Translate complex data findings into concise, business-friendly recommendations. - Work with internal ...

Job description Hiring for AWS Architect Mandatory Skills: AWS services, Data & Analytics Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed ...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to design, build and deploy highly secure and performant data engineering solutions You will analyze the requirements and specifications to understand the client requirements in a detailed manner and translate them into production grade data applications that meet the client requirements. You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey If you think you fit righ...

At Thomson Reuters, our strategic vision is to build a world-class Data & Analytics company by fostering a data-driven culture across the organization. We are seeking a highly motivated Senior Data Scientist with strong organizational and technical skills to play a pivotal role in our data-driven journey. In this position, you will leverage predictive models, machine learning, and generative AI to deliver actionable business insights and drive informed decision-making. You will also mentor junior team members and collaborate with cross-functional teams to design and implement impactful data solutions. About the Role As a Senior Data Scientist, you will: Engage with stakeholders, business ana...

We await your innovation at TCS: Hiring | AWS Data Lake Admin| Greetings from TCS!! We are Hiring for AWS Data Lake Admin Required Experience: 7-12 years Work location: Bangalore, Hyderabad Job Description : We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role involves managing data ingestion, security, and performance of the data lake, ensuring efficient and secure access to data for analytics and reporting. Key Responsibilities : Administer and manage the AWS...

6 years relevant in Data Engineering & Data Architecture Good understanding of Data Architecture. Experience in AWS mandatory Experience in Python & pyspark. Required Candidate profile Experience in ETL Development, ETL pipeline. Experience in Data Modelling & Data Pipeline & Data Lake. Experience in SQL. Experience in working as Individual Contributor + Lead.

Primary Responsibilities: Responsible for large and more complex components, while influencing overall Data architecture and patterns Implements component design in line with pre-defined team architectural patterns Creates design documents, for larger component work to gain alignment Delivers designs aligning to appropriate componentized architectures and integration patterns Can work autonomously Influences the team designs and solutions. Mentors software engineers through code reviews, and hands-on design sessions Code reviews are appropriately broken down in to reviewable chunks Contributes meaningfully to code reviews of teams work, providing collaborative guidance in areas of strength C...

AWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions Experience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern. Experience in designing and building data pipelines. Development experience in one or more object-oriented programming languages, preferably Python Advanced SQL knowledge/Strong SQL Experience designing and implementing large-scale distributed systems Maintains and improves CI / CD pipeline

Education : B.tech or M.Tech Location : India - SEZ - Hyderabad, India Required Skill Set : AWS Cloud, aws data engineer Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions. Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark. Optimize data pipelines for performance, scalability, and cost-effectiveness. Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue. Strong ...

Description: Server Side Integration Services (SSIS) is a Microsoft data integration tool that allows developers to extract transform and load (ETL) data between different relational databases and file formats. It's a powerful tool for data warehousing data migration and data cleansing. About The Role : for an SSIS Developer: An SSIS developer is responsible for designing developing and maintaining data integration solutions using SSIS. They work closely with business analysts data architects and database administrators to understand data requirements and create efficient ETL processes. Key Responsibilities: Data Analysis:Analyze source and target data systems to understand data structures r...

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

Description: 1.Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like S3 DynamoDB StepFunctions etc. 2.Hands on industry experience in design and coding from scratch in Snowflake 3.Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics solutions Level Senior Consultant or below Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :Yes Global Role Family :60236 (P) Software Engineering Local Role Name :6361 Software Engineer Local Skills :593...

Role:Sr Python Developer Must have:Python Spark/Postgres SQL ,Spark / Apache Spark (AWS) Strong development experience using Python and SQL on AWS using Glue, Lambda.

Description Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and processing. Utilize Python and PySpark to develop and optimize data workflows. Leverage AWS services such as S3 Redshift Glue Kinesis and Lambda for data storage processing and analytics. Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Ensure data quality i...

Description 1.Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like S3 DynamoDB StepFunctions etc. 2.Hands on industry experience in design and coding from scratch in Snowflake 3.Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics solutions Level Senior Consultant or below Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility Yes Global Role Family 60236 (P) Software Engineering Local Role Name 6361 Software Engineer Local Skills 59383 AWS G...

Description Primary/Mandatory Experience - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud Ar...

Description Primary/Mandatory Experience - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud Ar...