1844 Aws Glue Jobs - Page 23

At Thomson Reuters, our strategic vision is to build a world-class Data & Analytics company by fostering a data-driven culture across the organization. We are seeking a highly motivated Senior Data Scientist with strong organizational and technical skills to play a pivotal role in our data-driven journey. In this position, you will leverage predictive models, machine learning, and generative AI to deliver actionable business insights and drive informed decision-making. You will also mentor junior team members and collaborate with cross-functional teams to design and implement impactful data solutions. About the Role As a Senior Data Scientist, you will: Engage with stakeholders, business ana...

We await your innovation at TCS: Hiring | AWS Data Lake Admin| Greetings from TCS!! We are Hiring for AWS Data Lake Admin Required Experience: 7-12 years Work location: Bangalore, Hyderabad Job Description : We are seeking a highly skilled AWS Data Lake Administrator to manage and optimize our data lake architecture on AWS. The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge. The role involves managing data ingestion, security, and performance of the data lake, ensuring efficient and secure access to data for analytics and reporting. Key Responsibilities : Administer and manage the AWS...

6 years relevant in Data Engineering & Data Architecture Good understanding of Data Architecture. Experience in AWS mandatory Experience in Python & pyspark. Required Candidate profile Experience in ETL Development, ETL pipeline. Experience in Data Modelling & Data Pipeline & Data Lake. Experience in SQL. Experience in working as Individual Contributor + Lead.

Primary Responsibilities: Responsible for large and more complex components, while influencing overall Data architecture and patterns Implements component design in line with pre-defined team architectural patterns Creates design documents, for larger component work to gain alignment Delivers designs aligning to appropriate componentized architectures and integration patterns Can work autonomously Influences the team designs and solutions. Mentors software engineers through code reviews, and hands-on design sessions Code reviews are appropriately broken down in to reviewable chunks Contributes meaningfully to code reviews of teams work, providing collaborative guidance in areas of strength C...

AWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions Experience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern. Experience in designing and building data pipelines. Development experience in one or more object-oriented programming languages, preferably Python Advanced SQL knowledge/Strong SQL Experience designing and implementing large-scale distributed systems Maintains and improves CI / CD pipeline

Education : B.tech or M.Tech Location : India - SEZ - Hyderabad, India Required Skill Set : AWS Cloud, aws data engineer Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions. Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark. Optimize data pipelines for performance, scalability, and cost-effectiveness. Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue. Strong ...

Description: Server Side Integration Services (SSIS) is a Microsoft data integration tool that allows developers to extract transform and load (ETL) data between different relational databases and file formats. It's a powerful tool for data warehousing data migration and data cleansing. About The Role : for an SSIS Developer: An SSIS developer is responsible for designing developing and maintaining data integration solutions using SSIS. They work closely with business analysts data architects and database administrators to understand data requirements and create efficient ETL processes. Key Responsibilities: Data Analysis:Analyze source and target data systems to understand data structures r...

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

Description: 1.Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like S3 DynamoDB StepFunctions etc. 2.Hands on industry experience in design and coding from scratch in Snowflake 3.Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics solutions Level Senior Consultant or below Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :Yes Global Role Family :60236 (P) Software Engineering Local Role Name :6361 Software Engineer Local Skills :593...

Role:Sr Python Developer Must have:Python Spark/Postgres SQL ,Spark / Apache Spark (AWS) Strong development experience using Python and SQL on AWS using Glue, Lambda.

Description Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and processing. Utilize Python and PySpark to develop and optimize data workflows. Leverage AWS services such as S3 Redshift Glue Kinesis and Lambda for data storage processing and analytics. Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Ensure data quality i...

Description 1.Hands on industry experience in design and coding from scratch in AWS Glue-Pyspark with services like S3 DynamoDB StepFunctions etc. 2.Hands on industry experience in design and coding from scratch in Snowflake 3.Experience in Pyspark/Snowflake 1 to 3 years with overall around 5 years of experience in building data/analytics solutions Level Senior Consultant or below Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility Yes Global Role Family 60236 (P) Software Engineering Local Role Name 6361 Software Engineer Local Skills 59383 AWS G...

Description Primary/Mandatory Experience - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud Ar...

Description Primary/Mandatory Experience - Experience building data pipeline in Python along with AWS services (S3 SNS CloudWatch Lambda Step Function etc) - Proficient in AWS Server less technologies - Technical knowledge of Extract/Transform/Load (ETL) solutions for running analytic projects on the cloud - Candidate must have hands-on technical experience on the AWS cloud native technologies along with traditional ETL tools -Snowflake & DWH experience is a plus Daily Activity Excellent written and verbal communication skills and be able to lead meetings with technical peers and clients regarding the solution designs. Ability to communicate with the Business Analysts Data Modellers Cloud Ar...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

You will be working as an experienced ETL & Data Warehouse Developer at Kogta Financial Ltd, utilizing AWS services to design, develop, and optimize ETL processes and data warehousing solutions on the AWS platform. Your responsibilities will include: - Designing, developing, and implementing robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed. - Ensuring efficient extraction, transformation, and loading of data from diverse sources into the data warehouse. - Designing and maintaining data warehouse solutions on AWS, focusing on scalability, performance, and reliability. - Implementing and optimizing data models for efficient storage and retrieval in AWS Redshi...

Job Summary: We are seeking a highly skilled Database Software Engineer with 4-5 years of experience to join our team. The successful candidate will be responsible for designing, developing, and maintaining our database systems and ETL pipelines, ensuring high performance, scalability, and reliability. The Database Software Engineer will work closely with our development team to ensure that our database systems meet the requirements of our applications and services. Key Responsibilities: Database Design and Development: Design and develop database architectures to support business requirements Develop and maintain database models, including entity-relationship diagrams and schema definitions...

AWS Glue Data Engineer Mandatory Skills: AWS Glue, Glue, DBT, Pyspark, Atlan, Data catlouge We are seeking an experienced Senior Data Engineer with 6+ years of strong expertise in building and optimizing large-scale data pipelines using AWS Glue. The ideal candidate will have deep knowledge of AWS Glue Data Catalogue, AWS Glue Data Quality, and Data Quality Frameworks (AWS DQ), combined with hands-on experience in Python, PySpark, and PyDQ. This role requires a strategic thinker capable of leading data quality initiatives and ensuring robust data governance across complex data ecosystems. Key Responsibilities: Lead the design, development, and optimization of scalable ETL pipelines using AWS...

Your role at KPMG in India will involve the following: **Role Overview:** KPMG entities in India operate as professional services firms affiliated with KPMG International Limited. Established in August 1993, we leverage a global network of firms and possess in-depth knowledge of local laws, regulations, markets, and competition. With offices located across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, we offer services to national and international clients across various sectors. Our aim is to deliver rapid, performance-based, industry-focused, and technology-enabled services that demons...

As a Data Pipeline Developer (L1 Data Ops Analyst) at UST, your role will involve developing and maintaining data pipelines for ingesting, wrangling, transforming, and joining data from multiple sources. You will work independently to deliver high-quality code and ensure seamless operation of data systems. Proficiency in ETL tools such as Informatica, Glue, Databricks, and DataProc, along with strong coding skills in Python, PySpark, and SQL, will be essential. Operating with minimal supervision while adhering to established processes and guidelines is a key aspect of this position. **Key Responsibilities:** - Independently develop, test, and maintain data processing pipelines ensuring perfo...

As a Software Developer at FIS, you will be responsible for developing core versions of software applications for sale to external clients. Your key responsibilities will include: - Identifying client purchasing requirements and technical specifications through Product Management and/or client representatives - Interacting with engineering groups to assist in design changes to equipment and/or software - Training and communicating with clients on systems application To excel in this role, you must possess the following skills: - Proficiency with ETL (e.g., Informatica PowerCenter) and awareness of Informatica Intelligent Cloud Services (IICS) - Extensive SQL skills and familiarity with platf...

Job Position Title: AWS Data Engineer Location : Pan India Years of experience: 4 to 8 Years Responsibilities: - Design and build data pipelines & Data lakes to automate ingestion of structured and unstructured data that provide fast, optimized, and robust end-to-end solutions. - Knowledge about the concepts of data lake and data warehouse. - Experience working with AWS big data technologies Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection. - Deploy and configure components to production environments Mandatory skill sets: Redshift, S3, AWS Glue, Lambda, SQL, PySpark, SQL Preferred skill sets: Redshift, S3, AWS Glue, Lambda, SQL, ...

Job Position Title: AWS Data Architect Location : Pan India Years of experience : 8 to 12 years Responsibilities: -Design and build robust streaming and batch data pipelines with AWS Glue, Lambda, Kinesis Data Streams/Firehose, Amazon MSK (Kafka), and Step Functions. -Architect end-to-end systems for real-time ingestion, processing, and analytics, leveraging Kinesis, MSK, Managed Flink, EMR, and Lambda for low-latency, high-availability operations. -Implement batch ETL pipelines using Glue, EMR (Spark/Hadoop), and S3, optimizing for cost and performance while handling large-scale datasets. -Integrate source systems (IoT, logs, transactional DBs, third-party feeds) and downstream destinations...