1330 Aws Glue Jobs - Page 3

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

You will be working as an experienced ETL & Data Warehouse Developer at Kogta Financial Ltd, utilizing AWS services to design, develop, and optimize ETL processes and data warehousing solutions on the AWS platform. Your responsibilities will include: - Designing, developing, and implementing robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed. - Ensuring efficient extraction, transformation, and loading of data from diverse sources into the data warehouse. - Designing and maintaining data warehouse solutions on AWS, focusing on scalability, performance, and reliability. - Implementing and optimizing data models for efficient storage and retrieval in AWS Redshi...

Job Summary: We are seeking a highly skilled Database Software Engineer with 4-5 years of experience to join our team. The successful candidate will be responsible for designing, developing, and maintaining our database systems and ETL pipelines, ensuring high performance, scalability, and reliability. The Database Software Engineer will work closely with our development team to ensure that our database systems meet the requirements of our applications and services. Key Responsibilities: Database Design and Development: Design and develop database architectures to support business requirements Develop and maintain database models, including entity-relationship diagrams and schema definitions...

AWS Glue Data Engineer Mandatory Skills: AWS Glue, Glue, DBT, Pyspark, Atlan, Data catlouge We are seeking an experienced Senior Data Engineer with 6+ years of strong expertise in building and optimizing large-scale data pipelines using AWS Glue. The ideal candidate will have deep knowledge of AWS Glue Data Catalogue, AWS Glue Data Quality, and Data Quality Frameworks (AWS DQ), combined with hands-on experience in Python, PySpark, and PyDQ. This role requires a strategic thinker capable of leading data quality initiatives and ensuring robust data governance across complex data ecosystems. Key Responsibilities: Lead the design, development, and optimization of scalable ETL pipelines using AWS...

Your role at KPMG in India will involve the following: **Role Overview:** KPMG entities in India operate as professional services firms affiliated with KPMG International Limited. Established in August 1993, we leverage a global network of firms and possess in-depth knowledge of local laws, regulations, markets, and competition. With offices located across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, we offer services to national and international clients across various sectors. Our aim is to deliver rapid, performance-based, industry-focused, and technology-enabled services that demons...

As a Data Pipeline Developer (L1 Data Ops Analyst) at UST, your role will involve developing and maintaining data pipelines for ingesting, wrangling, transforming, and joining data from multiple sources. You will work independently to deliver high-quality code and ensure seamless operation of data systems. Proficiency in ETL tools such as Informatica, Glue, Databricks, and DataProc, along with strong coding skills in Python, PySpark, and SQL, will be essential. Operating with minimal supervision while adhering to established processes and guidelines is a key aspect of this position. **Key Responsibilities:** - Independently develop, test, and maintain data processing pipelines ensuring perfo...

As a Software Developer at FIS, you will be responsible for developing core versions of software applications for sale to external clients. Your key responsibilities will include: - Identifying client purchasing requirements and technical specifications through Product Management and/or client representatives - Interacting with engineering groups to assist in design changes to equipment and/or software - Training and communicating with clients on systems application To excel in this role, you must possess the following skills: - Proficiency with ETL (e.g., Informatica PowerCenter) and awareness of Informatica Intelligent Cloud Services (IICS) - Extensive SQL skills and familiarity with platf...

Job Position Title: AWS Data Engineer Location : Pan India Years of experience: 4 to 8 Years Responsibilities: - Design and build data pipelines & Data lakes to automate ingestion of structured and unstructured data that provide fast, optimized, and robust end-to-end solutions. - Knowledge about the concepts of data lake and data warehouse. - Experience working with AWS big data technologies Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection. - Deploy and configure components to production environments Mandatory skill sets: Redshift, S3, AWS Glue, Lambda, SQL, PySpark, SQL Preferred skill sets: Redshift, S3, AWS Glue, Lambda, SQL, ...

Job Position Title: AWS Data Architect Location : Pan India Years of experience : 8 to 12 years Responsibilities: -Design and build robust streaming and batch data pipelines with AWS Glue, Lambda, Kinesis Data Streams/Firehose, Amazon MSK (Kafka), and Step Functions. -Architect end-to-end systems for real-time ingestion, processing, and analytics, leveraging Kinesis, MSK, Managed Flink, EMR, and Lambda for low-latency, high-availability operations. -Implement batch ETL pipelines using Glue, EMR (Spark/Hadoop), and S3, optimizing for cost and performance while handling large-scale datasets. -Integrate source systems (IoT, logs, transactional DBs, third-party feeds) and downstream destinations...

As a Consultant & Senior Consultant in our Consulting team, you ll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations. You ll: We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages. Key Responsibilities: 1. Design and implement scalable, high-performance data pipelines using AWS services 2. Develop and optimize ETL processes using AWS Glue, EMR, and Lambda 3. Build and maintain data lakes using S3 and Delta Lake ...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill : AWS Data Engineer Exp range: 6 yrs to 10 yrs Location : Chennai/Hyderbad/ Kochi/Kolkata//Pune Notice period : Less than 30 Pls find the Job Description below. Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud,Talend etc Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models. Expertise with Python Language and Apache Spark. Have working experience in projects involving these. Strong hands on exposure to AWS Analytics services particulary Lambda,Step functions, Athena, Glue, Data-Pipelines • Unde...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your day will involve overseeing the application development process and ensuring seamless communication among team members and stakeholders. Roles & Responsibilities: Expected to be an SME Collaborate and manage the team to pe...

Administer and optimize AWS Data Lake infrastructure using services like S3, Lake Formation, Glue, Athena, and Redshift , ensuring secure, scalable, and efficient operations. Design and manage ETL workflows with AWS Glue and Step Functions , enabling seamless data ingestion, transformation, and cataloging. Implement access controls and data governance using Lake Formation, IAM policies, and resource tagging to ensure compliance and data security. Use SQL and automation scripts for data validation, performance tuning, and supporting analytics teams with curated, query-ready datasets.

Role Description : As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models. Key Responsibilities : - Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake - Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models - Optimize data pipelines for performance, scalability, and reliability using tools li...

AIA-Pune Job Summary We are seeking a skilled Developer with 4 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Amazon RDS AWS Glue AWS DevOps and other AWS technologies. This role involves working with big data and requires proficiency in Python and Apache Spark. Experience in regulatory and process control is a plus. Responsibilities Develop and maintain scalable data processing systems using Amazon RDS AWS Glue and AWS DevOps to ensure efficient data management and processing. Collaborate with cross-functional teams to design and implement data solutions that meet business requirements and enhance operational efficiency. Utilize ...

Role & responsibilities Python developer/ analyst to deliver enhancements to Trading ACDC application. Understanding of timeseries data & valuations Understanding of Extract / Transform / Load principles Amazon Web Services Glue Knowledge of DBB and snowflake Database skills (ability to create new database tables, add / remove columns, run SQL scripts etc) Python code specifically py spark Ability to debug python, setup local debug sessions / mock components in the cloud Analyse and evaluate data independently Create technicnical documentation and manuals Conduct software tests and ensure quality assurance Develop customised software solutions Provide guidance on implementing requirements (e...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS Glue Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your day will involve overseeing the application development process and ensuring seamless communication among team members and stakeholders. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Respons...

Job Title: AWS Data Engineer Exp Range: 5 -12 Years Job Location: Bangalore, Bhubaneswar, or Hyderabad Looking for Healthcare, Pharma or Life science domain. Job Description: Bachelors degree in engineering , Technology computer science, statistics, biostatistics, mathematics, biology or other health related field or equivalent experience that provides the skills and knowledge necessary to perform the job. Experience in data engineering, building data pipelines to manage heterogenous data ingestions or similar in data integration across multiple sources including collected data. Experience with Python/R, SQL, NoSQL Cloud experience (i.e., AWS, AZURE, or GCP) Experience with GitLab, GitHub Ex...

Hi, Greetings from NewVision Software!! We are hiring on an immediate basis for the role of Senior Data Engineer - AWS | NewVision Software | Pune, Hyderabad & Bhopal Location | Fulltime Looking for professionals who can join us Immediately or within 7 days is preferred. Please find the job details and description below. NewVision Software PUNE HQ OFFICE 701 &702, Pentagon Tower, P1, Magarpatta City, Hadapsar, Pune, Maharashtra - 411028, India NewVision Software The Hive Corporate Capital, Financial District, Nanakaramguda, Telangana - 500032 NewVision Software IT Plaza, E-8, Bawadiya Kalan Main Rd, near Aura Mall, Gulmohar, Fortune Pride, Shahpura, Bhopal, Madhya Pradesh - 462039 Job Descri...

Role Description Design, develop, and optimize data pipelines to extract, transform, and load (ETL/ELT) data from a variety of sources. Build and manage data models and data warehouses that support business intelligence, reporting, and analytics needs. Leverage cloud technologies such as AWS, Azure, or Google Cloud Platform for building scalable, reliable, and efficient data solutions. Develop and maintain automated data workflows using tools like Airflow, AWS Glue, Azure Data Factory, or similar technologies. Work with large datasets and complex data structures, ensuring data quality, integrity, and performance. Write and optimize SQL queries for complex data extraction, aggregation, and tr...

We are looking for a Senior Software Engineer to join our Technology team at Clarivate. He/She would be responsible for the Dev team deliverables. This would be an amazing opportunity to work in L & H domain. We are working on different tools and technologies like Java, Springboot, Resttemplate, Postgres SQL, Redshift, junit , JDBC Template , AWS Glue jobs and gradle. About You experience, education, skills, and accomplishments: Bachelors degree in engineering or masters degree (BE, ME, B Tech, MTech, MCA, MS) At least 2 years of experience in Back end APIs development. Clear understanding of Agile development approaches Have worked and significantly contributed to automation using build pip...

Experian UK&I Business information division is looking for an accomplished Senior Data Engineer to join our dynamic team. You will develop data engineering applications and scalable data platforms. You will collaborate closely with teams to implement solutions that create value. Key Responsibilities: Design, build, and maintain scalable, cloud-native data pipelines using AWS. Develop ETL/ELT workflows using Glue, Pyspark , and Python Improve data modeling, partitioning, and querying strategies Experience reading and developing Terraform-based infrastructure code Qualifications Bachelor's degree in computer science, Engineering 5 to 7 years of experience in data engineering. Strong expertise ...

What Youll Do Design and implement technical features leveraging best practices for technology stack being used Collaborate with client-facing teams to understand solution context and contribute to technical requirement gathering and analysis Work with technical architects on the team to validate design and implementation approach Write production-ready code that is easily testable, understood by other developers, and accounts for edge cases and errors Ensure the highest quality of deliverables by following architecture/design guidelines, coding best practices, periodic design/code reviews Write unit tests as well as higher-level tests to handle expected edge cases and errors gracefully, as ...