869 Aws Glue Jobs - Page 5

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Amazon Redshift, EMR, and AWS Glue. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time. Develop complex SQL queries to optimize database performance and troubleshoot issues. Implement data security measures to ensure compliance with company policies. Participate in code reviews to improve overall quality of the software. Desired Candidate Profile 5-10 years of experience as a Data Engineer with expertise in Amazon Redshift, EMR, and AWS Glue. Strong understanding of Lambda functions and their integration with other AWS services. Proficiency in writi...

POSITION DESCRIPTION POSITION TITLE: Data Engineer LOCATION: Noida- India TOTAL YEARS: 5-7 years PERSON SPECIFICATION: Summary: Looking for a Data Engineer with 57 years of experience in designing and implementing scalable data pipelines and solutions on AWS. Must be proficient in AWS Glue, PySpark, Spark SQL, S3, and RDS, with expertise in database design, ETL development, and data integration. Hands-on experience in Master Data Management, Data Quality frameworks, and governance practices is essential, along with the ability to optimize performance and ensure data reliability at scale. Technical Skillset – Data Engineer (5–7 Years of Experience) PySpark & Spark SQL: Hands-on experience in ...

As the Lead SAP Datasphere implementations, you will be responsible for overseeing various aspects including data modeling, ETL, integration, and performance optimization. Your role will involve developing and maintaining SAC stories, dashboards, and planning models with advanced formulas & allocations. You will also be expected to handle What-If planning & scenario modeling, predictive forecasting & planning cycles, and the migration and integration of SAP BPC models into Datasphere and SAC. In addition to the above, you will provide support for monthly financial close, budgeting, and forecasting activities. You will be the point of contact for production support, troubleshooting, and deplo...

As a Principal Data Engineer at FTSE Russell, you will play a crucial role in leading the development of foundational components for a lakehouse architecture on AWS. Your primary responsibility will involve driving the migration of existing data processing workflows to the new lakehouse solution. Collaboration across the Data Engineering organization is essential as you design and implement scalable data infrastructure and processes using cutting-edge technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. Success in this role hinges on your deep technical expertise, exceptional problem-solving skills, and your ability to lead and mentor within an agile te...

You are a highly skilled Data Engineering Lead with expertise in AWS and Snowflake. Your role involves designing and delivering scalable data engineering solutions, particularly within the telecommunications industry. Your deep knowledge of end-to-end data architectures, layered data processing frameworks, and optimized data pipelines will be crucial in this position. Your responsibilities include designing, developing, and maintaining scalable data architectures and pipelines for large-scale data platforms. You will be tasked with building and optimizing Data Lakes to consolidate structured and unstructured data sources. Implementing real-time and batch data processing using Snowflake featu...

Job Title: Techno-Functional Consultant / Data Modeler BI Location: Titan Corporate limited Experience: 4+ years Job Description We are looking for a Techno-Functional Consultant / Data Modeler BI to design and build scalable data models, manage enterprise-wide data layers, and deliver high-performance Data Marts. The role involves working with large-scale business data, cross-functional teams, and modern BI/ETL tools to enable data-driven decision-making across Titan businesses. Key Responsibilities Architect layered data models (LSA / Medallion) ensuring scalability, quality & performance. Design, optimize, and maintain data dictionaries, glossaries, and ERDs. Translate business requiremen...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless architectures (AWS Lambda, API Gateway, Step Functions). Experience of AWS networking (VPC, Route 53, ELB, Security Groups, etc.). Experience with AWS CloudFormation for automating infrastructure. Proficiency in scripting languages such as Python or Bash. Experience with automation tools (AWS Systems Manager, AWS Lambda) Experience of containerization (Docker, Kubernetes...

Role & responsibilities AWS AWS Glue or Databricks Python Pyspark

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing opti...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (5+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 5+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 5+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise De...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Develop full-stack forecasting and simulation tools using React, Node.js, and Python on AWS Modernize Excel/VBA tools into scalable cloud-native web applications Deploy solutions efficiently with AWS services, CI/CD, and infrastructure-as-code tools Food allowance Annual bonus Health insurance Provident fund

You will be working at Paras Twin Tower, Gurgaon as a full-time employee for Falcon, a Series-A funded cloud-native, AI-first banking technology & processing platform. Falcon specializes in assisting banks, NBFCs, and PPIs to efficiently launch cutting-edge financial products like credit cards, credit lines on UPI, prepaid cards, fixed deposits, and loans. Since its inception in 2022, Falcon has processed over USD 1 billion in transactions, collaborated with 12 of India's top financial institutions, and generated revenue exceeding USD 15 million. The company is supported by prominent investors from Japan, the USA, and leading Indian ventures and banks. To gain more insights about Falcon, vis...

As a Senior Developer in AWS Data Engineering, you will be responsible for utilizing your expertise in AWS Glue, Spark, S3, Redshift, Python, and SQL to design, build, and optimize large-scale data pipelines on the AWS platform. This role presents an exciting opportunity to create high-performance analytics and AI-ready data platforms. Your primary responsibilities will include building and managing data pipelines using Glue, Spark, and S3. You will also be tasked with optimizing Redshift queries, schema, and performance, as well as supporting large-scale data ingestion and transformation processes. Additionally, you will integrate with upstream APIs and external platforms to ensure seamless...

NTT DATA is looking for a Data Engineer with expertise in Snowflake, AWS Glue, Kafka, and API to join the team in Bangalore, Karnataka, India. As a Data Engineer, you should have at least 6 years of experience in Data Engineering or a related role. Your responsibilities will include working hands-on with Snowflake for tasks such as data modeling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks. Proficiency in AWS Glue for ETL job development, orchestration, and optimization is essential. You should also have a strong grasp of AWS services like S3, Lambda, Redshift, Athena, Step Functions, Kinesis, and CloudWatch. Strong programming skills in Python and/or PySpa...

You will be responsible for leading the development of foundational components for a lakehouse architecture on AWS and overseeing the migration of existing data processing workflows to the new lakehouse solution. Your role will involve collaborating with the Data Engineering team to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. The primary objective of this position is to ensure a successful migration and establish robust data quality governance across the new platform to enable reliable and efficient data processing. To excel in this position, you will need to demonstrate deep...

As a Data Engineer, you will be responsible for building scalable data pipelines using PySpark. Your role will involve implementing complex business logic using Spark SQL, DataFrame, and RDD APIs. You should have strong programming skills in Python, with a solid understanding of data structures, algorithms, and software engineering principles. Your expertise in designing, developing, and maintaining batch and streaming data pipelines will be crucial. You should be familiar with ETL/ELT processes and best practices for data transformation, data quality, and performance optimization. Knowledge of the modern data engineering ecosystem, including distributed data processing, storage systems, and...

As a Senior Software Engineer at our company, you will be part of a dynamic and talented engineering team working on cutting-edge IoT and cloud technologies. You will play a crucial role in designing, developing, and maintaining scalable applications and backend services that interface with IoT gateways using MQTT, while leveraging AWS cloud services such as Lambda, Glue, Athena, and S3. Your key responsibilities will include designing, building, and maintaining scalable backend services using Node.js and Python, developing interactive front-end interfaces using React or Angular, integrating and managing IoT Gateways, designing and managing relational databases with PostgreSQL, building and ...

As an AWS Senior Data Engineer at EY, you will play a crucial role in designing, developing, and maintaining scalable data pipelines for data ingestion and processing using Python, Spark, and various AWS services. With a minimum of 5+ years of experience, you will be responsible for ensuring data quality, optimizing data storage solutions, and collaborating with cross-functional teams to deliver solutions that meet business needs. Your key responsibilities will include working with on-prem Oracle databases, batch files, and Confluent Kafka for data sourcing, implementing ETL processes using AWS Glue and EMR for batch and streaming data, and developing data storage solutions using Medallion A...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise De...

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Should have developed/Worked for atleast 1 Gen AI project. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Has good knowledge of cloud compute services and load balancing. Has good knowledg...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...