1847 Aws Glue Jobs - Page 38

ReQ AWS Data Engineer Location: Hyderabad / Bangalore Experience: 5yrs 15 yrs Mode: Contract to Hire - (Intially 3-6 months Shell Infotech payroll after that you will be Perm with client) *****Pls send me your resume along Photo Graph and PAN Number is mandatory for client Submittal***** ****************** Need resource who can join in Immediatley/ 15 days****************** JD Below Strong experience with: AWS Glue - Python, Big Data – Pyspark, Control-M – ETL Batch job implementation stack Kinesis, Kafka, SNS – Real time message processing AWS Aurora, Dynamo, S3 – Data Storage AWS IAM, Cloud formation, Bamboo – Infra as code and CI/CD Lambda, Step function – Orchestration Kindly share your ...

Shift time-UK Shift time Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure Synapse Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key Responsibilities Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources. Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue. Collaborate with domain experts in genomics, clinical trials, and lab science to understand and implement robust data solutions. Develop and maintain data models, schemas, and governance practices for structured and unstructured biomedical data. Implement ...

Job Purpose and Impact The Professional, Trading Engineering job maintains and partners to design and develop software applications and systems that drive the trading operations. With limited supervision, this job participates in co-creation and maintenance of sophisticated software applications vital to our trading activities, collaboration with cross functional teams to conceptualize, design and implement new software features that meet user needs and advance our business objectives, including upgrading existing software by writing clean, efficient and scalable code to improve performance and functionality, and identifying and resolving issues promptly to ensure the seamless operation of t...

World Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others, but also include emerging tech players. WWT employs more than 10,000 people and operates in more than 2 million square feet of state-of-the-art warehousing, distribution and integration space strategically located throughout the world. WWT ranks Glassdoors Best Places to Work and has been on Fortune’s 100 Best Companies to Work For list 1...

Primary Responsibilities: Responsible for large and more complex components, while influencing overall Data architecture and patterns Implements component design in line with pre-defined team architectural patterns Creates design documents, for larger component work to gain alignment Delivers designs aligning to appropriate componentized architectures and integration patterns Can work autonomously Influences the team designs and solutions. Mentors software engineers through code reviews, and hands-on design sessions Code reviews are appropriately broken down in to reviewable chunks Contributes meaningfully to code reviews of teams work, providing collaborative guidance in areas of strength C...

Who we are: CloudifyOps is a technology consulting and services company that specializes in cloud computing, DevOps, and digital transformation. We help businesses modernize their IT infrastructure, optimize cloud operations, and accelerate software delivery through automation and best practices. Culture at CloudifyOps: Working with CloudifyOps is a rewarding experience. Great people, a work environment that thrives on creativity, and the opportunity to take on roles beyond a defined job description are just some of the reasons you should work with us. Role Overview: Seeking an experienced AWS Engineer who can lead solution architecture and hands-on development for projects involving large-s...

Role & responsibilities We are seeking a highly skilled AWS Data Engineer with 68 years of experience in designing, building, and optimizing scalable data pipelines and cloud-based data platforms. The ideal candidate will have deep expertise in AWS native services, data modeling, ETL/ELT processes, and hands-on experience in enabling analytics solutions. You will collaborate with cross-functional teams including data architects, analysts, and business stakeholders to deliver high-performance, secure, and reliable data solutions. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using AWS services (Glue, EMR, Lambda, Step Functions, etc.). Build ...

In this role as a Senior Associate at PwC, you will be working as part of a team of problem solvers, assisting in solving complex business issues from strategy to execution. Your responsibilities as a PwC Professional at this management level will include: - Using feedback and reflection to develop self-awareness, personal strengths, and address development areas. - Delegating tasks to others to provide stretch opportunities and coaching them to deliver results. - Demonstrating critical thinking and the ability to bring order to unstructured problems. - Utilizing a broad range of tools and techniques to extract insights from current industry or sector trends. - Reviewing your work and that o...

As a Software Development Partner for a large enterprise financial products and services firm listed on NYSE, your main task will involve re-architecting and migrating 30-year legacy systems to cloud-based microservices on AWS. The application you will be working on is crucial for their trading, journal, and bookkeeping platforms. Your responsibilities will include: - Developing an event-driven ETL pipeline using AWS services to transfer end-of-day securities data from the mainframe to a relational database. - Building highly resilient and available containerized microservices. - Automating build and deployment processes using Jenkins and Terraform for various environments such as Sandbox, D...

Role Overview: As a Database Designer / Senior Data Engineer at VE3, your primary responsibility will be to architect and design modern, scalable data platforms on AWS and/or Azure. You will ensure the implementation of best practices for security, cost optimization, and performance. Your tasks will involve developing detailed data models, documenting data dictionaries, and lineage to support data solutions. Moreover, you will be involved in building and optimizing ETL/ELT pipelines using languages such as Python, SQL, Scala, and services like AWS Glue, Azure Data Factory, Spark, and Airflow. Key Responsibilities: - Collaborate closely with data analysts, BI teams, and stakeholders to transl...

As an experienced AWS Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using AWS services. Your role will involve working with big data technologies, modern ETL tools, and cloud-native platforms to deliver efficient, secure, and high-performing data solutions. Key Responsibilities: - Build and optimize scalable data pipelines using AWS Glue, Redshift, and Lambda. - Develop ETL/ELT workflows using Python, PySpark, and Spark. - Integrate diverse data sources into centralized data platforms. - Design and maintain data models, warehouse solutions, and schemas. - Ensure performance tuning, data quality, and security best pract...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

CACI International Inc is an American multinational professional services and information technology company headquartered in Northern Virginia. CACI provides expertise and technology to enterprise and mission customers in support of national security missions and government transformation for defense, intelligence, and civilian customers. CACI has approximately 23,000 employees worldwide. Headquartered in London, CACI Ltd is a wholly owned subsidiary of CACI International Inc., a publicly listed company on the NYSE with annual revenue in excess of US $6.2bn. Founded in 2022, CACI India is an exciting, growing and progressive business unit of CACI Ltd. CACI Ltd currently has over 2000 intell...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore). Location: Gurgaon/Bengaluru Work Mode: Hybrid (2-3 days office in a week) Full time Job Description: 5-14 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience w...

Req ID: 340487 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). 6+ years of experience in Data Engineering or related role. Hands-on experience with Snowflake (data modelling, performance tuning, query optimization, Snowpipe, Time Travel, Streams & Tasks). Strong expertise in AWS Glue for ETL job development, orchestration, and optimization. Proficiency with AWS services such as S3, Lambda, Redshift, Athena, Step Functions, Kinesis , and CloudW...

Position Summary The Security Technology Engineering team is responsible for collaborating and partnering with various Business Units (BUs) and stakeholders across the organization to manage external and insider threat detection, mitigation, investigation and response efforts across the organization. The Sr.Info Security Engineer will participate in the activities of a global, expert team that develops robust technical solutions and advanced analytics to enable preventive threat detection efforts. KEY RESPONSIBILITIES AND DUTIES The cloud security engineer works with our Cyber Engineering, Operations, Architecture and Global Infrastructure teams to deploy and operate a secure cloud applicati...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in proble...

About The Role Project Role : Software Configuration Engineer Project Role Description : Implement the configuration management plan as directed by the Configuration Lead. Assist in the design of software configuration and customization to meet the business process design and application requirements. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs,...

About The Role Project Role : Software Configuration Engineer Project Role Description : Implement the configuration management plan as directed by the Configuration Lead. Assist in the design of software configuration and customization to meet the business process design and application requirements. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs,...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand projec...