6357 Redshift Jobs - Page 42

As an ETL Automation Test Engineer with expertise in Python development, ETL testing, and CI/CD implementation, you will play a crucial role in automating manual ETL processes using Python scripting. Your primary focus will be on designing, developing, and executing ETL test cases and scripts to ensure the validation of data pipelines. You will be responsible for performing data validation, reconciliation, and integrity checks across various source and target systems. Your role will involve implementing Python-based test automation frameworks for ETL workflows and integrating automated ETL tests into CI/CD pipelines to facilitate seamless deployments. You will collaborate closely with Data E...

As a senior software engineer at our company, you will have the opportunity to work with cutting-edge technologies to design and build high-performance and scalable products in the AWS Cloud environment. Your responsibilities will include developing solutions and components using JavaScript frameworks, Python, and various AWS technologies such as Redshift, Aurora, and Glue for enterprise-scale multi-user applications. To qualify for this role, you should have a Bachelor's degree in Math, EE, CS, or Software Engineering, with a Master's degree being preferred. You should also have at least 5 years of hands-on experience in developing commercial-grade software products and a minimum of 3 years...

You have an exciting opportunity as an Associate Technical Architect-AWS with 8-10 years of experience. As an Associate Technical Architect-AWS, you will be responsible for working with AWS Architect, AWS Glue or Databricks, PySpark, and Python. Your role will involve hands-on experience with AWS Glue or Databricks, PySpark, and Python, with a minimum of 2 years of expertise in PySpark and AWS Cloud. Additionally, you will be expected to have hands-on experience in StepFunction, Lambda, S3, Secret Manager, Snowflake/Redshift, RDS, Cloudwatch, and proficiency in crafting low-level designs for data warehousing solutions on AWS cloud. Your proven track record in implementing big-data solutions ...

About Delta Tech Hub: At Delta Air Lines, we are the global leader in safety, innovation, reliability, and customer experience. Our dedicated employees have been instrumental in maintaining our position as an industry leader for over a decade. We are committed to connecting people and cultures worldwide, fostering understanding, and contributing to social good. The Delta Technology Hub plays a crucial role in achieving our long-term goals by delivering innovative and high-value solutions, supporting various teams and functions across Delta, and enhancing customer experiences globally. The Customer Experience (CX) organization is focused on providing exceptional service that embodies the Delt...

As a Data Engineer, you will be responsible for designing and implementing data pipelines using various AWS services including S3, Glue, PySpark, and EMR. Your role will involve optimizing data storage and retrieval through AWS database services such as RDS, Redshift, and DynamoDB. Building different data warehousing layers to cater to specific use cases will be a key aspect of your responsibilities. Your expertise in SQL and strong understanding of ETL processes and data modeling will be essential in ensuring the accuracy and availability of data to customers. You will also need to comprehend how technical decisions can impact business analytics and reporting for our clients. Experience wit...

We are seeking an experienced Scala and Databricks Developer with a strong background in constructing data solutions on AWS. As the ideal candidate, you will possess hands-on expertise in crafting data pipelines, enhancing big data solutions, and enforcing best practices utilizing Scala, Databricks, and various AWS services. Your pivotal role will involve designing and delivering scalable, dependable, and high-performance data solutions to meet our business objectives effectively. Your responsibilities will encompass collaborating with data architects and analysts to devise and implement data models and processing frameworks. You will be tasked with optimizing the performance of data workflo...

We are seeking an Full Stack Developer (Associate Consultant) to join our India team based in Gurgaon. This role at Viscadia offers a unique opportunity to gain hands-on experience in the healthcare industry, with comprehensive training in core consulting skills such as critical thinking, market analysis, and executive communication. Through project work and direct mentorship, you will develop a deep understanding of healthcare business dynamics and build a strong foundation for a successful consulting career. ROLES AND RESPONSIBILITIES Technical Responsibilities Design and build full-stack forecasting and simulation platforms using modern web technologies (e.g., React, Node.js, Python) host...

Working Hours : Full Time Locations : Hyderabad Experience : 4 –6 years apply now apply now About The Role Soothsayer Analytics is a global AI & Data Science consultancy headquartered in Detroit, with a thriving delivery center in Hyderabad. We design and deploy end-to-end custom Machine Learning & GenAI solutions—spanning predictive analytics, optimization, NLP, and enterprise-scale AI platforms—that help leading enterprises forecast, automate, and gain a competitive edge. As a Data Engineer, you will build the foundation that powers these AI systems—scalable, secure, and high-performance data pipelines. Job Overview We seek a Data Engineer (Mid-level) with 4–6 years of hands-on experience ...

Key Responsibilities Design, develop, and maintain ETL/ELT pipelines for data extraction, transformation, and loading from diverse sources. Perform complex SQL development including queries, stored procedures, and performance tuning on MS SQL and other relational databases. Implement data modeling and schema design for data warehousing and reporting solutions. Work on API integrations including token-based authentication. Optimize and troubleshoot ETL processes for performance, scalability, and reliability. Develop reusable data integration interfaces and automate processes using scripting (Unix shell..etc). Ensure data quality, integrity, and security across systems. Collaborate with cross-...

You Are passionate about technology, wake up every morning to experiment, learn and develop new solutions! About Us At DBSync we provide the opportunity to use technology that creates innovative and next generation data integration products which helps our employees to cultivate their creativity and sense of belonging. DBSync is a leading provider for data integration and Data warehousing services for both cloud/SAAS-based-on-demand applications. We were incubated by Salesforce.com (as a part of Avankia), before getting spinned off as a separate company. DBSync provides data integration as a SAAS-based, Standalone or hosted integration at a competitive price with a plethora of benefits for b...

We seek a Data Engineer (Mid-level) with 46 years of hands-on experience in designing, building, and optimizing data pipelines. You will work closely with AI/ML teams to ensure data availability, quality, and performance for analytics and GenAI use cases.Key Responsibilities 1. Data Pipeline Development Build and maintain scalable ETL/ELT pipelines for structured and unstructured data. Ingest data from diverse sources (APIs, streaming, batch systems). 2. Data Modeling & Warehousing Design efficient data models to support analytics and AI workloads. Develop and optimize data warehouses/lakes using Redshift, BigQuery, Snowflake, or Delta Lake. 3. Big Data & Streaming Work with distributed syst...

We seek a Data Engineer (Mid-level) with 4-6 years of hands-on experience in designing, building, and optimizing data pipelines. You will work closely with AI/ML teams to ensure data availability, quality, and performance for analytics and GenAI use cases.Key Responsibilities 1. Data Pipeline Development Build and maintain scalable ETL/ELT pipelines for structured and unstructured data. Ingest data from diverse sources (APIs, streaming, batch systems). 2. Data Modeling & Warehousing Design efficient data models to support analytics and AI workloads. Develop and optimize data warehouses/lakes using Redshift, BigQuery, Snowflake, or Delta Lake. 3. Big Data & Streaming Work with distributed sys...

About The Role We are looking for an experienced Data Engineer with strong expertise in building and maintaining robust data pipelines, optimizing data workflows, and ensuring the availability of high-quality data for business insights and real-time systems (RTS). The ideal candidate will have hands-on experience with modern data engineering tools, cloud platforms, and big data ecosystems. Requirements Key Responsibilities Design, build, and maintain scalable data pipelines and ETL/ELT processes. Work with structured and unstructured datasets to ensure data quality, accuracy, and availability. Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets ...

Description As we strive to be Earth's most customer-centric company, Amazon has reinvented how hundreds of millions of people shop online – providing customers with the opportunity to find and discover virtually anything they want to buy and providing millions of sellers with a platform for growing successful businesses. We are looking for an exceptional data engineer to help us develop new ways to build trust and loyalty with sellers, a crucial component of our flywheel Sellers’ trust in Amazon is our top priority and in this role, you will be tasked with building that trust over time by building and maintaining the data sources that power all of our decision making. Amazon’s growth requir...

Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks job...

Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks job...

Description Amazon is seeking a candidate to identify, develop and integrate innovative solutions and programs that lead to improvements that redefine the standards for customer experience in our North American Transportation Network. Amazon transportation encompasses all of the operations that deliver shipments from our fulfillment centers and third party locations to customers worldwide. TESS team in Hyderabad is looking for an innovative, hands-on and customer-obsessed BIE for it's Analytics team. Candidate must be detail oriented, have superior verbal and written communication skills, strong organizational skills, excellent technical skills and should be able to juggle multiple tasks at ...

Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks job...

Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks job...

Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks job...

Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks job...

DESCRIPTION At AWS, we are looking for a Delivery Practice Manager with a successful record of leading enterprise customers through a variety of transformative projects involving IT Strategy, distributed architecture, and hybrid cloud operations. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and ...

IMEA (India, Middle East, Africa) India LIXIL INDIA PVT LTD Employee Assignment Fully remote possible Full Time 1 May 2025 Title Data Engineer Job Description A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure. Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository. Build and Maintain Data Infrastructure: Des...

DESCRIPTION When you attract people who have the DNA of pioneers and the DNA of explorers, you build a company of like-minded people who want to invent. And that’s what they think about when they get up in the morning: how are we going to work backwards from customers and build a great service or a great product” – Jeff Bezos Amazon.com’s success is built on a foundation of customer obsession. Have you ever thought about what it takes to successfully deliver millions of packages to Amazon customers seamlessly every day like a clock work? In order to make that happen, behind those millions of packages, billions of decision gets made by machines and humans. What is the accuracy of customer pro...

💻 Position: Principal Data Architect 📍Location: Delhi 🗓️ Working Days: Monday- Friday (WFO) 📌 Experience Required: 10+ years 💸 Salary: Upto 85 LPA Overview : As a Principal Data Architect, you will be responsible for leading the design, development, and scaling of our data infrastructure. You will collaborate with product managers, data scientists, and engineers to ensure our data pipelines and architectures are robust, scalable, and aligned with business objectives. The role requires a strong background in backend development, data processing, and scalable architecture design. Key Responsibilities: Lead and mentor a team of data engineers, ensuring high performance and career growth. Archit...