23086 Pyspark Jobs - Page 36

We are looking for a detail-oriented and experienced Senior Software Tester with 5-8 years of hands-on experience in software quality assurance and test automation. The candidate will play a crucial role in ensuring the reliability, performance, and scalability of applications developed within Country Intelligence, Site Intelligence, and ALLuminosity initiatives. This role involves manual and automated testing of web applications built on Node.js, Java Spring Boot, Python/PySpark, Azure SQL, Databricks with a focus on validating RESTful APIs and data pipelines, debugging issues, and collaborating closely with developers and business teams to deliver defect-free solutions. Requirements Test P...

About Gap Inc. Our past is full of iconic moments — but our future is going to spark many more. Our brands — Gap, Banana Republic, Old Navy and Athleta — have dressed people from all walks of life and all kinds of families, all over the world, for every occasion for more than 50 years. But we’re more than the clothes that we make. We know that business can and should be a force for good, and it’s why we work hard to make product that makes people feel good, inside and out. It’s why we’re committed to giving back to the communities where we live and work. If you're one of the super-talented who thrive on change, aren't afraid to take risks and love to make a difference, come grow with us. Abo...

Job Title: Databricks Developer Location: Remote (MNC) Experience: 4+ Years Employment Type: Full-time Aplply: sanjai@vysystems.com About the Role We are seeking a skilled Databricks Developer with hands-on experience in Apache Spark, PySpark, AWS and data engineering on the Azure Databricks platform. The ideal candidate will design and implement scalable data pipelines, optimize data processing workflows, and contribute to building robust data solutions supporting analytics and business intelligence initiatives. Key Responsibilities Design, develop, and maintain data pipelines and ETL workflows using Databricks (PySpark, SQL, Scala, or Python). Develop scalable and optimized data processing...

Job Title: Data Engineer Exp-5+yrs Location-Trivandrum, Kochi, Chennai, Pune Job Summary We are seeking a skilled Data Engineer to design, build, and maintain data pipelines and data models that support analytical and business intelligence needs. The ideal candidate will have hands-on experience with Python or SQL , Google Cloud Platform (GCP) , and a strong understanding of data management, quality, and security best practices . Key Responsibilities Build and maintain moderately complex data pipelines , ensuring data flow, transformation, and usability for analytical projects. Design and implement data models , optimizing for performance and scalability. Apply knowledge of data characterist...

🔹 Role: Data Engineer 🔹 Experience: 5 to 7 Years 🔹 Location: Thiruvananthapuram 🔹 Work Mode: Hybrid 🔹 Notice Period: Immediate Joiners Role Summary: Data Engineer Key Responsibilities 1.Develop and manage Azure Data Factory (ADF) pipelines to ingest data from legacy and cloud systems into the Data Lake. 2.Build and optimize Databricks notebooks for ingestion and curation, enabling semantic views for reporting and event streaming to messaging queues. 3.Optimize workflows for performance and cost-efficiency, including job scheduling, cluster sizing, and PySpark / SQL code tuning. 4.Develop and manage Unity Catalog objects, ensuring proper access control and data organization. 5.Ensure complian...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will engage in the development, migration, deployment, and maintenance of data-driven insights and knowledge engine interfaces. Your typical day will involve collaborating with various teams to ensure that the solutions you create drive adoption and informed decision-making while ...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will engage in the development, migration, deployment, and maintenance of data-driven insights and knowledge engine interfaces. Your typical day will involve collaborating with various teams to ensure that the solutions you create drive adoption and informed decision-making while ...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will engage in the development, migration, deployment, and maintenance of data-driven insights and knowledge engine interfaces. Your typical day will involve collaborating with various teams to ensure that the solutions you create drive adoption and informed decision-making while ...

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location : Pune Mode Of Work : Hyb...

Job Title: Senior Data Engineer Experience: 6+ Years Employment Type: Contract Location: Remote Overview We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines. The ideal candidate will have strong experience with Azure Data Factory (ADF), Azure Synapse, PySpark, and SQL, along with solid data orchestration and integration skills. DP-600 certification is mandatory. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines. Build and optimize data workflows using ADF, Synapse, and PySpark. Write and tune SQL queries for transformation and performance. Integrate and orchestrate d...

Note : Please do not apply if your salary expectations are higher than the provided Salary Range and experience less than 3 years. If you have experience with Travel Industry and worked on Hotel, Car Rental or Ferry Booking before then we can negotiate the package. Company Description Our company is involved in promoting Greece for the last 25 years through travel sites visited from all around the world with 10 million visitors per year such www.greeka.com, www.ferriesingreece.com etc Through the websites, we provide a range of travel services for a seamless holiday experience such online car rental reservations, ferry tickets, transfers, tours etc….. Role Description We are seeking a highly...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Your typical day will involve collaborating with various teams to ensure the integration of security and data privacy protection while deliveri...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Your typical day will involve collaborating with various teams to ensure the integration of security and data privacy protection while deliveri...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Your typical day will involve collaborating with various teams to ensure the integration of security and data privacy protection while deliveri...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Your typical day will involve collaborating with various teams to ensure the integration of security and data privacy protection while deliveri...

Project Role : BI Engineer Project Role Description : Develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Integrate security and data privacy protection. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a BI Engineer, you will develop, migrate, deploy, and maintain data-driven insights and knowledge engine interfaces that drive adoption and decision making. Your typical day will involve collaborating with various teams to ensure the integration of security and data privacy protection while deliveri...

Description Position Summary : We are seeking a highly skilled Azure Databricks Engineer to design, develop, and optimize large-scale data pipelines and analytical solutions on the Azure Cloud ecosystem. The ideal candidate will possess hands-on experience in Azure Databricks, Azure Data Factory (ADF), and PySpark, with a strong understanding of distributed data processing, ETL development, and data integration best practices. Key Responsibilities Data Engineering & Pipeline Development : Design, build, and maintain ETL/ELT pipelines in Azure Databricks using PySpark and Azure Data Factory, ensuring data reliability, accuracy, and performance. Data Integration Integrate and transform structu...

Description Job Description - PySpark Developer (Urgent Opening) Position : PySpark Developer Work Location : Navi Mumbai (Work from Office) Experience : 3 to 4 Years Notice Period : Immediate to 15 Days About The Role We are looking for a highly skilled PySpark Developer with strong experience in Python, SQL, and AWS cloud environments to design, build, and maintain scalable data pipelines and automation workflows. The ideal candidate should be comfortable handling large datasets, integrating APIs, and optimizing complex queries for performance. This role offers an exciting opportunity to work in a fast-paced environment with exposure to modern data platforms, AWS services, and big data too...

Description Location : Pune. Company Overview is a Global consulting company that provides technology-empowered business solutions for world-class organizations. Our Global Workforce of over 800 consultants provide best in class services to our clients to realize their digital transformation journey. Our clients span the emerging, mid-market and enterprise space. With multiple offices worldwide, we are uniquely positioned to deliver digital solutions to our clients leveraging Microsoft, Java and Open Source with a focus on Mobility, Cloud, Data Engineering and Intelligent Automation. Emtecs singular mission is to create Clients for Life long-term relationships that deliver rapid, meaningful,...

As a Lead Big Data Developer at CGI, you will play a crucial role in designing, building, and optimizing large-scale data pipelines and processing systems. Your expertise in Python, PySpark, and SQL will be instrumental in leading data initiatives, mentoring team members, and delivering high-performance data solutions. Here are your key responsibilities: - Lead the design and development of scalable, efficient, and reliable data pipelines using PySpark, Python, and SQL. - Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. - Optimize data workflows for performance, scalability, and cost efficiency ...

Description Job Title : Lead Data Engineer- contract Job Summary The Lead Data Engineer will provide technical expertise in analysis, design, development, rollout and maintenance of data integration initiatives. This role will contribute to implementation methodologies and best practices, as well as work on project teams to analyze, design, develop and deploy business intelligence / data integration solutions to support a variety of customer needs. This position oversees a team of Data Integration Consultants at various levels, ensuring their success on projects, goals, trainings and initiatives though mentoring and coaching. Provides technical expertise in needs identification, data modelli...

Role & responsibilities • A hands-on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics and distribution. • Good knowledge of data modelling and how to structure data within a data warehousing environment, while following best practice data management standards. • Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines. • Experience in real time streaming using Confluence Kafka and AWS services. • Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift and DataZo...

Position: Machine Learning Developer (5 years) Location: Remote (Company in Mumbai) Company: Big Rattle Technologies Private Limited Immediate Joiners only. Summary: The ML Developer will design, build, and maintain machine learning models and data pipelines powering core business use cases. The role is hands-on with Python for model development, feature engineering, and pipeline automation, leveraging Azure ML, and Azure DevOps. Success means robust, production-grade models with proven business impact, traceable lineage, and operational excellence at scale. Key Responsibilities: Feature Engineering & Model Development Translate model prototypes from Data Scientists into Azure ML production ...

Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. Citi’s Mission and Value Proposition explains what we do and Citi Leadership Standards explain how we do it. Our mission is to serve as a trusted partner to o...

Job Summary Snowflake Cortex Responsibilities Expert level knowledge of the Snowflake ecosystem with a focus on implementing best practices for data quality and security using native features. Proven experience in designing and building scalable high-performance data pipelines following a bronze silver gold architecture. Proficiency in ingesting diverse data types from various sources (OLTP databases APIs CSV JSON XML) using methods like OpenFlow Snowpipe Streaming Snowpark PySpark and Copy Into. Skills in developing data transformation logic in the silver layer using Dynamic Tables Tasks and Streams to cleanse conform and standardize data. Experience in curating and aggregating business-rea...