28830 Pyspark Jobs - Page 12

About The Role Project Role : Data Platform Architect Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : PySpark Good to have skills : Snowflake Data Warehouse, AWS Glue, Airflow Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Architect, you will be responsible for designing and implementing the data platform blueprint, ensuring that all components work seamlessly together. ...

About The Role Project Role : Data Platform Architect Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : PySpark Good to have skills : Snowflake Data Warehouse, AWS Glue Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Architect, you will engage in the design and implementation of a comprehensive data platform blueprint. Your typical day will involve collaborating with vari...

About The Role Project Role : Data Platform Architect Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : PySpark Good to have skills : Snowflake Data Warehouse, AWS Glue, Airflow Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Architect, you will be responsible for architecting the data platform blueprint and implementing the design, which includes various data platform comp...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in ...

Job Position Title: AWS Data Engineer_D&A_Advisory_PAN India Notice Period : Immediate to 60 days Years of experience required : 3-8 Years Location :Pan India (Bangalore & Kolkata most preferably) Responsibilities: - Design and build data pipelines & Data lakes to automate ingestion of structured and unstructured data that provide fast, optimized, and robust end-to-end solutions - Knowledge about the concepts of data lake and data warehouse - Experience working with AWS big data technologies - Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection. - Deploy and configure components to production environments Technology: Redshift, S3, A...

Warm Greetings from SP Staffing!! Role: Azure Data Engineer Experience Required :5 to 10 yrs Work Location :Hyderabad/Bangalore Required Skills, Azure Databricks Azure DataFactory Pyspark Interested candidates can send resumes to nandhini.spstaffing@gmail.com

What you will do Lead the design and execution of marketing mix models (MMM) to evaluate brand promotional effectiveness and inform investment decisions. Analyze trends across channels and campaigns to provide guidance on resource allocation and return on marketing investments. Translate complex model outputs into actionable insights and business recommendations through compelling visual and narrative storytelling. Build dashboards, PowerPoint summaries, and talking points for brand leadership and US-based commercial stakeholders. Collaborate with US brand teams, marketing, finance, and vendor partners to align on inputs, assumptions, and interpretation of results. Work hands-on in Databrick...

Role & responsibilities Design and implement ETL pipelines using PySpark and AWS Glue. Develop and optimize data processing frameworks on large-scale datasets. Work extensively with AWS services such as Glue, Lambda, ECS, S3, DynamoDB, and CloudWatch. Build and maintain data ingestion and transformation workflows. Develop and manage Python-based automation and data transformation scripts. Collaborate with cross-functional teams to ensure data availability, quality, and performance. (Good to have) Develop and integrate RESTful APIs for data access and service communication. Troubleshoot and optimize data solutions for performance and cost efficiency. Preferred candidate profile Strong profici...

About Aramya Our vision is to build some of the world's most loved fashion and lifestyle brands and enable people to express themselves. With a fast-moving team driven by creativity, technology, and customer obsession, we're building a movement that celebrates every woman's unique journey. We're well funded, with $12M raised from marquee investors like Accel, Z47, and industry veterans. Our first brand, Aramya, launched in 2024, achieved 40 Cr in revenue in its very first year, powered by a proprietary supply chain, in-house manufacturing, and data-led design. Today, we're operating at a 200 Cr ARR and scaling fast. As we expand across India, launch new stores, and roll out fresh collections...

Roles and Responsibilities Exp - 5-10 Years Location - Chennai/Bangalore/Gurgaon Design, develop, and maintain large-scale data pipelines using BigQuery, Hadoop, and PySpark on GCP. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop high-quality code in Python to process and analyze large datasets stored in BigQuery. Troubleshoot issues related to data processing, storage, and retrieval from various sources.

Databricks Engineer Job Description EXP- 6 - 10 year Role Overview The Data Engineer will be responsible for designing, building, and optimizing data pipelines and platforms to enable advanced analytics and business intelligence across the organization. This role requires strong expertise in Databricks , SQL , AWS , and Airflow , combined with a solid foundation in data analysis and engineering best practices. The ideal candidate will collaborate with cross-functional stakeholders and ensure scalable, secure, and high-performing data solutions. Location: Bengaluru Key Responsibilities Technical Design Develop, and maintain data pipelines and ETL workflows using Databricks and Airflow. Good u...

Responsibilities: * Design, develop, and maintain Azure data solutions using Databricks, Datalake, Factor, Synapse, SQL, PySpark. * Collaborate with cross-functional teams on project delivery and optimization.

Job Title: Data Engineer Experience: 59 years Location: [Remote] Job Summary: We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda), and Snowflake. The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced analytics and reporting across the organization. Key Responsibilities: Design, develop, and optimize ETL/ELT pipelines using Python, PySpark, and AWS Glue .Implement data ingestion, transformation, and integration from diverse structured and unstructured sources.Work extensively with Snowflake for data modeling, performance tuning, and query optimization.Aut...

Job Requirements Lead end-to-end technical design and implementation for cloud-based applications and data solutions. Implement secure and scalable solutions leveraging AWS best practices. Responsible for adopting new cloud services and features for cloud operations. Design and manage ETL pipelines for data ingestion and transformation. Communicate with stakeholders and build cloud applications to meet project needs. Keep cloud environments secure and prevent downtime or security breaches. Conduct Technical Reviews/ Quality reviews. Work Experience 8-12 years of experience working in AWS cloud related implementations. Proficient in developing and managing microservices using Java, Spring boo...

Primary Responsibilities: Lead applied research in LLMs, generative AI, and multimodal models Evaluate and experiment with state-of-the-art architectures (e.g., Transformers, Diffusion Models, Retrieval-Augmented Generation) Publish internal whitepapers and contribute to external conferences where applicable Engineering & Implementation Design and implement scalable AIML pipelines using frameworks like PyTorch, TensorFlow, Hugging Face, and MLflow Collaborate with engineering teams to deploy models into production using MLOps best practices (CI/CD, model versioning, monitoring) Tooling & Infrastructure Evaluate and integrate advanced AIML tools such as GitHub Copilot, Windsurf, Vertex AI, Az...

About PwC: PricewaterhouseCoopers (PwC) is a leading global consulting firm. For more than 160 years, PwC has worked to build trust in society and solve important problems for clients and the communities in which we live and work. Today we have more than 276,000 people across 157 countries working towards this goal. The US Advisory Bangalore Acceleration Center is a natural extension of our United States based consulting capabilities, providing support to a broad range of practice teams. Our US-owned ACs are fully integrated into our client facing teams and are key to PwC's success in the marketplace. Job Summary: At PwC, we are betting big on data, analytics, and a digital revolution to tra...

About PwC: PricewaterhouseCoopers (PwC) is a leading global consulting firm. For more than 160 years, PwC has worked to build trust in society and solve important problems for clients and the communities in which we live and work. Today we have more than 276,000 people across 157 countries working towards this goal. The US Advisory Bangalore Acceleration Center is a natural extension of our United States based consulting capabilities, providing support to a broad range of practice teams. Our US-owned ACs are fully integrated into our client facing teams and are key to PwC's success in the marketplace. Job Summary: At PwC, we are betting big on data, analytics, and a digital revolution to tra...

Working with Us Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the lives of patients, and the careers of those who do it. You'll get the chance to grow and thrive through opportunities uncommon in scale and scope, alongside high-achieving teams. Take your career farther than you thought possible. Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a w...

Working with Us Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the lives of patients, and the careers of those who do it. You'll get the chance to grow and thrive through opportunities uncommon in scale and scope, alongside high-achieving teams. Take your career farther than you thought possible. Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a w...

About PwC: PricewaterhouseCoopers (PwC) is a leading global consulting firm. For more than 160 years, PwC has worked to build trust in society and solve important problems for clients and the communities in which we live and work. Today we have more than 276,000 people across 157 countries working towards this goal. The US Advisory Bangalore Acceleration Center is a natural extension of our United States based consulting capabilities, providing support to a broad range of practice teams. Our US-owned ACs are fully integrated into our client facing teams and are key to PwC's success in the marketplace. Job Summary: At PwC, we are betting big on data, analytics, and a digital revolution to tra...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 1–2 years CTC: ₹3.6 LPA– ₹4.8 LPA Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using tools like Airflow, AWS Glue, Azure Data Factory, Databricks, BigQuery, and Redshift. If you enjoy architecting reliable data systems and solving complex cloud data challenges, this opportunity is for you. Key Skills Cloud Platforms: AWS, Azure Programming & Data Processing: Python (Strong) ...

Data Engineer Experience: 5-8 years Budget: 1500000 Fulltime Hybrid: Bangalore, Pune, Mumbai, Hyderabad, Noida) Hybrid: 2days work from office. Programming: Python, SQL * Frameworks: PySpark, Spark SQL * AWS Data Services: * EMR * Glue * Lambda * S3 * RDS / MySQL * Redshift * CloudWatch * Secrets Manager * Experience with distributed computing, data modeling, schema handling, and performance tuning. * Strong debugging and problem-solving skills." Job Type: Full-time Pay: ₹1,400,000.00 - ₹1,500,000.00 per year Work Location: Hybrid remote in Pune, Maharashtra

Must Have Skills Palantir Foundry (2+ years) Code Transforms, Ontology Management, Health Monitoring, Actions & Functions Python, PySpark, SQL JavaScript, TypeScript, basic HTML/CSS PyTest (nice to have) Data visualization & representation Strong communication and problem-solving skills Experience working in Agile (Scrum/Kanban/XP) Life at CGI It is rooted in ownership, teamwork, respect and belonging Here, youll reach your full potential because You are invited to be an owner from day 1 as we work together to bring our Dream to life Thats why we call ourselves CGI Partners rather than employees We benefit from our collective success and actively shape our companys strategy and direction You...

Define, Design, and Build an optimal data pipeline architecture to collect data from a variety of sources, cleanse, and organize data in SQL & NoSQL destinations (ELT & ETL Processes). Define and Build business use case-specific data models that can be consumed by Data Scientists and Data Analysts to conduct discovery and drive business insights and patterns. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ tec...

Company Description The Bosch Group is a leading global supplier of technology and services, in the areas of Automotive Technology, Industrial Technology, Consumer Goods, Energy and Building Technology. In India, the Group operates through nine companies with a combined strength of over 30,000 associates which includes around 14,000 research and development associates. Bosch Automotive Electronics India Pvt. Ltd. (RBAI) is a 100% subsidiary of Robert Bosch GmbH. RBAI was established at the right time to cater to the demands of future Indian market. Established in 2009, started out with manufacturing Electronic Control Units. On an average adding one new product every year, Antenna and Immobi...