26274 Pyspark Jobs - Page 29

Roles and Responsibilities: Develop and maintain Pyspark/Scala pipelines, implement ETL workflows, manage cloud (GCP/Azure) data solutions, work on Snowflake/Informatica MDM, and deliver Python/ML projects efficiently Office cab/shuttle Health insurance Annual bonus Provident fund

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Delhi, Pune About Tredence : Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the...

Architect & Design: Lead the design of data solutions on AWS, selecting the optimal services for data processing (EMR, Glue, EMR Serverless, Lambda), storage (Cassandra, Elasticsearch), and messaging (Kafka, SNS/SES). Build Data Pipelines: Develop, test, and deploy high-quality, scalable data pipelines using PySpark and Scala for both batch and real-time streaming applications. Manage Data Stores: Engineer and optimize OLTP data persistence layer utilizing Cassandra for high-throughput operational workloads and Elasticsearch for search and analytics needs. Implement Streaming Solutions: Build and maintain real-time data backbone using Apache Kafka for event streaming and AWS SNS/SES for asyn...

About Chubb Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: www.chubb.com . About Chubb India...

About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Inno...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Manager Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be part of a v...

Position : AWS Data Engineer Location : Hyderabad, Pune Duration : Fulltime Mandatory Skills: Very strong on Python, Pyspark, AWS, Glue Must Have: Coding: Proficiency in Python Cluster Computing frameworks: Proficiency in Spark and Spark SQL AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions + Event Bridge AWS Data Security: Good Understanding of security concepts such as: Lake formation, IAM, Service roles, Encryption, KMS, Secrets Manager Job Type: Full-time Work Location: In person

Role-Azure Data Engineer Exp- 5 to 10 years Job Description: Experience in data engineering Strong programming skills in PySpark, Python, and Scala. experience in Scala backend development. Proficient in Scala, both object oriented and functional programming concepts. Solid understanding of data lakes, lakehouses, and Delta Lake concepts. Experience in SQL development and performance tuning. Proficient in cloud services (e.g. S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM). Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline. Develop and maintain scalable data pipelines using Apache Spark on Databricks. Build end-to-end ETL/ELT pipelines on AWS/GCP/Azure using services...

Key Responsibilities: Key Responsibilities Design develop and deploy solutions using Microsoft Fabric components Data Engineer and Power BI and SQL Collaborate with business stakeholders to gather requirements and translate them into technical solutions Create interactive dashboards and reports using Power BI Experience in designing implementing and supporting Data Warehousing and Business Intelligence solutions on Microsoft Fabric data pipelinesBuild custom applications using Power Apps to support business needs Design and implement scalable and efficient data pipelines using Azure Data Factory Pyspark notebooks Spark SQL and Python This includes data ingestion data transformation and data ...

Role: Snowflake Developer Location: Bangalore Mode: Hybrid Type: Contract Job Desccription: Minimum 6 – 10 years of work experience with at least two projects implementation leveraging Snowflake - either migration from traditional DWHs or a fresh implementation Expert-level knowledge in SQL, SnowSQL, query optimization, performance tuning etc. Data Modelling: Knowledge of data modeling principles and techniques. Solid work experience in AWS/ AZURE cloud platforms Expertise in Snowflake concepts like setting up Data Masking, Tagging, SnowPipe, RBAC controls, virtual warehouse sizing, zero copy clone, data sharing, Snow pipe, Streams &Tasks, Time travel, Secure Data sharing, DMF, iceberg table...

We are seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and solutions in a cloud environment. This individual contributor role requires strong expertise in AWS services (IAM, EMR Serverless, Glue, Athena), advanced PySpark skills, and a solid understanding of data warehousing techniques. The ideal candidate will have experience in modern ETL frameworks and cloud-native data engineering practices. Familiarity with visualization tools like Power BI is a plus but not mandatory. You will work on building robust, secure, and high-performance data platforms that enable analytics and business intelligence across the organization. Key Responsibilities Interpretin...

We are seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and solutions in a cloud environment. This individual contributor role requires strong expertise in AWS services (IAM, EMR Serverless, Glue, Athena), advanced PySpark skills, and a solid understanding of data warehousing techniques. The ideal candidate will have experience in modern ETL frameworks and cloud-native data engineering practices. Familiarity with visualization tools like Power BI is a plus but not mandatory. You will work on building robust, secure, and high-performance data platforms that enable analytics and business intelligence across the organization. Key Responsibilities Design and ...

Manager/Senior Manager - Data Engineering (8-12 Years) Cognitio Analytics | Gurgaon (Hybrid) Location: Gurgaon (Hybrid) Experience: 8–12 years Website: www.cognitioanalytics.com Employment Type: Full-Time About Cognitio Analytics: Founded in 2013, Cognitio Analytics is a leading provider of AI/ML-driven productivity solutions for large enterprises. We have been recognized for our award-winning Smart Operations and Total Rewards Analytics solutions, built on deep R&D and a commitment to innovation. Our solutions help clients transform complex operations such as claims processing and commercial underwriting, and maximize ROI on Total Rewards programs through our proprietary Total Rewards Data ...

Inviting Applications for Azure Devops Engineer Job description: Job Title: AWS Data Engineer/Python Location: Chennai Experience Range: 5-10 yrs JD: Good hands on experience in Python programming and Pyspark · Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow Location Chennai Job Function IT INFRASTRUCTURE SERVICES Role Developer Job Id 384630 Desired Skills AWS | Python Desired Candidate Profile Qualifications : BACHELOR OF ENGINEERING

Job Title: Data Platforms Engineer (Data Warehouse) Location: Remote Shift: UK Timings Employment Type: Full-Time and Freelancing About the Role: We are looking for a Data Platforms Engineer (Data Warehouse) to join our data engineering team. The ideal candidate will have strong experience in building, maintaining, and optimizing data warehouse platforms using modern cloud technologies. You will be responsible for designing scalable data models, developing robust data pipelines, and ensuring smooth data operations including L3 production support. Key Responsibilities: Design, develop, and maintain end-to-end data warehouse solutions. Build and manage ETL/ELT pipelines using dbt and Airflow ....

Metyis is a Netherlands based fast-growing international company with a diverse team of over 700+ professionals with a mix of Analytics, Data Science and Technology Team. We are looking for an experienced Data Engineer to join our team with below requirements: Responsibilities: Independently execute data engineering projects Diagnose problems, disaggregate issues, develop hypotheses and execute relevant solutions Undertake processing of structured and unstructured data Undertake work related to ELT activities Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact with clients at the...

Note : Please do not apply if your salary expectations are higher than the provided Salary Range and experience less than 3 years. If you have experience with Travel Industry and worked on Hotel, Car Rental or Ferry Booking before then we can negotiate the package. Company Description Our company is involved in promoting Greece for the last 25 years through travel sites visited from all around the world with 10 million visitors per year such www.greeka.com, www.ferriesingreece.com etc Through the websites, we provide a range of travel services for a seamless holiday experience such online car rental reservations, ferry tickets, transfers, tours etc….. Role Description We are seeking a highly...

Python/Pyspark, Bigquery with GCP, TCS Hiring !!Virtual Drive *** 13-dec -25 Python/Pyspark, Bigquery with GCP, Apache Iceberg TCS - Hyderabad Immediate Joiners Role** Python/Pyspark, Bigquery with GCP, Apache Iceberg Exp -4 to 7 years Please read Job description before Applying NOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details: Name: Contact Number: Email ID: Highest Qualification in: (Eg. B.Tech/B.E./M.Tech/MCA/M.Sc./MS/BCA/B.Sc./Etc.) Current Organization Name: Total IT Experience-4 to 7 years Location : Hyderabad Current CTC Expected CTC Notice period: Immediate Whether worked with TCS - Y/N

Job title: Senior Data Engineer Location: Hyderabad Work type: Onsite Roles & Responsibilities: • 8 years of experience in application design, development and analysis • Experience in AWS Cloud Solutions. Retail Industry experience preferred. • Implement data transformations and data structures for data warehouse and lake/repository. • Manage cloud and/or on-premises solutions for data transfer and storage. • Process data using spark (PySpark) • Manage cloud and/or on-premises solutions for data transfer and storage. • Collaborate and work with data analysts in various functions to ensure that data meets their reporting and analysis needs. • Experience in creating Various ETL Frameworks in p...

**Immediate Joiners Preferred Job Overview: The job requires understanding the business and framing the business requirement as a data analytics problem statement. The individual will be responsible for providing business insights and managing end-to-end project delivery. The job requires building relationships with the client and presenting work directly to clients. The individual should effectively collaborate with team members around problem structuring and use of analytics (tools and techniques) to carry out analysis. The individual will be responsible for project delivery and gathering client feedback. Key Responsibilities: · Lead and manage analytics projects focused on banking/financi...

Core Skills: Data Warehousing, SQL/PLSQL, Unix ETL Development, Testing & Scheduling IBM DataStage (design, build, optimize) End-to-end project execution & troubleshooting PySpark, Python, AWS (EC2, S3, RDS, IAM) Provident fund

Job Title - Principal Data Scientist Job Location - Dhole Patil Road, Pune, Maharashtra Salary Budget - INR 55 lacs As part of our team, you'll be tasked with handling substantial datasets to develop machine learning models catering to our enterprise clients. Your role will also involve contributing to the development of foundational models for our product. To excel in this position, you should possess a strong analytical aptitude, with a deep understanding of data analysis, mathematics, and statistics. Critical thinking and problem-solving abilities are imperative for the interpretation of data. Furthermore, we value a genuine enthusiasm for machine learning and a commitment to research. Re...

Making a difference and driving positive change is what we do every day at Rapid Circle. Our Cloud Pioneers help our clients in their digital transformation. Are you someone who goes for constant, positive change? Then this vacancy is for you! As a Cloud Pioneer at Rapid Circle, you will work with our customers on different projects. For example, making impact in the healthcare sector, by making research data safely available. But also, awesome projects in the manufacturing or energy market make this job very challenging. At Rapid Circle we are curious and are constantly improving our expertise to help customers find their way in a rapidly changing world. We share our knowledge and discover ...

Job Summary Role : Power BI & Power Apps Location: Hyderabad years of Exp: 6+ We are looking for a highly skilled Power BI & Power Apps expert who can design, develop, and maintain enterprise-grade business intelligence solutions and low-code applications. This role also requires foundational experience in data engineering (preferably using Azure Databricks) and an understanding of Power BI administration, governance, and security. The ideal candidate is passionate about continuous learning and staying current with new features, capabilities, and best practices across the Microsoft Power Platform. Technical Expertise 5-8 years’ experience developing Power BI dashboards (or equivalent strong ...

Note: This is Work from office for 5 days (UST Office) JD for Data Scientist: Hands-on experience with data analysis tools: Proficient in using tools such as Python and R for data manipulation, querying, and analysis. Skilled in utilizing libraries like Pandas, NumPy, and Scikit-Learn to perform in-depth data analysis and modeling. Skilled in machine learning and predictive analytics: Expertise in building, training, and deploying machine learning models using frameworks such as TensorFlow and PyTorch. Capable of performing tasks like regression, classification, clustering, and recommendation, leading to data-driven predictions and insights. Expertise in big data technologies: Proficient in ...