15947 Pyspark Jobs - Page 49

Role & responsibilities Job Summary: We are seeking a skilled and motivated Data Engineer with hands-on experience in Azure Databricks , PySpark , and cloud-based data solutions. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions that support business decision-making and digital transformation initiatives. Key Responsibilities: Design and develop robust, scalable data pipelines using PySpark on Azure Databricks . Implement ETL/ELT processes to ingest, transform, and load data from various sources into data lakes or data warehouses. Collaborate with data scientists, analysts, and business stakeholders to understand ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Amazon Web Services (AWS) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark, Mulesoft ESB Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, ...

Role & responsibilities Preferred candidate profile Job Title: Data Engineer Azure Databricks & PySpark Location: Bangalore/ Kolkata Department: Data & Analytics Employment Type: Full-Time-ITC Infotech Hybrid 3+ Years immediate joiners up to 30 LPA Job Summary: We are seeking a skilled and motivated Data Engineer with hands-on experience in Azure Databricks , PySpark , and cloud-based data solutions. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and analytics solutions that support business decision-making and digital transformation initiatives. Key Responsibilities: Design and develop robust, scalable data pipelines using PySpark on...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are optimize...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Amazon Web Services (AWS) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Architecture Principles Good to have skills : AWS Architecture, PySpark Minimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating c...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Amazon Web Services (AWS) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Key ResponsibilitiesResponsible for developing ECE and other UDM data assets using Databricks (DBX).Collaborate with Subject Matter Experts (SMEs) to Write and test code using SQL, Python, and PySpark in Databricks.Implement business rules provided by SMEs. Support ETL changes to production in DatabricksDebug and optimize SQL queries a...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Athena Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : Microsoft Azure Databricks, Databricks Unified Data Analytics Platform Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are alig...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : PySpark, AWS AI Services Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. A typical day involves collaborating with cross-functional teams to gather insights, analyzing user needs, and translating them into functional specifi...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the solutions align with business objectives. You will also engage in problem-solvi...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Glue Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in problem-solvi...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Amazon Web Services (AWS) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

Role Summary We are seeking a highly skilled Data Architect to design and optimize cloud-native data architectures on platforms like Databricks and Snowflake . In this role, you will lead the development of scalable data pipelines, drive governance and security frameworks, and enable advanced analytics and AI/ML solutions for global enterprise clients. This is a leadership opportunity for professionals passionate about shaping modern data ecosystems and mentoring data engineering teams. Key Responsibilities Design and implement Lakehouse architectures using Databricks, Delta Lake, and Apache Spark. Build and optimize data pipelines, ETL/ELT processes, and integration strategies across platfo...

Azure Data Engineer with 4–6 years of experience in Azure Data Factory, Databricks (PySpark), and DevOps. The role involves building and managing data pipelines, implementing Infrastructure as Code .

We are seeking a dynamic professional with strong experience in Databricks and Machine Learning to design and implement scalable data pipelines and ML solutions. The ideal candidate will work closely with data scientists, analysts, and business teams to deliver high-performance data products and predictive models. Key Responsibilities: Design, develop, and optimize data pipelines using Databricks , PySpark , and Delta Lake Build and deploy Machine Learning models at scale Perform data wrangling , feature engineering , and model tuning Collaborate with cross-functional teams for ML model integration and monitoring Implement MLflow for model versioning and tracking Ensure best practices in MLO...

Job Description GCP Data Engineer / Analytics Engineer Position: GCP Data Engineer / Analytics Engineer Experience: [6–12 years – adjust as per requirement] Location: Bangalore / Hyderabad Role Overview We are looking for an experienced GCP Data Engineer with expertise in building and optimizing large-scale data pipelines, data models, and analytics solutions on Google Cloud Platform (GCP) . The ideal candidate should have hands-on experience with BigQuery, DBT, Airflow/Cloud Composer, Dataflow/Dataproc/Datafusion, Python/PySpark, SQL, and Looker to deliver scalable, reliable, and high-performing data solutions. Key Responsibilities Design, build, and manage data pipelines and ETL/ELT workfl...

Hands-on design, deployment, operations, maintenance of pipelines for data science related products and machine learning solutions, ensuring reliability, scalability, and maintainability. Develop a close working relationship with data science teams to facilitate and implement best practices relating to data engineering, and MLOps. Collaborate with stakeholders to define project objectives, formulate data-driven hypotheses and identify KPIs for analysis. Build and optimize robust data pipelines and analytical workflows to enable statistical analysis, support machine learning models, and deliver insights that inform strategic decision-making. Conduct exploratory data analysis (EDA) to identify...

Job Role : As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL,and collaborating with data teams for informed decision-making. Why Choose Ideas2IT: Ideas2IT has all the good attributes of a product startup and a services company. Since we launch our products, you will have ample opportunities to learn and contribute. However, single-product companies stagnate in the technologies they use. In our multiple product initiatives and customer-facing projects, you will have the opportunity to work on various technologies. AGI is going to change the world. Big companies like Microsoft are ...

KPMG India is looking for Consultant - PySpark to join our dynamic team and embark on a rewarding career journey Undertake short-term or long-term projects to address a variety of issues and needs Meet with management or appropriate staff to understand their requirements Use interviews, surveys etc. to collect necessary data Conduct situational and data analysis to identify and understand a problem or issue Present and explain findings to appropriate executives Provide advice or suggestions for improvement according to objectives Formulate plans to implement recommendations and overcome objections Arrange for or provide training to people affected by change Evaluate the situation periodicall...