15947 Pyspark Jobs - Page 45

Role Overview: As a Cloud Architect with expertise in Azure and Snowflake, you will be responsible for designing and implementing secure, scalable, and highly available cloud-based solutions on AWS and Azure Cloud. Your role will involve utilizing your experience in Azure Databricks, ADF, Azure Synapse, PySpark, and Snowflake Services. Additionally, you will participate in pre-sales activities, including RFP and proposal writing. Key Responsibilities: - Utilize experience in Azure Databricks, ADF, Azure Synapse, PySpark, and Snowflake Services to design and implement secure, scalable, and highly available cloud-based solutions on AWS and Azure Cloud. - Integrate various data sources with Dat...

As a candidate, you should have proficiency in Python with experience in Databricks (PySpark). It is mandatory to possess these skills for this role. Key Responsibilities: - Proficiency in Python - Experience in Databricks (PySpark) Good to Have: - Hands-on experience with Apache Airflow - Working knowledge of PostgreSQL - Working knowledge of MongoDB You may also have basic experience with cloud technologies like Azure, AWS, and Google. Please note that no additional details of the company were provided in the job description.,

**Role Overview:** With over 5 years of experience in developing AWS, SQS, Glue, Python, PySpark, dynamic frame, and dataframe, you will be responsible for demonstrating competency in various AWS services such as ECS, EC2, ECR, S3, RDS, VPC, IAM, QuickSight, CloudFront, CloudFormation, CloudWatch, SQS, ElastiCache, Lambda, Glue ETL, DynamoDB, Neptune, Route53, Application Load Balancers, and more. Your strong knowledge in developing code using Terraform (IAAC) tool and experience using GIT SCM tool will be essential for this role. Additionally, hands-on experience with Jenkins or Gitlab CI tool, containerization tools like Docker and Kubernetes, and handling containers, pods, and clusters in...

Role:DataEngineer Location: Hyderabad - CyberGateways (Hybrid -3 Days a week) Work Timing : US CST 8 AM to 5 PM CST ( India 6:30 PM to 3:30 AM ) Interested candidates please share your resume with " sam.kumar@comtecinfo.com " We are seeking a skilled AWS Data Engineer who has experience working with Python, PySpark, lambda, Airflow, and Snowflake. Responsibilities: Design, build, and optimize ETLs using Python, PySpark, lambda, Airflow and other AWS services. Create SQL queries to segment, manipulate, and formatdata. Build automations to ingest, transfer, move, upload, and manipulatedata. Build or maintain data ingestion pipelines that move data from source systems into Snowflake. Create and...

As a Python Full stack candidate with exposure to Azure, your role would involve developing highly scalable applications in Core Python. You should have experience working with any of the Python web frameworks such as Django, Flask, or Fast API. Additionally, you must have experience working on SQL and be able to run various data analytics tasks and queries. Exposure to JavaScript technologies, preferably React, is also required for this role. Moreover, you should have exposure to the Azure Databricks environment, including PySpark, notebooks, integrating repos, job workflows, delta lake, Unity catalog, etc. Familiarity with the Azure environment and various interconnected Azure components l...

Role Overview: You will be part of the managed services team at PwC, focusing on providing outsourced solutions and support to clients across various functions. Your role will involve streamlining operations, reducing costs, and enhancing efficiency by managing key processes and functions on behalf of clients. You will work on project management, technology, and process optimization to deliver high-quality services to clients. Your responsibilities will include transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Continuous improvement and optimization of managed services processes, tools, and services will be a key aspect of you...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Role Overview: We are seeking a detail-oriented and experienced Senior Data Analyst with 6 to 8 years of experience to join our data and analytics team. The ideal candidate will have strong expertise in data extraction, transformation, profiling, and quality checks using PySpark, SQL, and Hadoop. This role requires strong analytical skills, stakeholder management capabilities, and the ability to investigate and remediate data quality issues efficiently. Roles and Responsibilities: Perform data extraction, transformation, profiling, and quality checks using PySpark, SQL, and Hadoop frameworks. Conduct root cause analysis for data quality issues and recommend effective remediation strategies. ...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testing and tr...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testing and tr...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testing and tr...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testing and tr...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testing and tr...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Experience on Python, Python ML packages, TensorFlow, PyTorch. -Experience on Python, Flask, TensorFlow, PyTorch, SQL, NOSQL, Vector -Understanding of data structures, data modelling and data pipeline design in PySpark, Apache Airflow preferable A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. You will play a key ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Locations: Gurgaon, Noida, Pune, Mumbai, Chennai, Bangalore Experience : 5-13 Years Mandatory Skills : BigQuery, Airflow, GCS, Python, SQL, Pyspark (Optional) Skill Requirements: Essential Skills and experience: Excellent Programming skills in Python with object-oriented design Excellent knowledge in current computing trends and technologies Knowledge or working experience in Generative AI (GenAI) technologies is preferred. Experience in designing and implementing cloud infrastructure, platforms, and applications Hands-On Experience on Infrastructure as a Code using terraform /pulumi /typescript in GCP Hands-On Experience with Google Cloud platform & product deployment and automation Hands-O...

Experience- 8 to 15 years Location- Pan India Key Responsibilities Lead the design, architecture, and implementation of Snowflake-based data warehouse solutions . Define data ingestion, transformation, and integration strategies using Snowflake, Python, and PySpark. Build reusable frameworks for data pipelines, automation, and orchestration. Optimize performance, security, and cost of Snowflake environments. Required Skills & Qualifications 8+ years of IT experience , with strong focus on data architecture and engineering . 3+ years of hands-on experience with Snowflake (warehouses, schema design, performance tuning). Strong programming skills in Python for data processing and automation. Ha...

Roles and Responsibilities Design, develop, test, deploy, and maintain big data solutions using Spark (Scala) on Hadoop ecosystem. Collaborate with cross-functional teams to identify business requirements and design scalable data pipelines. Develop high-quality code that meets performance, security, and reliability standards. Troubleshoot complex issues related to big data processing and provide timely resolutions. Stay up-to-date with industry trends and best practices in big data technologies. Desired Candidate Profile 5+ years of experience in working with Spark (Scala) development. Strong understanding of Python programming language and its applications in big data processing. Experience...

Educational Requirements Bachelor of Engineering Service Line Strategic Technology Group Responsibilities Power Programmer is an important initiative within Global Delivery to develop a team of Full Stack Developers who will be working on complex engineering projects, platforms and marketplaces for our clients using emerging technologies., They will be ahead of the technology curve and will be constantly enabled and trained to be Polyglots., They are Go-Getters with a drive to solve end customer challenges and will spend most of their time in designing and coding, End to End contribution to technology oriented development projects., Providing solutions with minimum system requirements and in...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 5 years of experience in Pyspark, Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline creation , deployment , Maintenance and debugging Experience in scheduling and monitoring Jobs and creating tools for automation At least 4 years of experience with Scala and Python required. Proficient knowledge of SQL with any RDBMS....

Educational Requirements Bachelor of Engineering Service Line Strategic Technology Group Responsibilities Power Programmer is an important initiative within Global Delivery to develop a team of Full Stack Developers who will be working on complex engineering projects, platforms and marketplaces for our clients using emerging technologies., They will be ahead of the technology curve and will be constantly enabled and trained to be Polyglots., They are Go-Getters with a drive to solve end customer challenges and will spend most of their time in designing and coding, End to End contribution to technology oriented development projects., Providing solutions with minimum system requirements and in...

Skill required: Data Management - PySpark Designation: Data Eng, Mgmt & Governance Sr Analyst Qualifications: BE/BTech Years of Experience: 5 to 8 years About Accenture Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song all powered by the worlds largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 countries. Visit us at www.accenture.com What would you do Data & AIUnderstand Pyspark interface and integration in handling complexiti...