6547 Big Data Jobs - Page 29

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL.

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow.

Experience in automation, Java with selenium, rest assured is must. Experience with HDFS, Linux Commands Experience in Testinglarge data set which includes large extracts , Hive to Hive etc. Good knowledge of different Testing methodologies, concepts Experience in debugging application log files. Familiarity with DevOps (CI/CD) Mandatory Competencies QA/QE - QA Automation - Automation of Rest, Web / SOAP UI Services QA/QE - QA Automation - Selenium Beh - Communication and collaboration Big Data - Big Data - HDFS.

Python 4/5 years of experience Kubernetes/Docker Containerization API development Relational and NoSQL DB Version control GitHub Airflow Python libraries Pandas, flask, FastAPI Mandatory Competencies Programming Language - Python - Panda Big Data - Big Data - Mongo DB DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Containerization (Docker, Kubernetes) Beh - Communication and collaboration Database - No SQL - Elastic, Solr, Lucene etc.

Essential Skills/Basic Qualifications: More than 8 years of total experience in managing environments and DevOps tools. Knowledge and proven experience in one of the scripting languages (preferably PowerShell, Python, Bash). Knowledge and strong practical experience with CI/CD pipelines - Git, GitLab, deployment tools , Nexus, JIRA, TeamCity/ Jenkins , Infrastructure-as-a-Code ( Chef, or alternatives ) Good knowledge of Unix systems and basic understanding of Windows servers Experience in troubleshooting Database issues. Knowledge of middleware tools like Solace, MQ Experience with Agile (Scrum) methodology and software development approach Excellent Analytical skills Great interpersonal and...

Roles and Responsibilities : Design, develop, and maintain large-scale big data solutions using PySpark on AWS. Collaborate with cross-functional teams to gather requirements and deliver high-quality data pipelines. Develop complex SQL queries to optimize database performance in Snowflake. Troubleshoot issues related to big data processing, storage, and retrieval. Job Requirements : 6-12 years of experience in Big Data engineering with expertise in PySpark on AWS. Strong understanding of Python programming language and its applications in big data processing. Proficiency in designing scalable architectures for handling massive datasets using Snowflake as a database management system.

Job Description: Role descriptions / Expectations from the Role Experience in other messaging systems such as IBM MQ or Rabbit MQ. Experience in the Atlassian stack tools Jira, Confluence and Bitbucket (GIT). Experience in Jenkins automation development. Experience in the scripting languages shell and python. Experience in the operating systems Linux (RedHat and/or SuSE) and Windows Server. Experience in search engines such as Elasticsearch. Job description: must have • Cluster Management: Install, configure, and maintain Confluent and AWS MSK Kafka clusters. Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud). Troubleshoot and resolve issues related to Kafka broker...

Job summary 5+ years of experience in Teamcenter Experience in Active Workspace Customization Experience in Server-Side Customization Responsibilities Experience in BMIDE Workflow ACL BOM Management and Configuration Experience in Teamcenter Integration (T4S T4EA SOA SOAP and REST services etc. ) Experience in Automation Testing for Teamcenter Experience in Data lake and Reports (Microservice..) Should be having expertise in ITK RAC and AWC customization Should be having in depth knowledge in Teamcenter Data Model. Should be having experience in Document Management BOM Management Configuration Management and Change Management. Should be familiar with developing Workflow Handlers REST API SOA...

As a Senior Azure Cloud Engineer at Pristine Retail Solutions, you will play a crucial role in developing and migrating end-to-end solutions that empower our customers to succeed in their markets. Your primary responsibilities will include collaborating with engineering teams, evaluating optimal cloud solutions, migrating applications to Azure cloud platform, modifying existing systems, and educating teams on new cloud technologies. You will also design, develop, and deploy modular cloud-based systems, ensuring efficient data storage and processing functions in accordance with best practices in cloud security. **Key Responsibilities:** - Collaborate with engineering teams to evaluate and ide...

As a Senior Cloud Support Engineer at Snowflake, your role is to delight customers with your passion and knowledge of Snowflake Data Warehouse. Customers will look to you for technical guidance and expert advice on the effective and optimal use of Snowflake. You will be the voice of the customer regarding product feedback and improvements for Snowflake's product and engineering teams. You will play an integral role in building knowledge within the team and be part of strategic initiatives for organizational and process improvements. **Key Responsibilities:** - Drive technical solutions to complex problems, providing in-depth analysis and guidance to Snowflake customers and partners through e...

As an award-winning, equal opportunity, and culturally diverse organization, BMC fosters a work environment where giving back to the community is a driving force for continuous improvement. Balancing your priorities is encouraged as we believe that your best work stems from a harmonious work-life integration. Your achievements will be celebrated and acknowledged by our supportive peers who will also inspire and drive you towards success. Key Responsibilities: - Hands-on experience with Prompt Engineering, RAG, LLM Evaluation, and LLM Fine-tuning - Solid understanding of NLP concepts and familiarity with NLP libraries - Writing Python backend APIs using Fast API, Flask, or other frameworks - ...

As a Manager - AI/GenAI at EY, you will have the opportunity to work in a multi-disciplinary technology team focusing on Data Mining & Management, Visualization, Business Analytics, Automation, Statistical Insights, and AI/GenAI across various industry sectors. Your role will involve developing and delivering industry-specific solutions using Artificial Intelligence, Machine Learning, deep learning, and LLM models for Generative AI, text analytics, and Python Programming. **Key Responsibilities:** - Develop, review, and implement solutions utilizing AI, Machine Learning, Deep Learning, and Python APIs. - Lead the development and implementation of Generative AI applications using open source ...

About Lumen Technologies Lumen Technologies is a global technology company that delivers innovative communication and network solutions. Our mission is to empower businesses and individuals to connect, grow, and thrive in the digital age. With a focus on customer experience and operational excellence, we strive to provide cutting-edge solutions that meet the evolving needs of our customers. Job Description : Role : Senior Data Architect/Consultant Years of Experience : 8-14 years Work Location : Bangalore Work Mode : Hybrid Shift timing : Afternoon Shift. Mandatory skills : Advance in Oracle, Advance in SQL, Python or Bash scripting, Data analytics and any cloud. Main Responsibilities: Maint...

Job Title: Data Scientist Electric Load Forecasting Location: Mumbai / Pune Job Type: Full-time Experience: 3-5 years About the Role: We are seeking a highly motivated Data Scientist – Forecasting with a strong passion for energy, technology, and data-driven decision-making. In this role, you will be responsible for developing and refining energy load forecasting models , analyzing customer demand patterns , and improving forecasting accuracy using advanced time series analysis and machine learning techniques . Your insights will directly support risk management, operational planning, and strategic decision-making across the company. If you thrive in a fast-paced, dynamic environment and enj...

Job Title: Lead Data Engineer Location: Mumbai / Pune Experience: 8+ yrs Job Summary: We are seeking a technically strong and delivery-focused Lead Engineer to support and enhance enterprise-grade data and application products under the Durables model. The ideal candidate will act as the primary technical interface for the client, ensuring high system availability, performance, and continuous improvement. This role requires a hands-on technologist with strong team management experience, cloud (AWS) expertise, and excellent communication skills to handle client interactions and drive technical decisions. Key Responsibilities: Support & Enhancement Leadership Act as the primary technical lead ...

Role: Senior Data Engineer Location: Mumbai & Pune Experience: 3yrs to 8yrs Technologies / Skills: Advanced SQL, Python and associated libraries like Pandas, NumPy etc., Pyspark , Shell scripting, Data-Modelling, Big data, Hadoop, Hive, ETL pipelines. Responsibilities: • Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and develop data engineering strategy. • Ability to work with business owners to define key business requirements and convert to user stories with required technical specifications. • Communicate results and business impacts of insight initiatives to key stakeholders to collaborat...

Role Overview: As a Data Engineer, Senior Consultant for the Asia Pacific Region based out of Bangalore, you will bring deep expertise in data architecture, big data/data warehousing, and the ability to build large-scale data processing systems using the latest database and data processing technologies. Your role will be crucial in enabling VISA's clients in the region with foundational data capabilities needed to scale their data ecosystem for next-generation portfolio optimization and hyper-personalized marketing, especially within the BFSI space. You will work closely with VISA's market teams in AP, acting as a bridge between end-users and technology colleagues in Bangalore and the US to ...

Role Overview: As a Data Scientist at mPokket, you will be responsible for collaborating with the data science team to plan projects and build analytics models. Your strong problem-solving skills and proficiency in statistical analysis will be key in aligning our data products with our business goals. Your primary objective will be to enhance our products and business decisions through effective utilization of data. Key Responsibilities: - Oversee the data scientists" team and data specialists, providing guidance and support. - Educate, lead, and advise colleagues on innovative techniques and solutions. - Work closely with data and software engineers to implement scalable sciences and techno...

Role Overview: As a Data Scientist in our team, you will play a crucial role in handling analytics and data science projects. Your expertise will be utilized to deliver high-quality solutions and models to meet the business requirements effectively. Key Responsibilities: - Translate business requirements into actionable analytical plans and ensure alignment with strategic objectives. - Identify appropriate data sources and handle data discrepancies including ETL tasks, missing values, and outliers. - Deliver projects and POC initiatives from inception to completion. - Develop and refine technical and analytics architecture, implement scalable frameworks, and data pipelines. - Coordinate with...

Role Overview: At Goldman Sachs, as an Engineer, you will have the opportunity to not only create things, but also make them possible. Your role will involve connecting people and capital with ideas, solving complex engineering problems for clients, and contributing to the development of massively scalable software and systems. You will be part of a team that architects low latency infrastructure solutions, proactively guards against cyber threats, and utilizes machine learning in conjunction with financial engineering to transform data into actionable insights. By joining our engineering teams, you will have the chance to innovate, transform finance, and explore a world of opportunities at ...

Position Overview: The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems. Key Responsibilities: Develop and maintain scalable data pipelines using Databricks and Apache Spark (primarily with PySpark). Build and manage Delta Lake tables and optimize them for analytics and machine learning workloads. Integrate data from diverse sources including APIs, cloud storage, databases, and streaming platforms like Kafka. Transfor...

KEY RESPONSIBILITIES Efficient & Reliable Independent Contributor Independently design and implement complex data science projects, from initial concept through final deployment. Solve critical business problems with minimal oversight, ensuring the delivery of high-quality, impactful solutions. Proactively identify and address potential issues or opportunities for improvement in existing models and processes. Leadership and Mentorship Mentor and provide technical guidance to junior data scientists and team members. Foster a culture of continuous learning and improvement within the team. Advanced Model Development and Generative AI Lead the design, development, and deployment of advanced pred...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Job Purpose ICE Mortgage Technology is driving value to every customer through our effort to automate everything that can be automated in the residential mortgage industry. Our integrated solutions touch each aspect of the loan lifecycle, from the borrower's \"point of thought\" through e-Close and secondary solutions. Drive real automation that reduces manual workflows, increases productivity, and decreases risk. You will be working in a dynamic product development team while collaborating with other developers, management, and customer support teams. You will have an opportunity to participate in designing and developing services utilized across product lines. The ideal candidate should po...

The Data Engineer 1 works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. The team also supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier, faster and smarter. The team brings together data from different internal & external partners and builds a curated Marketing analytics focused data & tools ecosystem. The Data Engineer plays a crucial role in building this ecosystem depending on the Marketing analytics communities need. Essential Job Functions Collaboration - Collaborate s with internal/external stakeholders to m...