9747 Big Data Jobs - Page 39

We are looking for a skilled Sr. AWS Developer with 4 to 9 years of experience in developing scalable and secure cloud-based applications on AWS. Roles and Responsibility Design, develop, and deploy highly available and scalable cloud-based applications using AWS services such as EC2, S3, Lambda, and DynamoDB. Collaborate with cross-functional teams to identify and prioritize project requirements, ensuring timely delivery of high-quality solutions. Develop and maintain technical documentation for cloud-based applications, including architecture diagrams, code samples, and deployment scripts. Troubleshoot complex issues related to cloud infrastructure, application performance, and security, p...

AIA-Pune Job Summary Data Engineer 4 to 9 Years Responsibilities Data Engineering design experience (to support with HLD review LLD build out etc.) Azure experience confident in working with Azure Cloud and Data Engineering capabilities ( e.g. ADLS Gen2 Synapse ADF etc.) Advanced SQL experience query writing & optimisation data aggregation stored procedures etc. Experience writing data Pipelines using Python and PySpark. Relational data model / data schema design experience Understanding of DevOps and CI/CD in the context of Data Engineering Familiarity with working in a scrum environment and supporting scrum ceremonies Certifications Required Azure Pyspark Python

We are seeking a highly skilled and visionary Software Engineering Manager to lead a team of engineers in building Caterpillars next-generation Digital Manufacturing Data Platform . This platform is central to our Future of Manufacturing initiativedesigned to unify and operationalize data across design, engineering, production, and supply chain operations. The ideal candidate will possess deep expertise in Big Data, Data Warehousing, real-time data movement , and Snowflake-based architectures . You will architect and deliver scalable, secure, and intelligent data platforms that enable advanced analytics, AI, and digital twin capabilities across global manufacturing ecosystems. Key Responsibi...

AIA-Pune Job Summary We are seeking a skilled Developer with 4 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Amazon RDS AWS Glue AWS DevOps and other AWS technologies. This role involves working with big data and requires proficiency in Python and Apache Spark. Experience in regulatory and process control is a plus. Responsibilities Develop and maintain scalable data processing systems using Amazon RDS AWS Glue and AWS DevOps to ensure efficient data management and processing. Collaborate with cross-functional teams to design and implement data solutions that meet business requirements and enhance operational efficiency. Utilize ...

Job Overview We are looking for a Data Engineer who will be part of our Analytics Practice and will be expected to actively work in a multi-disciplinary fast paced environment. This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project; its primary responsibility is the acquisition, transformation, loading and processing of data from a multitude of disparate data sources, including structured and unstructured data for advanced analytics and machine learning in a big data environment. Responsibilities: \u2022Engineer a modern data pipeline to collect, organize, and process data from disparate sources. \u2022Performs d...

MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysis Hands on experience in installing, configuring, and using Hadoop HDFS, Yarn, MapReduce, HBase, Oozie, Hive, Sqoop, Pig, Kafka, Ranger

Role Overview: Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference. Key Responsibilities: Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase. Implement ETL/ELT workflows and ensure data integrity and scalability. Work closely with Data Architects and Analysts to translate business requirements into technical solutions. Troubleshoot, tune performance, and automate data operations. Contribute to best practices and mentor junior developers. Primary Skills & Technologies: Core Big Data Technologies: Hadoop, ...

Requirements: Python Dev with Bachelors degree in Computer Science, Information Technology, or a related field. Proven experience as a Python Developer with expertise in PySpark. Strong understanding of big data technologies and frameworks. Experience with distributed computing and parallel processing. Proficiency in SQL and experience with database systems. Solid understanding of data engineering concepts and best practices. Ability to work in a fast-paced environment and handle multiple projects simultaneously. Excellent problem-solving and debugging skills. Strong communication and collaboration abilities.

Overview Should have a strong understanding of Kafka and the Elk (Elasticsearch, Logstash, Kibana) stack, including hands-on experience in implementing and maintaining these technologies Strong background in scripting and programming languages like Python, Java is essential for building and maintaining Kafka and Elk based solutions. In-depth knowledge and hands-on experience utilizing Log Shipper tools such as Fluentd, Fluent Bit, and Filebeat. Candidate should have excellent troubleshooting and problem-solving skills to identify and resolve issues in the Data Pipeline and ensure smooth operation. Investigate and resolve complex issues related to log data, log parsing, and ELK Stack performa...

Overview Prodapt is lookig for Senior Technical Lead in Data Engineering stream having 11+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL. Responsibilities Understanding the requirements Performing in-depth analysis on data Setting up secure data pipelines from ingestion to delivery Individual contributor Requirements 11+ years of experience in Data Engineering with strong ability to work independently, communicate effectively, and deliver high-quality solutions. Should have strong SQL programming skills. Experience in cloud-based systems (GCP, BQ) is must. Performs data analysis required to troubleshoot data related issues and assist in the resolution...

About The Role Job Title Data Science/Data Engineering ML9 - Sales Excellence COE - Data Engineering Specialist Management Level :ML9 Location:Open Must have skills: strong GCP cloud technology experience, Big query, Data Science basics. Good to have skills: Build and maintain data models from different sources. Experience: Minimum 5 year(s) of experience is required Educational Qualification: Graduate/Post graduate Job Summary :The Center of Excellence (COE) makes sure that the sales and pricing methods and offerings of Sales Excellence are effective. The COE supports salespeople through its business partners and Analytics and Sales Operations teams. The Data Engineer helps manage data sour...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Experience is creating templates in Open Text Extreme CE 23.4 Version Responsible to design and develop different documents and business forms using OpenText Exstream. Understanding of different input, output file formats, and Print file formats(PDF etc). Perform unit testing of templates/documents. Apply styles and images to document design. Use output comparison tools to compare different outputs Should have experience working with Exstream Design Manager Exstream Designer Tool. Should have prior knowledge on working with Exstream Web Service. Designing Templates, Objects, Rules, Variables and creation of Documents based on Templates. Understand current SmartCOMM Templates and create templ...

Guarantee that Databricks best practices are applied throughout all projects Your role will involve designing and building robust data pipeline development and deployment of innovative big data and AI applications advanced data engineering techniques Required Candidate profile Expert-level proficiency in Spark Scala, Python, and PySpark. Knowledge of data architecture, including Spark Streaming, Spark SQL Data Bricks expertise Spark Scala, Python and PySpark etc. Perks and benefits Please reply ,share resume at info@whitepepper.in

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimise their costs and maximise the benefits from their investments in these technologies. Coeo has been established for over 15 years and has offices in Reading, UK and Hyderabad, India. We are exclusively focused on Microsoft technologies. Our mission is to "help our clients predict their future" through the better use of data, technology, people, and processes. To do this our business has always focused on:. Data Managed Services. Data Platform Consultancy. Analytic...

We're seeking a Jr. Thingworx Developer for one of our clients based in Pune, MH, India. This is a full-time work-from-office opportunity. Applicants from Pune are encouraged to apply. You will work alongside other engineers and developers, collaborating on the various technical implementations, taking an active role on both sides and defining how the application looks as well as how it works. Position:Jr. ThingWorx Developer. of Openings:2. Experience:4 to 5 Years. Notice Period:Immediate Joiners. More than 30 days will not be considered. Key Responsibilities. To build solutions for emerging technology in the Industrial Internet of Things (IIoT). Be a part of an exciting team to deliver IIo...

Skills: Android, ios, java, Big Data, react, React Native,. Job Overview. We are seeking a highly skilled Technical Lead Android/iOS. As a Technical Lead, you will be responsible for leading and managing the development of Android and iOS applications. This is a full-time position based in Hyderabad, Telangana, India, and is suitable for experienced professionals with more than 10 years of experience. Qualifications And Skills. More than 10 years of professional experience in Android and iOS application development. Strong knowledge of Android and iOS development frameworks, including Java and Swift. Experience with Big Data technologies and integration. Proficiency in React and React Native...

Skills: Azure, Data Engineer, python, SQL, ADF, Databrick, Azure Databricks,. Position:Azure Data Engineer. Work Experience:5-8years. Work location:Bangalore/Hyderabad/Pune. Required Skills. Azure, Strong SQL, ADF, Python, PySpark, Databricks. Key Responsibilities. Design and develop data pipelines using Azure services. Collaborate with cross-functional teams to understand data requirements. Optimize and troubleshoot data pipelines for performance and reliability. Implement data security and governance best practices. Stay updated with the latest industry trends and emerging Azure. Show more Show less

Skills: Machine Learning, Statistical Analysis, Python, Data Visualization, Big Data, Predictive Modeling, SQL, Data Mining,. Company Overview. CN Solutions, an IT services and IT consulting company, collaborates with clients to deliver top-notch solutions for their manpower needs. With a team of experienced professionals, CN Solutions excels in various skills including Web Technologies, Databases, Software Testing, CRM, ERP, Data warehousing, Middleware, ESM, Business Analyst (BFSI Domain), Cyber Security, IT infrastructure, and SAP Hiring. Job Overview. Position:Python Developer (Mid-Level). Employment Type:Full-Time, Hybrid. Location:Edakkulam. Experience:3-6 years. Company Size:11-50 emp...

Skills: ML, databricks, python, spark, sql, azure,. Company Overview. CN SOLUTIONS is a premier IT services and consulting company offering a wide range of manpower solutions to clients. With a team of experienced professionals, we excel in Web Technologies, Databases, Software Testing, CRM, ERP, Data warehousing, and more.and is headquartered in Hyderabad, India. Visit our website at http://www.cnsolutions.in. Job Overview. Seeking Senior DataBricks Engineer with 7-10 years of experience. Full-Time position in Bangalore, Karnataka, India. Salary range:Competitive. Join a dynamic team at CN Solutions, a leading IT services and consulting company with expertise in various technologies and ser...

Minimum 7+ years of experience in developing software applications including: analysis, design, coding, testing, deploying and supporting of applications, Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, Big Data model techniques using Python / Java. Extensive experience in developing complex stored Procedures/BTEQ Queries. Experience in Data Migration from RDBMS to Snowflake cloud data warehouse

We are looking for a skilled Business Technology Solutions Consultant - Data Engineer with 5-10 years of experience to join our team in India. The ideal candidate will have a strong background in data engineering and excellent problem-solving skills. Roles and Responsibility Design, develop, and implement data engineering solutions to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and architectures. Ensure data quality, integrity, and security. Troubleshoot and resolve complex technical issues. Provide technical guidance and support to junior team members. Job Requirements Stro...

We are looking for a skilled Business Technology Solutions Consultant with 5-10 years of experience to join our team in India. The ideal candidate will have a strong background in Big Data Development and be able to work on innovative solutions. Roles and Responsibility Design, develop, and implement Big Data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data processing systems and pipelines. Ensure data quality, integrity, and security in all developed systems. Troubleshoot and resolve complex technical issues related to Big Data development. Stay updated with ...

Role: AI Engineer with expertise in data governance, automated data policy management, data quality, data tagging cloud implementation, and optimization of Large Language Models (LLMs). This role focuses on designing secure, scalable cloud solutions, implementing robust data governance frameworks, and leveraging LLMs to enhance the management and processing of unstructured data. Experience: 5+ years of experience in AI/ML, data governance, and cloud implementation. Proven expertise in managing unstructured data and implementing automated data tagging methodologies. Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) and big data technologies (e.g., Databricks, AWS Sage Maker,...

Skill: Pyspark + Databricks Experience : 6 to 9 Years Location : AIA - Gurgaon Job Summary We are seeking a highly skilled Technical Lead with 12 to 16 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks Workflows Unity Catalog and Databricks with a preference for experience in Research and Development. This hybrid role offers the opportunity to work on cutting-edge projects during day shifts with no travel required. Responsibilities Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. Oversee the integration of Databricks Unity Catalog to ensure seamless data governan...