7560 Data Processing Jobs - Page 27

Overview We are looking for a skilled Cloud Developer with expertise in AWS, Azure, or GCP to design, deploy, and manage AI-powered cloud solutions. The ideal candidate will have a strong background in cloud computing, DevOps, and AI-driven automation. Key Responsibilities Design, develop, and implement cloud-based AI solutions using AWS, Azure, or GCP Deploy, manage, and optimize AI/ML models in cloud environments Develop serverless applications and microservices architectures Automate cloud infrastructure using Infrastructure-as-Code (Terraform, CloudFormation, ARM templates) Ensure the security, scalability, and performance of cloud-based applications Collaborate with AI engineers, DevOps...

Duration: 6 months (Possible Extension) Skill Required: Databricks, Python, Pyspark, Sql ETL Experience Range in Required Skills: 10 Above Azure Data Engineer with extensive experience on solution designing - Domain Data sets, data products hands on experience in Azure Databricks, Python, Pypark ETL Pipelines, Should know have working experience with Atlas framework. Should know and worked in medallion architecture. 1. Design, build, and maintain scalable and efficient data pipelines using Databricks. Integrate data from various sources (for eg. Azure storage account, SFTP, Fabric) using Apache Spark within Databricks. 2. Implement processes and checks to ensure the accuracy and completeness...

Hive/Python/Spark Technical hands on data processing Database SQL knowledge for retrieval of data - transformation queries such as joins (full, left , right) , ranking , group by Database SQL/Oracle Good Communication skills. Additional skills - GitHub , Jenkins , shell scripting would be added advantage, large-scale data processing model implementation, and performance tracking Mandatory Competencies Big Data - Big Data - HIVE Big Data - Big Data - Pyspark Big Data - Big Data - SPARK Data Science and Machine Learning - Data Science and Machine Learning - Data Analyst Database - Oracle - PL/SQL Packages Programming Language - Python - Python Shell Beh - Communication and collaboration

The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed Required Candidate profile Minimum requirement of 5 years of relevant work experience. Typically reflects 7 years or more of relevant experience. Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.

Urgent hiring for Data Entry / Back Office Executive. Role: data management, Excel, record keeping, documentation, email handling. Required: good typing speed, accuracy, MS Office skills. Freshers/experienced welcome. Apply now for immediate joining.

Could you be the full-time Assistant in Madhepura, Bihar were looking for? Your future role Take on a new challenge and apply your organizational and administrative expertise in a dynamic and innovative environment. Youll work alongside collaborative and dedicated teammates.You'll play a key role in ensuring smooth operations and supporting the leadership team. Day-to-day, youll work closely with teams across the business (such as Function Heads, Site Managing Directors, and the Projects team), manage schedules and logistics, and much more. Youll specifically take care of calendar management and meeting arrangements, but also support in travel coordination and administrative tasks. Well look...

Job Description Job Overview We are seeking an experienced Data Engineer with 3-5 years of experience to join our Video engineering team with Gracenote - a NielsenIQ Company. In this role, you will design, build, and maintain our data processing systems and pipelines. You will work closely with Product managers, Architects, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for Business, analytical and operational needs. Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes Optimize data flow and collection for cross-functional teams Build infrastructure required for optimal extraction, transformation, and loading of data...

A high growth environment where you can take new challenges, build a career, make an impact. Cross cultural, multi national exposure, access to experienced leaders and mentors. Competitive compensation and benefits. Roles & Responsibilities: Design, develop, and maintain scalable ETL/ELT data pipelines. Build and manage data lake and data warehouse solutions. Optimize and automate ingestion, transformation, and delivery of structured and unstructured data. Implement data quality, lineage, and governance best practices. Collaborate with Data Science, Visualization, and Engineering teams to operationalize data solutions. Monitor, debug, and improve data platform performance Primary Skills: Adv...

The Analyst ROI Quality will play a critical role in ensuring the accuracy and efficiency of the transactional processing within the organization. Required to work with the Quality Manager in designing the Quality Management System that standardizes and documents all processes. This position involves analyzing data, identifying trends, and implementing quality improvement initiatives related to ROI processing. The role also requires strong analytical and communication skills, as well as a deep understanding of insurance processes and relevant regulations. Key Responsibilities: Quality Assurance: Monitoring and evaluating the quality of ROI processing activities, identifying errors, and recom...

Job Summary : As an Azure AI Engineer, you will design, develop, and deploy AI-driven solutions leveraging Microsoft Azure AI services including Azure OpenAI, Cognitive Services, and Machine Learning. You will build scalable, secure, and cost-effective AI applications integrated with enterprise systems, driving innovation in AI technologies at scale. Lead end-to-end development of AI-powered solutions on Azure cloud platforms, from design to deployment and monitoring. Develop and optimize AI models including natural language processing, computer vision, and machine learning algorithms using Azure AI services. Implement AI pipelines and agentic AI workflows using frameworks like LangGraph or ...

Lead GCP AI Data Engineer/Architect Job Location: Hyderabad / Bangalore / Chennai / Kolkata / Noida/ Gurgaon / Pune / Indore / Mumbai Key Responsibilities AI/ML Solution Development: Design, build, train, and deploy scalable machine learning models and AI agents using Vertex AI , including Generative AI Studio, Model Garden, and custom training pipelines. Agentic AI Systems: Develop and manage intelligent agents and multi-agent systems using frameworks like Agentspace and the Google AI Development Kit (ADK) to automate complex workflows and create intelligent applications. Data Pipeline Orchestration: Architect, build, and maintain robust, scalable data processing pipelines and workflows usi...

Azure Data Engineer at N Consulting Ltd | Jobs at N Consulting Ltd Pimpri-Chinchwad, India 5 - 15 /year Required Details: Total Experience Relevant Experience Current Company: Current Designation: Current CTC LPA Monthly Take home: Expected CTC LPA: Expected Take home: Notice Period: Current Location Expected Location: Home Pincode: Offer In hand: PAN Number (upload profiles to the portal): DOB (upload profiles to the portal): Reason for Job Change: Degree Specialization: CGPA Education start date: Passed Out: University: UAN: Linkedin profile link: 3 different interview slots: Current Company address and pincode: Duration: 6 months (Possible Extension) Skill Required: Databricks, Python, Py...

Role & responsibilities 1. CPV Initiation 2. Pending cases Follow-up with agencies and Mentors 3. Maintenance of CPV reports. 4. Previous Employment and Reference Check 5. Adherence to approval grids, TATs, Formats, Vendor relationship, Rates etc 6. Email & Telephonic Correspondence. 7. Maintenance of MIS. Preferred candidate profile 1. Good knowledge of Excel & Word. 2. Accuracy and eye for detail 3. Timeliness and adherence to deadlines. 4. Customer service orientation 5. Good coordination- to play a vital role between Business, Employee and other stakeholders

Job Title Sr. Data Engineer Job Description Job Responsibilities: Develop scalable data pipelines using AWS Glue, Lambda and other AWS services Define workflow for data ingestion, cleansing, transformation, and storage using S3, Athena, Glue and other AWS services Ensure data security, compliance, and governance Implement robust monitoring and alerting mechanisms using CloudWatch and custom metrics for pipeline health and data quality Contribute to cloud optimization, cost control, and architectural design reviews Analyzes complex datasets to identify key trends, patterns, and potential data quality issues that could impact model performance or downstream analytics, working under general sup...

Were seeking top talents for our AI engineering team to develop high-quality machine learning models, services, and scalable data processing pipelines. Candidate should have a strong Machine Learning background with experience in managing a team of machine learning engineers and focus on taking ML models to production. As an Applied AI ML Tech Lead - Manager within the Digital Intelligence team at JPMorgan, you will lead a team of ML engineers with focus on all aspects of ML architecture, infra selection, model training, fine-tuning, ablation studies, and productization. This role requires strong technical expertise, leadership skills, and the ability to collaborate across teams. The ideal c...

Who Are We Step into the world of Mrsool where convenience meets innovation! As one of the largest delivery platforms in the Middle East and North Africa (MENA) region, Mrsool has captivated users with its unique and seamless experience, earning it the highest ratings among all major delivery platforms on both Apples App Store and Googles Play Store. What sets Mrsool apart is its commitment to providing an unmatched "order anything from anywhere" experience. Using Generative AI, we analyze customer instructions in real-time and search across 100,000+ restaurants and stores to find exactly what they need. Our cutting-edge technology, combined with a vast fleet of dedicated on-demand couriers,...

Description Enphase Energy is a global energy technology company and a leading provider of solar, battery, and electric vehicle charging products. Founded in 2006, our innovative microinverter technology revolutionized solar power, making it a safer, more reliable, and scalable energy source. Today, the Enphase Energy System enables users to make, use, save, and sell their own power. Enphase is also one of the most successful and innovative clean energy companies in the world, with more than 80 million products shipped across 160 countries. Join our dynamic teams designing and developing next-gen energy technologies and help drive a sustainable future! Must be available to work on-site at ou...

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

Job Description This role, part of the Digital Intelligence team, offers opportunity in the ficial services industry by developing impactful Machine Learning solutions As a Data Scientist Lead within the team at JPMorgan, you will collaborate with all lines of business and functions to deliver software solutions. You will have opportunity to research, experiment, develop, and productionize high-quality machine learning models, services, and platforms to make a significant business impact. You will also design and implement highly scalable and reliable data processing pipelines and perform analysis and insights to promote and optimize business results. Job responsibilities Design, deploy and ...

Looking for 4-6 years of hand-ons experience with production-level development and operations on AWS or Azure Cloud Develop and maintain infrastructure-as-code using Terraform to deploy and manage Kubernetes clusters (AKS) and Databricks environments Hands-on experience with data pipeline orchestration tools like Azure Data Factory, Amazon data Pipeline, Apache Spark, Databricks Hands-on experience with one or more of stream & batch processing systems: Kafka (Confluent cloud, open source), Apache Storm, Spark-Streaming, Apache Flink, Kappa architecture Experience in architecting right storage strategy for use-cases, keeping data processing, data accessibility, data availability and cloud cos...

Responsibilities: Build and maintain a database in the system. Assist in pre-sales outreach and follow-ups. Collaborate with marketing to run campaigns and generate quality leads. Prepare reports on lead generation activities and performance.

Technical Skills:(Primary) Overall, 6 8 yrs experience, with relevant experience on Azure Databricks for 4+ yrs Primary Technologies:Azure Databricks, spark, python Database Technologies:SQL, MS SQL Server, Relational Databases Experience in conducting Code Reviews for offshore team members Strong experience on ETL concepts Areas on Primary Skills Good understanding of databricks as a platform to write and execute notebooks. Should be able to create Databricks workflows and schedule them with dependencies Understands delta table as a concept and versioning to update/delete/merge the existing dataset and for DML operations Good knowledge of Spark framework, its internals and its distributed p...

Role:SAP BODS Consultant Experience :5 Years of Relevant Experience Location:Preferrable Bangalore, if not Location About The Role : : An accomplished SAP BODS (BusinessObjects Data Services) Consultant with five years of extensive experience in data integration, data quality, and data processing. Adept at transforming raw data into meaningful insights, optimizing ETL processes, and ensuring the smooth and efficient flow of data across various systems. Possesses a strong analytical mindset, excellent problem solving skills, and a proven track record of successful project deliveries. Technical Skills SAP BODS:Expertise in designing, developing, and deploying ETL solutions using SAP BODS. Data...

Description Maintains the ongoing operaensuring system performance availability reliability security recoverability change management regulatory compliances and efficient usage of server infrastructure resources. Performs the capacity planning required to build and maintain corporate databases to meet the processing demands. Provides database solutions to solve complex business issues including data processing loading performance improvements data storage and data replication. Diagnoses troubleshoots and resolves database related issues including storage performance availability data integrity and database security. Performs and automates database management maintenance and data processing a...

Description Responsibilities Must have 1. Strong expertise in SQL Python PySpark. 2. Good knowledge on Data warehousing techniques. 3. Good knowledge on AWS Big Data services and snowflake. Design develop and maintain scalable data pipelines and architectures for data processing and integration. Implement data streaming solutions to handle real-time data ingestion and processing. Utilize Python and PySpark to develop and optimize data workflows. Leverage AWS services such as S3 Redshift Glue Kinesis and Lambda for data storage processing and analytics. Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Ensure data quality i...