14310 Hive Jobs - Page 17

Engineering Manager – Data Engineering Experience: 6-14 Years Salary: Competitive Preferred Notice Period: Upto 45 Days Opportunity Type: Office (Noida) Placement Type: Full-time Note: This is a requirement for one of Uplers' Clients Nuaav: Must have skills: Azure OR synapse OR Data Factory OR Databricks OR Data lake OR Azure Data Lake AND Spark OR Python OR CI - CD AND Hive OR Scala About Nuaav: Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions. We partner with corporate clients to drive impactful change through specialized expertise in product engineering, data systems, AI/ML, and user experience. Our ser...

As AWS Data Engineer at organization, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives You will design and maintain scalable data pipelines using AWS data analytical resources, enabling efficient data processing and analytics. Key Responsibilities: - Highly experiences in developing ETL pipelines using AWS Glue and EMR with PySpark/Scala. - Utilize AWS services (S3, Glue, Lambda, EMR, Step Functions) for data solutions. - Design scalable data models for analytics and reporting. - Implement data validation, quality, and governance ...

Description: Proficiency/good understanding in at least couple of the following:Ab Initio SQL Data Modelling / relationships RDBMS Hadoop Machine Learning algorithms Ensure consistency in approach design and output to deliver quality and concise design solution documentation. Lead best practice methodology for design Define promote re-usable extendible scalable maintainable solution considering tradeoff for cost vs benefit Communicate at all levels in a clear and credible way about the importance of solution design. Lead developers in the team and foster a shared vision for design. Knowledgeable and skilled at the practice of data driven design solutions. Expert communications to all levels ...

Description: Proficiency/good understanding in at least couple of the following:Ab Initio SQL Data Modelling / relationships RDBMS Hadoop Machine Learning algorithms Ensure consistency in approach design and output to deliver quality and concise design solution documentation. Lead best practice methodology for design Define promote re-usable extendible scalable maintainable solution considering tradeoff for cost vs benefit Communicate at all levels in a clear and credible way about the importance of solution design. Lead developers in the team and foster a shared vision for design. Knowledgeable and skilled at the practice of data driven design solutions. Expert communications to all levels ...

Description: Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be ...

Description: Objective:Build and maintain data pipelines and infrastructure to support data storage and processing. Key Responsibilities: -Design develop and optimize data pipelines using Azure Databricks. -Ensure data reliability scalability and quality. -Integrate data sources into a unified platform. -Monitor and troubleshoot data workflows. Skills Required: -Expertise in Azure Databricks Spark and big data tools. -Strong programming skills (e.g. Python Scala SQL). -Knowledge of ETL processes and cloud technologies. -Familiarity with CI/CD practices for data pipelines Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named J...

Description: 1. Job Summary:We are seeking a C2 Level skilled HVR Administrator to join our team for a critical data migration project at GE Vernova. The successful candidate will be responsible for overseeing the migration of data from GE's OneStream ERP system to a new data lake using HVR (High Volume Replication). This role involves the initial installation and configuration of HVR on a new instance, ensuring seamless data replication and integration. 2.Key Responsibilities:HVR Installation and Configuration:Install and configure HVR on the new instance. Set up HVR hub, channels, and locations for data replication. Data Migration:Plan and execute the migration of data from OneStream ERP t...

Description Primary Skill Kafka Cluster Management,Kafka admin,Kubernetes,Helm ,DevOps, Jenkins Secondary Skill:Grafana, Prometheus, Dynatrace Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Kafka Cluster Management;Kubernetes Languages RequiredENGLISH Role Rarity To Be Defined

To ensure successful initiation, planning, execution, control and completion of the project by guiding team members on technical aspects, conducting reviews of technical documents and artefacts. Lead project development, production support and maintenance activities. Fill and ensure timesheets are completed, as is the invoicing process, on or before the deadline. Lead the customer interface for the project on an everyday basis, proactively addressing any issues before they are escalated. Create functional and technical specification documents. Track open tickets/ incidents in queue and allocate tickets to resources and ensure that the tickets are closed within the deadlines. Ensure analysts ...

Description Job Summary Role Value Proposition MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights and value to its customers. The team is the center of excellence in data engineering in MetLife and plays a key role in data enablement through multiple data stores supporting different kind of analytical use cases to be able to derive predictive prescriptive and descriptive insights. The Azure Data Engineer III serves as big data development expert within the data analytics engineering organization of MetLife Data & Analytics. This p...

Description Key Responsibilities Analyse raw data from various source files (e.g. EXCEL CSV JSON XML Parquet etc.) to identify formatting issues inconsistencies missing values and discrepancies. Use PySpark to transform clean and restructure source data to match the expected format for further processing and analysis. Apply data validation rules and data quality checks to correct issues related to data integrity including handling null values duplicate records and data type mismatches. Develop PySpark jobs to transform raw data into standardized formats (e.g. converting date formats normalizing text fields correcting encoding issues). Ensure that data transformations meet the required schema...

Location Hyd / Pune / Bengaluru JD 1ETL, Pyspark Experience4 8 years Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Familiarity with Agile/Scrum development methodologies. Excellent analytical and problem solving skills. Strong communi...

Title / Role No of Pos About The Role Must Skills Yrs of Exp Location Work Timings Scala+spark scala+spark/play+hive+cicd+cloud(aws perfered or any other cloud) and sql, candidate should be good with advanced programming language (scala) Scala,(either spark or play),sql & cloud(aws preferred) 5+yr Hyderabad WFO

Description Key job responsibilities include, but are not limited to Become involved with day-to-day operations in Production Control. Understand the workflows and be able to troubleshoot issues and define new workflows in PCS and Control-M Design Airflow infrastructure according to the industry best practices. Work with System Administrators, Platform Engineers, Network, Firewall and Monitoring teams on the implementation of the infrastructure. Document the system's specifics, define, and implement administrative controls and policies of Airflow. Work with the development teams to identify the groups of jobs to migrate to airflow. Assist the development teams with the migrationsdefine DAGs,...

Description The position involves working within our CX Program Implementation team with a focus on building the surveys and reporting. Your day would include working with the business analyst to understand CX requirements shared by the stakeholders and work with the implementation team to develop solutions. The role requires a creative thinker who can solve problems through innovative technology solutions while supporting the development of customer experience programs. Responsibilities ? Configure the Medallia surveys and reporting setup as per the requirements shared by the Business Analyst. ? Build Auto Importers for the new survey programs. ? Conduct file inflow reviews to understand th...

Data ModelingThey create data models using Entity Relationship (ER) diagrams to define how data entities interact and relate to each other. This ensures data organization and accessibility. Data Architecture DesignThey design and implement the technical architecture for data storage, processing, and retrieval. This includes data lakes, data warehouses, and data pipelines. Data GovernanceData architects establish data governance policies and procedures to ensure data quality, security, and compliance with regulations Skills: Strong understanding of data modeling concepts (ER diagrams) Knowledge of database technologies (SQL, NoSQL) Expertise in data warehousing and data lakes Experience with ...

Description JDCompany Profile Morgan Stanley is a leading global financial services firm providing a wide range of investment banking, securities, investment management, and wealth management services. The Firm's employees serve clients worldwide, including corporations, governments, and individuals from more than 43 countries. Morgan Stanley is an equal opportunities employer. As a market leader, the talent and passion of our people are critical to our success. Together, we share a common set of values rooted in integrity, excellence, and strong team ethic. We work to provide a supportive and inclusive environment where all individuals can maximize their full potential. Our strong commitmen...

JR REQ---Data Engineer(Pyspark, Big mailto:data)--4to8year---hyd----hemanth.karanam@tcs.com----TCS C2H ---900000

Abinitio Developer 4+ years Up to 15LPA Trivandrum, Chennai AbInitio,Java,Gde,Unix Immediate to 30 days

Abinitio Lead 7 +years Up to 25LPA Trivandrum, Chennai AbInitio,Java,Gde,Unix Immediate to 30 days

Description Proficiency in Apache NiFi, including developing, deploying, and managing NiFi data flows.(Primary) Strong knowledge of data integration and ETL processes.(Primary) DatabasesProficient in working with MySQL, Oracle, HBase, and MongoDB.(primary) Languages FrameworksExpertise in Scripting z. Experience with developing RESTful web services and integrating Apache Kafka.(Secondary) Development OperationsKnowledge of CI/CD pipelines, Jenkins, Docker, Kubernetes, and Git.( Secondary) Required Skills: Big Data TechnologiesExperience with Apache NiFi, HDFS, and Hive. (Primary) Cloud TechnologiesHands-on experience with AWS services, including EC2, S3, Elastic Beanstalk, DynamoDB, RDS, Lam...

Description Must have Skills in PowerBuilder and strong SQL /database skills Good to Have SSIS Powerbuilder 20172022 R3 Sybase MS SQL server Production support 10 years of experience with PowerBuilder development 10 years of experience with MS SQL server Experience in writing SQL scripts to manipulate data using Sybase SQL server database and ability to create or modify stored procedures and triggers Experience with supporting systems in production support and maintenance Ability to analyze requirements and formulate design Excellent oral and written communication skills Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job...

Data engineer Skills Required: Strong proficiency in Pyspark , Scala , and Python Experience with AWS Glue Experience Required: Minimum 5 years of relevant experience Location: Available across all UST locations Notice Period: Immediate joiners (Candidates available to join by 31st January 2025 ) SO - 22978624 Location - Chandigarh,Dadra & Nagar Haveli,Daman,Diu,Goa,Haveli,Jammu,Lakshadweep,Nagar,New Delhi,Puducherry,Sikkim

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight

Clientpersistent Role- C2H Location(Hybrid) Experience5-8 Years Budget20 LPA POC:Bhajan About The Role MUST have SkillData Stage, SnowSQL Skill Description ETL, Data Warehousing, Data Stage, Testing,IBM Datastage Data Stage, IBM Datastage, ETL, Testing, Data Warehousing, SnowSQL Location - Chandigarh,Dadra & Nagar Haveli,Daman,Diu,Goa,Haveli,Jammu,Lakshadweep,Nagar,New Delhi,Puducherry,Sikkim