1357 Hbase Jobs - Page 14

JD:- Total Yrs. of Experience* 6+ Relevant Yrs. of experience* 6+ Detailed JD *(Roles and Responsibilities) 6+ years experience in Kafka, Spark, Scala ,Pyspark Strong knowledge of implementing and maintaining scalable streaming and batch data solutions with high throughput and strict SLA. Extensive experience of working in production with Kafka, Spark and Kafka Stream including best practices, observability, optimization, performance tuning. Knowledge of Python and Scala including best practices, architecture, dependency management Collaborate with cross-functional teams to understand data requirements and integrate data from multiple sources, ensuring data consistency and quality Mandatory ...

Job Details: Skill: Scala,hadoop,java, Job type: contract to hire Job Description: - 10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this inclu...

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

Notice Period: Immediate Joiners Job Description: Must have skills Azure DataBricks, Python And Pyspark, Spark. Please find the JD In the mail chain Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on experience in Azure Databricks , Data Factory, Data Lake store/Blob storage, SQL DB Experience in creating Big data Pipelines with Azure components Hands on programing with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience with messaging systems, such as Kafka or RabbitMQ Good understanding of...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

We are looking for a skilled Hadoop Admin with 7 to 12 years of experience, located in Hyderabad, Bangalore, Chennai, and Bhubaneshwar. The ideal candidate will have hands-on experience in building EKS clusters, Spark on EKS, AWS (EMR, S3, RDS), Python as programming skills, Shell scripting, and any CI/CD. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement scalable data processing pipelines using Spark and Airflow instances. Integrate Ranger and Hive Metastore services in EKS for secure data storage and access. Collaborate with cross-functional teams to identify and resolve technical issues. Develop and impleme...

We are looking for skilled Hadoop Developers with 5-10 years of experience to join our team in Bangalore, Kolkata, Hyderabad, and Pune. The ideal candidate should have strong proficiency in Hadoop, Scala, Spark, and SQL. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Spark and Scala. Troubleshoot and resolve complex technical issues related to Hadoop. Participate in code reviews and ensure high-quality code standards. Stay updated with the latest trends and technologies in Hadoop development. Job...

We are looking for a skilled Data Engineer with 4 to 7 years of experience to join our team in Bangalore. The ideal candidate will have expertise in Python, SQL, AWS, Spark, and Big Data processing frameworks. Roles and Responsibility Design and develop scalable data pipelines using Python, Scala, or Java. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Hadoop and Big Data processing frameworks. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data storage and retrieval processes for improved performance and efficiency. Participate in code reviews t...

We are looking for a skilled professional with expertise in Spark and Scala to join our team. The ideal candidate will have 4 to 10 years of experience. Roles and Responsibility Design, develop, and implement scalable data processing pipelines using Spark and Scala. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Big Data Technologies such as Hadoop, Hive, and HBase. Troubleshoot and optimize performance issues in existing data systems. Participate in code reviews and ensure adherence to coding standards. Stay updated with industry trends and emerging technologies in the field of Spark and Scala. Job...

We are looking for a skilled Data Engineer with 4 to 7 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. The ideal candidate will have expertise in Python, Pyspark, SQL, Hadoop, and NoSQL databases. Roles and Responsibility Design and develop scalable data pipelines using Azure ML, Azure Data Factory, and MLOps. Collaborate with cross-functional teams to integrate data from various sources into a unified platform. Develop and maintain large-scale data warehouses using Hadoop and NoSQL databases. Implement CI/CD pipelines for automated testing and deployment of data engineering projects. Troubleshoot and resolve complex technical issues related to data engineeri...

We are looking for a skilled Pyspark Data Engineer with 3 to 5 years of experience. The ideal candidate will have expertise in Hadoop, Spark/Pyspark, Hive, YARN, Scala development, and data modeling. This position is based in Pune and Hyderabad. Roles and Responsibility Design and develop scalable data pipelines using Pyspark and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and architectures. Ensure data quality and integrity by implementing robust testing and validation procedures. Participate in code reviews and contribute to improving overall code quality. Troubleshoot and resolve complex tech...

We are looking for skilled Hadoop Developers with 7-10 years of experience to join our team in Bangalore and Hyderabad. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and optimize system performance issues. Ensure data quality and integrity through data validation and testing procedures. Participate in code reviews and contribute to improving overall code quality. Job Requirements Strong proficiency in Hadoop, Scala, Spark, and SQL. Experience working with big ...

We are looking for a skilled Pyspark Data Engineer with 5 to 7 years of experience, located in Pune and Hyderabad. The ideal candidate will have expertise in Pyspark, Scala, Hive, Airflow, Control M, CICD, Python, Hadoop, Data Modelling, and experience with Jira, Confluence, GitHub, or other similar Agile Scrum technologies. Roles and Responsibility Design and develop scalable data pipelines using Pyspark and Airflow. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Hadoop and Data Modelling techniques. Troubleshoot and resolve complex technical issues related to data processing and analysis. Implemen...

We are looking for a skilled professional with 7 to 12 years of experience in Azure API, APIM, Integration, and Restful Services-Architecture Design. The ideal candidate will have a strong background in these areas and be able to work on complex projects. This position is based in Bangalore. Roles and Responsibility Design and develop scalable and secure Azure API solutions. Collaborate with cross-functional teams to integrate APIs with other systems. Develop and implement RESTful services architecture designs. Ensure compliance with API security standards. Troubleshoot and resolve technical issues related to Azure API integration. Participate in code reviews and contribute to improving over...

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

We are looking for a skilled Databricks & AWS Lead with 7-14 years of experience to join our team in Pune, Mumbai, Chennai, Hyderabad, Bangalore, and Noida. The ideal candidate will have expertise in Databricks and AWS, Unity Catalog, Spark, SQL, and Python. Roles and Responsibility Design and implement data pipelines using Databricks and AWS. Develop and maintain big data technologies and data warehousing solutions. Create CI/CD pipelines using Jenkins or GitLab CI/CD. Collaborate with cross-functional teams to identify and prioritize project requirements. Troubleshoot and resolve technical issues related to Databricks and AWS. Ensure data quality and integrity by implementing data validati...

We are looking for a highly skilled MLOps professional with 0 to 30 days of experience to join our team in Bangalore, Hyderabad, Pune, Chennai, and Kolkata. The ideal candidate will have expertise in MLOps, including Azure/AWS/GCP, Pyspark, and Bigdata. Roles and Responsibility Design and implement scalable data pipelines using MLOps tools. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale machine learning models and algorithms. Ensure seamless integration of MLOps solutions with existing systems and infrastructure. Troubleshoot and resolve complex technical issues related to MLOps. Stay up-to-date with industry trends a...

We are looking for a skilled Hadoop Admin with 4 to 9 years of experience. The ideal candidate will have expertise in Hadoop administration, CDP distribution, Dataflow, and Big data platform. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement data pipelines using Kafka and Nifi profiles. Develop and execute Linux shell scripts for automation and monitoring. Collaborate with cross-functional teams to resolve technical issues and improve processes. Ensure compliance with security best practices and industry standards. Troubleshoot and optimize HBase databases for improved query performance. Job Requirements Stron...

We are looking for a skilled Lead Data Engineer with 5 to 10 years of experience to join our team in Bangalore. The ideal candidate will have expertise in Data Engineering, Python, SQL, AWS, Spark, Hadoop, and Big Data processing frameworks. Roles and Responsibility Design and develop large-scale data pipelines using various data engineering tools and technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data architectures and data warehouses. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Mentor...

What youll do: Undertake primary ownership in driving self and team effort across all phases of a project lifecycle. Translate business requirements into technical terms and drive team effort to design, build and manage technology solutions that solve business problems. Apply appropriate development methodologies (e.g. agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA procedures, unit testing) to ensure successful and timely completion. Partner with Project lead/ Program lead in delivering projects and assist in project management responsibility like - project plans, people management, staffing and risk mitigation. Collaborate with other team members acr...

Responsibility Develops ETL technical specifications, designs, develops, tests, implements, and supports optimal data solutions. Hands on experience on Pentaho reporting tool. Pentaho Report designing, sub-reports and ad hoc reports, Developing API through CDA community data access. The ability to write Mondrian cubes both on snowflakes and star schema and build analyzer reports. Hands on experience in writing code to process large amount of structured & unstructured data Excellent analytical capability and problem-solving abilities. Exposure to Agile software development process. Demonstrated technical communication skills - both oral and written. Good English communication skills - present...

Location - Bangalore Experience- 5+ Years Job Details: Must Have Skills (Top 3 technical skills only) * 1. Spark 2. Java 3. Hive Nice to have skills (Top 2 only) 1. scala 2. Cloud understanding Detailed Job Description: 4 to 5 years of experience in big data analytic solutions. Familiarity with Agile or other rapid application development methods. Hands on experience with one or more programming languages Java, Python, Scala. Handson expertise with application design and software development in Big Data across one or more platforms, languages, and tools Hadoop, MapReduce, Spark PySpark, HIVE, HBase, NoSQL SQL Databases. Strong communication and analytical skills. Able to communicate with pro...

Hiring!! Pune Only!!!!!! Key Responsibilities Analyze and evaluate ML algorithms for specific business problems, ranking them by success probability. Explore, analyze, and visualize datasets to derive insights and ensure data quality. Oversee data acquisition and preprocessing, including feature engineering workflows. Define model validation strategies and design/implement data augmentation pipelines. Train, optimize, and fine-tune ML/DL models, analyze errors, and implement corrective solutions. Establish and manage A/B testing frameworks. Deploy and maintain MLOps pipelines for production use. Technical Expertise Strong hands-on experience with ML/DL frameworks: TensorFlow, PyTorch, Keras,...

Skills : Experienced in MS*Server, SSIS, and Talend Knowledge on Databricks, Snowflake, Teradata, Oracle, Google Big Query, Hadoop, and related stacks, diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases. Notice Period: immediate-30 days Education BE BTech, ME MTech, BCA,

Skills: Complex Databricks implementations,Architect level certification from Databricks, Python, Scala and SQL,Strong depth in Lakehouse Architecture with Delta Tables, Expertise in Spark ecosystems, Data frame API, spark streaming, Data set API, RDD APIs & Spark SQL.,Expertise Notice Period: Immediate -45 days