9690 Big Data Jobs - Page 7

Description: The position involves working within our CX Program Implementation team with a focus on building the surveys and reporting. Your day would include working with the business analyst to understand CX requirements shared by the stakeholders and work with the implementation team to develop solutions. The role requires a creative thinker who can solve problems through innovative technology solutions while supporting the development of customer experience programs. Responsibilities ? Configure the Medallia surveys and reporting setup as per the requirements shared by the Business Analyst. ? Build Auto Importers for the new survey programs. ? Conduct file inflow reviews to understand t...

Data Engineer- Skill-Apache, Scala, Spark

Greetings from Encora Innovation Labs Pvt Ltd (Encora)! Encora is looking for Lead Data Engineer with 10-15 year s experience in Scala, Spark (Databricks) and PySpark. Important Note : We are looking for an immediate joiner for this role! If you're on a 30/60/90-day notice period, this opportunity may not be the right fit at the moment. We truly appreciate your understanding! Please find the below detailed job description and the company profile for your better understanding. Position: Lead Data Engineer Experience: 10-15 years Job Location: Bangalore / Chennai / Pune / Hyderabad / Noida Position Type: Full time Qualification: Any graduate Work Mode: Hybrid Job Summary: We are looking for an...

Description: Strong understanding on any Azure services like ADF, Synapse, Spark/Pyspark, SQL, data analysis will remain critical. Another critical one that the resource should have 5+ years of experience with hands-on with programming. Implementation of data pipelines using big data tools such as Fabric, Azure Data Factory, PySpark, SparkSQL, SQL, Azure DevOps etc. ETL (Extract, Transform, Load) scripts and workflow configurations Analyzing functional specifications, design and development of dimensional models, KPIs and metrics Data Ingestion from various source applications with adherence to business SLAs Implementation of data security measures, such as encryption and access controls Dat...

Description: Responsibilities: Develop and implement data governance frameworks and policies to ensure data trust. Establish data quality standards metrics and processes for monitoring and improving data integrity. Implement data privacy measures and ensure compliance with regulations. Collaborate with cross-functional teams to define data stewardship roles and responsibilities. Conduct regular audits and assessments to maintain data quality and security. Implement data management tools and technologies to support data governance initiatives. Provide training and guidance on data trust best practices to internal stakeholders. Stay informed on industry trends and best practices in data govern...

Description: Experience in following technologies: Hadoop Spark Hive Pig SQL query experience in data application development at scale in the Hadoop ecosystem. Bigdata Spark kafka Java/python/scala Hadoop hive design and architecture problem solving skills Roles and responsibilities Drive the technical design of large scale data platforms utilizing modern and open source technologies. Set standards for data engineering functions; design templates for the data management program which are scalable repeatable and simple Serve as a consultant on all aspects of data engineering analytics and data projects Be able to consult on complex data engineering efforts and lead project teams through the s...

Java Developer SIP implementation experience Exposure to OCAAS would be added advantage 1. Hands-on experience in software development (testing and support experience will not be counted) 2. Must have worked on least 2 microservices based projects 3. Technical skills 4. Programming - Java, J2EE, Struts/Spring MVC Framework with JSON and XML usage 5.Hands on experience in Java8, Spring 4+, JPA, REST API 6.Hands on experience in Spring Boot and Spring Cloud 7.Good experience in designing Webservices (REST) 8.Databases lilkeSQl, NO SQL, Graph Db, Big Data 9.Design patterns Good knowledge of OOPS concepts, Hibernate 10.Messaging likeRabbitMQ, KAFKA and likes,DevOps tools 11. Experience with unit...

Looking for a Data Engineer to manage and optimize data pipelines and architectures. Candidate should have experience in database management, ETL processes, and data integration. Proficiency in tools such as SQL, Python, and big data technologies is required. The role involves working with large datasets and ensuring data quality. Location: Flexible.

Description India Template - R2D2 Global Interfaces Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade D Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills data architecture;AWS Languages RequiredENGLISH Role Rarity To Be Defined

JD for Unity Catalog and Databricks Engineer ClientPersistent Role C2H LocationPan India Job description Experience-6 to 9yrs overall, Also experience in Pyspark, Databricks Location-PAN INDIA(except Hyderabad and Chennai as preferred location) NP-Immediate/15 days Hybrid-2 or 3 days WFO "Unity Catalog Adoption Data Engineer 3-6 Years,PySpark,Databricks,Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows. Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to e...

Description Strong knowledge in ETL testing using Big Data/DWH Core hands on testing skills in Bigdata ecosystem i.e. Hbase hive Solar Good knowledge of test data management process and test management tools like QC/ALM and Qtest Working knowledge of FRD BRD mapping documents based on requirements Understanding of Agile methodology Working knowledge of Azure devops boards and JIRA Strong knowledge on complex queries such as SQL HQL Knowledge of UNIX commands Knowledge of TOSCA is plus Knowledge of Putty and IBM data studio . Automation knowledge Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs ...

Description Strong knowledge in ETL testing using Big Data/DWH Core hands on testing skills in Bigdata ecosystem i.e. Hbase hive Solar Good knowledge of test data management process and test management tools like QC/ALM and Qtest Working knowledge of FRD BRD mapping documents based on requirements Understanding of Agile methodology Working knowledge of Azure devops boards and JIRA Strong knowledge on complex queries such as SQL HQL Knowledge of UNIX commands Knowledge of TOSCA is plus Knowledge of Putty and IBM data studio . Automation knowledge Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs ...

Skill : Big Data Need to Have : Python, Pyspark, Trino, Hive Good to Have : Snowflake, SQL, Airflow, Openshift, Kubernentes Location : Hyderabad, Pune, Bangalore Job Description : Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data. Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform, including structured and unstructured data from various document formats . Collaborate closely with cross functional teams to gather requirements, understand data needs, and translate them into technical solutions. Implement DataOps pr...

Seeking an Azure Data Engineer with expertise in data architecture and .NET development. Responsibilities include building and optimizing data pipelines, as well as integrating .NET applications with cloud data solutions. Experience with Azure Data Factory, SQL, and .NET Core required. Strong data engineering and development skills are essential for the role. Location: Flexible.

Looking for a Data Scientist with experience in analyzing and interpreting complex data sets. Responsibilities include building predictive models, data analysis, and reporting. Must be proficient in data science tools and languages such as Python, R, or SQL. Experience with machine learning algorithms and big data technologies is a plus. Location: Flexible.

Location : Hyd / Pune / Bengaluru JD 1: ETL, Pyspark Experience: 4 8 years Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Familiarity with Agile/Scrum development methodologies. Excellent analytical and problem solving skills. Strong c...

Description: Data Engineer : You will be responsible for designing building and maintaining our data infrastructure ensuring data quality and enabling data-driven decision-making across the organization. The ideal candidate will have a strong background in data engineering excellent problem-solving skills and a passion for working with data. Responsibilities: Design build and maintain our data infrastructure including data pipelines warehouses and databases Ensure data quality and integrity by implementing data validation testing and monitoring processes Collaborate with cross-functional teams to understand data needs and translate them into technical requirements Develop and implement data ...

Job Title: Engineer, Associate Location: Pune, India Role Description An Engineer is responsible for designing, developing and support a strategic US Finance Regulatory Reporting platform for the Bank. Join us and you will be on the front lines of transformation for this domain - leveraging cutting edge open-source technologies and highly collaborative agile processes to deliver valuable business solutions that you can be proud of. You will share your passion for technical excellence and engage the full depth of your engineering skills in a diverse cross functional team that partners with business and technology experts globally to develop innovative solutions to complex business problems. Y...

Location Chennai and Hyderbad preferred but customer is willing to take resources from Hyderabad Experience 5 to 8 yrs ( U3 ). Exp - 5- 10 Yrs Location - Hyderabad / Chennai Location Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Famil...

SQL Budget -13$ /Hour (18 LPA) Location - Bangalore 3-5 years Primary skill is SQL we are looking for someone with expertise in SQL, advanced SQLbasic working knowledge of Python, Shell scriptinggood to have Airflow and MDM conceptsNeed to work from Bangalore office of customer few days from customer and few days remotely.Good knowledge on SQLbasic knowledge on Python, Shellgood to have Airflow and MDM concepts

Description Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Ruby;automation;Python Languages RequiredENGLISH Role Rarity To Be Defined

SUMMARY Wissen Technology is Hirin g for Data Engineering Support Engineer / Manager About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domai...

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

JD Java Developer SIP implementation experience Exposure to OCAAS would be added advantage 1. Hands-on experience in software development (testing and support experience will not be counted) 2. Must have worked on least 2 microservices based projects 3. Technical skills 4. Programming - Java, J2EE, Struts/Spring MVC Framework with JSON and XML usage 5.Hands on experience in Java8, Spring 4+, JPA, REST API 6.Hands on experience in Spring Boot and Spring Cloud 7.Good experience in designing Webservices (REST) 8.Databases lilkeSQl, NO SQL, Graph Db, Big Data 9.Design patterns Good knowledge of OOPS concepts, Hibernate 10.Messaging likeRabbitMQ, KAFKA and likes,DevOps tools 11. Experience with u...

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...