ETL Testing (ETL Pipeline ,DWH, Test cases, SQL, Regression, Azure Databricks) VidPro Consultancy Services

3.0 - 7.0 years

0 Lacs

chennai, tamil nadu

On-site

You will be responsible for performing comprehensive testing of ETL pipelines to ensure data accuracy and completeness across different systems. This includes validating Data Warehouse objects such as fact and dimension tables, designing and executing test cases and test plans for data extraction, transformation, and loading processes, as well as conducting regression testing to validate enhancements with no breakage of existing data flows. You will also work with SQL to write complex queries for data verification and backend testing, and test data processing workflows in Azure Data Factory and Databricks environments. Collaboration with developers, data engineers, and business analysts to understand requirements and proactively raise defects is a key part of this role. Additionally, you will be expected to perform root cause analysis for data-related issues and suggest improvements, as well as create clear and concise test documentation, logs, and reports. The ideal candidate for this position should possess strong knowledge of ETL testing methodologies and tools, excellent skills in SQL including joins, aggregation, subqueries, and performance tuning, hands-on experience with Data Warehousing and data models (Star/Snowflake), and experience in test case creation, execution, defect logging, and closure. Proficiency in regression testing, data validation, and data reconciliation is also required, as well as a working knowledge of Azure Data Factory (ADF), Azure Synapse, and Databricks. Experience with test management tools like JIRA, TestRail, or HP ALM is essential. Nice to have qualifications include exposure to automation testing for data pipelines, scripting knowledge in Python or PySpark, understanding of CI/CD in data testing, and experience with data masking, data governance, and privacy rules. To qualify for this role, you should have a Bachelors degree in Computer Science, Information Systems, or a related field, along with at least 3 years of hands-on experience in ETL/Data Warehouse testing. Excellent analytical and problem-solving skills, strong attention to detail, and good communication skills are also necessary for this position.,

Posted 2 weeks ago

Apply

Data Engineer - Pyspark Veracity Software Inc

3.0 - 7.0 years

0 Lacs

pune, maharashtra

On-site

The ideal candidate for this position should have advanced proficiency in Python, with a solid understanding of inheritance and classes. Additionally, the candidate should be well-versed in EMR, Athena, Redshift, AWS Glue, IAM roles, CloudFormation (CFT is optional), Apache Airflow, Git, SQL, Py-Spark, Open Metadata, and Data Lakehouse. Experience with metadata management is highly desirable, particularly with AWS Services such as S3. The candidate should possess the following key skills: - Creation of ETL Pipelines - Deploying code in EMR - Querying in Athena - Creating Airflow Dags for scheduling ETL pipelines - Knowledge of AWS Lambda and ability to create Lambda functions This role is for an individual contributor, and as such, the candidate is expected to autonomously manage client communication and proactively resolve technical issues without external assistance.,

Posted 3 weeks ago

Apply

Sharepoint Administrator Shashwath Solution

9.0 - 14.0 years

9 - 14 Lacs

Bengaluru / Bangalore, Karnataka, India

On-site

Designing and developing custom SharePoint solutions based on business requirements. Creating and configuring SharePoint sites, lists, libraries, workflows, and web parts. Developing custom forms and templates using InfoPath and SharePoint Designer. Providing technical support for SharePoint users. Developing and implementing SharePoint security and access controls. Monitoring SharePoint performance and troubleshooting issues. Collaborating with other developers and stakeholders to ensure solutions meet business needs. Excellent knowledge of understanding organization structures and business operations and accordingly designing a SharePoint implementation Experience on SharePoint Online Experience with Document Management Portals as well as Intranet. Ensure security by design to uphold building automated testing into the build and release pipelines. Creation of re-usable design patterns, and guard rails for citizen developers Identify, analyse, and develop points of integration with other solutions to enable better use of data. Develop integrations using APIs to improve ETL pipeline mechanism. Work closely with the business and users to gather requirements, provide status updates, and build relationships.

Posted 1 month ago

Apply

Tech. PM - Data Engineering-Data Analytics@ Gurgaon/Blore_Urgent Bean Hr Consulting

5.0 - 10.0 years

27 - 32 Lacs

Gurugram, Bengaluru

Work from Office

Job Title - Technical Project Manager Location - Gurgaon/ Bangalore Nature of Job - Permanent Department - data analytics What you will be doing Demonstrated client servicing and business analytics skills with at least 5 - 9 years of experience as data engineer, BI developer, data analyst, technical project manager, program manager etc. Technical project management- drive BRD, project scope, resource allocation, team coordination, stakeholder communication, UAT, Prod fix, change requests, project governance Sound knowledge of banking industry (payments, retail operations, fraud etc.) Strong ETL experience or experienced Teradata developer Managing team of business analysts, BI developers, ETL developers to ensure that projects are completed on time Responsible for providing thought leadership and technical advice on business issues Design methodological frameworks and solutions. What were looking for Bachelors/masters degree in computer science/data science/AI/statistics, Certification in Gen AI. Masters degree Preferred. Manage multiple projects, at a time, from inception to delivery Superior problem-solving, analytical, and quantitative skills Entrepreneurial mindset, coupled with a “can do” attitude Demonstrated ability to collaborate with cross-functional, cross-border teams and coach / mentor colleagues.

Posted 1 month ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.