Jobs
Interviews
UST logo

StreamSets and Snowflake Developer

3 - 7 years

0 Lacs

karnataka

Posted:1 day ago| Platform: Shine logo

Apply

Skills Required

snowflake python sql docker streamsets etlelt cicd

Work Mode

On-site

Job Type

Full Time

Job Description

You are an experienced StreamSets and Snowflake Developer who will be responsible for designing and implementing robust, scalable data pipelines and efficient data management solutions. Your proficiency in StreamSets, Snowflake, Python, and SQL will be key in building modern data platforms and automation using CI/CD tools. **Key Responsibilities:** - **Technical Delivery:** - Design and implement scalable data pipelines in StreamSets to migrate data from SQL Server to Snowflake. - Develop and manage StreamSets pipelines using the StreamSets Python SDK. - Build stored procedures in Snowflake using SQL, Python, or JavaScript. - Create and manage Snowflake virtual warehouses, tasks, streams, and Snowpipe. - Upgrade and manage StreamSets Data Collector engines using Docker. - Deploy and manage credentials in Azure Key Vault, integrating with StreamSets. - **Optimization & Security:** - Apply performance tuning and optimization techniques for Snowflake warehouses. - Implement data security via RBAC, masking policies, and row-level access policies in Snowflake. - **Development Practices:** - Write clean, maintainable, and secure code in Python and SQL. - Conduct unit testing and manage defect lifecycle (raise, fix, retest). - Estimate time, effort, and resources for assigned tasks. - **Collaboration & Mentorship:** - Mentor junior developers and provide feedback via FAST goal-setting. - Actively engage with customers to understand business problems and propose effective solutions. - **CI/CD & Automation:** - Automate deployment and integration using GitHub Actions and Azure DevOps pipelines. - Identify opportunities for process improvement and automation in agile delivery models. **Outputs Expected:** - Clean, tested code with proper documentation - Updated knowledge repositories (e.g., SharePoint, wikis) - Accurate task estimates and timely delivery - Regular status updates in line with project standards - Compliance with release and configuration management processes **Skills Required:** **Must-Have Technical Skills:** - StreamSets: Strong knowledge of StreamSets architecture and pipeline design - Snowflake: Experience with Snowflake SQL, Snowpark, Snowpipe, RBAC, masking & row access policies - Python: Developing data pipelines and stored procedures - SQL: Strong experience writing complex SQL queries - ETL/ELT: Deep understanding of data integration concepts - Docker: Managing containers and deploying StreamSets Data Collector - CI/CD: GitHub Actions and Azure DevOps pipeline experience **Additional Technical Knowledge:** - Experience with stored procedures in SQL, Python, and JavaScript - Working knowledge of Agile methodologies - Familiarity with data security best practices - Operating systems, IDEs, and database platforms - Knowledge of customer domain and sub-domain **Soft Skills:** - Excellent verbal and written communication - Team collaboration and mentoring capabilities - Proactive problem-solving - Customer-centric mindset **Performance Metrics:** - Adherence to coding standards, SLAs, and timelines - Minimal post-delivery defects - Timely bug resolution - Completion of training and certifications - Knowledge contribution and documentation quality,

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs
|

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs
|

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs
|

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

UST logo

StreamSets and Snowflake Developer

UST

karnataka

UST logo

StreamSets and Snowflake Developer

UST

karnataka