Pipeline Automation Jobs – Apply to Latest Pipeline Automation Job Vacancies

Salesforce DevOps Engineer Ngauge Digital

6 - 10 years

0 - 1 Lacs

Nagpur

Remote

Position: Salesforce DevOps Engineer Experience: 6-10 Years Location: Remote Working Hours: UK Time Zone Expected Start Date: Immediate Joiner Required Skills & Experience: Strong Salesforce development background Hands-on experience with Azure DevOps Expertise in YAML scripting for pipeline configuration CI/CD pipeline development and maintenance Experience with GitHub Actions and workflow automation AKS (Azure Kubernetes Service) expertise is a must Strong knowledge of Azure cloud platform Familiarity with PowerShell scripting (good to have) Version control and branching strategy implementation Experience with automated testing frameworks Understanding of DevOps security best practices

Posted 1 month ago

Apply

Devops+ Python+ C# Experts immediate joining For Bangalore White Horse Manpower Consultancy

6 - 8 years

20 - 27 Lacs

Bengaluru

Work from Office

Strong programming skills* in C# and Python. Experience with Azure* cloud platform, including Azure DevOps, AKS, Azure Functions, and Azure Storage. YAML expertise* for CI/CD pipeline configuration and Azure DevOps. Exp with CI/CD pipelines* Required Candidate profile Cloud Infrastructure Management: including Azure Kubernetes Service (AKS), Azure Functions, and Azure Storage. C# and Python Development* Perks and benefits Perks and Benefits

Posted 1 month ago

Apply

Sr. Data Engineer US Shift Iconma

7 - 12 years

20 - 35 Lacs

Hyderabad

Work from Office

Job Description Data Engineer Job Description Job Title: Senior Data Engineer (Data Lake & Medallion Architecture) Location: US based Remote (U.S. working hours) / Hybrid (if near office locations) Mutiple opportunities - Employment Type: Contract (6+ months, extendable) / Full-Time Level: Senior (810+ years of experience) Send resume to priya.clara@iconma.com About the Role: CMS Energy is seeking a highly skilled Data Engineer to join their team in modernizing their data infrastructure through the Data Lake 2.0 initiative. Candidate will play a pivotal role in designing and implementing a cloud-based Medallion architecture (using Databricks ) to centralize fragmented data systems, enabling advanced analytics and actionable insights for customer operations and experience teams. This role requires deep expertise in ETL, data warehousing, and pipeline automation , with a focus on cost efficiency and scalability . Key Responsibilities: Data Pipeline Development: Build and optimize ETL/ELT pipelines to ingest data from SAP, CRMs, and legacy systems into Databricks . Implement the Medallion architecture (bronze (raw) silver (cleaned and validated data) gold (enriched and analytics-ready data)) layers with strict data quality checks. Leverage DBT for transformation workflows and ensure alignment with business logic. Cloud Data Infrastructure: Design and deploy scalable data models in Databricks (AWS/Azure). Collaborate with platform teams to retire legacy systems (e.g., SAP Business Objects, Crystal Reports). Collaboration & Governance: Work with analytics teams to support Power BI/Tableau dashboards and predictive models (e.g., customer propensity, outage forecasting). Document data standards, lineage, and metadata for governance. Performance Optimization: Troubleshoot pipeline bottlenecks and optimize SQL/Python scripts for efficiency. Ensure data security and compliance with access controls. Required Skills & Qualifications: Technical Expertise: Must-Have : 8+ years in data engineering , with proven experience in cloud-based data lakes/warehouses . Advanced proficiency in SQL, Python, and DBT . Hands-on experience with Databricks (Delta Lake, Spark SQL) and Medallion architecture. Strong knowledge of ETL frameworks and data modeling (star schema, fact/dimension tables). Nice-to-Have : Familiarity with SAP HANA , CRM systems, or utility industry data. Exposure to AI/ML pipelines (e.g., LLMs for customer analytics). Soft Skills: Ability to collaborate with cross-functional teams (operations, marketing, IT). Strong problem-solving skills to address legacy system challenges. Comfortable in an Agile environment (sprint planning, retrospectives).

Posted 2 months ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.