Custom Software Engineer

 About The Role  

Project Role :Custom Software Engineer

Project Role Description :Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills :Microsoft SQL Server

Good to have skills :NA
Minimum 12 year(s) of experience is required

Educational Qualification :15 years full time education
Key ResponsibilitiesData Pipeline Development:Design and implement robust ETL/ELT pipelines using tools like Azure Synapse Pipeline & Notebooks to extract, transform, and load data from various sources.Data Storage Management:Manage and optimize large volumes of structured and unstructured data within Azure Data Lake Storage (ADLS Gen2).Data Transformation and Processing:Utilize Azure Synapse Analytics'' serverless SQL pools, and data flows to process and transform data at scale.Integration and Collaboration:Integrate data solutions with analytics and visualization tools like Power BI and work with cross-functional teams to meet business requirements.Performance Optimization:Identify and automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability and efficiency. Key Skills and TechnologiesCloud PlatformsGrasp on Microsoft Azure services.Azure Synapse Analytics:Proficiency with serverless SQL pools, data flows, and notebooks.Data Orchestration:Experience with Azure Synapse Pipeline for building data pipelines.Programming Languages:Strong skills in SQL and Python for data manipulation and processing.Big Data Technologies:Familiarity with Apache Spark.Version Control:Experience with Git for version control and Azure DevOps for CI/CD processes.Analytical Thinking:Strong analytical skills to perform root cause analysis, identify data-related opportunities for improvement, and derive insights from complex datasets. Qualification 15 years full time education