The ProEx Group

1 Job openings at The ProEx Group
Data Engineer (Gas & Energy Trading) pune,maharashtra,india 0 years None Not disclosed On-site Contractual

Data Engineer (Gas & Energy Trading) Day Rate Contract Immediate Start PRIORITY SELECTION FOR CANDIDATES WITH A STRONG BACKGROUND WITHIN ENERGY TRADING. What you’ll do: o Design and implement data storage solutions. o Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. o Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure Create data models for analytics purposes o Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations o Use Azure Data Factory and Databricks to assemble large, complex data sets o Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. o Ensure data security and compliance o Optimize Azure SQL databases for efficient query performance o Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures o Participate in all scrum ceremonies What technical skills you’ll have: o ML Modelling: Develop and evaluate statistical/ML models. o Software Testing: Experience with testing methodologies and tools. o Data Analysis: Proficient in data wrangling and analysis (Python, R, SQL). o AI/ML: Experience designing and testing AI/ML models, including prompt engineering and bias detection. o ML Systems: Design and implement ML systems; strong Python/SQL; software engineering best practices; Azure experience; excellent communication. What essentials you’ll bring to the table: o Blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams o Azure DevOps o Apache Spark, Python o SQL proficiency o Data Modelling o ETL processes o Azure Databricks knowledge o Familiarity with data warehousing o Big data technologies o Data governance principles How do you apply? o Contact us at talent@theproexgroup.com and include the following: o Curriculum Vitae / Resume o Current Employment Position (Including notice period) o Contact Details o Remuneration Expectation o Optional Cover Letter Be sure to follow our LinkedIn profile for more exciting global opportunities across a range of industries and sectors