Data Engineer

Position: Data Engineer

Relevant years of Experience: 4+ years

Job Type: Contract

Work Location: Remote (India)

Salary Range: 8L PA

Skills Required:

• Spark or Pyspark, SQL, Python, - Must have
• Databricks, Cloud servies (Azure/ GCP/ AWS), -Good to have
• Azure/AWS/GCP, Databricks Certified - Good to have
• Hadoop, Hive, Sqoop- Can have - not compulsory

Fundamentals of Cloud Computing: Understanding of cloud concepts like IaaS, PaaS, SaaS, and Azure architecture. SQL & Database Administration: Proficiency in SQL (T-SQL) for querying, managing, and troubleshooting Azure SQL databases. Basic understanding of database design and normalization.

Data Warehousing & ETL: Conceptual knowledge of data warehousing principles, data transformation, and ETL processes.

Azure Data Services: Experience/ Familiarity with Azure Data Lake Store, and Azure Analysis Services.

Azure Data Factory: Expertise in ETL pipeline creation and data integration from various sources.

Azure Synapse Analytics: Skills in big data processing, SQL performance tuning, and data visualization.

Azure Databricks: Proficiency in Spark-based data engineering, machine learning model deployment, and real-time analytics.

Data Visualization & Reporting: Basic understanding of Power BI and the ability to create simple reports and dashboards.

Troubleshooting & Issue Resolution: Ability to diagnose and troubleshoot basic issues related to Azure data services and resolve them with guidance.

Monitoring & Logging: Basic understanding of Azure monitoring tools and logs for identifying and resolving issues.

Power BI: Competency in dashboard creation, data modeling, and interactive reporting for business insights.