Data Analyst/Engineer I

As a Data Engineer, you will be responsible for handling various technologies related to cloud platforms such as Azure Datalake, Azure function, Azure Databricks, Azure Data Factory, and PostgreSQL. Additionally, having experience in Azure DevOps and Git flow would be advantageous. Moreover, familiarity with AWS services like Kinesis, EMR, Glue, RDS, Athena, and RedShift is also desirable. Expertise in working with timeseries data and Industry 4.0 projects is essential, along with knowledge of Palantir. Your role will require strong problem-solving skills with an emphasis on sustainable development practices. Proficiency in Python/PySpark, Pandas, Numpy, seaborn/matplotlib, and Streamlit.io is necessary. Knowledge of Scala, GoLang, Java, and big data tools like Hadoop, Spark, and Kafka will be beneficial for this position. Furthermore, experience with various relational databases such as Microsoft SQL Server, MySQL, PostGreSQL, Oracle, as well as NoSQL databases like Hadoop, Cassandra, and MongoDB is expected. You should also have proficiency in data pipeline and workflow management tools like Azkaban, Luigi, and Airflow to optimize big data pipelines and architectures effectively. Your analytical skills will be put to test while working with unstructured datasets, requiring you to provide innovative solutions to data engineering problems. It is crucial to document technology choices and integration patterns, following best practices for project delivery with clean code. You should demonstrate innovation and proactiveness in meeting project requirements. In addition to the technical responsibilities, you will be reporting to the Director of Intelligent Insights and Data Strategy. Travel will be a key component of this role, as you must be willing to be deployed at client locations globally for both long and short terms. Flexibility for shorter durations within India and abroad is a requirement for this position.,