Job
Description
Technical Skills: Proficiency in Python, Java, or Scala for data processing. Strong knowledge of SQL and relational databases (e.g., MySQL, PostgreSQL, MS SQL Server). Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase). Hands-on experience with ETL frameworks and tools (e.g., Apache NiFi, Talend, Informatica, Airflow). Expertise in big data technologies (e.g., Hadoop, Apache Spark, Kafka). Experience with cloud platforms (AWS, Azure, Google Cloud) and related data storage/processing services. Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes). Knowledge of data modeling concepts (star schema, snowflake schema). Understanding of data lakes, data warehousing architectures, and scalable storage solutions. Experience with version control systems (e.g., Git) and collaboration tools (e.g., Jira, Confluence). Soft Skills: Strong problem-solving skills to address complex data challenges. Excellent communication skills for interacting with technical and non-technical stakeholders. Attention to detail with a commitment to data accuracy and integrity. Ability to thrive in a fast-paced, team-oriented environment. Experience: 10+ years of total experience in software/data engineering. 5+ years of experience building and maintaining scalable data pipelines. Proven ability to implement data engineering solutions at scale. Experience working with data governance, compliance, and security. Preferred Qualifications: Experience with machine learning and preparing data for AI/ML models. Knowledge of stream processing frameworks (e.g., Apache Kafka, Apache Flink). Cloud certifications (e.g., AWS Certified Big Data Specialty, Google Cloud Professional Data Engineer). Experience with DevOps practices and CI/CD pipelines for data workflows. Familiarity with automation/orchestration tools (e.g., Apache Airflow, Luigi). Experience with data visualization and reporting tools (e.g., Tableau, Power BI). Work Environment & Benefits: Collaborative and fast-paced work culture. Opportunity to work with cutting-edge data and AI/ML technologies. Career growth opportunities in data engineering and AI/ML fields. If you are passionate about building next-generation data solutions that power AI and machine learning, wed love to hear from you! Please reach-out to h1b@infyshine.com
