Engineer- Data II IND

Basic Job Functions:

We are seeking an experienced Data Engineer with a minimum of 5 years of experience, specializing in Databricks, Python, SQL, SSIS, SAS, IoT, Azure Data Lake Services, and DataOps. The ideal candidate will have a strong background in building and maintaining scalable data pipelines, managing cloud-based data platforms, and collaborating with cross-functional teams to deliver high-quality data solutions.

Education/Experience:

• Preferred Qualifications
  • Bachelor's or Master’s degree in Computer Science, Engineering, or related fields.

  • Certifications such as Azure Data Engineer Associate or Databricks Certified Professional are highly desirable.

  • Familiarity with containerization technologies like Docker or Kubernetes is a plus.

  • Familiarity with agile methodologies for product development.
• Key Technologies
  • Databricsk, SQL, Python, Azure Synapse, Kafka/MQTT, ETL Pltforms

  • IoT Platforms (e.g., AWS IoT Core, Azure IoT)

  • Familiarity Machine Learning frameworks (e.g., TensorFlow, PyTorch)

  • Cloud Computing

  • Predictive Analytics

  • Data Security Protocols

Required Skills/Competencies:

• Databricks Expertise: 3+ years of hands-on experience with Databricks for building scalable data solutions using Spark SQL, Delta Lake, and other Databricks utilities.
• Programming Skills: Proficiency in Python for scripting and automation. Experience with SAS for statistical analysis is a plus.
• Azure Services: Strong experience working with Azure Data Lake Storage (ADLS), Azure Databricks, and other related Azure cloud services.
• IoT Integration: Experience in handling IoT data ingestion pipelines from various devices into cloud storage systems.
• DataOps Practices: Familiarity with DataOps methodologies for automating data pipeline deployments using CI/CD tools such as Jenkins or Azure DevOps.
• SQL & Big Data Technologies: Strong knowledge of SQL for querying large datasets. Experience with distributed computing frameworks like Apache Spark is essential.
• Cloud Platforms: Hands-on experience with Azure cloud infrastructure. Knowledge of AWS or GCP is beneficial but not mandatory.

Essential Responsibilities:

• Data Pipeline Development: Design, build, and maintain robust and scalable data pipelines using Databricks, Python, and Azure Data Lake services.
• Data Integration: Ingest, process, and integrate data from various IoT devices and external sources into Azure Data Lake for further analysis.
• ETL/ELT Processes: Develop efficient ETL/ELT processes to transform raw data into structured formats suitable for analytics and machine learning models.
• DataOps Automation: Implement DataOps practices to automate the deployment, monitoring, and management of data pipelines. Ensure continuous integration (CI) and continuous deployment (CD) of data workflows.
• Data Quality & Validation: Ensure the quality, consistency, and reliability of data through validation checks and testing frameworks.
• Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand requirements and deliver optimized data solutions.
• Cloud Platform Management: Manage cloud resources on Azure, including Azure Data Lake Storage, Databricks clusters, and related services.
• Performance Optimization: Optimize the performance of data pipelines for large-scale IoT datasets using Apache Spark on Databricks.
• Documentation & Reporting: Maintain comprehensive documentation of data pipeline architecture, processes, and governance policies. Provide regular reports on pipeline performance and data quality.

Reporting Relationships:

• Reports to the Sr Manager- Data Science IND
• This is an Individual contributor position

Travel:

• 0% - 5% (On occasion/as needed for training, etc.)

Estimated Salary Range:

US Physical Requirements:

Office Physical Requirements:

All positions in our office require interaction with people and technology while either standing or sitting. To best service our customers, internal and external, all associates must be able to communicate face-to-face and on the phone with or without reasonable accommodation. First Solar is committed to compliance with its obligations under all applicable state and federal laws prohibiting employment discrimination. In keeping with this commitment, it attempts to reasonably accommodate applicants and employees in accordance with the requirements of the disability discrimination laws. It also invites individuals with disabilities to participate in a good faith, interactive process to identify reasonable accommodations that can be made without imposing an undue hardship.

Potential candidates will meet the education and experience requirements provided on the above job description and excel in completing the listed responsibilities for this role. All candidates receiving an offer of employment must successfully complete a background check and any other tests that may be required.

Equal Opportunity Employer Statement: First Solar is an Equal Opportunity Employer that values and respects the importance of a diverse and inclusive workforce. It is the policy of the company to recruit, hire, train and promote persons in all job titles without regard to race, color, religion, sex, age, national origin, veteran status, disability, sexual orientation, or gender identity. We recognize that diversity and inclusion are a driving force in the success of our company.