Azure Data Engineer/Consultant

Role: Azure Data Engineer/Consultant/Lead Type: Full time Location: Sydney, AU Status: Valid visa with full work rights/ Visa Sponsorship available
Requirements:

• Design, develop, and maintain scalable data pipelines and ETL processes using Microsoft Azure and Azure Data Factory (ADF) or equivalent ETL tools.
• Collaborate with stakeholders to understand data engineering requirements and deliver high-quality data solutions.
• Establish data integration patterns for varied data sources as per the business need.
• Implement and manage data integration solutions using Databricks, PySpark, and Azure DevOps.
• Optimize and troubleshoot data workflows to ensure high performance and reliability.
• Migrate the legacy ETL codes to existing cloud environment
• Enforce data governance and security policies.
• Monitor and maintain data infrastructure, ensuring data quality and integrity.

  Qualifications:  

• 6-10 years of experience in data engineering or a related role.
• Strong expertise in Microsoft Azure, including Azure Data Factory (ADF) or equivalent ETL tools.
• Strong fundamentals in data integration and ETL/ELT best practices.
• Strong experience in Data Technical design document and mapping documents.
• Proficiency in Databricks, PySpark, Python, and Azure DevOps.
• Experience with SQL databases and experience in ingesting multiple file formats.
• Solid understanding of data warehousing concepts and best practices.
• Strong communication and collaboration skills.

• Interested? Please apply, thanks for your interest and time.
  To read about our privacy policy https://www.frconsultancy.com.au/privacy-policy
  We acknowledges Traditional Owners of Country throughout Australia and recognises the continuing connection to lands, waters and communities. We pay our respect to Aboriginal and Torres Strait Islander cultures; and to Elders both past and present