Knowledge And Skills
Following skills and knowledge are required for the performance of the above listed tasks:
- Core Engineering Languages: Expert proficiency in SQL and Python (PySpark); strong working knowledge of Java for backend data processing or SDK integrations.
- Generic Data Engineering: Solid understanding of Software Engineering principles applied to data (DRY code, modularity, error handling, and logging).
- Data Structures: Proficiency in working with structured, semi-structured (JSON/XML), and unstructured data formats.
- DevOps & CI/CD: Practical experience with Git, branching strategies, and automating deployments through Azure DevOps or GitHub Actions.
- Distributed Computing: Strong grasp of Apache Spark internals, memory management, and execution plans.
- Languages: Good knowledge of written/spoken English (working language). Knowledge of French is an asset
SPECIFIC EXPERTISE
- Fabric Delta Lake Management: Expertise in optimizing and managing transaction logs within the Fabric Lakehouse.
- Multi-stack Integration: Proven ability to connect Fabric with non-Microsoft tools, utilizing generic JDBC/ODBC drivers or REST APIs.
- Performance Tuning: Deep experience in identifying bottlenecks in data flows and optimizing code for low-latency processing.
- Data Design Patterns: Practical experience implementing standard patterns like SCD (Slowly Changing Dimensions), Change Data Capture ingestion and idempotency in a Delta Lake environment.
CERTIFICATIONS & STANDARDS:
- Microsoft Focus: DP-700 (Microsoft Certified: Fabric Data Engineer Associate) – required.
- Generic/Cloud Focus: DP-203 (Azure Data Engineer) or equivalent certifications from Databricks (Data Engineer Associate) or AWS – a plus.
What can you expect from us?
Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.
100% Remote opportunities
We want you to have the flexibility to work where you feel most comfortable and productive.
International Career
- You can expect professional growth and to be connect with the world.
- We are represented in Portugal, Belgium, Luxembourg, and Denmark.
- And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)
Extra Benefits & Perks
If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!
As a plus, we provide Health and Life Insurance.