The Key Responsibilites:
- Design, implementation, and development of ETL/ELT processes from multiple source systems to the Data Warehouse's data staging layer.
- Design and maintenance of data architecture and schemas in the data staging layer, with a focus on performance, scalability, and reliability.
- Data integration from source systems using APIs and other data exchange mechanisms.
- Creation, optimization, and maintenance of advanced SQL queries used in data loading processes and by analytical teams.
- Utilization of Python for data transformation, validation, and processing, process automation, and building components supporting ETL pipelines.
- Ensuring data quality through validation, completeness checks, monitoring, and involvement in resolving data incidents.
- Close collaboration with data and analytics teams in defining data contracts between the staging layer and the silver and gold layers, as well as in planning changes to data models.
Requirements:
- Minimum 3 years of commercial experience in the position of Data Engineer or related.
- Very good knowledge of SQL and relational databases (PostgreSQL, MS SQL Server).
- Practical experience in designing, building, and orchestrating ETL/ELT processes, including task scheduling.
- Good knowledge of Python language in the context of data processing and transformation.
- Experience in collaboration with BI tools (e.g. Power BI, Apache Superset) in terms of feeding data models and reports.
- Understanding of data quality issues, schema versioning, and basic CI/CD practices in data projects.
- Ability to effectively collaborate with data analysts and business stakeholders, good communication skills, and independence in problem-solving.
We offer:
- Work on modern data solutions in an innovative education sector company.
- Attractive terms of cooperation, commensurate with experience and skills.
- Bonus system.
- Flexible forms of employment: employment contract (full-time) or B2B cooperation.
- Hybrid work model (3 days in the office, 2 days remotely).
- Modern and comfortable office in Warsaw (near Dworzec Zachodni).
- Opportunity for competence development and participation in interesting projects.
- Private medical care (with the option to extend to family) and additional benefits such as life insurance and a sports card.
Nice to have:
- Experience working with Mage.ai or other data orchestration tools.
- Experience in cloud environments.
