About
Real-time data, Microsoft Fabric and AI
I spent a year and a half inside Microsoft on the Fabric Real-Time Intelligence team — owning the backlog, supporting customers worldwide and building internal Fabric pipelines, KQL analytics and Power BI reporting, and managing a terabyte-scale telemetry platform. I'm certified in Fabric as both Data Engineer (DP-700) and Analytics Engineer (DP-600), and in Azure AI (AI-102).
Today I'm a Data Engineer modernizing enterprise data pipelines for a global pharmaceutical company — and I deliver much of that work by directing AI coding agents: defining prompts, guardrails and review workflows so agents implement, refactor and test pipeline code while I own the architecture and quality.
After hours I build czyjedzie.live, a real-time public transport platform for Kraków that started on Fabric RTI and was built end-to-end with AI agents. My roots are in GIS, product ownership and analytics — which helps me bridge technical and business needs.
Outside of tech I'm a licensed drone pilot, a traveler (30+ countries and counting), a photographer and a smart home enthusiast.
Experience
Where I've worked
Data Engineer
- Migrating legacy ETL from Informatica IICS to a modern stack built with dbt, DuckDB, Airflow and Ansible.
- Designing scalable ELT pipelines and transformation frameworks in SQL and Python, orchestrated with Airflow.
- CI/CD with Jenkins and Bitbucket; integrating mastered data into the Reltio MDM platform.
- AI-assisted engineering: directing and coaching AI coding agents (OpenCode, GitHub Copilot) as part of the team's daily delivery workflow.
- Defining prompts, project context and guardrails that let agents autonomously implement, refactor and test pipeline code within agreed standards.
- Designing review workflows for agent-generated code — human-in-the-loop checks before anything reaches the main branch.
- Using agents to speed up the IICS migration: translating legacy mappings into dbt models and SQL, and generating tests and documentation — significantly accelerating delivery.
Technical Program Manager — Fabric RTI
- Program management for Microsoft Fabric Real-Time Intelligence: product backlog, roadmap and sprint planning in close cooperation with engineering and management.
- Real-time streaming analysis and KQL statistics on Azure Data Explorer in Fabric; built Real-Time Analysis (RTA) cubes.
- Built and maintained internal Fabric pipelines, workflows and notebooks on Warehouse and Lakehouse — OPEX, storage monitoring and performance tracking.
- Managed Microsoft Aria — an internal terabyte-scale telemetry tool for Windows, Office, Teams and more.
- 3rd-line support for Fabric customers worldwide; became the team's go-to expert for ADX queries and Power BI reporting.
Product Manager
- Responsible for GIS domain products — long-term roadmap and product vision.
- Worked with stakeholders and product owners, reporting to top management; prepared and estimated offers.
- Power BI reporting for company boards; owned ETL migration of spatial data in projects.
Product Owner
- Scrum Product Owner for three teams: GIS, Web Backend and Web Frontend.
- Defined product requirements, epics and user stories; managed delivery priorities with the Product Manager.
- Managed ETL/ELT data migration, coordinated analysts and supported development and QA teams.
Principal Analyst · GIS Consultant
Selected public-sector projects
- OFSA PROW 2014–2020 — Agency for Restructuring and Modernisation of Agriculture (ARMA)
- Comarch C3ISR — military project for the Polish Army
- Mazovia GIS — Head Office of Land Surveying and Cartography
- Tauron ZMS — one of the largest power companies in Poland
- POBR — data warehouse and geoportal on road accidents in Poland (Motor Transport Institute)
- CLM — Comarch Loyalty Management
Case study
czyjedzie.live — real-time transit on Microsoft Fabric RTI, built with AI agents
Architecture on Microsoft Fabric Real-Time Intelligence
Built with AI coding agents
The whole project — Fabric notebooks, KQL, the web app and the backend — was developed by directing AI coding agents, with me as architect and reviewer.
- Repository rules for agents and a living knowledge base: architecture, decisions, known pitfalls, deployment runbook.
- Clear guardrails: agents prepare changes and verify every release (checksums, HTTP status), while production writes in Fabric stay with a human.
- Every change logged in a project changelog, so the next agent session starts with full context.
From Fabric to open source — with parity tests
Ahead of the end of the Fabric trial I ported the same notebook code to an open-source stack (ClickHouse on a VPS), rewriting KQL as SQL. The Fabric edition kept running side by side for comparison.
Skills
Toolbox
Microsoft Fabric & Real-Time Intelligence
AI & agents
Data engineering
Azure & BI
GIS
Databases & tools
Agile & product
Certifications
Fabric, AI and Azure — seven Microsoft certifications
- Google: AI in business development — five-week training program (10.2025)
- Professional Scrum Product Owner™ (PSPO I) (06.2021)
- Drone remote pilot: Open A1/A2/A3 and Specific NSTS-01, NSTS-02 (01.2021)
Projects
Things I build after hours
czyjedzie.live
Real-time public transport platform for Kraków — live positions, delays, punctuality, congestion and a journey planner. Built on Microsoft Fabric RTI with AI coding agents (see the case study above).
czyjedzie.live →Kraków in 24 hours
An animated map of every tram and bus trip in Kraków over a single day.
Open the animation →Isochrones
Travel time by public transport from anywhere in Kraków to the Main Market Square.
Open the map →Gentree
Genealogy software for Windows, my own commercial product. The tree stays on your computer: GEDCOM import and export, photos with face tagging, 19th-century cadastral maps of ancestral villages in 3D, a private family website and a Claude (MCP) connection. UI in Polish, free demo in the browser.
gentree.com.pl →Education
Geography, geodesy, GIS
References
What colleagues say
“When he joined, he had limited experience with Azure Data Explorer (ADX) and Power BI, but he quickly became the go-to expert for ADX queries and Power BI reporting in our team. He also played a key role in product support, defining processes and improving reporting to keep things running smoothly. Lukasz is reliable, honest, and genuinely committed to making a difference.”
“A very dedicated and trustworthy person, very passionate about GIS, geography and geopolitics. He dives deeply into his work field and analyzes topics very carefully. His recommendations were accurate and he had no problem finding the best possible solution.”