Winter days 2020
Some moments caught during the winter 2020-2021 in Berlin.
Street views, quite a lot of snow this year …
Berlin (1 post)
Big data (5 posts)
Thoughts about the modern data engineering stack
Random thoughts about the modern data engineering stack - the modern stack should be the best from the beginning, or at least aiming to be so.
It means any required …
Apr 5, 2022
Data engineering,
Big data,
Engineering
Reverse ETL - definition and use-cases
In this article I’d like to summarise my knowledges and understanding of the new buzzword Reverse ETL.
No long introductions, let’s jump into the topic. …
Oct 23, 2021
Data engineering,
Big data,
Engineering
DWH approaches
With this post I’d like to cover some well-know approaches to data-warehousing in order to have a brief overview of them:
Jun 15, 2021
Data engineering,
Big data
About the modern data engineering stack
Not a secret we’re living in the rapidly changing world, generating more and more machine data. A new era of big data and so on, words you’ve probably …
Feb 22, 2021
Data engineering,
Big data
Notes about data catalog solutions
Data catalogs have become an essential part of the modern data infrastructure and management. It allows to have an overview of data, presented in the organisation, …
Jan 25, 2021
Data catalog,
Big data
Comments (1 post)
Choosing open-source comment system
During this web-site development I naturally had an idea to add a comment system here. Although Hugo, which I use, supports Disqus out of the box, I’m not so …
Data catalog (1 post)
Notes about data catalog solutions
Data catalogs have become an essential part of the modern data infrastructure and management. It allows to have an overview of data, presented in the organisation, …
Jan 25, 2021
Data catalog,
Big data
Data engineering (7 posts)
Combining dbt and SQLFluff
In this post I’d like to share how to adopt two very useful tools SQLFluff, a SQL linter, and dbt, a data modelling tool, into a powerful combination and make …
Jul 4, 2022
Data engineering,
Dbt,
Sqlfluff
Takeouts on new GCP products DataPlex and Analytics Hub
Google has recently introduced new products DataPlex and Analytics Hub aiming to help engineers in building a modern data engineering stack. With this writing, …
May 31, 2022
Data engineering,
Gcp,
Google cloud
Implementing slim CI for dbt with GitHub Actions
Recently I’ve started working with dbt, and have to say it’s quite amazing. With this post I’d like to share the approach for deploying only newly …
Apr 5, 2022
Data engineering,
Dbt,
Github actions
Thoughts about the modern data engineering stack
Random thoughts about the modern data engineering stack - the modern stack should be the best from the beginning, or at least aiming to be so.
It means any required …
Apr 5, 2022
Data engineering,
Big data,
Engineering
Reverse ETL - definition and use-cases
In this article I’d like to summarise my knowledges and understanding of the new buzzword Reverse ETL.
No long introductions, let’s jump into the topic. …
Oct 23, 2021
Data engineering,
Big data,
Engineering
DWH approaches
With this post I’d like to cover some well-know approaches to data-warehousing in order to have a brief overview of them:
Jun 15, 2021
Data engineering,
Big data
About the modern data engineering stack
Not a secret we’re living in the rapidly changing world, generating more and more machine data. A new era of big data and so on, words you’ve probably …
Feb 22, 2021
Data engineering,
Big data
Dbt (2 posts)
Combining dbt and SQLFluff
In this post I’d like to share how to adopt two very useful tools SQLFluff, a SQL linter, and dbt, a data modelling tool, into a powerful combination and make …
Jul 4, 2022
Data engineering,
Dbt,
Sqlfluff
Implementing slim CI for dbt with GitHub Actions
Recently I’ve started working with dbt, and have to say it’s quite amazing. With this post I’d like to share the approach for deploying only newly …
Apr 5, 2022
Data engineering,
Dbt,
Github actions
Engineering (3 posts)
Thoughts about the modern data engineering stack
Random thoughts about the modern data engineering stack - the modern stack should be the best from the beginning, or at least aiming to be so.
It means any required …
Apr 5, 2022
Data engineering,
Big data,
Engineering
Reverse ETL - definition and use-cases
In this article I’d like to summarise my knowledges and understanding of the new buzzword Reverse ETL.
No long introductions, let’s jump into the topic. …
Oct 23, 2021
Data engineering,
Big data,
Engineering
Some lessons learned working with Spark/AWS Glue
Random general and specific notes from Notion made after a couple of projects working with Spark/AWS Glue:
- Parquet format doesn’t support empty arrays
- Schema …
Nov 23, 2020
Spark,
Engineering
France (1 post)
Gcp (1 post)
Takeouts on new GCP products DataPlex and Analytics Hub
Google has recently introduced new products DataPlex and Analytics Hub aiming to help engineers in building a modern data engineering stack. With this writing, …
May 31, 2022
Data engineering,
Gcp,
Google cloud
Github actions (1 post)
Implementing slim CI for dbt with GitHub Actions
Recently I’ve started working with dbt, and have to say it’s quite amazing. With this post I’d like to share the approach for deploying only newly …
Apr 5, 2022
Data engineering,
Dbt,
Github actions
Google cloud (1 post)
Takeouts on new GCP products DataPlex and Analytics Hub
Google has recently introduced new products DataPlex and Analytics Hub aiming to help engineers in building a modern data engineering stack. With this writing, …
May 31, 2022
Data engineering,
Gcp,
Google cloud
Hugo (1 post)
Choosing open-source comment system
During this web-site development I naturally had an idea to add a comment system here. Although Hugo, which I use, supports Disqus out of the box, I’m not so …
Interesting (1 post)
Connecting people
An application which is not available to everyone helps those, who have it, to make a secret out of what was democratized and devalued to the limit - own talk-shit. …
Feb 25, 2021
Interesting
Notion (1 post)
Switching to Notion after many years of using Onenote
OneNote was my primary place for collecting every note for many years. I started to use it long ago, maybe 10 years ago in the times when Windows phones still exist. …
Dec 16, 2020
Notion,
Zettelkasten
Photos (2 posts)
Winter days 2020
Some moments caught during the winter 2020-2021 in Berlin.
Street views, quite a lot of snow this year …
Spark (1 post)
Some lessons learned working with Spark/AWS Glue
Random general and specific notes from Notion made after a couple of projects working with Spark/AWS Glue:
- Parquet format doesn’t support empty arrays
- Schema …
Nov 23, 2020
Spark,
Engineering
Sqlfluff (1 post)
Combining dbt and SQLFluff
In this post I’d like to share how to adopt two very useful tools SQLFluff, a SQL linter, and dbt, a data modelling tool, into a powerful combination and make …
Jul 4, 2022
Data engineering,
Dbt,
Sqlfluff
Surfing (1 post)
Vacation (1 post)
Winter (1 post)
Winter days 2020
Some moments caught during the winter 2020-2021 in Berlin.
Street views, quite a lot of snow this year …
Zettelkasten (1 post)
Switching to Notion after many years of using Onenote
OneNote was my primary place for collecting every note for many years. I started to use it long ago, maybe 10 years ago in the times when Windows phones still exist. …
Dec 16, 2020
Notion,
Zettelkasten