Modern Data Stack in a Box with DuckDB

There is a large volume of literature (1, 2, 3) about scaling data pipelines. “Use Kafka! Build a lake house! Don’t build a lake house, use Snowflake! Don’t use Snowflake, use XYZ!” However, with advances in hardware and the rapid maturation of data software, there is a simpler approach. This article will light up the path to highly performant single node analytics with an MDS-in-a-box open source stack: Meltano, DuckDB, dbt, & Apache Superset on Windows using Windows Subsystem for Linux (WSL). There are many options within the MDS, so if you are using another stack to build an MDS-in-a-box, please share it with the community on the DuckDB Twitter, GitHub, or Discord, or the dbt slack! Or just stop by for a friendly debate about our choice of tools

https://duckdb.org/2022/10/12/modern-data-stack-in-a-box.html

https://duckdb.org/2022/10/12/modern-data-stack-in-a-box.html

https://www.datafold.com/

The Modern Data Stack: Past, Present, and Future

https://www.getdbt.com/blog/future-of-the-modern-data-stack

Learn how some of the most amazing companies in the world are organising their data stack. Learn more about the tools that they are using and why.

https://www.moderndatastack.xyz/stacks

Data Warehouse and Data Lake Modernization: From Legacy On-Premise to Cloud-Native Infrastructure

Many people talk about data warehouse modernization when they move to a cloud-native data warehouse. Though, what does data warehouse modernization mean? Why do people move away from their on-premise data warehouse? What are the benefits?

Data Warehouse and Data Lake Modernization: From Legacy On-Premise to Cloud-Native Infrastructure – Kai Waehner (ampproject.org)

Data Warehouse and Data Lake Modernization: From Legacy On-Premise to Cloud-Native Infrastructure – Kai Waehner (ampproject.org)

Reset des Südwind Ambientika wireless+

Wenn der Südwind Ambientika wireless+ nur noch im Feuchtigkeitsbetrieb ausgeführt wird (Feuchtigkeitsalarm = rote LED leuchtet und nur noch Abluftbetrieb), gibt die Anleitung zur Fehlerbehebung folgenden Tipp: „Erhöhen Sie den Schwellenwert für das Eingreifen des Hygrostats“.

Dieser Schwellenwert ist bei mir seit der Inbetriebnahme unverändert auf dem höchsten Wert eingestellt und kann somit das Problem nicht lösen.

Der nette Support der Firma lieferte dann die Lösung. Folgende Aktionen müssen in dieser Reihenfolge ausgeführt werden. Nach danach funktionierte der Lüfter wieder wie gewohnt.

Daszu folgendes am Master ausführen:

  • Gerät AUS
  • Gerät EIN
  • Gerät FILTER RESET
  • dann AUTO Modus mit 3 Tropfen Feuchtigkeitsschwelle

Jetzt sollte der Südwind Ambientika wireless+ wieder normal arbeiten.

Home Assitent – deye microinverter

GitHub – Hypfer/deye-microinverter-cloud-free: Documentation and tooling to use Deye microinverters without the solarman cloud

GitHub – StephanJoubert/home_assistant_solarman: Home Assistant component for Solarman collectors used with a variety of inverters.

GitHub – kbialek/deye-inverter-mqtt: Reads Deye solar inverter metrics and posts them over mqtt

VZLOGGER:

GitHub – markussiebert/homeassistant-addon-vzlogger: vzlogger as addon for homeassistant supervisor

GitHub – volkszaehler/vzlogger: Logging utility for various meters & sensors

SmartMeter ist „freigeblinkt“:

vzlogger ohne middleware: „api“:“null“

The Digital Antiquarian – filfre.net

The Digital Antiquarian (filfre.net)



e.g. read about » Elite (or, The Universe on 32 K Per Day) The Digital Antiquarian (filfre.net)

A universe in 32 K, an icon of British game development, and the urtext of a genre of space-combat simulations, the sheer scope of David Braben and Ian Bell’s game of combat, exploration, and trade can inspire awe even today.

» Hall of Fame The Digital Antiquarian (filfre.net)

The best graphic adventure ever made for the Commodore 64 and the starting point of the LucasArts tradition of saner, fairer puzzling, this intricately nonlinear and endlessly likable multi-character caper deserves a spot here despite a few rough edges.

» A New Force in Games, Part 3: SCUMM The Digital Antiquarian (filfre.net)

In this video Scott and Mark use Copilot to create a asteroid game

https://build.microsoft.com/en-US/sessions/e9568a77-7cf7-451e-a14b-a347313b2494?source=/favorites

GitHub Copilot is a powerful AI tool that helps you write code faster and better. Join Scott Hanselman and Mark Russinovich as they use GitHub Copilot to create a fun and interactive application from scratch. You will learn how LLMs that power GitHub Copilot work under the cover, LLM capabilities and limitations, and the difference between finetuning and prompt engineering. Whether you are a beginner or an expert, it will inspire you to explore new possibilities with GitHub Copilot and LLMs