This commit is contained in:
2025-02-19 12:35:41 +01:00
parent 7185a9c10d
commit 79ab9ecebb
5 changed files with 517 additions and 1 deletions

View File

@@ -1,3 +1,25 @@
# clickhouse-airbyte-normer
GoProg to move data from raw tables to normal tables #hack
GoProg to move data from raw tables to normal tables #hack
A quick hack to get the Airbyte raw tables to normal tables so my collegueas can query the data better in clickhouse.
env variables for docker build:
```
chHost := os.Getenv("CH_HOST")
chPort := os.Getenv("CH_PORT")
chUser := os.Getenv("CH_USER")
chPass := os.Getenv("CH_PASS")
rawDB := os.Getenv("RAW_DB")
```
flags
```
forceOnce := flag.Bool("force-once", false, "Run the migration immediately without waiting for a webhook")
debug := flag.Bool("debug", false, "Enable debug logging")
dropRawFlag := flag.Bool("drop-raw", false, "Drop raw tables after migration (default: keep raw tables)")
```
It's not production ready but feel free to use as a quick hack to at least make the data more usable.