25 lines
800 B
Markdown
25 lines
800 B
Markdown
# clickhouse-airbyte-normer
|
|
|
|
GoProg to move data from raw tables to normal tables #hack
|
|
|
|
A quick hack to get the Airbyte raw tables to normal tables so my collegueas can query the data better in clickhouse.
|
|
|
|
env variables for docker build:
|
|
|
|
```
|
|
chHost := os.Getenv("CH_HOST")
|
|
chPort := os.Getenv("CH_PORT")
|
|
chUser := os.Getenv("CH_USER")
|
|
chPass := os.Getenv("CH_PASS")
|
|
rawDB := os.Getenv("RAW_DB")
|
|
```
|
|
|
|
flags
|
|
|
|
```
|
|
forceOnce := flag.Bool("force-once", false, "Run the migration immediately without waiting for a webhook")
|
|
debug := flag.Bool("debug", false, "Enable debug logging")
|
|
dropRawFlag := flag.Bool("drop-raw", false, "Drop raw tables after migration (default: keep raw tables)")
|
|
```
|
|
|
|
It's not production ready but feel free to use as a quick hack to at least make the data more usable. |