clickhouse-airbyte-normer

GoProg to move data from raw tables to normal tables #hack

A quick hack to get the Airbyte raw tables to normal tables so my collegueas can query the data better in clickhouse.

env variables for docker build:

	chHost := os.Getenv("CH_HOST")
	chPort := os.Getenv("CH_PORT")
	chUser := os.Getenv("CH_USER")
	chPass := os.Getenv("CH_PASS")
	rawDB := os.Getenv("RAW_DB")

flags

	forceOnce := flag.Bool("force-once", false, "Run the migration immediately without waiting for a webhook")
	debug := flag.Bool("debug", false, "Enable debug logging")
	dropRawFlag := flag.Bool("drop-raw", false, "Drop raw tables after migration (default: keep raw tables)")

It's not production ready but feel free to use as a quick hack to at least make the data more usable.

800 B Raw Blame History

clickhouse-airbyte-normer

800 B

Raw Blame History