Skip to content

Conversation

fish-gangan
Copy link

@fish-gangan fish-gangan commented Nov 27, 2024

  1. 对源代码的改动极小,只是在DataBaseType增加了bytehouse的支持,依旧采用JDBC协议
  2. bytehouse reader和writer的插件基本用的都是源代码中的公共类,没有复杂的自定义部分
  3. 新增了ArrayColumn 简单做了string化,不会影响其它插件
  4. 模板
{
	"job": {
		"setting": {
			"speed": {
				"channel": 2
			}
		},
		"content": [
			{
				"reader": {
					"name": "clickhousereader",
					"parameter": {
						"username": "gcods",
						"password": "O95L987rhEc5b36zmdV9",
						"where":"sdk_event_date>='2024-01-01' and  sdk_event_date<'2024-01-02'",
						"column": [
							"sdk_event_hour",
							"sdk_event_minute",
							"sdk_event_date",
							"event_ad_code_id"
						],
						"connection": [
							{
								"table": [
									"table_name"
								],
								"jdbcUrl": [
									"jdbc:clickhouse://1p:8123/test"
								]
							}
						]
					}
				}
				,
				"writer": {
					"name": "bytehousewriter",
					"parameter": {
						"username": "bytehouse",
						"password": "aAUvBmMEoo:eeLDmfk9Mt",
						"column": [
								"sdk_event_hour",
								"sdk_event_minute",
								"sdk_event_date",
								"event_ad_code_id"
						],
						"preSql": [
							" "
						],
						"connection": [
							{
								"jdbcUrl": "jdbc:bytehouse://ip:19000?secure=true&database=test",
								"table": [
									"table_name"
								]
							}
						]
					}
				}
			}
		]
	}
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant