kettle-plugin

Download and install kettle Download: https://pentaho.com/download/#download-pentaho

After downloading, unzip it and run spoon.sh to start kettle.

You can also compile it yourself, refer to the compilation section

Compile doris stream load plugin

cd doris/extension/kettle
mvn clean package -DskipTests

After the compilation is complete, unzip the plugin package and copy it to the plugins directory of kettle

cd assemblies/plugin/target
unzip doris-stream-loader-plugins-9.4.0.0-343.zip 
cp -r doris-stream-loader ${KETTLE_HOME}/plugins/
mvn clean package -DskipTests

Build job Find Doris Stream Loader in Batch Loading in Kettle and build the job
Click Start to run the job to complete data synchronization
Configuration

Key	Default Value	Required	Comment
Step name	--	Y	Step name
fenodes	--	Y	Doris FE http address, supports multiple addresses, separated by commas
DataBase	--	Y	Doris's write database
Table	--	Y	Doris's write table
User	--	Y	Username to access Doris
Password	--	N	Password to access Doris
Maximum rows for load	10000	N	Maximum number of rows to load at a time
Maximum bytes for load	10485760(10MB)	N	Maximum size in bytes of a single load
Load retries	3	N	Number of retries after load failure
StreamLoad Properties	--	N	Streamload http header for request