Spring Batch規劃好你的配置文件，用好Flow

原創 落涯 2020-02-20 17:55

隨着項目的規模的不斷擴大，Spring Batch的配置文件，也是一個頭疼的問題，本人試了很多次，建議的配置方式如下：

基礎配置放在一個文件中applicationContext-batch.xml：

<beans:beans xmlns="http://www.springframework.org/schema/batch"
	xmlns:beans="http://www.springframework.org/schema/beans" xmlns:bean="http://www.springframework.org/schema/beans"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://www.springframework.org/schema/beans 
	http://www.springframework.org/schema/beans/spring-beans.xsd
	http://www.springframework.org/schema/batch
	http://www.springframework.org/schema/batch/spring-batch-2.1.xsd">
	
	<bean:bean id="jobRepository"
		class="org.springframework.batch.core.repository.support.MapJobRepositoryFactoryBean">
		<bean:property name="transactionManager" ref="transactionManager" />
	</bean:bean>
	<bean:bean id="transactionManager"
		class="org.springframework.batch.support.transaction.ResourcelessTransactionManager">
	</bean:bean>
	<bean:bean id="jobLauncher"
		class="org.springframework.batch.core.launch.support.SimpleJobLauncher">
		<bean:property name="jobRepository" ref="jobRepository" />
		<bean:property name="taskExecutor">
			<bean:bean class="org.springframework.core.task.SimpleAsyncTaskExecutor"></bean:bean>
		</bean:property>
	</bean:bean>
	
</beans:beans>

一個業務場景對應一個配置文件applicationContext-batch-mysteps.xml： 

<beans:beans xmlns="http://www.springframework.org/schema/batch"
	xmlns:beans="http://www.springframework.org/schema/beans" xmlns:bean="http://www.springframework.org/schema/beans"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://www.springframework.org/schema/beans 
	http://www.springframework.org/schema/beans/spring-beans.xsd
	http://www.springframework.org/schema/batch
	http://www.springframework.org/schema/batch/spring-batch-2.1.xsd">
	
	<flow id="mysteps_flow">
		<step id="mysteps_flow_first" parent="mysteps_first" next="mysteps_flow_second"></step>
		<step id="mysteps_flow_second" parent="mysteps_second" next="mysteps_flow_third"></step>
		<step id="mysteps_flow_third" parent="mysteps_third"></step>
	</flow>
	<step id="mysteps_first">
		<tasklet ref="first"></tasklet>
	</step>
	<step id="mysteps_second">
		<tasklet ref="second"></tasklet>
	</step>
	<step id="mysteps_third">
		<tasklet ref="third"></tasklet>
	</step>
	<bean:bean id="first" class="com.test.tasklet.MyFirstTasklet" scope="step">
	</bean:bean>
	<bean:bean id="second" class="com.test.tasklet.MySecondTasklet" scope="step">
	</bean:bean>
	<bean:bean id="third" class="com.test.tasklet.MyThirdTasklet" scope="step">
	</bean:bean>
</beans:beans>

業務場景的配置，最好到Flow級別。

所有的Job放在同一個配置文件中applicationContext-batch-job.xml：

<beans:beans xmlns="http://www.springframework.org/schema/batch"
	xmlns:beans="http://www.springframework.org/schema/beans" xmlns:bean="http://www.springframework.org/schema/beans"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://www.springframework.org/schema/beans 
	http://www.springframework.org/schema/beans/spring-beans.xsd
	http://www.springframework.org/schema/batch
	http://www.springframework.org/schema/batch/spring-batch-2.1.xsd">
	<job id="fJob">
		<step id="fJob_begin" parent="mysteps_first" next="fJob_second"></step>
		<flow id="fJob_second" parent="mysteps_flow"></flow>
	</job>
	<job id="sJob">
		<step id="sJob_begin" parent="mysteps_first"></step>
	</job>
</beans:beans>

這樣，我們只需要看Job的配置文件就能看到所有的可以執行的Job。

一個Flow是一些Steps的集合，用好parent屬性，parent可以讓一個step或者flow繼承父元素的所有屬性。


main函數：

/**
 * 
 */
package com.test.springbatch;

import org.springframework.batch.core.ExitStatus;
import org.springframework.batch.core.Job;
import org.springframework.batch.core.JobExecution;
import org.springframework.batch.core.JobParametersBuilder;
import org.springframework.batch.core.JobParametersInvalidException;
import org.springframework.batch.core.launch.JobLauncher;
import org.springframework.batch.core.repository.JobExecutionAlreadyRunningException;
import org.springframework.batch.core.repository.JobInstanceAlreadyCompleteException;
import org.springframework.batch.core.repository.JobRestartException;
import org.springframework.context.ApplicationContext;
import org.springframework.context.support.FileSystemXmlApplicationContext;

/**
 * @author hadoop
 *
 */
public class AppMain {

	/**
	 * @param args
	 */
	public static void main(String[] args) {
		ApplicationContext context;
		JobParametersBuilder jobPara = new JobParametersBuilder();  //設置文件路徑參數
		context = new FileSystemXmlApplicationContext(new String[]{"classpath:applicationContext-batch-mysteps.xml",
				"classpath:applicationContext-batch.xml", "classpath:applicationContext-batch-job.xml"});
		Job fJob = (Job)context.getBean("fJob");
		Job sJob = (Job)context.getBean("sJob");
	    JobLauncher launcher = (JobLauncher)context.getBean("jobLauncher");
	    try {
	      launcher.run(fJob, jobPara.toJobParameters());
	      //launcher.run(sJob, jobPara.toJobParameters());
	    } catch (JobExecutionAlreadyRunningException e) {
	    	e.printStackTrace();
	    } catch (JobRestartException e) {
	    	e.printStackTrace();
	    } catch (JobInstanceAlreadyCompleteException e) {
	    	e.printStackTrace();
	    } catch (JobParametersInvalidException e) {
	    	e.printStackTrace();
	    }
	}

}

三個task類： 

/**
 * 
 */
package com.test.tasklet;

import org.springframework.batch.core.StepContribution;
import org.springframework.batch.core.scope.context.ChunkContext;
import org.springframework.batch.core.step.tasklet.Tasklet;
import org.springframework.batch.repeat.RepeatStatus;

/**
 * @author hadoop
 *
 */
public class MyFirstTasklet implements Tasklet {

	/* (non-Javadoc)
	 * @see org.springframework.batch.core.step.tasklet.Tasklet#execute(org.springframework.batch.core.StepContribution, org.springframework.batch.core.scope.context.ChunkContext)
	 */
	public RepeatStatus execute(StepContribution arg0, ChunkContext arg1)
			throws Exception {
		
		for(int i = 0; i < 10; i++)
		{
			System.out.println(Thread.currentThread().getName() + "F" + i);
			Thread.sleep(1000);
		}
		
		return RepeatStatus.FINISHED;
	}

}


/**
 * 
 */
package com.test.tasklet;

import org.springframework.batch.core.StepContribution;
import org.springframework.batch.core.scope.context.ChunkContext;
import org.springframework.batch.core.step.tasklet.Tasklet;
import org.springframework.batch.repeat.RepeatStatus;

/**
 * @author hadoop
 *
 */
public class MySecondTasklet implements Tasklet {

	/* (non-Javadoc)
	 * @see org.springframework.batch.core.step.tasklet.Tasklet#execute(org.springframework.batch.core.StepContribution, org.springframework.batch.core.scope.context.ChunkContext)
	 */
	public RepeatStatus execute(StepContribution arg0, ChunkContext arg1)
			throws Exception {
		
		for(int i = 0; i < 10; i++)
		{
			System.out.println(Thread.currentThread().getName() + "S" + i);
			Thread.sleep(1000);
		}
		
		return RepeatStatus.FINISHED;
	}

}


/**
 * 
 */
package com.test.tasklet;

import org.springframework.batch.core.StepContribution;
import org.springframework.batch.core.scope.context.ChunkContext;
import org.springframework.batch.core.step.tasklet.Tasklet;
import org.springframework.batch.repeat.RepeatStatus;

/**
 * @author hadoop
 *
 */
public class MyThirdTasklet implements Tasklet {

	/* (non-Javadoc)
	 * @see org.springframework.batch.core.step.tasklet.Tasklet#execute(org.springframework.batch.core.StepContribution, org.springframework.batch.core.scope.context.ChunkContext)
	 */
	public RepeatStatus execute(StepContribution arg0, ChunkContext arg1)
			throws Exception {
		
		for(int i = 0; i < 10; i++)
		{
			System.out.println(Thread.currentThread().getName() + "T" + i);
			Thread.sleep(1000);
		}
		
		return RepeatStatus.FINISHED;
	}

}

執行結果： 

INFO [org.springframework.context.support.FileSystemXmlApplicationContext] - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@68fe748f: display name [org.springframework.context.support.FileSystemXmlApplicationContext@68fe748f]; startup date [Sat May 04 09:46:27 CST 2013]; root of context hierarchy
INFO [org.springframework.beans.factory.xml.XmlBeanDefinitionReader] - Loading XML bean definitions from class path resource [applicationContext-batch-mysteps.xml]
INFO [org.springframework.beans.factory.xml.XmlBeanDefinitionReader] - Loading XML bean definitions from class path resource [applicationContext-batch.xml]
INFO [org.springframework.beans.factory.xml.XmlBeanDefinitionReader] - Loading XML bean definitions from class path resource [applicationContext-batch-job.xml]
INFO [org.springframework.beans.factory.support.DefaultListableBeanFactory] - Overriding bean definition for bean 'fJob': replacing [Generic bean: class [org.springframework.batch.core.configuration.xml.SimpleFlowFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null] with [Generic bean: class [org.springframework.batch.core.configuration.xml.JobParserJobFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null]
INFO [org.springframework.beans.factory.support.DefaultListableBeanFactory] - Overriding bean definition for bean 'sJob': replacing [Generic bean: class [org.springframework.batch.core.configuration.xml.SimpleFlowFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null] with [Generic bean: class [org.springframework.batch.core.configuration.xml.JobParserJobFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null]
INFO [org.springframework.context.support.FileSystemXmlApplicationContext] - Bean factory for application context [org.springframework.context.support.FileSystemXmlApplicationContext@68fe748f]: org.springframework.beans.factory.support.DefaultListableBeanFactory@1232784a
INFO [org.springframework.beans.factory.support.DefaultListableBeanFactory] - Overriding bean definition for bean 'first': replacing [Generic bean: class [com.test.tasklet.MyFirstTasklet]; scope=step; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=false; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in class path resource [applicationContext-batch-mysteps.xml]] with [Root bean: class [org.springframework.batch.core.scope.util.PlaceholderProxyFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in BeanDefinition defined in class path resource [applicationContext-batch-mysteps.xml]]
INFO [org.springframework.beans.factory.support.DefaultListableBeanFactory] - Overriding bean definition for bean 'second': replacing [Generic bean: class [com.test.tasklet.MySecondTasklet]; scope=step; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=false; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in class path resource [applicationContext-batch-mysteps.xml]] with [Root bean: class [org.springframework.batch.core.scope.util.PlaceholderProxyFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in BeanDefinition defined in class path resource [applicationContext-batch-mysteps.xml]]
INFO [org.springframework.beans.factory.support.DefaultListableBeanFactory] - Overriding bean definition for bean 'third': replacing [Generic bean: class [com.test.tasklet.MyThirdTasklet]; scope=step; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=false; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in class path resource [applicationContext-batch-mysteps.xml]] with [Root bean: class [org.springframework.batch.core.scope.util.PlaceholderProxyFactoryBean]; scope=singleton; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null; defined in BeanDefinition defined in class path resource [applicationContext-batch-mysteps.xml]]
INFO [org.springframework.beans.factory.support.DefaultListableBeanFactory] - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@1232784a: defining beans [org.springframework.batch.core.scope.internalStepScope,org.springframework.beans.factory.config.CustomEditorConfigurer,org.springframework.batch.core.configuration.xml.CoreNamespacePostProcessor,mysteps_flow_first,mysteps_flow_second,mysteps_flow_third,mysteps_flow,mysteps_first,mysteps_second,mysteps_third,first,second,third,jobRepository,transactionManager,jobLauncher,fJob_begin,fJob,sJob_begin,sJob,lazyBindingProxy.first,lazyBindingProxy.second,lazyBindingProxy.third]; root of factory hierarchy
INFO [org.springframework.batch.core.launch.support.SimpleJobLauncher] - Job: [FlowJob: [name=fJob]] launched with the following parameters: [{}]
INFO [org.springframework.batch.core.job.SimpleStepHandler] - Executing step: [fJob_begin]
SimpleAsyncTaskExecutor-1F0
SimpleAsyncTaskExecutor-1F1
SimpleAsyncTaskExecutor-1F2
SimpleAsyncTaskExecutor-1F3
SimpleAsyncTaskExecutor-1F4
SimpleAsyncTaskExecutor-1F5
SimpleAsyncTaskExecutor-1F6
SimpleAsyncTaskExecutor-1F7
SimpleAsyncTaskExecutor-1F8
SimpleAsyncTaskExecutor-1F9
INFO [org.springframework.batch.core.job.SimpleStepHandler] - Executing step: [mysteps_flow_first]
SimpleAsyncTaskExecutor-1F0
SimpleAsyncTaskExecutor-1F1
SimpleAsyncTaskExecutor-1F2
SimpleAsyncTaskExecutor-1F3
SimpleAsyncTaskExecutor-1F4
SimpleAsyncTaskExecutor-1F5
SimpleAsyncTaskExecutor-1F6
SimpleAsyncTaskExecutor-1F7
SimpleAsyncTaskExecutor-1F8
SimpleAsyncTaskExecutor-1F9
INFO [org.springframework.batch.core.job.SimpleStepHandler] - Executing step: [mysteps_flow_second]
SimpleAsyncTaskExecutor-1S0
SimpleAsyncTaskExecutor-1S1
SimpleAsyncTaskExecutor-1S2
SimpleAsyncTaskExecutor-1S3
SimpleAsyncTaskExecutor-1S4
SimpleAsyncTaskExecutor-1S5
SimpleAsyncTaskExecutor-1S6
SimpleAsyncTaskExecutor-1S7
SimpleAsyncTaskExecutor-1S8
SimpleAsyncTaskExecutor-1S9
INFO [org.springframework.batch.core.job.SimpleStepHandler] - Executing step: [mysteps_flow_third]
SimpleAsyncTaskExecutor-1T0
SimpleAsyncTaskExecutor-1T1
SimpleAsyncTaskExecutor-1T2
SimpleAsyncTaskExecutor-1T3
SimpleAsyncTaskExecutor-1T4
SimpleAsyncTaskExecutor-1T5
SimpleAsyncTaskExecutor-1T6
SimpleAsyncTaskExecutor-1T7
SimpleAsyncTaskExecutor-1T8
SimpleAsyncTaskExecutor-1T9
INFO [org.springframework.batch.core.launch.support.SimpleJobLauncher] - Job: [FlowJob: [name=fJob]] completed with the following parameters: [{}] and the following status: [COMPLETED]

落涯
發佈了55 篇原創文章 · 獲贊 6 · 訪問量 12萬+
私信 關注
發表評論
所有評論
還沒有人評論，想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章

WebSocket替換Http協議的邏輯實現

 · 前言     · 在國內，公網服務器與本地服務器的通信一直是個難題，本地服務器因爲IP是動態變化的，公網服務器沒辦法將請求發送給本地服務器。爲了解決這個問題，所以採用WebSocket協議替換Http協議。爲了實現請求等待，使用Gu

原創 2024-06-03 11:25:33

Spring 中如何控制 Bean 的加載順序？

如果你脫口而出說添加 @Order 註解或者是實現 Ordered 接口，那麼恭喜，你掉坑了。 一 @Order 註解和 Ordered 接口 在 Spring 框架中，@Order 是一個非常實用的元註解，它位於 spring-core

原創 2024-06-03 01:17:22

「Java開發指南」如何用MyEclipse搭建Spring安全策略？

本教程將引導您向現有的Web應用程序添加Spring安全策略，在本教程中您將學習如何： 搭建Spring安全策略 部署應用程序 MyEclipse v2023.1.2離線版下載   搭建Spring安全策略 1. 創建一個 scaf

原創 2024-05-30 12:19:47

spring源碼閱讀之bean加載過程(一)

如果想要閱讀源碼,首先要選擇版本,然後將源代碼下載到本地,導入idea中,話不多說,直接看步驟吧 這裏我選擇5版本, 下載源碼 默認是main分支,看想學習的分支,比如我切換到5版本,截圖如下:     2.安裝gradle 3

原創 2024-05-27 23:55:57

使用 Spring Cloud Alibaba AI 構建 RAG 應用

作者：姬世文 背景介紹 RAG（Retrieval Augmented Generation） 檢索增強生成（RAG）是一種用於將數據與人工智能模型集成的技術。在 RAG 工作流程中，第一步將文檔數據加載到矢量數據庫（例如 Redis）中。

原創 2024-05-27 21:13:51

聊聊Spring中的數據綁定 --- WebDataBinder、ServletRequestDataBinder、WebBindingInitializer 文章源於Ai生成

每篇一句 大魔王張怡寧：女兒，這堆金牌你拿去玩吧，但我的銀牌不能給你玩。你要想玩銀牌就去找你王浩叔叔吧，他那銀牌多 前言 爲了講述好Spring MVC最爲複雜的數據綁定這塊，我前面可謂是做足了功課，對此部分知識此處給小夥伴留一個學

微學網絡 2024-05-27 10:53:57

@ResponseBody是怎麼起作用的

前言 　　最近參與的項目中，接口中返回的日期格式不對，發現項目中配置了fastjson作爲spring的數據轉換器，於是使用了fastjson的字段格式化轉換註解 發現不起作用。這讓我很疑惑，然後在fastjson的相關代碼中打斷點發現請

微學網絡 2024-05-27 10:53:54

Spring項目中使用NIO並行調用http接口指南

1-背景 後臺BFF層服務爲了SEO，涉及大量對底層數據的聚合，如果按照過程化編程，串行執行請求數據再聚合會造成很高的延遲，因此我們往往大量使用多線程技術並行化多個查詢，來減少單個請求的響應時間。 多線程一定程度上也能達成通過並行化提升

原創 2024-05-23 11:10:25

Spring優雅使用log4j2日誌

1-前言 Spring框架本身提供了對日誌的集成，對logback的支持非常好，但是對log4j和log4j2的支持就沒那麼好。 在同步打印日誌的場景下logback擁有最高的日誌吞吐量《Logback Throughput Benchma

原創 2024-05-22 23:12:10

爲什麼不推薦在Spring Boot中使用@Value加載配置

@Value註解相信很多Spring Boot的開發者都已經有接觸了，通過使用該註解，我們可以快速的把配置信息加載到Spring的Bean中。 比如下面這樣，就可以輕鬆的把配置文件中key爲com.didispace.title配置信息加載

原創 2024-05-21 21:46:20

系統國際化之多語言解決方案| 京東物流技術團隊

1. 背景 隨着京東各業務板塊國際化進程的不斷推進，諸多業務已經融入了多元文化中，一個一體化的多語言系統解決方案成爲各個技術團隊討論的焦點。國際物流系統憑藉在國際化領域多年的經驗，特別是在系統多語言處理上長期的經驗積累，總結了一套標準

原創 2024-05-17 23:56:46

「Java開發指南」如何用MyEclipse搭建GWT 2.1和Spring？（二）

本教程將指導您如何生成一個可運行的Google Web Toolkit (GWT) 2.1和Spring應用程序，該應用程序爲域模型實現了CRUD應用程序模式。在本教程中，您將學習如何： 安裝Google Eclipse插件 爲GWT配置

原創 2024-05-17 12:21:26

Spring boot自動裝配實現原理

自動裝配原理分析 條件註冊機制 spring-context模塊中有兩個組件：Condition接口和@Conditional註解，在@Conditional註解中可以指定一組Condition實現， 通常@Conditional是和@Co

原創 2024-05-16 23:48:07

Spring @EnableXxx註解的使用理解

@EnableXxx註解 Spring有很多@EnableXxx這種形式的註解，類似於可以一鍵打開某項功能，相當於暴露給用戶的一種便捷的配置API，例如 @EnableAsync 激活異步執行能力，@EnableTransactionMan

原創 2024-05-16 23:48:06

流水線 YAML 高級用法來了！大幅降低重複代碼、靈活編排多任務

作者：木煙 在 YAML 化配置流水線時，你是否會遇到以下問題？ 單流水線中批量執行類似任務場景時，YAML 中需要定義多個類似邏輯的 Job，Job 越多，流水線 YAML 配置的越長，YAML 中的重複代碼越多，代碼複用性低，可讀性差

原創 2024-05-16 21:13:44