1.線程池的初始化
- 構(gòu)造參數(shù)
| 參數(shù)名稱 | 說明 |
|---|---|
| int corePoolSize | 核心線程數(shù) |
| int maximumPoolSize | 最大線程數(shù) |
| long keepAliveTime | 空閑線程存活時間數(shù)量 |
| TimeUnit unit | 空閑線程存活時間單位 |
| BlockingQueue<Runnable> workQueue | 任務(wù)隊列 |
| ThreadFactory threadFactory | 線程工廠,可以自定義創(chuàng)建線程 |
| RejectedExecutionHandler handler | 拒絕策略 |
- 提交任務(wù)方法 execute解析
public void execute(Runnable command)
第一步,首先創(chuàng)建核心線程處理任務(wù)
//判定線程池線程數(shù)量是否小于核心線程數(shù)
int c = ctl.get();
if (workerCountOf(c) < corePoolSize) {
//增加核心線程數(shù)成功直接返回
if (addWorker(command, true))
return;
c = ctl.get();
}
第二步,走到這一步,說明核心線程已經(jīng)創(chuàng)建完畢,新提交的任務(wù)走下面的處理流程
//檢查線程池狀態(tài),并且將任務(wù)加入隊列
if (isRunning(c) && workQueue.offer(command)) {
//double check線程池狀態(tài)
int recheck = ctl.get();
if (! isRunning(recheck) && remove(command))
//線程池狀態(tài)不符合條件,則從隊列移除任務(wù)并且使用拒絕策略處理任務(wù)
reject(command);
//線程池狀態(tài)符合條件,但發(fā)現(xiàn)線程數(shù)為0,則增加線程,覺得是個兜底,
//防止出現(xiàn)任務(wù)隊列有任務(wù)卻沒有線程來處理的情況,極端情況下會有所有線程都銷毀了
else if (workerCountOf(recheck) == 0)
addWorker(null, false);
}
第三步,任務(wù)隊列滿了,會嘗試建立非核心線程處理任務(wù),否則使用拒絕策略
else if (!addWorker(command, false))
//如果創(chuàng)建非核心線程失?。ㄟ_到最大線程數(shù)),則任務(wù)交給拒絕策略來處理
reject(command);
小結(jié),提交任務(wù)處理流程
| 序號 | 條件 | 動作 |
|---|---|---|
| 1 | 線程數(shù)<corePoolSize | 新建核心線程,處理任務(wù) |
| 2 | 線程數(shù)>= corePoolSize 并且 workQueue 不滿 | 將任務(wù)加入workQueue |
| 3 | corePoolSize <= 線程數(shù) < maximumPoolSize 并且workQueue 滿了 | 創(chuàng)建非核心線程處理任務(wù) |
| 4 | 線程數(shù)> maximumPoolSize 并且workQueue 滿了 | 使用拒絕策略處理任務(wù) |
2.核心方法addWorker解析
private boolean addWorker(Runnable firstTask, boolean core)
| 參數(shù)名稱 | 說明 |
|---|---|
| Runnable firstTask | 處理的任務(wù),可以為空,創(chuàng)建線程時不處理任務(wù) |
| boolean core | 是否為核心線程 |
第一部分,判斷線程池是否符合增加線程r條件,不可以直接返回false
符合條件,直接cas增加線程池線程數(shù)量繼續(xù),并繼續(xù)下一步真正的增加線程
??不符合條件的情況
??? 1.線程池狀態(tài)為STOP、TIDYING、TERMINATED,這些狀態(tài)下不允許增加Worker
??? 2.線程池狀態(tài)為SHUTDOWN
????2.1新提交的任務(wù)不為空 或者 2.2新提交的任務(wù)為空,并且隊列為空
????相當(dāng)于判斷條if (rs == SHUTDOWN && (firstTask != null || workQueue.isEmpty())) return false;
????2.1的情況,SHUTDOWN狀態(tài)下線程池不接受新任務(wù),所以返回false
????2.2的情況,SHUTDOWN狀態(tài)下,新任務(wù)為空,這種情況為單純的增加線程,例如execute中這段代碼
else if (workerCountOf(recheck) == 0)
addWorker(null, false)
????此時,SHUTDOWN狀態(tài)下且任務(wù)隊列為空,即不存在需要執(zhí)行的任務(wù),無需增加線程,所以也返回false
??? 3.線程數(shù)量超限
???? 3.1 超過線程池最大線程容量(一般不會,很大的一個數(shù))
???? 3.2 超過核心線程數(shù),或者最大線程數(shù)
retry:
for (;;) {
int c = ctl.get();
int rs = runStateOf(c);
// Check if queue empty only if necessary.
if (rs >= SHUTDOWN &&
! (rs == SHUTDOWN &&
firstTask == null &&
! workQueue.isEmpty()))
return false;
for (;;) {
int wc = workerCountOf(c);
if (wc >= CAPACITY ||
wc >= (core ? corePoolSize : maximumPoolSize))
return false;
if (compareAndIncrementWorkerCount(c))
//cas 數(shù)量增加成功,則跳出循環(huán)進行到下一步
break retry;
c = ctl.get(); // Re-read ctl
if (runStateOf(c) != rs)
continue retry;
// else CAS failed due to workerCount change; retry inner loop
}
}
第二部分,真正的去增加線程
創(chuàng)建Worker,加入到線程池,并啟動Worker
將worker加入到線程池前,會再次檢查線程池的狀態(tài),
因為并發(fā)情況下execute、shutdown、shutdownNow等方法完全可能并發(fā)執(zhí)行,mainLock保護之外的代碼都可能并行
worker成功加入線程池后,會啟動該worker
啟動失敗執(zhí)行 addWorkerFailed 移除worker,維護數(shù)量,并且嘗試中止線程池,這種情況往往是線程池狀態(tài)發(fā)生變化
操縱線程池的wokers列表,都是在mainlock的保護之下進行的,所以不會存在并發(fā)問題
boolean workerStarted = false;
boolean workerAdded = false;
ThreadPoolExecutor.Worker w = null;
try {
w = new ThreadPoolExecutor.Worker(firstTask);
final Thread t = w.thread;
if (t != null) {
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
// Recheck while holding lock.
// Back out on ThreadFactory failure or if
// shut down before lock acquired.
int rs = runStateOf(ctl.get());
if (rs < SHUTDOWN ||
(rs == SHUTDOWN && firstTask == null)) {
if (t.isAlive()) // precheck that t is startable
throw new IllegalThreadStateException();
workers.add(w);
int s = workers.size();
if (s > largestPoolSize)
largestPoolSize = s;
workerAdded = true;
}
} finally {
mainLock.unlock();
}
if (workerAdded) {
t.start();
workerStarted = true;
}
}
} finally {
if (! workerStarted)
addWorkerFailed(w);
}
return workerStarted;
3.Worker的運行
3.1 構(gòu)造worker
Worker(Runnable firstTask) {
//線程中斷之前都會判定state>=0,這里設(shè)置state為-1 保證運行runwoker前不被中斷,
setState(-1); // inhibit interrupts until runWorker
this.firstTask = firstTask;
//把自身當(dāng)做runnable傳入線程,線程start會調(diào)用woker的run方法
this.thread = getThreadFactory().newThread(this);
}
public void run() {
runWorker(this);
}
3.2 runWorker方法
final void runWorker(ThreadPoolExecutor.Worker w) {
Thread wt = Thread.currentThread();
Runnable task = w.firstTask;
w.firstTask = null;
//unlock將state設(shè)置為0,之后就允許打斷當(dāng)前線程了
w.unlock(); // allow interrupts
boolean completedAbruptly = true;
try {
//循環(huán)獲取任務(wù),當(dāng)獲取任務(wù)為空或者執(zhí)行任務(wù)拋異常,線程結(jié)束,注意這兩個就是線程結(jié)束的條件
// getTask方法可能阻塞等待,阻塞的過程其實就是線程空閑的過程,阻塞超過時限,就會獲取不到任務(wù),進而線程會結(jié)束
while (task != null || (task = getTask()) != null) {
//在worker鎖的保護之下執(zhí)行任務(wù),獲取這個lock以后,worker進入執(zhí)行任務(wù)狀態(tài)了
w.lock();
// If pool is stopping, ensure thread is interrupted;
// if not, ensure thread is not interrupted. This
// requires a recheck in second case to deal with
// shutdownNow race while clearing interrupt
//如果線程池正在終止,確保當(dāng)前線程處于打斷狀態(tài),task仍然會被執(zhí)行,但下次循環(huán)getTask會為空,進而worker退出
if ((runStateAtLeast(ctl.get(), STOP) ||
(Thread.interrupted() &&
runStateAtLeast(ctl.get(), STOP))) &&
!wt.isInterrupted())
wt.interrupt();
try {
//執(zhí)行任務(wù)前鉤子
beforeExecute(wt, task);
Throwable thrown = null;
try {
//執(zhí)行任務(wù),從這里可以看出,我們定義任務(wù)要處理所有異常,不要拋給線程池會導(dǎo)致線程退出的
task.run();
} catch (RuntimeException x) {
thrown = x; throw x;
} catch (Error x) {
thrown = x; throw x;
} catch (Throwable x) {
thrown = x; throw new Error(x);
} finally {
//執(zhí)行完畢后的鉤子
afterExecute(task, thrown);
}
} finally {
task = null;
w.completedTasks++;
w.unlock();
}
}
//正常結(jié)束,會有這個標(biāo)識,如果異常結(jié)束則為true
completedAbruptly = false;
} finally {
//線程結(jié)束后執(zhí)行
processWorkerExit(w, completedAbruptly);
}
}
3.3 getTask方法
boolean timedOut = false; // Did the last poll() time out?
for (;;) {
int c = ctl.get();
int rs = runStateOf(c);
// Check if queue empty only if necessary.
/**
* 判斷線程池的狀態(tài),是否適合退出線程
* 1.線程池狀態(tài)大于等于STOP 返回null,worker退出
* 線程池狀態(tài)=SHUTDOWN 并且任務(wù)隊列為空,返回null,worker退出
*/
if (rs >= SHUTDOWN && (rs >= STOP || workQueue.isEmpty())) {
decrementWorkerCount();
return null;
}
int wc = workerCountOf(c);
// Are workers subject to culling?
/**
* 判斷當(dāng)前線程是否允許超時
* 1.設(shè)置核心線程允許超時allowCoreThreadTimeOut
* 2.線程池當(dāng)前線程數(shù)超過核心線程數(shù)
*/
boolean timed = allowCoreThreadTimeOut || wc > corePoolSize;
/**
* 判斷當(dāng)前線程是否可以退出
* 第一步 判定當(dāng)前線程是否符合退出的基本條件
* 1.線程池線程數(shù)大于最大線程數(shù) (為了保證線程池數(shù)量可控)或者
* 2.當(dāng)前線程允許超時并且已經(jīng)超時(為了處理真正超時的線程)
* 符合線程退出的基本條件以后再進行第二步的判斷
* 第二步,判定當(dāng)前的線程池狀態(tài),是否可以支持線程退出
* 1,線程池線程數(shù) 大于1 (不是最后一個線程就可以直接退出)或者
* 2.線程池任務(wù)隊列為空(相當(dāng)于(wc <= 1 && workQueue.isEmpty()) 最后一個線程需要隊列為空才可以退出)
* 符合兩步的條件的線程,可以正常退出
*/
if ((wc > maximumPoolSize || (timed && timedOut))
&& (wc > 1 || workQueue.isEmpty())) {
if (compareAndDecrementWorkerCount(c))
return null;
//cas失敗,繼續(xù)自旋
continue;
}
//獲取任務(wù)
try {
//worker線程會在這里阻塞等待獲取任務(wù),如果woker線程允許超時,則阻塞等待一段時間
//不允許超時,則會一直阻塞在這里,直到能獲取到任務(wù)
//這里會響應(yīng)中斷,一旦線程池關(guān)閉,會中斷worker線程,等待任務(wù)的阻塞狀態(tài)將被打破
Runnable r = timed ?
workQueue.poll(keepAliveTime, TimeUnit.NANOSECONDS) :
workQueue.take();
if (r != null)
return r;
//獲取不到任務(wù),則標(biāo)記為超時,繼續(xù)下次循環(huán)從而返回任務(wù)為空
timedOut = true;
} catch (InterruptedException retry) {
timedOut = false;
}
}
3.4 processWorkerExit方法
//異常退出,需要維護線程數(shù)量
if (completedAbruptly) // If abrupt, then workerCount wasn't adjusted
decrementWorkerCount();
//鎖保護下維護任務(wù)完成數(shù)量
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
completedTaskCount += w.completedTasks;
workers.remove(w);
} finally {
mainLock.unlock();
}
//worker數(shù)量減少,嘗試中止線程池
tryTerminate();
int c = ctl.get();
//線程池沒有中止的話
if (runStateLessThan(c, STOP)) {
//正常退出的情況
if (!completedAbruptly) {
//計算線程池最小維持線程數(shù)
int min = allowCoreThreadTimeOut ? 0 : corePoolSize;
if (min == 0 && ! workQueue.isEmpty())
min = 1;
//線程池數(shù)量多于最小維持?jǐn)?shù)量,則直接結(jié)束,這里就是worker的run方法真正結(jié)束的地方了
if (workerCountOf(c) >= min)
return; // replacement not needed
}
//非正常退出的情況,再次增加worker,比如worker執(zhí)行任務(wù)時拋異常了導(dǎo)致worker結(jié)束,需要追加新的worker
addWorker(null, false);
}
4.線程池的關(guān)閉
4.1 shutdown方法
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
checkShutdownAccess();
//修改線程池狀態(tài),這步以后線程池不再接收新的任務(wù)了,加入不到任務(wù)隊列
advanceRunState(SHUTDOWN);
//中斷非執(zhí)行狀態(tài)的worker,從這里可以看出shutdown不會中斷運行中(正在執(zhí)行任務(wù))的worker
interruptIdleWorkers();
onShutdown(); // hook for ScheduledThreadPoolExecutor
} finally {
mainLock.unlock();
}
//嘗試中止線程池
tryTerminate();
4.2 shutdownNow
關(guān)閉比較暴力,可能會丟失任務(wù)
List<Runnable> tasks;
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
checkShutdownAccess();
//修改線程池狀態(tài),這步以后線程池不再接收新的任務(wù)了,加入不到任務(wù)隊列
advanceRunState(STOP);
//打斷所有的worker
interruptWorkers();
//返回任務(wù)隊列中沒有執(zhí)行的任務(wù)
tasks = drainQueue();
} finally {
mainLock.unlock();
}
//嘗試中止線程池
tryTerminate();
return tasks;
4.3 interruptIdleWorkers
中斷未執(zhí)行任務(wù)的worker
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
for (ThreadPoolExecutor.Worker w : workers) {
Thread t = w.thread;
if (!t.isInterrupted() && w.tryLock()) {
//這里能獲取worker的鎖,說明worker處于非執(zhí)行任務(wù)狀態(tài),執(zhí)行任務(wù)狀態(tài)下獲取不到鎖
try {
t.interrupt();
} catch (SecurityException ignore) {
} finally {
w.unlock();
}
}
if (onlyOne)
break;
}
} finally {
mainLock.unlock();
}
4.4 interruptWorkers
中斷所有的worker
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
for (ThreadPoolExecutor.Worker w : workers)
//這里不管woker是否在執(zhí)行任務(wù),直接打斷
w.interruptIfStarted();
} finally {
mainLock.unlock();
}
4.5 tryTerminate
嘗試中止線程池,此方法被可能中止線程池的操作調(diào)用,如下
1.減少線程數(shù)量
2.在shutdown過程中移除任務(wù)
3.加入worker失敗
4.shutdownNow 過程
5.worker執(zhí)行完畢
for (;;) {
int c = ctl.get();
/**
* 這幾種情況,不需要進一步終止,直接返回
* 1,線程池狀態(tài):RUNNING,TIDYING,TERMINATED
* 2. SHUTDOWN狀態(tài)下,且隊列不為空
*/
if (isRunning(c) ||
runStateAtLeast(c, TIDYING) ||
(runStateOf(c) == SHUTDOWN && ! workQueue.isEmpty()))
return;
//執(zhí)行到這里說明,線程池處于SHUTDOWN 并且workQueue空了 or STOP (這個狀態(tài)不用關(guān)心workQueue)
if (workerCountOf(c) != 0) { // Eligible to terminate
//線程池線程數(shù)量不為0,中斷一個空閑的Worker
interruptIdleWorkers(ONLY_ONE);
return;
}
//執(zhí)行到這里,說明線程池線程數(shù)量為0了,可以關(guān)閉線程池了
final ReentrantLock mainLock = this.mainLock;
mainLock.lock();
try {
//在mainlock的保護之下,更改線程池狀態(tài)到TIDYING
if (ctl.compareAndSet(c, ctlOf(TIDYING, 0))) {
try {
//執(zhí)行鉤子方法
terminated();
} finally {
//更改線程池狀態(tài)到TERMINATED
ctl.set(ctlOf(TERMINATED, 0));
termination.signalAll();
}
return;
}
} finally {
mainLock.unlock();
}
// else retry on failed CAS
}
5.涉及到的鎖
mainLock 線程池級別的鎖
更改線程池狀態(tài),以及訪問workers列表(循環(huán),增加、移除),都需要mainlock的保護下進行
worker lock ,worker級別的鎖
worker獲取任務(wù)以后,需要獲取該鎖,然后執(zhí)行任務(wù),任務(wù)執(zhí)行完畢釋放該鎖
判定worker是否可以被中斷,也是通過該鎖,其他線程如果能獲取該鎖,說明worker處于沒有正在執(zhí)行任務(wù)的狀態(tài),可以進行中斷操作