Android MultiDex實(shí)現(xiàn)原理解析

本文主要從源碼角度出發(fā),分析MultiDex的實(shí)現(xiàn)原理。

出處: Allen's Zone
作者: Allen Feng

分析

調(diào)用MultiDex的方式有多種,不論是直接使用官方提供的MultiDexApplication,還是繼承MultiDexApplication,或者是重寫自定義Application的attachBaseContext方法,最后都會(huì)調(diào)用到MultiDex.install(this);

  @Override
  protected void attachBaseContext(Context base) {
    super.attachBaseContext(base);
    MultiDex.install(this);
  }

MultiDex.install是整個(gè)MultiDex的入口點(diǎn),我們以此為切入點(diǎn)開始分析:

   public static void install(Context context) {
        Log.i(TAG, "install");

        // 檢查當(dāng)前系統(tǒng)是否支持multidex
        if (IS_VM_MULTIDEX_CAPABLE) {
            Log.i(TAG, "VM has multidex support, MultiDex support library is disabled.");
            try {
                clearOldDexDir(context);
            } catch (Throwable t) {
                Log.w(TAG, "Something went wrong when trying to clear old MultiDex extraction, "
                        + "continuing without cleaning.", t);
            }
            return;
        }

        // MultiDex最低只支持到1.6
        if (Build.VERSION.SDK_INT < MIN_SDK_VERSION) {
            throw new RuntimeException("Multi dex installation failed. SDK " + Build.VERSION.SDK_INT
                    + " is unsupported. Min SDK version is " + MIN_SDK_VERSION + ".");
        }

        try {
            ApplicationInfo applicationInfo = getApplicationInfo(context);
            if (applicationInfo == null) {
                // Looks like running on a test Context, so just return without patching.
                return;
            }

            synchronized (installedApk) {

                // sourceDir對(duì)應(yīng)于/data/app/<package-name>.apk
                String apkPath = applicationInfo.sourceDir;

                // 若給定apk已經(jīng)install過,直接退出
                if (installedApk.contains(apkPath)) {
                    return;
                }
                installedApk.add(apkPath);


                // MultiDex 最高只支持到20(Android 4.4W),更高的版本不能保證正常工作

                if (Build.VERSION.SDK_INT > MAX_SUPPORTED_SDK_VERSION) {
                    Log.w(TAG, "MultiDex is not guaranteed to work in SDK version "
                            + Build.VERSION.SDK_INT + ": SDK version higher than "
                            + MAX_SUPPORTED_SDK_VERSION + " should be backed by "
                            + "runtime with built-in multidex capabilty but it's not the "
                            + "case here: java.vm.version=\""
                            + System.getProperty("java.vm.version") + "\"");
                }

                /* 
                 * 待Patch的class loader應(yīng)該是BaseDexClassLoaderd的子類,
                 * MultiDex主要通過修改pathList字段來添加更多的dex
                 */
                ClassLoader loader;
                try {
                    loader = context.getClassLoader();
                } catch (RuntimeException e) {
                    /* Ignore those exceptions so that we don't break tests relying on Context like
                     * a android.test.mock.MockContext or a android.content.ContextWrapper with a
                     * null base Context.
                     */
                    Log.w(TAG, "Failure while trying to obtain Context class loader. " +
                            "Must be running in test mode. Skip patching.", e);
                    return;
                }
                if (loader == null) {
                    // Note, the context class loader is null when running Robolectric tests.
                    Log.e(TAG,
                            "Context class loader is null. Must be running in test mode. "
                            + "Skip patching.");
                    return;
                }


                // MultiDex的二級(jí)dex文件將存放在 /data/data/<package-name>/secondary-dexes 下

                File dexDir = new File(context.getFilesDir(), SECONDARY_FOLDER_NAME);

                // 從apk中查找并解壓二級(jí)dex文件到/data/data/<package-name>/secondary-dexes
                List<File> files = MultiDexExtractor.load(context, applicationInfo, dexDir, false);

                // 檢查dex壓縮文件的完整性
                if (checkValidZipFiles(files)) {

                    // 開始安裝dex
                    installSecondaryDexes(loader, dexDir, files);
                } else {
                    Log.w(TAG, "Files were not valid zip files.  Forcing a reload.");

                    // 第一次檢查失敗,MultiDex會(huì)盡責(zé)的再檢查一次
                    files = MultiDexExtractor.load(context, applicationInfo, dexDir, true);

                    if (checkValidZipFiles(files)) {

                        // 開始安裝dex
                        installSecondaryDexes(loader, dexDir, files);
                    } else {
                        // Second time didn't work, give up
                        throw new RuntimeException("Zip files were not valid.");
                    }
                }
            }

        } catch (Exception e) {
            Log.e(TAG, "Multidex installation failure", e);
            throw new RuntimeException("Multi dex installation failed (" + e.getMessage() + ").");
        }
        Log.i(TAG, "install done");
    }

這個(gè)方法涵蓋了MultiDex安裝的整個(gè)流程:

1. 檢查虛擬機(jī)版本判斷是否需要MultiDex;

在ART虛擬機(jī)中(部分4.4機(jī)器及5.0以上的機(jī)器),采用了Ahead-of-time(AOT)compilation技術(shù),系統(tǒng)在apk的安裝過程中,會(huì)使用自帶的dex2oat工具對(duì)apk中可用的dex文件進(jìn)行編譯,并生成一個(gè)可在本地機(jī)器上運(yùn)行的odex(optimized dex)文件,這樣做會(huì)提高應(yīng)用的啟動(dòng)速度。(但是安裝速度降低了)

若不需要使用MultiDex,將使用clearOldDexDir清除/data/data/pkgName/code-cache/secondary-dexes目錄下下所有文件

2. 根據(jù)applicationInfo.sourceDir的值獲取安裝的apk路徑

安裝完成的apk路徑為/data/app/<package-name>.apk

3. 檢查apk是否執(zhí)行過MultiDex.install,若已經(jīng)安裝直接退出

4. 使用MultiDexExtractor.load獲取apk中可用的二級(jí)dex列表

static List<File> load(Context context, ApplicationInfo applicationInfo, File dexDir, boolean forceReload) throws IOException {

    Log.i("MultiDex", "MultiDexExtractor.load(" + applicationInfo.sourceDir + ", " + forceReload + ")");
    File sourceApk = new File(applicationInfo.sourceDir);
    long currentCrc = getZipCrc(sourceApk);
    List files;
    if(!forceReload && !isModified(context, sourceApk, currentCrc)) {
        try {
            files = loadExistingExtractions(context, sourceApk, dexDir);
        } catch (IOException var9) {
            Log.w("MultiDex", "Failed to reload existing extracted secondary dex files, falling back to fresh extraction", var9);
            files = performExtractions(sourceApk, dexDir);
            putStoredApkInfo(context, getTimeStamp(sourceApk), currentCrc, files.size() + 1);
        }
    } else {
        Log.i("MultiDex", "Detected that extraction must be performed.");
        files = performExtractions(sourceApk, dexDir);
        putStoredApkInfo(context, getTimeStamp(sourceApk), currentCrc, files.size() + 1);
    }

    Log.i("MultiDex", "load found " + files.size() + " secondary dex files");
    return files;
}

MultiDexExtractor.load會(huì)先判斷是否需要從apk中解壓dex文件,主要判斷依據(jù)是:上次保存的apk(zip文件)的CRC校驗(yàn)碼和last modify日期與dex的總數(shù)量是否與當(dāng)前apk相同。此外,forceReload也會(huì)決定是否需要重新解壓,這個(gè)參數(shù)后文會(huì)提到。

如果需要解壓dex文件,將會(huì)使用performExtractions將.dex從apk中解壓出來,解壓路徑為

/data/data/<package-name>/code_cache/secondary-dexes/<package-name>.apk.classes2.zip
/data/data/<package-name>/code_cache/secondary-dexes/<package-name>.apk.classes3.zip 
...
private static List<File> performExtractions(File sourceApk, File dexDir) throws IOException {

        // extractedFilePrefix值為<package-name>.apk.classes

        String extractedFilePrefix = sourceApk.getName() + ".classes";
        prepareDexDir(dexDir, extractedFilePrefix);
        ArrayList files = new ArrayList();
        ZipFile apk = new ZipFile(sourceApk);

        try {
            int e = 2;

            // 掃描apk內(nèi)所有classes2.dex、classes3.dex...文件
            for(ZipEntry dexFile = apk.getEntry("classes" + e + ".dex"); dexFile != null; dexFile = apk.getEntry("classes" + e + ".dex")) {

                // 解壓路徑為 /data/data/<package-name>/secondary-dexes/<package-name>.classes2.dex.zip 、/data/data/<package-name>/secondary-dexes/<package-name>.classes3.dex.zip ...
                String fileName = extractedFilePrefix + e + ".zip";

                File extractedFile = new File(dexDir, fileName);
                files.add(extractedFile);

                Log.i("MultiDex", "Extraction is needed for file " + extractedFile);
                
                int numAttempts = 0;
                boolean isExtractionSuccessful = false;

                // 每個(gè)dex文件都會(huì)嘗試3次解壓
                while(numAttempts < 3 && !isExtractionSuccessful) {
                    ++numAttempts;
                    extract(apk, dexFile, extractedFile, extractedFilePrefix);
                    isExtractionSuccessful = verifyZipFile(extractedFile);
                    Log.i("MultiDex", "Extraction " + (isExtractionSuccessful?"success":"failed") + " - length " + extractedFile.getAbsolutePath() + ": " + extractedFile.length());
                    if(!isExtractionSuccessful) {
                        extractedFile.delete();
                        if(extractedFile.exists()) {
                            Log.w("MultiDex", "Failed to delete corrupted secondary dex \'" + extractedFile.getPath() + "\'");
                        }
                    }
                }

                if(!isExtractionSuccessful) {
                    throw new IOException("Could not create zip file " + extractedFile.getAbsolutePath() + " for secondary dex (" + e + ")");
                }

                ++e;
            }
        } finally {
            try {
                apk.close();
            } catch (IOException var16) {
                Log.w("MultiDex", "Failed to close resource", var16);
            }

        }

        return files;
    }

解壓成功后,會(huì)保存本次解壓所使用的apk信息,用于下次調(diào)用MultiDexExtractor.load時(shí)判斷是否需要重新解壓:

private static void putStoredApkInfo(Context context, long timeStamp, long crc, int totalDexNumber) {
    SharedPreferences prefs = getMultiDexPreferences(context);
    Editor edit = prefs.edit();

    // apk最后修改時(shí)間戳
    edit.putLong("timestamp", timeStamp);

    // apk的CRC校驗(yàn)碼
    edit.putLong("crc", crc);

    // dex的總數(shù)量
    edit.putInt("dex.number", totalDexNumber);
    apply(edit);
}

如果apk未被修改,將會(huì)調(diào)用loadExistingExtractions方法,直接加載上一次解壓出來的文件:

private static List<File> loadExistingExtractions(Context context, File sourceApk, File dexDir) throws IOException {
        Log.i("MultiDex", "loading existing secondary dex files");
        String extractedFilePrefix = sourceApk.getName() + ".classes";
        int totalDexNumber = getMultiDexPreferences(context).getInt("dex.number", 1);
        ArrayList files = new ArrayList(totalDexNumber);

        for(int secondaryNumber = 2; secondaryNumber <= totalDexNumber; ++secondaryNumber) {
            String fileName = extractedFilePrefix + secondaryNumber + ".zip";
            File extractedFile = new File(dexDir, fileName);
            if(!extractedFile.isFile()) {
                throw new IOException("Missing extracted secondary dex file \'" + extractedFile.getPath() + "\'");
            }

            files.add(extractedFile);
            if(!verifyZipFile(extractedFile)) {
                Log.i("MultiDex", "Invalid zip file: " + extractedFile);
                throw new IOException("Invalid ZIP file.");
            }
        }

        return files;
}

不管是調(diào)用了loadExistingExtractions還是performExtractions,都會(huì)返回一個(gè)解壓后的<package-name>.apk.classes2.zip、<package-name>.apk.classes3.zip...File列表,供下一步使用。

5. 兩次校驗(yàn)dex壓縮包的完整性

通過上一步得到解壓后的dex File列表后,在MultiDex中會(huì)兩次檢查zip文件的完整性:

   public static void install(Context context) {

        ...

        try {
            ...

            synchronized (installedApk) {

                ...

                // 從apk中查找并解壓二級(jí)dex文件到/data/data/<package-name>/secondary-dexes
                List<File> files = MultiDexExtractor.load(context, applicationInfo, dexDir, false);

                // 檢查dex壓縮文件的完整性
                if (checkValidZipFiles(files)) {

                    // 開始安裝dex
                    installSecondaryDexes(loader, dexDir, files);
                } else {
                    Log.w(TAG, "Files were not valid zip files.  Forcing a reload.");

                    // 第一次檢查失敗,MultiDex會(huì)盡責(zé)的再檢查一次
                    files = MultiDexExtractor.load(context, applicationInfo, dexDir, true);

                    if (checkValidZipFiles(files)) {

                        // 開始安裝dex
                        installSecondaryDexes(loader, dexDir, files);
                    } else {
                        // Second time didn't work, give up
                        throw new RuntimeException("Zip files were not valid.");
                    }
                }
            }

        } catch (Exception e) {
            Log.e(TAG, "Multidex installation failure", e);
            throw new RuntimeException("Multi dex installation failed (" + e.getMessage() + ").");
        }
        Log.i(TAG, "install done");
    }

若第一次校驗(yàn)失?。╠ex文件損壞等),MultiDex會(huì)重新調(diào)用MultiDexExtractor.load方法重查找加載二級(jí)dex文件列表,值得注意的是此時(shí)forceReload的值為true,會(huì)強(qiáng)制重新從apk中解壓dex文件。

6. 開始dex的安裝

經(jīng)過上面的重重檢驗(yàn)和解壓,終于到了最關(guān)鍵的一步:將二級(jí)dex添加到我們classLoader中

    private static void installSecondaryDexes(ClassLoader loader, File dexDir, List<File> files) throws IllegalArgumentException, IllegalAccessException, NoSuchFieldException, InvocationTargetException, NoSuchMethodException, IOException {
        if(!files.isEmpty()) {
            if(VERSION.SDK_INT >= 19) {
                MultiDex.V19.install(loader, files, dexDir);
            } else if(VERSION.SDK_INT >= 14) {
                MultiDex.V14.install(loader, files, dexDir);
            } else {
                MultiDex.V4.install(loader, files);
            }
        }

    }

由于SDK版本不同,ClassLoader中的實(shí)現(xiàn)存在差異,所以使用了三個(gè)分支去執(zhí)行dex的安裝。這里我們選擇MultiDex.V14.install進(jìn)行分析,其他兩個(gè)大同小異:

先明確入?yún)ⅲ?/p>

入?yún)?/th> 含義
ClassLoader loader 通過context.getClassLoader獲取到的默認(rèn)類加載器
List<File> additionalClassPathEntries 二級(jí)dex文件解壓后的路徑(通過步驟4獲得)
optimizedDirectory 對(duì)應(yīng)/data/data/<package-name>/code_cache/secondary-dexes/目錄
private static Field findField(Object instance, String name) throws NoSuchFieldException {
    Class clazz = instance.getClass();

    while(clazz != null) {
        try {
            Field e = clazz.getDeclaredField(name);
            if(!e.isAccessible()) {
                e.setAccessible(true);
            }

            return e;
        } catch (NoSuchFieldException var4) {
            clazz = clazz.getSuperclass();
        }
    }

    throw new NoSuchFieldException("Field " + name + " not found in " + instance.getClass());
}

private static Method findMethod(Object instance, String name, Class... parameterTypes) throws NoSuchMethodException {
    Class clazz = instance.getClass();

    while(clazz != null) {
        try {
            Method e = clazz.getDeclaredMethod(name, parameterTypes);
            if(!e.isAccessible()) {
                e.setAccessible(true);
            }

            return e;
        } catch (NoSuchMethodException var5) {
            clazz = clazz.getSuperclass();
        }
    }

    throw new NoSuchMethodException("Method " + name + " with parameters " + Arrays.asList(parameterTypes) + " not found in " + instance.getClass());
}


private static final class V14 {
        private V14() {
        }

        private static void install(ClassLoader loader, List<File> additionalClassPathEntries, File optimizedDirectory) throws IllegalArgumentException, IllegalAccessException, NoSuchFieldException, InvocationTargetException, NoSuchMethodException {

            // 通過反射獲取 ClassLoader中的pathList
            Field pathListField = MultiDex.findField(loader, "pathList");
            Object dexPathList = pathListField.get(loader);

            // 先調(diào)用pathList的makeDexElements,然后將生成的Element[]傳入expandFieldArray中
            MultiDex.expandFieldArray(dexPathList, "dexElements", makeDexElements(dexPathList, new ArrayList(additionalClassPathEntries), optimizedDirectory));
        }

        private static Object[] makeDexElements(Object dexPathList, ArrayList<File> files, File optimizedDirectory) throws IllegalAccessException, InvocationTargetException, NoSuchMethodException {

            Method makeDexElements = MultiDex.findMethod(dexPathList, "makeDexElements", new Class[]{ArrayList.class, File.class});
            return (Object[])((Object[])makeDexElements.invoke(dexPathList, new Object[]{files, optimizedDirectory}));
        }
}

/libcore/dalvik/src/main/java/dalvik/system/BaseDexClassLoader.java

public class BaseDexClassLoader extends ClassLoader {
    ...

    /** structured lists of path elements */
    private final DexPathList pathList;

    ...

    public BaseDexClassLoader(String dexPath, File optimizedDirectory, String libraryPath, ClassLoader parent) {
        super(parent);

        this.originalPath = dexPath;
        this.originalLibraryPath = libraryPath;
        this.pathList =
            new DexPathList(this, dexPath, libraryPath, optimizedDirectory);
    }
}

/libcore/dalvik/src/main/java/dalvik/system/DexPathList.java

/*package*/ final class DexPathList {
    ....

    /**
     * Makes an array of dex/resource path elements, one per element of
     * the given array.
     */
    private static Element[] makeDexElements(ArrayList<File> files,
            File optimizedDirectory) {
        ArrayList<Element> elements = new ArrayList<Element>();

        /*
         * Open all files and load the (direct or contained) dex files
         * up front.
         */
        for (File file : files) {
            File zip = null;
            DexFile dex = null;
            String name = file.getName();

            if (name.endsWith(DEX_SUFFIX)) {
                // Raw dex file (not inside a zip/jar).
                try {
                    dex = loadDexFile(file, optimizedDirectory);
                } catch (IOException ex) {
                    System.logE("Unable to load dex file: " + file, ex);
                }
            } else if (name.endsWith(APK_SUFFIX) || name.endsWith(JAR_SUFFIX)
                    || name.endsWith(ZIP_SUFFIX)) {
                zip = file;

                try {
                    dex = loadDexFile(file, optimizedDirectory);
                } catch (IOException ignored) {
                    /*
                     * IOException might get thrown "legitimately" by
                     * the DexFile constructor if the zip file turns
                     * out to be resource-only (that is, no
                     * classes.dex file in it). Safe to just ignore
                     * the exception here, and let dex == null.
                     */
                }
            } else {
                System.logW("Unknown file type for: " + file);
            }

            if ((zip != null) || (dex != null)) {
                elements.add(new Element(file, zip, dex));
            }
        }

        return elements.toArray(new Element[elements.size()]);
    }

    ...
}

所以MultiDex在安裝開始時(shí),會(huì)先通過反射調(diào)用BaseDexClassLoader
DexPathList類型的pathList字段,接著通過pathList調(diào)用DexPathList的makeDexElements方法,將上面解壓得到的additionalClassPathEntries(二級(jí)dex文件列表)封裝成Element數(shù)組。

需要注意的是,makeDexElements最終會(huì)去進(jìn)行dex2opt操作,這是一個(gè)比較耗時(shí)的過程,如果全部放在main線程去處理的話,比較影響用戶體驗(yàn),甚至可能引起ANR。

dex2opt后,/data/data/<package-name>/code_cache/secondary-dexes/下的會(huì)出現(xiàn)優(yōu)化后的文件:<package-name>.apk.classes2.dex等

最后調(diào)用MultiDex.expandFieldArray

private static void expandFieldArray(Object instance, String fieldName, Object[] extraElements) throws NoSuchFieldException, IllegalArgumentException, IllegalAccessException {
    Field jlrField = findField(instance, fieldName);
    Object[] original = (Object[])((Object[])jlrField.get(instance));
    Object[] combined = (Object[])((Object[])Array.newInstance(original.getClass().getComponentType(), original.length + extraElements.length));
    System.arraycopy(original, 0, combined, 0, original.length);
    System.arraycopy(extraElements, 0, combined, original.length, extraElements.length);
    jlrField.set(instance, combined);
}

expandFieldArray同樣是通過反射調(diào)用,找到pathList中的dexElements字段,并將上一步生成的封裝了二級(jí)dex的Element數(shù)組添加到dexElements之后,完成整個(gè)安裝流程

總結(jié)

通過上面的分析,我們可以總結(jié)出來MultiDex的原理如下:

  1. apk在Applicaion實(shí)例化之后,會(huì)檢查系統(tǒng)版本是否支持MultiDex,判斷二級(jí)dex是否需要安裝;
  2. 如果需要安裝則會(huì)從apk中解壓出classes2.dex并將其拷貝到應(yīng)用的/data/data/<package-name>/code_cache/secondary-dexes/目錄下;
  3. 通過反射將classes2.dex等注入到當(dāng)前的ClassLoader的pathList中,完成整體安裝流程。
最后編輯于
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請(qǐng)聯(lián)系作者
【社區(qū)內(nèi)容提示】社區(qū)部分內(nèi)容疑似由AI輔助生成,瀏覽時(shí)請(qǐng)結(jié)合常識(shí)與多方信息審慎甄別。
平臺(tái)聲明:文章內(nèi)容(如有圖片或視頻亦包括在內(nèi))由作者上傳并發(fā)布,文章內(nèi)容僅代表作者本人觀點(diǎn),簡(jiǎn)書系信息發(fā)布平臺(tái),僅提供信息存儲(chǔ)服務(wù)。

相關(guān)閱讀更多精彩內(nèi)容

友情鏈接更多精彩內(nèi)容