Sharding-Sphere實戰(zhàn):實現(xiàn)類多租戶分庫分表

分表模式

以分表模式實現(xiàn)類多租戶的意思是,假定基礎表是tb_order,那么租戶A對應的表是tb_order_a,租戶B對應的表是tb_order_b。接下來借助sharding-sphere-3.1.0這個優(yōu)秀的分庫分表中間件實現(xiàn)一個這樣的需求:作為一個支付平臺,給多個商戶提供服務,要求每個商戶的訂單表獨立且以商戶名為后綴,例如taobao的訂單表是tb_order_taobao,tmall的訂單表是tb_order_tmall,aliyun的訂單表是tb_order_aliyun。

訂單表DDL如下:

CREATE TABLE tb_order (
  id int(11) NOT NULL AUTO_INCREMENT PRIMARY KEY,
  user_id int(11) NOT NULL COMMENT '姓名',
  order_no varchar(32) NOT NULL COMMENT '訂單號',
  order_time datetime NOT NULL COMMENT '訂單時間',
  merchant varchar(16) NOT NULL COMMENT '商戶名稱',
  UNIQUE KEY uk_order_no (order_no)
) ENGINE=InnoDB  DEFAULT CHARSET=utf8;

核心Maven依賴:

<dependency>
    <groupId>io.shardingsphere</groupId>
    <artifactId>sharding-jdbc-spring-boot-starter</artifactId>
    <version>3.1.0</version>
</dependency>

集成sharding-sphere的核心配置文件部分內容如下:

# 數據庫名稱(因為只分表不分庫,所以數據源只有一個)
sharding.jdbc.datasource.names=afei

sharding.jdbc.datasource.afei.type=com.alibaba.druid.pool.DruidDataSource
sharding.jdbc.datasource.afei.driver-class-name=com.mysql.jdbc.Driver
sharding.jdbc.datasource.afei.url=jdbc:mysql://127.0.0.1:3306/afei?useUnicode=true&characterEncoding=utf8
sharding.jdbc.datasource.afei.username=root
sharding.jdbc.datasource.afei.password=root

sharding.jdbc.config.sharding.default-data-source-name=afei
# 默認數據源不用分庫分表,所以不需要配置sharding.jdbc.config.sharding.default-database-strategy...

sharding.jdbc.config.sharding.tables.tb_order.actual-data-nodes=afei.tb_order_tmall,afei.tb_order_taobao,afei.tb_order_aliyun
# 分片鍵(重要)
sharding.jdbc.config.sharding.tables.tb_order.table-strategy.standard.sharding-column=merchant
# 自定義分表算法(重要)
sharding.jdbc.config.sharding.tables.tb_order.table-strategy.standard.precise-algorithm-class-name=com.afei.boot.util.OrderShardingAlgorithm
        
sharding.jdbc.config.props.sql.show=true

自定義分表算法OrderShardingAlgorithm.java的源碼如下:

public class OrderShardingAlgorithm implements PreciseShardingAlgorithm<String> {

    @Override
    public String doSharding(final Collection<String> availableTargetNames, final PreciseShardingValue<String> shardingValue) {
        String targetTable = "tb_order_" + shardingValue.getValue();
        if (availableTargetNames.contains(targetTable)){
            return targetTable;
        }

        throw new UnsupportedOperationException("無法判定的值: " + shardingValue.getValue());
    }
}

由于筆者采用springboot+mybatis+shardingsphere的方案,所以sql都在mapper.xml中,訂單保存接口涉及的SQL如下:

<insert id="save" parameterType="com.afei.sjdbc.model.Order">
    insert into tb_order (user_id, order_no, order_time, merchant)
    values (#{userId}, #{orderNo}, #{orderTime}, #{merchant})
</insert>

這個實例只以測試用例啟動驗證,測試用例代碼如下:

@RunWith(SpringJUnit4ClassRunner.class)
@SpringBootTest(classes = OrderSpringBootTests.class)
@SpringBootApplication
@ActiveProfiles("sharding")
public class OrderSpringBootTests {

    @Resource
    private OrderService orderService;

    @Test
    public void save(){
        List<String> merchantList = Lists.newArrayList("aliyun", "taobao", "tmall");
        // 測試20筆訂單,且所屬商戶隨機產生
        for (int i = 0; i < 20; i++) {
            Order order = new Order();
            order.setUserId(i);
            order.setOrderNo(System.currentTimeMillis() + String.format("%06d", i));
            order.setOrderTime(new Date());
            order.setMerchant(merchantList.get(new Random().nextInt(merchantList.size())));
            orderService.save(order);

        }
    }

}

運行測試用例后的部分輸出部分日志如下(需要sharding.jdbc.config.props.sql.show=true才能輸出這些日志,是sharding-sphere記錄的SQL重寫前后的日志),從日志中我們可以看到,商戶tmall的訂單最終持久化在表tb_order_tmall中:

2019-06-02 21:27:43.270  INFO 15415 --- [           main] ShardingSphere-SQL                       : Logic SQL: insert into tb_order (user_id, order_no, order_time, merchant) values (?, ?, ?, ?)
... ...
2019-06-02 21:27:43.271  INFO 15415 --- [           main] ShardingSphere-SQL                       : Actual SQL: afei ::: insert into tb_order_tmall (user_id, order_no, order_time, merchant) values (?, ?, ?, ?) ::: [[6, 1559482063270000006, 2019-06-02 21:27:43.27, tmall]]

tb_order_tmall表中該訂單記錄如下:

mysql> select * from tb_order_tmall where order_no='1559482063270000006';
+----+---------+---------------------+---------------------+----------+
| id | user_id | order_no            | order_time          | merchant |
+----+---------+---------------------+---------------------+----------+
|  6 |       6 | 1559482063270000006 | 2019-06-02 08:27:43 | tmall    |
+----+---------+---------------------+---------------------+----------+
1 row in set (0.00 sec)

分庫模式

有些業(yè)務的需求可能是每個接入的商戶對應一個對立的數據庫實例,這樣的話,底層存儲會更清晰,權限也比較好控制。

如此一來,商戶taobao的訂單表是pay_taobao.tb_order(即表示數據庫pay_taobao中的表tb_order),商戶tmall的訂單表是pay_tmall.tb_order,商戶aliyun的訂單表是pay_aliyun.tb_order。這種設計,相比前面的分表模式,改動的不大,主要改動涉及如下幾個地方。

首先,需要創(chuàng)建多個數據庫,例如pay_aliyun,pay_taobao,pay_tmall。每個庫中都有表tb_order。

其次,核心配置文件有比較大的改動,分庫模式配置如下:

# 3個商戶,3個數據庫
sharding.jdbc.datasource.names=pay_aliyun,pay_tmall,pay_taobao

sharding.jdbc.datasource.pay_aliyun.type=com.alibaba.druid.pool.DruidDataSource
sharding.jdbc.datasource.pay_aliyun.driver-class-name=com.mysql.jdbc.Driver
sharding.jdbc.datasource.pay_aliyun.url=jdbc:mysql://127.0.0.1:3306/pay_aliyun?useUnicode=true&characterEncoding=utf8
sharding.jdbc.datasource.pay_aliyun.username=root
sharding.jdbc.datasource.pay_aliyun.password=root

sharding.jdbc.datasource.pay_taobao.type=com.alibaba.druid.pool.DruidDataSource
sharding.jdbc.datasource.pay_taobao.driver-class-name=com.mysql.jdbc.Driver
sharding.jdbc.datasource.pay_taobao.url=jdbc:mysql://127.0.0.1:3306/pay_taobao?useUnicode=true&characterEncoding=utf8
sharding.jdbc.datasource.pay_taobao.username=root
sharding.jdbc.datasource.pay_taobao.password=root

sharding.jdbc.datasource.pay_tmall.type=com.alibaba.druid.pool.DruidDataSource
sharding.jdbc.datasource.pay_tmall.driver-class-name=com.mysql.jdbc.Driver
sharding.jdbc.datasource.pay_tmall.url=jdbc:mysql://127.0.0.1:3306/pay_tmall?useUnicode=true&characterEncoding=utf8
sharding.jdbc.datasource.pay_tmall.username=root
sharding.jdbc.datasource.pay_tmall.password=root

sharding.jdbc.config.sharding.tables.tb_order.actual-data-nodes=pay_tmall.tb_order,pay_taobao.tb_order,pay_aliyun.tb_order
# 根據merchant列進行分庫
sharding.jdbc.config.sharding.default-database-strategy.standard.sharding-column=merchant
# 自定義分庫算法
sharding.jdbc.config.sharding.default-database-strategy.standard.precise-algorithm-class-name=com.afei.boot.util.DbShardingAlgorithm

sharding.jdbc.config.props.sql.show=true

自定義分庫算法DbShardingAlgorithm.java的源碼如下:

public class DbShardingAlgorithm implements PreciseShardingAlgorithm<String> {
    private static final String DB_NAME_PREFIX = "pay_";
    @Override
    public String doSharding(final Collection<String> availableTargetNames, final PreciseShardingValue<String> shardingValue) {
        String targetTable = DB_NAME_PREFIX + shardingValue.getValue();
        if (availableTargetNames.contains(targetTable)){
            return targetTable;
        }
        throw new UnsupportedOperationException("無法判定的值: " + shardingValue.getValue());
    }
}

再次,測試用例和SQL都沒有任何改動,業(yè)務代碼只需要知道往表tb_order中插入訂單即可,至于實際會插入哪個數據庫中,sharding-sphere會幫你搞定。

最后,運行測試用例,得到部分sharding-sphere輸出日志如下,由日志可知,tmall這個商戶的訂單保存在pay_tmall這個數據庫中:

2019-06-02 22:28:56.091  INFO 15578 --- [           main] ShardingSphere-SQL                       : Logic SQL: insert into tb_order (user_id, order_no, order_time, merchant)values (?, ?, ?, ?)
2019-06-02 22:28:56.091  INFO 15578 --- [           main] ShardingSphere-SQL                       : Actual SQL: pay_tmall ::: insert into tb_order (user_id, order_no, order_time, merchant)values (?, ?, ?, ?) ::: [[2, 1559485736091000002, 2019-06-02 22:28:56.091, tmall]]

pay_tmall庫中tb_order表這條訂單數據如下所示:

mysql> select * from pay_tmall.tb_order where order_no='1559485736091000002';
+----+---------+---------------------+---------------------+----------+
| id | user_id | order_no            | order_time          | merchant |
+----+---------+---------------------+---------------------+----------+
|  5 |       2 | 1559485736091000002 | 2019-06-02 09:28:56 | tmall    |
+----+---------+---------------------+---------------------+----------+
1 row in set (0.00 sec)

代碼地址

https://github.com/feelwing1314/shardingsphere-multitenancy

最后編輯于
?著作權歸作者所有,轉載或內容合作請聯(lián)系作者
【社區(qū)內容提示】社區(qū)部分內容疑似由AI輔助生成,瀏覽時請結合常識與多方信息審慎甄別。
平臺聲明:文章內容(如有圖片或視頻亦包括在內)由作者上傳并發(fā)布,文章內容僅代表作者本人觀點,簡書系信息發(fā)布平臺,僅提供信息存儲服務。

友情鏈接更多精彩內容