首页|期刊导航|通信学报|基于CKKS函数型Bootstrapping的融合式同态LayerNorm方案设计

基于CKKS函数型Bootstrapping的融合式同态LayerNorm方案设计OA

Design of a fused homomorphic LayerNorm scheme based on CKKS functional Bootstrapping

中文摘要英文摘要

针对CKKS同态Transformer中LayerNorm倒数平方根运算深度高的问题,提出了函数型Bootstrapping融合方案.在EvalMod阶段,以倒数平方根复合多项式替换反正弦多项式,结合预缩放和统计边界约束输入,在校准边界内实现零额外乘法深度.此外,采用Remez算法构造31阶极小极大逼近.实验结果表明,相较Gold-schmidt(k=3),所提方案节省6层乘法深度,LayerNorm加速1.26倍,峰值内存降低16.7%.在BERT-Base的SST-2数据集上,获得92.1%的同态分类准确率,较明文低0.4个百分点.所提方案在保持精度的同时降低了同态LayerNorm的计算深度和资源开销.

To address the high multiplicative depth required for inverse square root computation in LayerNorm for CKKS-based homomorphic Transformer inference,a fused functional Bootstrapping scheme was proposed.In the Eval-Mod stage,the arcsine polynomial was replaced with a composite polynomial that directly computed the inverse square root.Pre-scaling and statistical bounds were used to constrain the input,enabling zero additional multiplicative depth within the calibrated bound.In addition,the Remez algorithm was employed to construct a degree-31 minimax approxi-mation.Experimental results show that,compared with the Goldschmidt iteration(k=3),the proposed scheme saves six levels of multiplicative depth,accelerates LayerNorm computation by 1.26 times,and reduces peak memory usage by 16.7%.BERT-Base achieves a homomorphic classification accuracy of 92.1%on the SST-2 dataset,only 0.4 percentage points lower than plaintext inference.The proposed scheme reduces the computational depth and resource overhead of homomorphic LayerNorm while maintaining classification accuracy.

陈智罡;宋新霞;Liqun Chen

宁波财经学院人工智能学院,浙江 宁波 315175浙江万里学院大数据与软件工程学院,浙江 宁波 315100英国萨里大学计算机科学系,吉尔福德 萨里 GU27XH

信息技术与安全科学

全同态加密CKKS层归一化函数型BootstrappingTransformer隐私保护推理

fully homomorphic encryptionCKKSLayerNormfunctional BootstrappingTransformerprivacy-preserving inference

《通信学报》 2026 (8)

296-310,15

国家自然科学基金资助项目(No.62571283)浙江省自然科学基金资助项目(No.LMS26F020025)宁波市自然科学基金资助项目(No.2025J185)宁波财经学院高级别科研培育基金资助项目(No.1320263702) The National Natural Science Foundation of China(No.62571283),Zhejiang Provincial Natural Science Founda-tion of China(No.LMS26F020025),Ningbo Natural Science Foundation of China(No.2025J185),High-Level Scientific Research In-cubation Project of Ningbo University of Finance&Economics(No.1320263702)

10.11959/j.issn.1000-436x.TXXB260263

评论