Register Your Forests: Decision Tree Ensemble Optimization by Explicit CPU Register Allocation
arxiv(2024)
摘要
Bringing high-level machine learning models to efficient and well-suited
machine implementations often invokes a bunch of tools, e.g. code generators,
compilers, and optimizers. Along such tool chains, abstractions have to be
applied. This leads to not optimally used CPU registers. This is a shortcoming,
especially in resource constrained embedded setups. In this work, we present a
code generation approach for decision tree ensembles, which produces machine
assembly code within a single conversion step directly from the high-level
model representation. Specifically, we develop various approaches to
effectively allocate registers for the inference of decision tree ensembles.
Extensive evaluations of the proposed method are conducted in comparison to the
basic realization of C code from the high-level machine learning model and
succeeding compilation. The results show that the performance of decision tree
ensemble inference can be significantly improved (by up to ≈1.6×),
if the methods are applied carefully to the appropriate scenario.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要