Shared Concepts and Topics

Truncated Power Function Basis

A truncated power function for a knot k Subscript i is a function defined by

t Subscript i Baseline left-parenthesis x right-parenthesis equals StartLayout Enlarged left-brace 1st Row 1st Column 0 2nd Column x less-than k Subscript i Baseline 2nd Row 1st Column left-parenthesis x minus k Subscript i Baseline right-parenthesis Superscript d Baseline 2nd Column x greater-than-or-equal-to k Subscript i EndLayout

FigureĀ 1 shows such functions for d = 1 and d = 3 with a knot at x = 1.

Figure 1: Truncated Power Functions with Knot at x = 1

Truncated Power Functions with Knot at  = 1


The name is derived from the fact that these functions are shifted power functions that get truncated to zero to the left of the knot. These functions are piecewise polynomial functions with two pieces whose function values and derivatives of all orders up to d minus 1 are zero at the defining knot. Hence these functions are splines of degree d. It is easy to see that these n functions are linearly independent. However, they do not form a basis, because such a basis requires n plus d plus 1 functions. The usual way to add d plus 1 additional basis functions is to use the polynomials 1 comma x comma x squared comma ellipsis comma x Superscript d. These d plus 1 functions together with the n truncated power functions t Subscript i Baseline left-parenthesis x right-parenthesis comma i equals 1 comma 2 comma ellipsis comma n form the truncated power basis.

Note that each time a knot is repeated, the associated exponent used in the corresponding basis function is reduced by 1. For example, for splines of degree d with three repeated knots k Subscript i Baseline equals k Subscript i plus 1 Baseline equals k Subscript i plus 2 the corresponding basis functions are t Subscript i Baseline left-parenthesis x right-parenthesis equals left-parenthesis x minus k Subscript i Baseline right-parenthesis Subscript plus Superscript d, t Subscript i plus 1 Baseline left-parenthesis x right-parenthesis equals left-parenthesis x minus k Subscript i Baseline right-parenthesis Subscript plus Superscript d minus 1, and t Subscript i plus 2 Baseline left-parenthesis x right-parenthesis equals left-parenthesis x minus k Subscript i Baseline right-parenthesis Subscript plus Superscript d minus 2. Provided that the multiplicity of each repeated knot is less than or equal to the degree, this construction continues to yield a basis for the associated space of splines.

The main advantage of the truncated power function basis is the simplicity of its construction and the ease of interpreting the parameters in a model that corresponds to these basis functions. However, there are two weaknesses when you use this basis for regression. These functions grow rapidly without bound as x increases, resulting in numerical precision problems when the x data span a wide range. Furthermore, many or even all of these basis functions can be nonzero when evaluated at some x value, resulting in a design matrix with few zeros that precludes the use of sparse matrix technology to speed up computation. This weakness can be addressed by using a B-spline basis.

Last updated: December 09, 2022