Progressive-iterative approximation method
![]() | This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages)
|
Progressive-iterative approximation method is an iterative method of data fitting with geometric meanings.[1] Given the data points to be fitted, the method obtains a series of fitting curves (surfaces) by iteratively updating the control points, and the limit curve (surface) can interpolate or approximate the given data points.[2] It avoids solving a linear system of equations directly and allows flexibility in adding constraints during the iterative process.[3] Therefore, it has been widely used in geometric design and related fields.[2]
The study of the iterative method with geometric meaning can be traced back to the work of scholars such as Prof. Dongxu Qi and Prof. Carl de Boor in the 1970s.[4][5] In 1975, Qi et al. developed and proved the "profit and loss" algorithm for uniform cubic B-spline curves,[4] and in 1979, de Boor independently proposed this algorithm.[5] In 2004, Hongwei Lin and coauthors proved that non-uniform cubic B-spline curves and surfaces have the "profit and loss" property.[3] Later, in 2005, Lin et al. proved that the curves and surfaces with normalized and totally positive basis all have this property and named it progressive iterative approximation (PIA).[1] In 2007, Maekawa et al. changed the algebraic distance in PIA to geometric distance and named it geometric interpolation (GI).[6] In 2008, Cheng et al. extended it to subdivision surfaces and named the method progressive interpolation (PI).[7] Since the iteration steps of the PIA, GI, and PI algorithms are similar and all have geometric meanings, we collectively referred to them as geometric iterative methods (GIM).[2]
PIA is now extended to several common curves and surfaces in the geometric design field,[8] including NURBS curves and surfaces,[9] T-spline surfaces,[10] implicit curves and surfaces,[11] etc.
Iteration Methods
[edit]Generally, progressive-iterative approximation can be divided into interpolation and approximation schemes.[2] In interpolation algorithms, the number of control points is equal to that of the data points; in approximation algorithms, the number of control points can be less than that of the data points. Specifically, there are some representative iteration methods, such as local-PIA,[12] implicit-PIA,[11] fairing-PIA,[13] and isogeometric least-squares progressive-iterative approximation (IG-LSPIA),[14] which is specialized for solving the isogeometric analysis problem.[15]
![](http://upload.wikimedia.org/wikipedia/commons/thumb/5/58/%E6%88%AA%E5%B1%8F2024-08-10_09.23.08.png/439px-%E6%88%AA%E5%B1%8F2024-08-10_09.23.08.png)
To facilitate the description of the PIA iteration format for different forms of curves and surfaces, we write B-spline curves and surfaces, NURBS curves and surfaces, B-spline solids, T-spline surfaces, and triangular Bernstein–Bézier (B–B) surfaces uniformly in the following form:[17]
For example:
- If is a B-spline curve,then is a scalar, is a B-spline basis function,and denotes the control point;[8]
- If is a B-spline patch with control points,then ,,where and are B-spline basis functions;[8]
- If is a trivariate B-spline solid with control points, then ,, where , and are B-spline basis functions.[18]
Given an ordered data set ,with parameters satisfying , the initial fitting curve (surface) is[1]
where the initial control points of the initial fitting curve (surface) can be randomly selected. Suppose that after the th iteration, the th fitting curve (surface) is generated by
To construct the st curve (surface),we first calculate the difference vectors,
and then update the control points by
leading to the st fitting curve (surface):
In this way, we obtain a sequence of curves (surfaces)
It has been proved that this sequence of curves (surfaces) converges to a limit curve (surface) that interpolates the give data points,[1][9] i.e.,
![](http://upload.wikimedia.org/wikipedia/commons/thumb/d/d7/%E6%88%AA%E5%B1%8F2024-08-13_09.51.05.png/641px-%E6%88%AA%E5%B1%8F2024-08-13_09.51.05.png)
For the B-spline curve and surface fitting problem, Deng and Lin proposed a least-squares progressive–iterative approximation(LSPIA),[19] which allows the number of control points to be less than that of the data points and is more suitable for large-scale data fitting problems.[10]
Assume that the number of data points is ,and the number of control points is . Following the notations in the Section above, the th fitting curve (surface) generated after the th iteration is , i.e.,
To generate the st fitting curve (surface),we compute the following difference vectors in turn:[10][19]
Difference vectors for data points:
and,
Difference vectors for control points
where is the index set of the data points in the th group,whose parameters fall in the local support of the th basis function, i.e., . are weights that guarantee the convergence of the algorithm, usually taken as .
Finally, the control points of the st curve (surface) are updated by leading to the st fitting curve (surface) . In this way,we obtain a sequence of curve (surface),and the limit curve (surface) converges to the least-squares fitting result to the given data points.[10][19]
![](http://upload.wikimedia.org/wikipedia/commons/thumb/7/7d/%E6%88%AA%E5%B1%8F2024-08-13_13.45.43.png/573px-%E6%88%AA%E5%B1%8F2024-08-13_13.45.43.png)
In the local-PIA, the control points are divided into active and fixed control points, whose subscripts are denoted as and , respectively.[12] Assume that, the th fitting curve (surface) is ,where the fixed control point satisfy
Then,on the one hand, the iterative formula of the difference vector corresponding to the fixed control points is
On the other hand, the iterative formula of the difference vector corresponding to the active control points is
Arranging the above difference vectors into a one-dimensional sequence,
the local iteration format in matrix form is,
where, is the iteration matrix,
and are the identity matrices and
The above local iteration format converges and can be extended to blending surfaces[12] and subdivision surfaces.[20]
The progressive iterative approximation format for implicit curve and surface reconstruction is presented in the following. Given an ordered point cloud and a unit normal vector on the data points, we want to reconstruct an implicit curve (surface) from the given point cloud. To avoid trivial solution, some offset points are added to the point cloud.[11] They are offset by a distance along the unit normal vector of each point
Assume that is the value of the implicit function at the offset point
Let the implicit curve after the th iteration be
where is the control point.
Define the difference vector of data points as[11]
Next, calculate the difference vector of control coefficients
where is the convergence coefficient. As a result, the new control coefficients are
leading to the new algebraic B-spline curve
The above procedure is carried out iteratively to generate a sequence of algebraic B-spline functions . The sequence converges to a minimization problem with constraints when the initial control coefficients .[11]
Assume that the implicit surface generated after the th iteration is
the iteration format is similar to that of the curve case.[11][21]
To develop fairing-PIA, we first define the functionals as follows:[13]
where represents the th derivative of the basis function ,[8] (e.g. B-spline basis function).
Let the curve after the th iteration be
To construct the new curve ,we first calculate the st difference vectors for data points,[13]
Then, the fitting difference vectors and the fairing vectors for control points are calculated by[13]
Finally, the control points of the st curve are produced by[13]
where is a normalization weight, and is a smoothing weight corresponding to the th control point. The smoothing weights can be employed to adjust the smoothness individually, thus bringing great flexibility for smoothness.[13] The larger the smoothing weight is, the smoother the generated curve is. The new curve is obtained as follows
In this way, we obtain a sequence of curves . The sequence converges to the solution of the conventional fairing method based on energy minimization when all smoothing weights are equal ( ).[13] Similarly, the fairing-PIA can be extended to the surface case.
Given a boundary value problem[15]
where is the unknown solution, and are the differential operator and boundary operator, respectively. and are the continuous functions. In the isogeometric analysis method, NURBS basis functions[8] are used as shape functions to solve the numerical solution of this boundary value problem.[15] The same basis functions are applied to represent the numerical solution and the geometric mapping :
where denotes the NURBS basis function, is the control coefficient. After substituting the collocation points[22] into the strong form of PDE,we obtain a discretized problem[22]
where and denote the subscripts of internal and boundary collocation points, respectively.
Arranging the control coefficients of the numerical solution into an -dimensional column vector, i.e., , the discretized problem can be reformulated in matrix form
where is the collocation matrix,and is the load vector.
Assume that the discretized load values are data points to be fitted. Given the initial guess of the control coefficients(),we obtain an initial blending function[14]
where , ,represents the combination of different order derivatives of the NURBS basis functions determined using the operators and
where and indicate the interior and boundary of the parameter domain, respectively. Each corresponds to the th control coefficient. Assume that and are the index sets of the internal and boundary control coefficients, respectively. Without loss of generality, we further assume that the boundary control coefficients have been obtained using strong or weak imposition and are fixed, i.e.,
The th blending function, generated after the th iteration of IG-LSPIA,[14] is assumed to be as follows:
Then, the difference vectors for collocation points (DCP) in the st iteration are obtained using
Moreover, group all load values whose parameters fall in the local support of the th derivatives function, i.e., , into the th group corresponding to the th control coefficient, and denote the index set of the th group of load values as . Lastly, the differences for control coefficients (DCC) can be constructed as follows:[14]
where is a normalization weight to guarantee the convergence of the algorithm.
Thus, the new control coefficients are updated via the following formula,
Consequently, the st blending function is generated as follows:
The above iteration process is performed until the desired fitting precision is reached and a sequence of blending functions is obtained
The IG-LSPIA converges to the solution of a constrained least-squares collocation problem.[14]
Proof of convergence
[edit]Non-singular case
- If , the PIA iterative format in matrix form is[1]
where,
The convergence of the PIA is related to the properties of the collocation matrix. If the spectral radius of iteration matrix is less than ,then the PIA is convergent. It has been shown that the PIA methods for Bézier curves and surface, B-spline curves and surfaces, NURBS curves and surfaces, Triangular Bernstein-Bézier surface, and subdivision surfaces (Loop, Catmull-Clark, Doo-Sabin) are convergent.[2]
When the matrix is nonsingular,the following results can be obtained.[23]
Lemma If ,where is the largest eigenvalue of the matrix ,then the eigenvalues of are real numbers and satisfy .
Proof Since is nonsingular,and ,then . Moreover,
In summary,.
Theorem If ,LSPIA is convergent, and converges to the least-squares fitting result to the given data points.[10][19]
Proof From the matrix form of iterative format, we obtain the following :
According to above Lemma, the spectral radius of the matrix satisfies
Thus,the spectral radius of the iteration matrix satisfies
When
As a result,
i.e., ,which is equivalent to the normal equation of the fitting problem. Hence, the LSPIA algorithm converges to the least squares result for a given sequence of points.
Singular case
[edit]Lin et al. showed that LSPIA converges even when the iteration matrix is singular.[17]
Acceleration algorithms and others
[edit]- Precondition:Liu et al. proposed a preconditioned PIA for Bézier surfaces via the diagonally compensated reduction method, effectively improving the accuracy and efficiency of the classical algorithm.[24]
- Iteration matrix inverse approximation: Sajavičius improves the LSPIA based on the matrix approximate inverse method. In each iteration step, the approximate inverse of the coefficient matrix of the least-squares fitting problem is first computed and then used as the weight to adjust the control points.[25]
- Optimal weight: Lu initially presented a weighted progressive-iterative approximation (WPIA) that introduces the optimal weight of difference vectors for control points to accelerate the convergence.[26] Moreover, Zhang et al. proposed a weighted local PIA format for tensor Bézier surfaces.[27] Li et al. assigned initial weights to each data point, and the weights of the interpolated points are determined adaptively during the iterative process.[28]
- Acceleration with memory: In 2020, Huang et al. proposed a progressive-iterative approximation method with memory for least square fitting (MLSPIA), which has a similar format to the momentum method. MLSPIA generates a series of fitting curves (surfaces) with three weights by iteratively adjusting the control points. With appropriate parameter selection, these curves (surfaces) converge to the least squares fit results for a given data point and are more efficient than LSPIA.[29]
- Stochastic descent strategy:Rios and Jüttle explored the relationship between LSPIA and gradient descent method and proposed a stochastic LSPIA algorithm with parameter correction.[30]
Applications
[edit]Since PIA has obvious geometric meaning, constraints can be easily integrated in the iterations. Currently, PIA has been widely applied in many fields, such as data fitting, reverse engineering, geometric design, mesh generation, data compression, fairing curve and surface generation, and isogeometric analysis.
Data fitting
- Adaptive data fitting:The control points are divided into active control points and fixed control points. In each round of iteration, if the fitting error of a data point reaches a given precision, its corresponding control point is fixed and not updated. The above iterative process is repeated until all control points are fixed . The algorithm performs well on large-scale data fitting by adaptively reducing the number of active control points.[31]
- Large-scale data fitting:By combining T-spline with PIA, an incremental fitting algorithm suitable for fitting large-scale data sets is proposed. During the incremental iteration, each new round of iterations reuses information from the last round of iterations to save computation. While the convergence speed of the traditional point-by-point iterative algorithm decreases as the number of control points increases, in PIA the computation of each iteration step is unrelated to the number of control points, thus exhibiting a powerful data fitting capability.[10]
- Local fitting:Based on the local property of PIA,a series of local PIA formats have been proposed.[12][32]
Implicit reconstruction
For implicit curve and surface reconstruction, the PIA avoids the additional zero level set and regularization term, which greatly improves the speed of the reconstruction algorithm.[11]
Offset curve approximation
Firstly, the data points are sampled on the original curve. Then, the initial polynomial approximation curve or rational approximation curve of the offset curve is generated from these sampled points. Finally, the offset curve is approximated iteratively using the PIA method.[33]
Mesh generation
Input a triangular mesh model, the algorithm first constructs the initial hexahedral mesh, and extracts the quadrilateral mesh of the surface as the initial boundary mesh. During the iterations, the movement of each mesh vertex is constrained to ensure the validity of the mesh. Finally, the hexahedral model is fitted to the given input model. The algorithm can guarantee the validity of the generated hexahedral mesh, i.e., the Jacobi value at each mesh vertex is greater than zero.[34]
Data compression
First, the image data are converted into a one-dimensional sequence by Hilbert scan; then, these data points are fitted by LSPIA to generate a Hilbert curve; finally, the Hilbert curve is sampled, and the compressed image can be reconstructed. This method can well preserve the neighborhood information of pixels.[35]
Fairing curve and surface generation
Given a data point set, we first define the fairing functional, and calculate the fitting difference vector and the fairing vector of the control point; then, adjust the control points with fairing weights. According to the above steps, the fairing curve and surface can be generated iteratively. Due to the sufficient fairing parameters, the method can achieve global or local fairing. It is also flexible to adjust knot vectors, fairing weights, or data parameterization after each round of iteration. The traditional energy-minimization method is a special case of this method, i.e., when the smooth weights are all the same.[13]
Isogeometric analysis
The discretized load values are regarded as the set of data points, and the combination of the basis functions and their derivative functions is used as the blending function for fitting. The method automatically adjusts the degrees of freedom of the numerical solution of the partial differential equation according to the fitting result of the blending function to the load values. In addition, the average iteration time per step is only related to the number of data points (i.e., collocation points) and unrelated to the number of control coefficients.[14]
References
[edit]- ^ a b c d e f Lin, Hong-Wei; Bao, Hu-Jun; Wang, Guo-Jin (2005). "Totally positive bases and progressive iteration approximation". Computers & Mathematics with Applications. 50 (3–4): 575–586. doi:10.1016/j.camwa.2005.01.023. ISSN 0898-1221.
- ^ a b c d e Lin, Hongwei; Maekawa, Takashi; Deng, Chongyang (2018). "Survey on geometric iterative methods and their applications". Computer-Aided Design. 95: 40–51. doi:10.1016/j.cad.2017.10.002. ISSN 0010-4485.
- ^ a b c Lin, Hongwei; Wang, Guojin; Dong, Chenshi (2004). "Constructing iterative non-uniform B-spline curve and surface to fit data points". Science in China Series F. 47 (3): 315. doi:10.1360/02yf0529. ISSN 1009-2757. S2CID 966980.
- ^ a b Qi, Dongxu; Tian, Zixian; Zhang, Auxin; Feng, Jiabin (1975). "The method of numeric polish in curve fitting". Acta Math Sinica. 18 (3): 173–184.
- ^ a b Carl, de Boor (1979). "How does Agee's smoothing method work?". Proceedings of the 1979 Army Numerical Analysis and Computers Conference, ARO Report.
- ^ Maekawa, Takashi; Yasunori, Matsumoto; Ken, Namiki (2007). "Interpolation by geometric algorithm". Computer-Aided Design. 39 (4): 313–323. doi:10.1016/j.cad.2006.12.008.
- ^ Cheng, Fuhua; Fan, Fengtao; Lai, Shuhua; Huang, Conglin; Wang, Jiaxi; Yong, Junhai (2008). "Progressive Interpolation Using Loop Subdivision Surfaces". Advances in Geometric Modeling and Processing. Lecture Notes in Computer Science. Vol. 4975. pp. 526–533. doi:10.1007/978-3-540-79246-8_43. ISBN 978-3-540-79245-1.
- ^ a b c d e Hoschek, Josef (February 1993). Fundamentals of computer aided geometric design. USA: A. K. Peters, Ltd. ISBN 978-1-56881-007-2.
- ^ a b c Shi, Limin; Wang, Renhong (2006). "An iterative algorithm of NURBS interpolation and approximation". Journal of Mathematical Research with Applications. 26 (4): 735–743.
- ^ a b c d e f g h Lin, Hongwei; Zhang, Zhiyu (2013). "An Efficient Method for Fitting Large Data Sets Using T-Splines". SIAM Journal on Scientific Computing. 35 (6): A3052–A3068. Bibcode:2013SJSC...35A3052L. doi:10.1137/120888569. ISSN 1064-8275.
- ^ a b c d e f g h Hamza, Yusuf Fatihu; Lin, Hongwei; Li, Zhao (2020). "Implicit progressive-iterative approximation for curve and surface reconstruction". Computer Aided Geometric Design. 77: 101817. arXiv:1909.00551. doi:10.1016/j.cagd.2020.101817. S2CID 202540812.
- ^ a b c d e Lin, Hongwei (2010). "Local progressive-iterative approximation format for blending curves and patches". Computer Aided Geometric Design. 27 (4): 322–339. doi:10.1016/j.cagd.2010.01.003. ISSN 0167-8396.
- ^ a b c d e f g h i Jiang, Yini; Lin, Hongwei; Huang, Weixian (2023-05-16). "Fairing-PIA: progressive-iterative approximation for fairing curve and surface generation". The Visual Computer. 40 (3): 1467–1484. arXiv:2211.11416. doi:10.1007/s00371-023-02861-7. ISSN 0178-2789.
- ^ a b c d e f g Jiang, Yini; Lin, Hongwei (2023-02-10). "IG-LSPIA: Least Squares Progressive Iterative Approximation for Isogeometric Collocation Method". Mathematics. 11 (4): 898. doi:10.3390/math11040898. ISSN 2227-7390.
- ^ a b c Hughes, T. J. R.; Cottrell, J. A.; Bazilevs, Y. (2005-10-01). "Isogeometric analysis: CAD, finite elements, NURBS, exact geometry and mesh refinement". Computer Methods in Applied Mechanics and Engineering. 194 (39): 4135–4195. Bibcode:2005CMAME.194.4135H. doi:10.1016/j.cma.2004.10.008. ISSN 0045-7825.
- ^ Chen, Jie; Wang, Guo-Jin (2011). "Progressive iterative approximation for triangular Bézier surfaces". Computer-Aided Design. 43 (8): 889–895. doi:10.1016/j.cad.2011.03.012. ISSN 0010-4485.
- ^ a b Lin, Hongwei; Cao, Qi; Zhang, Xiaoting (2018). "The Convergence of Least-Squares Progressive Iterative Approximation for Singular Least-Squares Fitting System". Journal of Systems Science and Complexity. 31 (6): 1618–1632. doi:10.1007/s11424-018-7443-y. ISSN 1009-6124. S2CID 255157830.
- ^ Lin, Hongwei; Jin, Sinan; Hu, Qianqian; Liu, Zhenbao (2015). "Constructing B-spline solids from tetrahedral meshes for isogeometric analysis". Computer Aided Geometric Design. 35–36: 109–120. doi:10.1016/j.cagd.2015.03.013. ISSN 0167-8396.
- ^ a b c d e f Deng, Chongyang; Lin, Hongwei (2014). "Progressive and iterative approximation for least squares B-spline curve and surface fitting". Computer-Aided Design. 47: 32–44. doi:10.1016/j.cad.2013.08.012. ISSN 0010-4485.
- ^ Zhao, Yu; Lin, Hongwei; Bao, Hujun (2012). "Local progressive interpolation for subdivision surface fitting". Journal of Computer Research and Development. 49 (8): 1699–1707.
- ^ Liu, Shengjun; Liu, Tao; Hu, Ling; Shang, Yuanyuan; Liu, Xinru (2021-09-01). "Variational progressive-iterative approximation for RBF-based surface reconstruction". The Visual Computer. 37 (9): 2485–2497. doi:10.1007/s00371-021-02213-3. ISSN 1432-2315.
- ^ a b Lin, Hongwei; Hu, Qianqian; Xiong, Yunyang (2013-12-01). "Consistency and convergence properties of the isogeometric collocation method". Computer Methods in Applied Mechanics and Engineering. 267: 471–486. Bibcode:2013CMAME.267..471L. doi:10.1016/j.cma.2013.09.025. ISSN 0045-7825.
- ^ Horn, Roger A.; Johnson, Charles R. (2012-10-22). Matrix Analysis. Cambridge University Press. doi:10.1017/cbo9781139020411. ISBN 978-0-521-83940-2.
- ^ Liu, Chengzhi; Han, Xuli; Li, Juncheng (2020). "Preconditioned progressive iterative approximation for triangular Bézier patches and its application". Journal of Computational and Applied Mathematics. 366: 112389. doi:10.1016/j.cam.2019.112389. ISSN 0377-0427. S2CID 202942809.
- ^ Sajavičius, Svajūnas (2023). "Hyperpower least squares progressive iterative approximation". Journal of Computational and Applied Mathematics. 422: 114888. doi:10.1016/j.cam.2022.114888. ISSN 0377-0427. S2CID 252965212.
- ^ Lu, Lizheng (2010). "Weighted progressive iteration approximation and convergence analysis". Computer Aided Geometric Design. 27 (2): 129–137. doi:10.1016/j.cagd.2009.11.001. ISSN 0167-8396.
- ^ Zhang, Li (2014-05-01). "Weighted Local Progressive Iterative Approximation for Tensor-product B\'{e}zier Surfaces". Journal of Information and Computational Science. 11 (7): 2117–2124. doi:10.12733/jics20103359. ISSN 1548-7741.
- ^ Li, Shasha; Xu, Huixia; Deng, Chongyang (2019). "Data-weighted least square progressive and iterative approximation and related B-Spline curve fitting". Journal of Computer-Aided Design & Computer Graphics. 31 (9): 1574–1580.
- ^ Huang, Zheng-Da; Wang, Hui-Di (2020). "On a progressive and iterative approximation method with memory for least square fitting". Computer Aided Geometric Design. 82: 101931. arXiv:1908.06417. doi:10.1016/j.cagd.2020.101931. ISSN 0167-8396. S2CID 201070122.
- ^ Rios, Dany; Jüttler, Bert (2022). "LSPIA, (stochastic) gradient descent, and parameter correction". Journal of Computational and Applied Mathematics. 406: 113921. doi:10.1016/j.cam.2021.113921. ISSN 0377-0427. S2CID 244018717.
- ^ Lin, Hongwei (2012). "Adaptive data fitting by the progressive-iterative approximation". Computer Aided Geometric Design. 29 (7): 463–473. doi:10.1016/j.cagd.2012.03.005. ISSN 0167-8396.
- ^ Zhao, Yu; Lin, Hongwei; Bao, Hujun (2012). "Local progressive interpolation for subdivision surface fitting". Computer Research and Development. 49 (8): 1699–1707.
- ^ Zhang, Li; Wang, Huan; Li, Yuanyuan; Tan, Jieqing (2014). "A progressive iterative approximation method in offset approximation". Journal of Computer Aided Design and Computer Graphics. 26 (10): 1646–1653.
- ^ Lin, Hongwei; Jin, Sinan; Liao, Hongwei; Jian, Qun (2015). "Quality guaranteed all-hex mesh generation by a constrained volume iterative fitting algorithm". Computer-Aided Design. 67–68: 107–117. doi:10.1016/j.cad.2015.05.004. ISSN 0010-4485.
- ^ Hu, Lijuan; Yi, Yeqing; Liu, Chengzhi; Li, Juncheng (2020). "Iterative method for image compression by using LSPIA". IAENG International Journal of Computer Science. 47 (4): 1–7.
This article needs additional or more specific categories. (August 2024) |