Optimal Control of Time-Delay Systems

Optimal Control of Time-Delay Systems

Article Fingerprint

ReserarchID

67K7G

Optimal Control of Time-Delay Systems Banner

AI TAKEAWAY

Connecting with the Eternal Ground
  • English
  • Afrikaans
  • Albanian
  • Amharic
  • Arabic
  • Armenian
  • Azerbaijani
  • Basque
  • Belarusian
  • Bengali
  • Bosnian
  • Bulgarian
  • Catalan
  • Cebuano
  • Chichewa
  • Chinese (Simplified)
  • Chinese (Traditional)
  • Corsican
  • Croatian
  • Czech
  • Danish
  • Dutch
  • Esperanto
  • Estonian
  • Filipino
  • Finnish
  • French
  • Frisian
  • Galician
  • Georgian
  • German
  • Greek
  • Gujarati
  • Haitian Creole
  • Hausa
  • Hawaiian
  • Hebrew
  • Hindi
  • Hmong
  • Hungarian
  • Icelandic
  • Igbo
  • Indonesian
  • Irish
  • Italian
  • Japanese
  • Javanese
  • Kannada
  • Kazakh
  • Khmer
  • Korean
  • Kurdish (Kurmanji)
  • Kyrgyz
  • Lao
  • Latin
  • Latvian
  • Lithuanian
  • Luxembourgish
  • Macedonian
  • Malagasy
  • Malay
  • Malayalam
  • Maltese
  • Maori
  • Marathi
  • Mongolian
  • Myanmar (Burmese)
  • Nepali
  • Norwegian
  • Pashto
  • Persian
  • Polish
  • Portuguese
  • Punjabi
  • Romanian
  • Russian
  • Samoan
  • Scots Gaelic
  • Serbian
  • Sesotho
  • Shona
  • Sindhi
  • Sinhala
  • Slovak
  • Slovenian
  • Somali
  • Spanish
  • Sundanese
  • Swahili
  • Swedish
  • Tajik
  • Tamil
  • Telugu
  • Thai
  • Turkish
  • Ukrainian
  • Urdu
  • Uzbek
  • Vietnamese
  • Welsh
  • Xhosa
  • Yiddish
  • Yoruba
  • Zulu
Font Type
Font Size
Font Size
Bedground

Abstract

It is shown how the time delay of industrial processes can be handled in optimal control algorithms. Comparison of the classical and new modern algorithms is presented.

I. INTRODUCTION

It is clear for control engineers that handling time delay requires special attention from the early days of the control history. The time delay is an uncancelable, invariant property of the process. The early goals tried to find design procedures which allow the selection of the regulator quasi independently from the delay. An early success story was the SMITH predictor or regulator [1].

Consider a continuous time delay process given by its transfer function

( 1 ) P ( s ) = P + ( s ) P ¯ ( s ) = P + ( s ) e s T d P = P + P ¯ = P + e s T d

where T d is the time delay, P + is stable and P = e s T d is the Inverse-Unstable-Unrealizable (IUU) part of the process, respectively. The original SMITH predictor is shown in Fig. 1, where r is the reference signal and y is the process output.

Fig.1: The Block-Scheme of the SMITH predictor
Fig.1: The Block-Scheme of the SMITH predictor

It is easy to check that the SMITH predictor is equivalent to the scheme shown in Fig. 2. This figure clearly shows that the regulator C + can be designed to the delay free P + , independently of the time delay T d . This scheme explains why the SMITH predictor is also called SMITH regulator [8], [9], [10]. The whole procedure is, of course, not independent of T d , because the predictor scheme contains block depending on the delay.

Fig. 3: IMC form of the SMITH predictor
Fig. 3: IMC form of the SMITH predictor

It is possible to redraw the SMITH predictor into further schemes, which allow special interpretations. Fig. 3. shows another equivalent scheme what corresponds to the well known Internal Model Control (IMC) scheme and principle. Fig. 4. presents the resulting closed-loop with the serial regulator C s equivalent to the application of the SMITH predictor.

Fig. 2: Equivalent Block-Scheme of the SMITH predictor
Fig. 2: Equivalent Block-Scheme of the SMITH predictor
Fig. 4: The Resulting Closed-Loop of the SMITH predictor Fig. 5: YOULA-Parameterized Closed-Loop
Fig. 4: The Resulting Closed-Loop of the SMITH predictor Fig. 5: YOULA-Parameterized Closed-Loop

II. THE YOULA PARAMETERIZATION

A YOULA-parameterized (YP) closed-loop [4], [8] is shown in Fig. 5, where e is the error, u is the regulator output and w is the output disturbance signal, respectively.

Here the plant P is stable and the A / RealizableStabilizing (ARS) regulator is

( 2 ) C = Q 1 Q P

The closed-loop transfer function or Complementary Sensitivity Function (CSF)

( 3 ) T = C P 1 + C P = Q P

which is linear in the stable YOULA parameter Q .

It is well known that the Y P regulator corresponds to the classical IMC structure shown in Fig.

6, where r is the reference signal, u is the regulator output, y is the output signal and w is the output disturbance signal, respectively. If there is no disturbance and the internal model is equal to the process transfer function, the signal fed back to the reference signal is zero, and the forward path Q P determines the reference signal tracking. The feedback loop rejects the effect of the disturbance and of the plant/model mismatch.

Fig. 6: IMC form of the YP Closed-Loop
Fig. 6: IMC form of the YP Closed-Loop

It can also be well seen that Q + in Fig. 3 corresponds to the YOULA parameter. For a more detailed comparison consider the extension of Y P regulator for more general case next.

III. A G2DOF CONTROLLER FOR STABLE LINEAR PLANTS

The first systematic method introducing the generic two degree of freedom (G2DOF) scheme was presented in [5], [8], [9], [10] when the process is open-loop stable and it is allowed to cancel the stable process poles, which case occurs at many practical tasks. 2DOF in this approach means that the dynamics of reference signal tracking and that of disturbance rejecting are different. This framework and topology is based on the Y P providing ARS regulators for open-loop stable plants and capable to handle the plant time-delay, too.

Fig. 7: The generic 2DOF (G2DOF) Control System
Fig. 7: The generic 2DOF (G2DOF) Control System

A G2DOF control system is shown in Fig. 7 for the stable process

P = P + P ¯ = P + P e s T d

which is more general than what was used in (1), because here P + is stable and Inverse-Stable-Realizable (ISR), P is Inverse-Unstable-Unrealizable (IUU).

The optimal ARS regulator of the G2DOF scheme can be given by an explicit form

( 5 ) C opt = R w K w 1 R w K w P = Q o 1 Q o P = R w G w P + 1 1 R w G w P e s T d
( 8 ) y = R r K r P y r + ( 1 R w K w P ) w = R r G r P e s T d y r + ( 1 R w G w P e s T d ) w = y t + y d

where y t is the tracking (servo) and y d is the regulating (or disturbance rejection) independent behaviors of the closed-loop response, respectively. So the delay e s T d and P can not be eliminated, consequently the ideal design goals R r and R w are biased by G r P and G w P . Here R r and R w are assumed stable and usually strictly proper transfer functions, that are partly capable to place desired poles in the tracking and the regulatory transfer functions, furthermore they where

( 6 ) Q o = Q w = R w K w = R w G w P + 1

is the associated optimal Y -parameter. Furthermore

( 7 ) Q r = R r K r = R r G r P + 1 ; K w = G w P + 1 ; K r = G r P + 1

The YP regulator (5) can be considered the generalization of the TRUXAL-GUILLEMIN [2], [8], [9], [10] method for stable processes.

It is interesting to see how the transfer characteristics of the closed-loop look like:

are usually referred as reference signal and output disturbance predictors. They can even be called as reference models, so reasonably R r ( ω = 0 ) = 1 and R w ( ω = 0 ) = 1 are selected. The unity gain of R w ensures integral action in the regulator, which is maintained if the applied optimization provides G w P ( ω = 0 ) = 1 .

The role of R r and R w (predictors or filters) is threefold.

They prescribe the tracking and regulatory properties of the control loop. They influence the magnitude of the actuating signal and also influence the robustness properties of the control system.

An interesting result was found [6] that the optimization of the G2DOF scheme can be performed in H 2 and H norm spaces by the proper selection of the serial embedded filters G r and G w attenuating the influence of the invariant process factor P . Using

H 2 norm a Diophantine-equation (DE) should be solved to optimize these filters. If the optimality requires a H norm, then the NEVANLINNA-PICK (NP) approximation is applied.

After some straightforward block manipulations the G2DOF control system can be transformed to another form shown in Fig. 8, which is the generalized version of the classical IMC scheme in Fig. 6.

Fig. 8: The generalized IMC form of the G2DOF control system
Fig. 8: The generalized IMC form of the G2DOF control system

IV. SMITH PREDICTOR AS A SUBCLASS OF G2DOF CONTROLLER

The previous two sections clearly show that the SMITH predictor is a special subclass of the G2DOF controllers with a Y P parameterized regulator

( 9 ) Q + = C + 1 + C + P + = C + P + 1 + C + P + P + 1 = L + 1 + L + P + 1 = R + P + 1

if C + is stabilizing P + , i.e., the delay free part of the process. Here the special CSF

( 10 ) T + = R + = L + 1 + L +

characterizing the closed-loop in Fig. 2 is the reference model R + and L + = C + P + is its loop transfer function.

It is also easy to see that the resulting serial regulator of the SMITH predictor in Fig. 4 is

( 11 ) C S = Q + 1 Q + P + e s T d = C + 1 + C + P e x t + ( 1 e s T d ) = C + K S

This formula presents the possible way of realization for a continuous-time (CT) case. Here K S denotes a serial factor modifying the original C + regulator of the SMITH predictor

( 12 ) K S = 1 1 + C + P + ( 1 e s T d ) = 1 1 + L + ( 1 e s T d )

At the stability limit cross over frequency ω c where L + = 1 the factor K s takes a considerable positive phase advance into the closed-loop

( 13 ) K S = 1 1 + ( 1 ) ( 1 e s T d ) = 1 1 1 + e s T d = e s T d | ω c = e j ω c T d

This is the simple physical explanation of the success of the SMITH predictor [3].

Some early evaluations state that unfortunately the SMITH predictor is only good for tracking and not for disturbance rejection. This evaluation is wrong. The SMITH regulator was proposed for a one-degree of freedom (1DOF) closed-loop, so it is naturally not for 2DOF purposes. The real problem of the SMITH regulator is that it allows the design of the closed-loop only via an indirect way by selecting R + = T + , while the design procedure of the G2DOF scheme gives a direct procedure to design the independent tracking and disturbance rejection properties. This means that the original idea of SMITH was that a classical design of T + is necessary for the proper application. One must know that the YOULA parameterization and its application for regulator design was unknown for Otto SMITH when he invented his predictor.

V. THE DISCRETE-TIME VERSION OF G2DOF CONTROLLER

Although (11) suggests a proper way how to realize the SMITH regulator, it is not realistic to build any regulator containing the e s T d delay element for continuous-time case. In the practice only the discrete-time (DT) version can be applied by computer realization. Consider the DT model of the CT process in the form of its pulse transfer function given by

( 14 ) G ( z 1 ) = G + ( z 1 ) G ¯ ( z 1 ) = G + ( z 1 ) G ( z 1 ) z d
G = G + G = G + G z d

where G + is stable and I S R , G is I U U and z d corresponds to the discrete time-delay, where d is the integer multiple of the sampling time. (In a practical case the factor G can incorporate the underdamped zeros and the neglected poles providing realizability, too). The optimal ARS regulator of the G2DOF scheme can be given now by

( 15 ) C o = R w K w 1 R w K w S = Q o 1 Q o G = R w G w G + 1 1 R w G w G z d

which corresponds to the CT case of (5), furthermore (6) and (7) are formally exactly the same for DT case. The transfer characteristics of the closed-loop is now

y = R r K r G y r + ( 1 R w K w G ) w = R r G r G z d y r + ( 1 R w G w G z d ) w = y t + y d

Because the optimization of the embedded filters G r and G w requires special knowledge and practice of getting the solution from a DE and NP approximation, suboptimal design is mostly applied assuming G r = G w = 1 . In such cases the influence of the invariant process factors are not attenuated at all, so they appear in the closed-loop characteristics (15) directly. Such G2DOF control scheme is shown in Fig.

It follows from the above discussion that it is not necessary to apply the classical SMITH predictor principle, instead it is more effective to use the regulator design procedure of the G2DOF controller scheme.

Fig. 9: Discrete-Time G2DOF Control System for the Suboptimal G r = G w = 1 case

VI. SIMPLE EXAMPLES

Example 1

Consider a very simple first order time-delay process

( 17 ) P = 1 1 + 1 0 s e 5 s ; P + = 1 1 + 1 0 s ; P ¯ = e 5 s ; P = 1

The tracking and disturbance rejection reference models are

( 18 ) R r = 1 1 + 4 s and R w = 1 1 + 2 s

Here P = 1 , therefore G r = G w = 1 is the optimal selection for the embedded filters.

Design a YOULA-parameterized optimal regulator.

( 19 ) C opt = R w G w P + 1 1 R w G w P e s T d = 1 1 R w e s T d R w P + 1 = 1 1 1 1 + 2 s e 5 s 1 + 1 0 s 1 + 2 s = ( 1 + 2 s ) ( 1 + 1 0 s ) 1 + 2 s e 5 s

and the optimal serial compensator is

( 20 ) R r K r = R r G r P + 1 = R r P + 1 = 1 + 1 0 s 1 + 4 s

Both transfer functions are realizable.

Because C opt ( s = 0 ) = the regulator is integrating obtained from the condition R w ( s = 0 ) = 1 . The optimal

It is easy to check that the closed-loop characteristics is

( 21 ) y opt = R r e s T d y r + ( 1 R w e s T d ) w = 1 1 + 4 s e 5 s y r + ( 1 1 1 + 2 s e 5 s ) w

according to the general theory.

Fig. 10: The Designed Optimal Closed-Loop of the Example
Fig. 10: The Designed Optimal Closed-Loop of the Example

Example 2

Consider the DT model of a very simple first order time delay process

( 22 ) G = 0 . 2 z 1 1 0 . 8 z 1 z 3 = 0 . 2 z 4 1 0 . 8 z 1 ; G + = 0 . 2 z 1 1 0 . 8 z 1 and G = 1

It is required to speed up the process by a closed-loop.

Design a YP controller. Select the reference models

( 23 ) R r = 0 . 8 z 1 1 0 . 2 z 1 and R w = 0 . 5 z 1 1 0 . 5 z 1

Because G = 1 , there is no optimization task, so the selections G r = 1 and G w = 1 are optimal. The optimal regulator is

( 24 ) C opt = R w G w G + 1 1 R w G w G z d = 1 1 R w z d R w G + 1 = 1 1 0 . 5 z 1 1 0 . 5 z 1 z 3 0 . 5 z 1 1 0 . 5 z 1 1 0 . 8 z 1 0 . 2 z 1 = 2 . 5 ( 1 0 . 8 z 1 ) 1 0 . 5 z 1 0 . 5 z 4

and the serial compensator is

( 25 ) R r G + 1 = 0 . 8 z 1 1 0 . 2 z 1 1 0 . 8 z 1 0 . 2 z 1 = 4 ( 1 0 . 8 z 1 ) 1 0 . 2 z 1

The optimal final closed-loop is shown in Fig. 11. Observe that C opt ( z = 1 ) = , i.e. the regulator is an integrating one, which follows from the condition R w ( z = 1 ) = 1 .

Fig.11: The designed optimal closed-loop of the example
Fig.11: The designed optimal closed-loop of the example

The closed-loop characteristics is

( 26 ) y opt = R r z d y r + ( 1 R w z d ) w = 0.8 z 1 1 0.2 z 1 z 3 y r + ( 1 0.5 z 1 1 0.5 z 1 z 3 ) w = 0.8 z 4 1 0.2 z 1 y r + ( 1 0.5 z 4 1 0.5 z 1 ) w

which exactly corresponds to our design goals.

This example shows that there is no applicability problem for DT regulator design. These filters are easy to be realized in a computer controlled system.

Example 3.

The continuous first order plant with significant time delay is given by the transfer function

( 27 ) P ( s ) = 1 1 + 1 0 s e 3 0 s

The plant is sampled with sampling time T s = 5 sec and a zero order hold is applied at its input. Let us design a PI controller ensuring about 60 of phase margin, a Smith predictor and a YOULA-parameterized controller. Compare the reference signal tracking and output disturbance rejection behaviour of the three control systems. Demonstrate the effect of time delay mismatch.

The pulse transfer function of the plant is

( 28 ) G ( z ) = 0 . 3 9 3 5 z 0 . 6 0 6 5 z 6

The pulse transfer function of the P I controller [7] applying pole cancellation with a gain ensuring the required phase margin is

( 29 ) C P I ( z ) = 0. 2 0 4 z 0 . 6 0 6 5 z 1

The SMITH predictor controller C + is designed for the delay free process as a PI controller and it is obtained as

( 30 ) C + ( z ) = 2. 5 z 0 . 6 0 6 5 z 1

Then it is transformed to the SMITH predictor form according to the discretized version of (11).

( 31 ) C s ( z ) = 2 . 5 z 7 1 . 5 1 6 z 6 z 7 0 . 0 1 6 3 6 z 6 0 . 9 8 3 7

In the case of the YOULA parameterized controller let us choose the disturbance filter

( 32 ) R w ( s ) = 1 1 + 5 s

and the reference filter as

( 33 ) R r ( s ) = 1 1 + 8 s

whose pulse transfer functions are

( 34 ) R w ( z ) = 0 . 6 3 2 1 z 0 . 3 6 7 9 and R r ( z ) = 0 . 4 6 4 7 z 0 . 5 3 5 3 ,

Fig. 12: Step response and disturbance rejection dynamics of the P I , SMITH and YOULA controllers

The YOULA parameter supposing G r = G w = 1 is

( 35 ) Q ( z ) = R w ( z ) G + 1 ( z ) = 0.6321 z 0.3679 z 0.6065 0.3935

Figure 12 shows the step response and a shifted step disturbance rejection of the three controllers.

It is seen that in case of significant time delay SMITH predictor and the YOULA parameterized controllers ensure significant acceleration compared to the PI controller.

Figure 13 demonstrates the effect of time delay mismatch in the case of the SMITH and the YOULA controllers. The time delay of the model is 30, while the time delay of the process is 33.

It is seen that the YOULA parameterized controller tolerates much better the inaccuracy of the parameter than the SMITH predictor. While the SMITH predictor is very sensitive to the inaccuracies in the parameters (it is not robust), the filters in the YOULA parameterized controller can be designed for robust behaviour [11].

Fig. 13: The Effect of Time Delay Mismatch in Case of the SMITH and the YOULA Controllers
Fig. 13: The Effect of Time Delay Mismatch in Case of the SMITH and the YOULA Controllers

These are, of course, very simple examples standing only to present the simplicity of the G2DOF controller scheme, which should replace the classical approach of a SMITH predictor.

VII. CONCLUSIONS

The SMITH predictor is a classical method of handling time-delay in closed-loop control design. It is shown that this method is a subclass of the YP based G2DOF control scheme. An obvious drawback of the SMITH predictor is that the closed-loop properties cannot be designed directly using simple algebraic methods, which is possible in the G2DOF structure. The G2DOF scheme allows even the optimal attenuation of the invariant process factors. The appropriate choice and design of the filters allows to influence such important properties as performance and robustness. So the paper suggests to use the newer methodology to design DT controllers for time-delay processes.

The role of the SMITH predictor remains important in the history of control engineering, because it was one of the first, easy to use and widely applied method to simply eliminate the influence of the delay in the design of closed-loop control properties. Nevertheless this method is sensitive to the accurate knowledge of the time delay.

The recent theoretical developments and easily applicable algebraic design methods allow to use more effective and more general controller design procedures.

References

11 Cites in Article
  1. O Smith (1957). Closed control of loops with dead time.
  2. Isaac Horowitz (1963). Synthesis of Linear, Multivariable Feedback Control Systems.
  3. K Åström,B Wittenmark (1984). Computer Controlled Systems.
  4. J Maciejowski (1989). Multivariable Feedback Design, by J.M. Maciejowski. Addison-Wesley, Wokingham, Berkshire, UK, 1989, xv + 409 pp. index (£24.95).
  5. L Keviczky (1995). Combined identification and control: another way.
  6. L Keviczky,Cs Bányász (1999). Optimality of two-degree of freedom controllers in H 2 - and H ∞ -norm space, their robustness and minimal sensitivity.
  7. Nusret Tan (2005). Computation of stabilizing PI and PID controllers for processes with time delay.
  8. László Keviczky,Csilla Bányász (2015). Feedback Regulators.
  9. László Keviczky,Ruth Bars,Jenő Hetthéssy,Csilla Bányász (2019). Control Engineering.
  10. L Keviczky,R Bars,J Hetthéssy,Cs Bányász (2019). Control Engineering: MATLAB Exercises.
  11. Cs Bányász,L Keviczky,R Bars (2018). Influence of Time-Delay Mismatch for Robustness and Stability.

Funding

No external funding was declared for this work.

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

No ethics committee approval was required for this article type.

Data Availability

Not applicable for this article.

How to Cite This Article

L. Keviczky, Cs. Bányász, R. Bars. 2026. "Optimal Control of Time-Delay Systems". Global Journal of Computer Science and Technology - G: Interdisciplinary GJCST-G Volume 23 (GJCST Volume 23 Issue G2).

Download Citation

High-quality image related to optimal control in time-delay systems for academic research.
Journal Specifications

Crossref Journal DOI 10.17406/gjcst

Print ISSN 0975-4350

e-ISSN 0975-4172

Keywords
Classification
GJCST-G Classification LCC: TJ213 ACM: G.1.7
Version of record

v1.2

Issue date
October 7, 2023

Language
English
Experiance in AR

Explore published articles in an immersive Augmented Reality environment. Our platform converts research papers into interactive 3D books, allowing readers to view and interact with content using AR and VR compatible devices.

Read in 3D

Your published article is automatically converted into a realistic 3D book. Flip through pages and read research papers in a more engaging and interactive format.

Article Matrices
Total Views: 834
Total Downloads: 53
All Trends

Request Access

Please fill out the form below to request access to this research paper. Your request will be reviewed by the editorial or author team.
X

This is the heading

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

High-quality academic research articles on global topics and journals.

Optimal Control of Time-Delay Systems

L. Keviczky
L. Keviczky
Cs. Bányász
Cs. Bányász
R. Bars
R. Bars