Log in

Relevant bibliographies by topics / Markov processes - Evaluation / Journal articles

To see the other types of publications on this topic, follow the link: Markov processes - Evaluation.

Journal articles on the topic 'Markov processes - Evaluation'

Author: Grafiati

Published: 4 June 2021

Last updated: 1 February 2022

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles

Select a source type:

Consult the top 50 journal articles for your research on the topic 'Markov processes - Evaluation.'

Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.

You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.

Browse journal articles on a wide variety of disciplines and organise your bibliography correctly.

1

Świderski, Andrzej, Anna Borucka, Małgorzata Grzelak, and Leszek Gil. "Evaluation of Machinery Readiness Using Semi-Markov Processes." Applied Sciences 10, no. 4 (2020): 1541. http://dx.doi.org/10.3390/app10041541.

Full text

Abstract:

This article uses Markov and semi-Markov models as some of the most popular tools to estimate readiness and reliability. They allow to evaluate of both individual elements as well as entire systems—including production systems—as multi-state structures. To be able to distinguish states with varying degrees of technical readiness in complicated and complex objects (systems) allows to determine their individual impact on the tasks performed, as well as on the total reliability. The application of the Markov process requires, for the process dwell times in the individual states, to be random vari

APA, Harvard, Vancouver, ISO, and other styles

2

Ragab-Hassen, Hani, and Esma Lounes. "A key management scheme evaluation using Markov processes." International Journal of Information Security 16, no. 3 (2016): 271–80. http://dx.doi.org/10.1007/s10207-016-0323-3.

Full text

APA, Harvard, Vancouver, ISO, and other styles

3

Wang, Qi, Masayuki Kageyama, and Jingyao Zhang. "New evaluation criteria in the Markov decision processes." Journal of Statistics and Management Systems 24, no. 3 (2021): 625–32. http://dx.doi.org/10.1080/09720510.2020.1800228.

Full text

APA, Harvard, Vancouver, ISO, and other styles

4

Ying, Ming-Sheng, Yuan Feng, and Sheng-Gang Ying. "Optimal Policies for Quantum Markov Decision Processes." International Journal of Automation and Computing 18, no. 3 (2021): 410–21. http://dx.doi.org/10.1007/s11633-021-1278-z.

Full text

Abstract:

AbstractMarkov decision process (MDP) offers a general framework for modelling sequential decision making where outcomes are random. In particular, it serves as a mathematical framework for reinforcement learning. This paper introduces an extension of MDP, namely quantum MDP (qMDP), that can serve as a mathematical model of decision making about quantum systems. We develop dynamic programming algorithms for policy evaluation and finding optimal policies for qMDPs in the case of finite-horizon. The results obtained in this paper provide some useful mathematical tools for reinforcement learning

APA, Harvard, Vancouver, ISO, and other styles

5

Belousov, Boris, and Jan Peters. "Entropic Regularization of Markov Decision Processes." Entropy 21, no. 7 (2019): 674. http://dx.doi.org/10.3390/e21070674.

Full text

Abstract:

An optimal feedback controller for a given Markov decision process (MDP) can in principle be synthesized by value or policy iteration. However, if the system dynamics and the reward function are unknown, a learning agent must discover an optimal controller via direct interaction with the environment. Such interactive data gathering commonly leads to divergence towards dangerous or uninformative regions of the state space unless additional regularization measures are taken. Prior works proposed bounding the information loss measured by the Kullback–Leibler (KL) divergence at every policy improv

APA, Harvard, Vancouver, ISO, and other styles

6

Haifeng Ge and Sohrab Asgarpoor. "Reliability Evaluation of Equipment and Substations With Fuzzy Markov Processes." IEEE Transactions on Power Systems 25, no. 3 (2010): 1319–28. http://dx.doi.org/10.1109/tpwrs.2009.2038387.

Full text

APA, Harvard, Vancouver, ISO, and other styles

7

Janssen, Jacques, and Raimondo Manca. "Salary cost evaluation by means of non-homogeneous semi-Markov processes." Stochastic Models 18, no. 1 (2002): 7–23. http://dx.doi.org/10.1081/stm-120002772.

Full text

APA, Harvard, Vancouver, ISO, and other styles

8

Alagoz, Oguzhan, Heather Hsu, Andrew J. Schaefer, and Mark S. Roberts. "Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty." Medical Decision Making 30, no. 4 (2009): 474–83. http://dx.doi.org/10.1177/0272989x09353194.

Full text

Abstract:

We provide a tutorial on the construction and evaluation of Markov decision processes (MDPs), which are powerful analytical tools used for sequential decision making under uncertainty that have been widely used in many industrial and manufacturing applications but are underutilized in medical decision making (MDM). We demonstrate the use of an MDP to solve a sequential clinical treatment problem under uncertainty. Markov decision processes generalize standard Markov models in that a decision process is embedded in the model and multiple decisions are made over time. Furthermore, they have sign

APA, Harvard, Vancouver, ISO, and other styles

9

Uc-Cetina, Víctor, Francisco Moo-Mena, and Rafael Hernandez-Ucan. "Composition of Web Services Using Markov Decision Processes and Dynamic Programming." Scientific World Journal 2015 (2015): 1–9. http://dx.doi.org/10.1155/2015/545308.

Full text

Abstract:

We propose a Markov decision process model for solving the Web service composition (WSC) problem. Iterative policy evaluation, value iteration, and policy iteration algorithms are used to experimentally validate our approach, with artificial and real data. The experimental results show the reliability of the model and the methods employed, with policy iteration being the best one in terms of the minimum number of iterations needed to estimate an optimal policy, with the highest Quality of Service attributes. Our experimental work shows how the solution of a WSC problem involving a set of 100,0

APA, Harvard, Vancouver, ISO, and other styles

10

Cooper, William L., Shane G. Henderson, and Mark E. Lewis. "CONVERGENCE OF SIMULATION-BASED POLICY ITERATION." Probability in the Engineering and Informational Sciences 17, no. 2 (2003): 213–34. http://dx.doi.org/10.1017/s0269964803172051.

Full text

Abstract:

Simulation-based policy iteration (SBPI) is a modification of the policy iteration algorithm for computing optimal policies for Markov decision processes. At each iteration, rather than solving the average evaluation equations, SBPI employs simulation to estimate a solution to these equations. For recurrent average-reward Markov decision processes with finite state and action spaces, we provide easily verifiable conditions that ensure that simulation-based policy iteration almost-surely eventually never leaves the set of optimal decision rules. We analyze three simulation estimators for soluti

APA, Harvard, Vancouver, ISO, and other styles

11

Keilson, Julian, and Ravi Ramaswamy. "The Relaxation time for truncated birth-death processes." Probability in the Engineering and Informational Sciences 1, no. 4 (1987): 367–81. http://dx.doi.org/10.1017/s0269964800000462.

Full text

Abstract:

The relaxation time for an ergodic Markov process is a measure of the time until ergodicity is reached from its initial state. In this paper the relaxation time for an ergodic truncated birth-death process is studied. It is shown that the relaxation time for such a process on states {0,1, …, N} is the quasi-stationary exit time from the set {,2, …, N{0,1,…, N, N + 1} with two-sided absorption at states 0 and N + 1. The existence of such a dual process has been observed by Siegmund [15] for stochastically monotone Markov processes on the real line. Exit times for birth- death processes with two

APA, Harvard, Vancouver, ISO, and other styles

12

Dahl, F. A. "Variance reduction for Markov chain processes using state space evaluation for control variates." Journal of the Operational Research Society 52, no. 12 (2001): 1402–7. http://dx.doi.org/10.1057/palgrave.jors.2601232.

Full text

APA, Harvard, Vancouver, ISO, and other styles

13

Fagundes, Moser Silva, Sascha Ossowski, Jesús Cerquides, and Pablo Noriega. "Design and evaluation of norm-aware agents based on Normative Markov Decision Processes." International Journal of Approximate Reasoning 78 (November 2016): 33–61. http://dx.doi.org/10.1016/j.ijar.2016.06.005.

Full text

APA, Harvard, Vancouver, ISO, and other styles

14

Helmes, Kurt, and Richard H. Stockbridge. "Numerical evaluation of resolvents and Laplace transforms of Markov processes using linear programming." Mathematical Methods of Operations Research (ZOR) 53, no. 2 (2001): 309–31. http://dx.doi.org/10.1007/s001860100121.

Full text

APA, Harvard, Vancouver, ISO, and other styles

15

Bochkovskyi, A. "METHODOLOGICAL BASIS FOR THE USE OF MARKOV PROCESSES FOR RISK ASSESSMENT IN SYSTEMS «MAN–MACHINE–ENVIRONMENT»." Bulletin of Lviv State University of Life Safety, no. 18 (December 31, 2018): 88–95. http://dx.doi.org/10.32447/20784643.18.2018.09.

Full text

Abstract:

Introduction. For today there are about a hundred high-quality, quantitative and combined risks evaluation techniques, but none of them is suitable for use in the field of occupational healthy and safety since it does not take into account the dynamic nature of the random hybrid influence on the employee of dangerous and harmful productive factors within "man-machine-environment" systems. For a description of the actual process of hybrid influence of dangers on a employee, it is necessary to use a special subclass of Markov processes with drift, the use of which for risk evaluation in the fiel

APA, Harvard, Vancouver, ISO, and other styles

16

Feldman, Z., and C. Domshlak. "Simple Regret Optimization in Online Planning for Markov Decision Processes." Journal of Artificial Intelligence Research 51 (September 25, 2014): 165–205. http://dx.doi.org/10.1613/jair.4432.

Full text

Abstract:

We consider online planning in Markov decision processes (MDPs). In online planning, the agent focuses on its current state only, deliberates about the set of possible policies from that state onwards and, when interrupted, uses the outcome of that exploratory deliberation to choose what action to perform next. Formally, the performance of algorithms for online planning is assessed in terms of simple regret, the agent's expected performance loss when the chosen action, rather than an optimal one, is followed. To date, state-of-the-art algorithms for online planning in general MDPs are either b

APA, Harvard, Vancouver, ISO, and other styles

17

Yassir, Yassir, and Langford B. White. "Folding Algorithm for Policy Evaluation for Markov Decision Processes With Quasi-Birth Death Structure." IEEE Transactions on Automatic Control 60, no. 4 (2015): 1164–68. http://dx.doi.org/10.1109/tac.2014.2348803.

Full text

APA, Harvard, Vancouver, ISO, and other styles

18

White, Langford B. "A New Policy Evaluation Algorithm for Markov Decision Processes with Quasi Birth-Death Structure." Stochastic Models 21, no. 2-3 (2005): 785–97. http://dx.doi.org/10.1081/stm-200056019.

Full text

APA, Harvard, Vancouver, ISO, and other styles

19

Staňová, Sidónia, Ján Soták, and Norbert Hudec. "Markov Chain analysis of turbiditic facies and flow dynamics (Magura Zone, Outer Western Carpathians, NW Slovakia)." Geologica Carpathica 60, no. 4 (2009): 295–305. http://dx.doi.org/10.2478/v10096-009-0021-4.

Full text

Abstract:

Markov Chain analysis of turbiditic facies and flow dynamics (Magura Zone, Outer Western Carpathians, NW Slovakia)Methods based on the Markov Chains can be easily applied in the evaluation of order in sedimentary sequences. In this contribution Markov Chain analysis was applied to analysis of turbiditic formation of the Outer Western Carpathians in NW Slovakia, although it also has broader utilization in the interpretation of sedimentary sequences from other depositional environments. Non-random facies transitions were determined in the investigated strata and compared to the standard deep-wat

APA, Harvard, Vancouver, ISO, and other styles

20

Tennenholtz, Guy, Uri Shalit, and Shie Mannor. "Off-Policy Evaluation in Partially Observable Environments." Proceedings of the AAAI Conference on Artificial Intelligence 34, no. 06 (2020): 10276–83. http://dx.doi.org/10.1609/aaai.v34i06.6590.

Full text

Abstract:

This work studies the problem of batch off-policy evaluation for Reinforcement Learning in partially observable environments. Off-policy evaluation under partial observability is inherently prone to bias, with risk of arbitrarily large errors. We define the problem of off-policy evaluation for Partially Observable Markov Decision Processes (POMDPs) and establish what we believe is the first off-policy evaluation result for POMDPs. In addition, we formulate a model in which observed and unobserved variables are decoupled into two dynamic processes, called a Decoupled POMDP. We show how off-poli

APA, Harvard, Vancouver, ISO, and other styles

21

Guerreiro, Sérgio. "Using Markov Theory to Deliver Informed Decisions in Partially Observable Business Processes Operation." International Journal of Operations Research and Information Systems 9, no. 2 (2018): 53–72. http://dx.doi.org/10.4018/ijoris.2018040103.

Full text

Abstract:

This article explores the stochastic capabilities offered by Markov theories combined with business transaction models, from the Enterprise Engineering field, to contribute to the decision-making body of knowledge. An agro-food case study shows the utility of this solution and the evaluation argues the management decisions value in situations where is not possible to fully observe the state of the reality, or to be fully aware about it. A full policy graph that forecasts the belief states from observations and enacted actions is delivered.

APA, Harvard, Vancouver, ISO, and other styles

22

Popyack, J. L., and C. C. White. "Suboptimal policy determination for large-scale Markov decision processes, part 2: Implementation and numerical evaluation." Journal of Optimization Theory and Applications 46, no. 3 (1985): 343–58. http://dx.doi.org/10.1007/bf00939288.

Full text

APA, Harvard, Vancouver, ISO, and other styles

23

Briones-Reyes, Arturo, Luis Alberto Vásquez-Toledo, Alfonso Prieto-Guerrero, and Rafael Aguilar-Gonzalez. "Mathematical evaluation of spectrum sharing in cognitive radio networks for 5G systems using Markov processes." Computer Networks 182 (December 2020): 107521. http://dx.doi.org/10.1016/j.comnet.2020.107521.

Full text

APA, Harvard, Vancouver, ISO, and other styles

24

Bochkovskyi, A. P. "Elaboration of occupational risks evaluation models considering the dynamics of impact of harmful factors." Journal of Achievements in Materials and Manufacturing Engineering 2, no. 102 (2020): 76–85. http://dx.doi.org/10.5604/01.3001.0014.6777.

Full text

Abstract:

Purpose: Elaborate and substantiate stochastic models of occupational risk evaluation for application in the occupation health and safety. Design/methodology/approach: Analysis of scientific and technical literature and regulatory framework for risk evaluation in the occupation health and safety; methods of probability theory, theory of Markov processes; methods of restoration theory. Findings: A system of differential equations and limit conditions for finding the limit distribution of probabilities of a random process of occupational dangers is derived. Based on the results of solving the li

APA, Harvard, Vancouver, ISO, and other styles

25

Lewiński, Andrzej, and Marta Żurek-Mortka. "Analysis and evaluation of the functionality of the mass service system on the basis of customs of truck vehicles." AUTOBUSY – Technika, Eksploatacja, Systemy Transportowe 19, no. 6 (2018): 906–10. http://dx.doi.org/10.24136/atest.2018.199.

Full text

Abstract:

Paper discussed the modeling of customs processes for truck vehicles using the Markov processes and mass service theory (queue theory), showing the operation of the notification handling system as a system dependent on random events. The system is characterized as a system with Poisson input stream, exponential service time and many service stations. The results are presented in the form of graphs based on real data received from the customs office

APA, Harvard, Vancouver, ISO, and other styles

26

Bochkovskyi, A. P. "Elaboration of stochastic models to comprehensive evaluation of occupational risks in complex dynamic systems." Journal of Achievements in Materials and Manufacturing Engineering 1, no. 104 (2021): 31–41. http://dx.doi.org/10.5604/01.3001.0014.8484.

Full text

Abstract:

Purpose: Elaborate stochastic models to comprehensive evaluation of occupational risks in “man - machine - environment” systems taking into account the random and dynamic nature of the impact on the employee of negative factors over time. Design/methodology/approach: Within study, the methods of probability theory and the theory of Markov processes - to find the limit distribution of the random process of dynamic impact on the employee of negative factors over time and obtain main rates against which the level of occupational risks within the "man - machine - environment" systems can be compre

APA, Harvard, Vancouver, ISO, and other styles

27

Lezhniuk, Petro, Vyacheslav Komar, Natalya Sobchuk, and Olena Sikorska. "Evaluation of Functioning Quality of Local Electrical Systems by the Criterion Method Based on Markov Processes." Modeling, Control and Information Technologies, no. 3 (November 6, 2019): 169–72. http://dx.doi.org/10.31713/mcit.2019.37.

Full text

Abstract:

The article proposes to use of a combination of the criterion method and Markov processes to evaluate the quality of functioning of renewable energy sources (RES) in the form of integrated readiness characteristic of the electricity network with RES or a local electrical system (LES). This is possible throughthe analysis of the problems of ensuring the quality of electricity supply in the conditions of intensive development of RES and defined by the qualimetric characteristics of the electricity networks, which are important for the provision of quality electricity. This contribute the develop

APA, Harvard, Vancouver, ISO, and other styles

28

Champagnat, F., and J. Idier. "On the correlation structure of unilateral AR processes on the plane." Advances in Applied Probability 32, no. 02 (2000): 408–25. http://dx.doi.org/10.1017/s0001867800010004.

Full text

Abstract:

In, Tory and Pickard show that a simple subclass of unilateral AR processes identifies with Gaussian Pickard random fields on Z 2. First, we extend this result to the whole class of unilateral AR processes, by showing that they all satisfy a Pickard-type property, under which correlation matching and maximum entropy properties are assessed. Then, it is established that the Pickard property provides the ‘missing’ equations that complement the two-dimensional Yule-Walker equations, in the sense that the conjunction defines a one-to-one mapping between the set of AR parameters and a set of correl

APA, Harvard, Vancouver, ISO, and other styles

29

Champagnat, F., and J. Idier. "On the correlation structure of unilateral AR processes on the plane." Advances in Applied Probability 32, no. 2 (2000): 408–25. http://dx.doi.org/10.1239/aap/1013540171.

Full text

Abstract:

In, Tory and Pickard show that a simple subclass of unilateral AR processes identifies with Gaussian Pickard random fields on Z2. First, we extend this result to the whole class of unilateral AR processes, by showing that they all satisfy a Pickard-type property, under which correlation matching and maximum entropy properties are assessed. Then, it is established that the Pickard property provides the ‘missing’ equations that complement the two-dimensional Yule-Walker equations, in the sense that the conjunction defines a one-to-one mapping between the set of AR parameters and a set of correla

APA, Harvard, Vancouver, ISO, and other styles

30

Młynarski, Stanisław, Robert Pilch, Maksymilian Smolnik, Maciej Szkoda, and Jan Szybka. "Evaluation Of The Safety Integrity Level (SIL) Due To The Guidelines Of EN 61508 And With The Use Of Markov Processes." Journal of KONBiN 35, no. 1 (2015): 73–84. http://dx.doi.org/10.1515/jok-2015-0041.

Full text

Abstract:

Abstract The methods of evaluation of the Probability of Failure on Demand (PFD) of safety systems were presented in the paper, assuming that the safety systems may be represented by the k out of n reliability structures. The results of the calculations obtained according to EN 61508 were compared with another results, this time obtained from the calculations done for these systems assuming that their failure-and-renewal process is a Markov process.

APA, Harvard, Vancouver, ISO, and other styles

31

Seyr, Helene, and Michael Muskulus. "Use of Markov Decision Processes in the Evaluation of Corrective Maintenance Scheduling Policies for Offshore Wind Farms." Energies 12, no. 15 (2019): 2993. http://dx.doi.org/10.3390/en12152993.

Full text

Abstract:

Optimization of the maintenance policies for offshore wind parks is an important step in lowering the costs of energy production from wind. The yield from wind energy production is expected to fall, which will increase the need to be cost efficient. In this article, the Markov decision process is presented and how it can be applied to evaluate different policies for corrective maintenance planning. In the case study, we show an alternative to the current state-of-the-art policy for corrective maintenance that will achieve a cost-reduction when energy production prices drop below the current le

APA, Harvard, Vancouver, ISO, and other styles

32

D'Amico, Guglielmo, Giuseppe Di Biase, Fulvio Gismondi, and Raimondo Manca. "The Input Evaluation of Generalized Bernoulli Processes for Salary Lines Construction by Means of Continuous Time Generalized Non-Homogeneous Semi-Markov Processes." Communications in Statistics - Theory and Methods 42, no. 16 (2013): 2889–901. http://dx.doi.org/10.1080/03610926.2012.745558.

Full text

APA, Harvard, Vancouver, ISO, and other styles

33

Burtnyak, Ivan, and Anna Malytska. "The evaluation of derivatives of double barrier options of the Bessel processes by methods of spectral analysis." Investment Management and Financial Innovations 14, no. 3 (2017): 126–34. http://dx.doi.org/10.21511/imfi.14(3).2017.12.

Full text

Abstract:

The paper deals with the spectral methods to calculate the value of the double barrier option generated by the Bessel diffusion process. This technique enables us to calculate the option price in the form of a Fourier-Bessel series with the corresponding ratio. The autors propose a simple method to estimate options using the Green’s expansion function for boundary value problem for a singular parabolic equation. Thus, the accuracy of the estimation coincides with the accuracy of the convergence of the Fourier-Bessel series. In this paper, the authors use the spectral theory to calculate the pr

APA, Harvard, Vancouver, ISO, and other styles

34

Karnon, Jonathan. "Alternative decision modelling techniques for the evaluation of health care technologies: Markov processes versus discrete event simulation." Health Economics 12, no. 10 (2003): 837–48. http://dx.doi.org/10.1002/hec.770.

Full text

APA, Harvard, Vancouver, ISO, and other styles

35

Guze, Sambor, Krzysztof Kołowrocki, and Joanna Soszyńska. "Modelling Environment and Infrastructure Influence on Reliability and Operation Processes of Port Transportation Systems." Journal of Konbin 4, no. 1 (2008): 25–38. http://dx.doi.org/10.2478/v10040-008-0008-8.

Full text

Abstract:

Modelling Environment and Infrastructure Influence on Reliability and Operation Processes of Port Transportation SystemsIn the paper a probabilistic model of industrial systems environment and infrastructure influence on their operation processes is proposed. Semi-markov processes are used to construct a general model of complex industrial systems' operation processes. Main characteristics of this model are determined as well. In particular case, for a port grain transportation system, its operation states are defined, the relationships between them are fixed and particular model of its operat

APA, Harvard, Vancouver, ISO, and other styles

36

RUDNICKI, Jacek. "The time of the first transition of the semi-Markov process in the evaluation of diesel engine operation." Combustion Engines 145, no. 2 (2011): 89–98. http://dx.doi.org/10.19206/ce-117106.

Full text

Abstract:

The paper presents the extension of the method discussed in the literature of quantitative evaluation of operation on the example of a marine engine. According to this interpretation, the engine operation can be shown as a physical quantity. In this aspect, based on the main marine diesel engine an evaluation of the usefulness of this index for the description of the engine reliability related properties has been performed. Apart from the generally used reliability indexes, it seems purposeful to consider the engine operation (as well as its functional subsystems) in the evaluative way, so tha

APA, Harvard, Vancouver, ISO, and other styles

37

Miyazaki, Kazuteru, and Shigenobu Kobayashi. "An Extension of Profit Sharing to Partially Observable Markov Decision Processes: Proposition of PS-r* and its Evaluation." Transactions of the Japanese Society for Artificial Intelligence 18 (2003): 286–96. http://dx.doi.org/10.1527/tjsai.18.286.

Full text

APA, Harvard, Vancouver, ISO, and other styles

38

Hubbard, R. A., J. Lange, Y. Zhang, B. A. Salim, J. R. Stroud, and L. Y. T. Inoue. "Using semi-Markov processes to study timeliness and tests used in the diagnostic evaluation of suspected breast cancer." Statistics in Medicine 35, no. 27 (2016): 4980–93. http://dx.doi.org/10.1002/sim.7055.

Full text

APA, Harvard, Vancouver, ISO, and other styles

39

Stefanov, Valeri T. "The intersite distances between pattern occurrences in strings generated by general discrete- and continuous-time models: an algorithmic approach." Journal of Applied Probability 40, no. 04 (2003): 881–92. http://dx.doi.org/10.1017/s0021900200020179.

Full text

Abstract:

The formation of patterns from letters of a finite alphabet is considered. The strings of letters are generated by general discrete- and continuous-time models which embrace as particular cases all models considered in the literature. The letters of the alphabet are identified by the states of either discrete- or continuous-time semi-Markov processes. A new and unifying method is introduced for evaluation of the generating functions of both the intersite distance between occurrences of an arbitrary, but fixed, pattern and the waiting time until the first occurrence of that pattern. Our method

APA, Harvard, Vancouver, ISO, and other styles

40

Stefanov, Valeri T. "The intersite distances between pattern occurrences in strings generated by general discrete- and continuous-time models: an algorithmic approach." Journal of Applied Probability 40, no. 4 (2003): 881–92. http://dx.doi.org/10.1239/jap/1067436088.

Full text

Abstract:

The formation of patterns from letters of a finite alphabet is considered. The strings of letters are generated by general discrete- and continuous-time models which embrace as particular cases all models considered in the literature. The letters of the alphabet are identified by the states of either discrete- or continuous-time semi-Markov processes. A new and unifying method is introduced for evaluation of the generating functions of both the intersite distance between occurrences of an arbitrary, but fixed, pattern and the waiting time until the first occurrence of that pattern. Our method

APA, Harvard, Vancouver, ISO, and other styles

41

Kołowrocki, Krzysztof, and Joanna Soszyńska. "Reliability and Safety of Complex Technical Systems an Overall Approach." Journal of Konbin 13, no. 1 (2010): 255–74. http://dx.doi.org/10.2478/v10040-008-0153-0.

Full text

Abstract:

Reliability and Safety of Complex Technical Systems an Overall ApproachThe paper is concerned with the identification, evaluation, prediction and optimization of reliability, availability and safety of technical systems related to their operation processes. The main emphasis is on multi-state systems composed of ageing components and changing during their operation their structures and their components reliability and safety characteristics. The convenient tools suggested for analyzing these complex technical systems are semi-markov modeling of the systems' operation processes and multistate a

APA, Harvard, Vancouver, ISO, and other styles

42

Postnikov, Ivan. "Application of the Methods for Comprehensive Reliability Analysis of District Heating Systems." Environmental and Climate Technologies 24, no. 3 (2020): 145–62. http://dx.doi.org/10.2478/rtuect-2020-0093.

Full text

Abstract:

AbstractThe general idea of the methodology for the comprehensive reliability analysis of district heating systems (DHS), developed earlier by the author of this paper, is a joint considering and modelling of each technological processes, including fuel supply to heat sources (HS), generation of heat energy by these HS and its distribution on district heating network (HN). For solving this problem different methods and models are applied: statistical testing method, Markov random processes, methods of the theory of hydraulic circuits, basic laws of district heating and heat transfer processes,

APA, Harvard, Vancouver, ISO, and other styles

43

Postnikov, Ivan. "Application of the Methods for Comprehensive Reliability Analysis of District Heating Systems." Environmental and Climate Technologies 24, no. 3 (2020): 145–62. http://dx.doi.org/10.2478/rtuect-2020-0093.

Full text

Abstract:

Abstract The general idea of the methodology for the comprehensive reliability analysis of district heating systems (DHS), developed earlier by the author of this paper, is a joint considering and modelling of each technological processes, including fuel supply to heat sources (HS), generation of heat energy by these HS and its distribution on district heating network (HN). For solving this problem different methods and models are applied: statistical testing method, Markov random processes, methods of the theory of hydraulic circuits, basic laws of district heating and heat transfer processes

APA, Harvard, Vancouver, ISO, and other styles

44

Li, Bin Quan. "The Numerical Control Device Reliability Based on Bayesian Approach." Applied Mechanics and Materials 556-562 (May 2014): 2515–18. http://dx.doi.org/10.4028/www.scientific.net/amm.556-562.2515.

Full text

Abstract:

The material selection and manufacturing processes of numerical control device were related with the reliability of system. Therefore, the reliability evaluation of it was significant. Numerical control system was, obviously, high-reliability product and the application of Bayesian theory has become an important means of its reliability assessment. The failure data of numerical control device obeys Weibull distribution which has complex forms. The posterior distribution becomes extremely complicated and the numerical integration which Bayesian computing depends on is not available. Markov chai

APA, Harvard, Vancouver, ISO, and other styles

45

Sun, Shih-Wan, Ping-Chen Chang, and Yi-Kuei Lin. "Confidence-Based Reliability Evaluation of Multistate Production Network with Process Improvement." International Journal of Reliability, Quality and Safety Engineering 22, no. 06 (2015): 1550028. http://dx.doi.org/10.1142/s021853931550028x.

Full text

Abstract:

Effectively assessing and improving production systems in different scenarios are critical for the management of production processes. This paper proposes a new approach that takes process improvement into consideration to evaluate system reliability. The system reliability is defined as the probability that the volume of input processed successfully through the individual workstations within a production system. This system reliability evaluation approach models the production system as a confidence-based multistate production network (CP-MPN). The discrete-time Markov chain is adopted to fea

APA, Harvard, Vancouver, ISO, and other styles

46

Gellert, Arpad, Stefan-Alexandru Precup, Bogdan-Constantin Pirvu, Ugo Fiore, Constantin-Bala Zamfirescu, and Francesco Palmieri. "An Empirical Evaluation of Prediction by Partial Matching in Assembly Assistance Systems." Applied Sciences 11, no. 7 (2021): 3278. http://dx.doi.org/10.3390/app11073278.

Full text

Abstract:

Industrial assistive systems result from a multidisciplinary effort that integrates IoT (and Industrial IoT), Cognetics, and Artificial Intelligence. This paper evaluates the Prediction by Partial Matching algorithm as a component of an assembly assistance system that supports factory workers, by providing choices for the next manufacturing step. The evaluation of the proposed method was performed on datasets collected within an experiment involving trainees and experienced workers. The goal is to find out which method best suits the datasets in order to be integrated afterwards into our conte

APA, Harvard, Vancouver, ISO, and other styles

47

Taghva, Alexander. "An Automated Navigation System for Deep Brain Stimulator Placement Using Hidden Markov Models." Operative Neurosurgery 66, suppl_1 (2010): ons—108—ons—117. http://dx.doi.org/10.1227/01.neu.0000365369.48392.e8.

Full text

Abstract:

Abstract Objective: Placement of deep brain stimulators (DBSs) currently involves the use of both image-based stereotaxy and intraoperative microelectrode recording (MER). Interpretations of MER data and integration with anatomical data are currently manual processes. Hidden Markov models (HMMs) are commonly used in signal processing, speech recognition, and a wide array of biologic applications. Methods: A 6-state HMM was designed and trained for evaluation in simulated surgery for subthalamic nucleus (STN) DBS. Results: The accuracy of identifying the correct brain location was 98.5%. Sensit

APA, Harvard, Vancouver, ISO, and other styles

48

Stennikov, V. A., and I. V. Postnikov. "Methods for Comprehensive Analysis of Heat Supply Reliability." International Journal of Energy Optimization and Engineering 2, no. 4 (2013): 120–42. http://dx.doi.org/10.4018/ijeoe.2013100107.

Full text

Abstract:

The paper deals with the problem of comprehensive analysis of heat supply reliability for consumers. It implies a quantitative assessment of the impact of all stages of heat energy production and distribution on heat supply reliability for each consumer of the heat supply system. A short review of existing methods for the analysis of fuel and heat supply reliability is presented that substantiates the key approaches to solving the problem of comprehensive analysis of heat supply reliability. A methodological approach is suggested, in which mathematical models and methods for nodal evaluation o

APA, Harvard, Vancouver, ISO, and other styles

49

Bordak, I. V., and A. P. Rosenko. "Development of a method for quantitative evaluation and prediction of information security with restricted access on the basis of Markov random processes." Proceedings of Tomsk State University of Control Systems and Radioelectronics 20, no. 4 (2017): 67–70. http://dx.doi.org/10.21293/1818-0442-2017-20-4-67-70.

Full text

APA, Harvard, Vancouver, ISO, and other styles

50

DISTEFANO, SALVATORE. "RELIABILITY EVALUATION OF WSN WITH DYNAMIC-DEPENDENT NODES." International Journal of Reliability, Quality and Safety Engineering 18, no. 06 (2011): 515–30. http://dx.doi.org/10.1142/s0218539311004226.

Full text

Abstract:

A wireless sensor network (WSN) is a distributed system composed of autonomous sensor nodes wireless connected and randomly scattered into a geographical area to cooperatively monitor physical or environmental conditions. Adequate techniques and strategies are required to manage a WSN in order it works properly, mainly focusing on its reliability. From the system reliability perspective, it is important to take into account that WSN nodes are usually battery-powered and the WSN reliability strongly depends on the power management at node level. Since standby power management policies are often

APA, Harvard, Vancouver, ISO, and other styles

We offer discounts on all premium plans for authors whose works are included in thematic literature selections. Contact us to get a unique promo code!