Issue
Int. J. Metrol. Qual. Eng.
Volume 12, 2021
Topical Issue - Advances in Metrology and Quality Engineering
Article Number 5
Number of page(s) 10
DOI https://doi.org/10.1051/ijmqe/2021003
Published online 17 March 2021

© J. Zhou et al., published by EDP Sciences, 2021

Licence Creative CommonsThis is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

1 Introduction

Due to the complexity of manufacturing systems and the limitations of detection technology, it is difficult to measure the accuracy of some product or process characteristics. For this kind of product or process characteristics, most enterprises use multilevel fuzzy quality characteristics for characterization. For example, in the machining process, when the comparison method is used to evaluate the work-piece with large surface roughness, three fuzzy conclusions are often given: very rough, general and good. Food is often described as very fresh, relatively fresh, not very fresh, and not fresh on four levels of fuzzy conclusion. To control this kind of characteristic, the traditional control chart first uses dichotomy to transform it into binary values of 0 or 1, and then uses attribute control charts (p, np, c and u charts) to control. There are three disadvantages:

  • When information is simply classifieds to “qualified” or “unqualified”, information is lost. Therefore, it is difficult to describe the variance or average value to achieve fine control of the characteristic when classifying the quality characteristics of a product or process into such binary categories.

  • The sample size requirements are particularly large. To make a p-chart or np-chart requires a subgroup sample size of 1 n p 5. If p = 2 % , then n 50 , at least 1000 samples are needed to make the control chart for analysis.

  • Insufficient detection capability.

At present, there is little research on fuzzy multilevel control charts. Hou et al. [13] proposed constructing a fuzzy function of product quality by quality expert score, drawing a control chart with a fuzzy function, and monitoring the fuzzy degree by using possibility measures and necessity measures. Faraz et al. [4] designed a fuzzy control chart with an alarm limit to control the process mean value. Shu et al. [5] designed a fuzzy X S control chart. Gubay and Kahraman [6,7] proposed using the percentage of sample fuzzy data points falling into the control limit to determine whether the process is in control. Wibawati et al. [8] proposed a kind of fuzzy binary Poisson (FBP) control chart based on C-chart. The above mentioned literature proposed good ideas for the treatment of fuzzy multilevel quality characteristics, but their common point is that the processing and evaluation of fuzzy multilevel quality characteristics can be realized by changing control limits of the control chart, which is not sufficient for solving the current situation of dichotomy quality control with multilevel fuzzy quality characteristics. In this paper, fuzzy theory is introduced. The “fitness criterion” of quality is expressed in the form of fuzzy sets. The real number set or the corresponding subset is taken as the universe of discourse. The fuzzy membership function and its semantic rules are used to quantitatively describe the gradual change level, and a new fuzzy control chart is designed. Through MATLAB simulation, the performance of the new design control chart is explained, and it is successfully applied to the control of the electric energy metre assembly process.

2 Characterization and calculation of fuzzy multilevel quality characteristic statistics

Assume that a quality feature is divided into i (i = 1, 2, … , m) levels; for example, the electric energy meter starting characteristic can be divided into several levels of fuzzy characteristics, such as {very good, good, common, bad, very bad}. According to the real number set or corresponding subset, as the domain fuzzy membership function and semantic rules are used to quantitatively describe the gradual level of the fuzzy quality characteristics, the fuzzy function is important in the decision-making process.

Definition 1: Let U the universe of discourse, and the fuzzy set A on U is represented by a U → [0, 1] function: u → μ A  (x). The function value μ A  (x) is called the membership degree U of x in A, and the function μ A  (x) is referred to as a membership function of A. All the fuzzy sets on U are called F (U) and referred as the fuzzy power set [9].

Definition 2: Let A ∈ F (U), take any one α ∈ [0, 1], denoted A α  = {u ∈ U/A (u) ≥ α}, 0 ≤ α ≤ 1, where A α is the α cut set of A, and α is the threshold or cut set level [10].

Theorem 1: (Fuzzy sets decomposition theorem) Provided A ∈ F (Z) ,   A = U α∈[0,1] αA α .

Theorem 2: (Expansion theorem) Set f is a mapping of normal sets from X to Y, which is denoted by fuzzy sets on X and expressed as A = {(a, F A  (a)) |a ∈ X}; then, the fuzzy set B on Y is obtained by extending f, and B = {(f (a) , F A  (a)) |f (a) ∈ Y}. The membership function of B is expressed as F B ( f ( a ) ) = { V f ( a ) = b F A ( a ) , b Y 0 , b Y (1)

Definition 3: Let R be a real number domain; if A ∈ F (R), its membership function can be expressed as equation (2). A ( u ) = { L ( b u b a ) , a u < b 1 , b u < c T ( u c d c ) , c u < d 0 , e l s e (2)

LR is called the fuzzy number, where [b, c] is the kernel value interval of fuzzy function A. L and R are continuously increasing or decreasing shape functions on the left and right, respectively, and satisfy the requirements of L (a) = L (d) = 0  and  L (b) = L (c) = 1. Then,  α (0 ≤ a ≤ 1) is the horizontal cut set and can be expressed as equation (3) A α = [ b ( b a ) L 1 ( α ) , c + ( d c ) T 1 ( α ) ] , α [ 0,1 ] (3)

The triangular membership function and trapezoidal membership function are the two most common fuzzy numbers. As shown in Figure 1, the triangular membership function is represented as A = (a, b, c), and the trapezoidal membership function is expressed as A =   (a ′, b ′, c ′, d ′).

Then, α horizontal truncation sets are: A α = [ a + ( b a ) α , c ( c b ) α ] (4) A α = [ a ' + ( b ' a ' ) α , d ' ( d ' c ' ) α ] (5)

A =   (a ′ , b ′ , c ′ , d ′) is a trapezoidal membership function. Then: M w ( A ) = 1 2 ( M w ( A ) + M w + ( A ) ) (6)

where: M w ( A ) = b ( b a ) 0 1 L 1 ( α ) d α (7) M w + ( A ) = c + ( d c ) 0 1 T 1 ( α ) d α (8)

Let a fuzzy quality characteristic expressed as multiple levels {good, general, bad, very bad}; each term set corresponds to a fuzzy function μ (x). Fuzzy functions are expressed by trapezoidal membership functions. If other types of fuzzy functions are selected, the processing methods are similar.

Fuzzy mode f mode, fuzzy interval value f mr α of cut set α, fuzzy median f med, and fuzzy mean value f avg are used to characterize the concentration degree of the fuzzy data. Their interrelationships are shown in Figure 2. f mode = { x | μ F ( x ) = 1 } , x F (9)

When the ambiguity functions as a single peak, the mode is unique.

Definition 3: Let F as a fuzzy set on the domain; then, the α horizontal truncation set of F is denoted as F α , and F α  = {x|μ F  (x) ≥ α}. Assume a α and c α are both ends of F α ; for a α = M i n { F α } , c α = M a x { F α } , then f mr α = 1 2 ( a α + c α ) .

The α takes different values, and some common sets can be obtained by original fuzzy set A. The smaller α is, the lower the number of classes is, and the more elements A α contains; the larger α is, the more classes are separated, and the fewer elements A α contains. In other words, a series of classifications are obtained by taking different values of α. a f med μ F ( x ) d x = f med c μ F ( x ) d x = 1 2 a c μ F ( x ) d x (10) f avg = x = 0 1 x μ F ( x ) d x x = 0 1 μ F ( x ) d x (11)

The fuzzy representative value methods proposed in the existing research can be summarized into three categories:

  • Emphasizing the information of a section set of fuzzy data, such as fuzzy mode f mode and α cut set fuzzy interval value f mr α ;

  • Focusing on the information equal to or higher than α cut set, such as fuzzy median f med;

  • The weights of all α cut sets are the same, such as fuzzy average f avg.

When fuzzy data are transformed into fuzzy representative values, the problem of data information loss inevitably occurs. I. Kaya et al. [1113] discussed the problem of information loss in the process of transforming fuzzy data into representative numerical values. The above four fuzzy representative values may lead to the loss of some important sample data information, which is due to the different information contained in different α level cut sets not being fully and accurately utilized.

thumbnail Fig. 1

Triangular membership function and trapezoidal membership function.

thumbnail Fig. 2

Correlation between fuzzy data concentration degree statistics.

3 Design of the fuzzy control chart

3.1 Design of fuzzy control limits

Normally, data are represented as trapezoid membership function (a, b, c, d) or triangular membership function (a, b, c). Triangular membership function is a special case of trapezoid membership function c = d. This paper takes trapezoid membership function as an example to study the control chart design under different fuzzy statistics.

When fuzzy samples are represented as (a i , b i , c i , d i ), samples of m were taken on the centre line of the fuzzy control chart: C L = ( i = 1 m a i m , i = 1 m b i m , i = 1 m c i m , i = 1 m d i m ) = ( a , b , c , d ) (12)

The control centreline is a fuzzy set, which can be expressed by the fuzzy majority in the closed interval of [ b , c ] . Then, the centre line and upper and lower control limits of the fuzzy control chart are as follows: C L = ( a , b , c , d ) = ( C L 1 , C L 2 , C L 3 , C L 4 ) (13) U C L = ( a + 3 a , b + 3 b , c + 3 c , d + 3 d ) (14) L C L = ( a 3 d , b 3 c , c 3 b , d 3 a ) (15)

The control limits of fuzzy control charts based on fuzzy interval values of α cut sets (FCC-Midrange) and fuzzy control charts based on the fuzzy median of α cut sets (FCC-Median) can be expressed as (Fig. 3): C L α = ( a α , b , c , d α ) = ( C L 1 α , C L 2 , C L 3 , C L 4 α ) (16) L C L α = C L α 3 C L α = ( a α , b , c , d α ) 3 ( a α , b , c , d α ) = ( a α 3 d α , b 3 c , c 3 b , d α 3 a α ) = ( L C L 1 α , L C L 2 , L C L 3 ,L C L 4 α ) (17) U C L α = C L α + 3 C L α = ( a α , b , c , d α ) + 3 ( a α , b , c , d α ) = ( a α + 3 d α , b + 3 c , c + 3 b , d α + 3 a α ) = ( U C L 1 α , U C L 2 , U C L 3 , U C L 4 α ) (18)

The fuzzy mode satisfies f mode = {x |μ F  (x) = 1}, ∀x ∈ F. When membership functions are unimodal, this value is unique.

The fuzzy number of sample j is as follows: S mod , j = [ b j , c j ] (19)

The control centre line and upper and lower control limits of FCC-Mode are as follows: C L mod = ( C L 2 , C L 3 ) (20) U C L mod = C L mod + 3 C L mod (21) U C L mod = ( C L 2 + 3 C L 2 , C L 3 + 3 C L 3 ) (22) L C L mod = C L mod 3 C L mod (23) L C L mod = ( C L 2 3 C L 2 , C L 3 3 C L 3 ) (24)

Control limits of the fuzzy control charts are shown in Figure 4.

thumbnail Fig. 3

Control limits of the fuzzy control charts.

thumbnail Fig. 4

Relationship between the direct fuzzy statistics and the control limit.

3.2 Design of the direct fuzzy control chart (DFCC)

Direct Fuzzy Control Charts are referred as DFCC (Direct Fuzzy Control Chart). FCC-Mode control chart, FCC-Midrange control chart and FCC-Median control chart all convert fuzzy data into representative values. In the conversion process, data information is inevitably lost. The basic principle of the control chart is hypothesis testing and concluding whether uncontrolled or controlled are based on sample information. Therefore, the most scientific conclusion about controlled or uncontrolled should be at a certain significance level.

Based on this, this paper proposes a Direct Fuzzy Control Chart method. This method no longer converts the fuzzy information of samples into representative values, so it avoids the problem of information loss in the process of data transformation. The DFCC control chart determines the probability of the process being controlled or out of control according to the percentage of the sample statistic area falling into the upper and lower control limits. When the area of sample statistics falls into the fuzzy control limit, the process is in control; when the area of sample statistics exceeds the fuzzy control limit, the process is out of control; when the area of sample statistics exceeds the fuzzy control limit, that is, the proportion of area β j  > β, the process is in control; otherwise, the process is relatively out of control. Here, β can be given according to the actual needs.

The area within the control limit is determined by the control limit and the relationship between samples. Figure 4 shows the calculation method of the area of fuzzy samples falling within the control limit. The area of the sample falling within the control limit is recorded as A I N j . β j = A I N j S j (25)

The area of the sample is divided into the following situations: Type 1: β 1 = 0 (26) Type 2: A I N 2 = 1 2 × d 2 L C L 1 L C L 2 L C L 1 + d 2 c 2 × ( d 2 L C L 1 ) (27) A I N 2 = 1 2 × ( d 2 L C L 1 ) 2 ( L C L 2 L C L 1 + d 2 c 2 ) (28) β 2 = A I N 2 S 2 = 1 2 × ( d 2 L C L 1 ) 2 ( L C L 2 L C L 1 + d 2 c 2 ) 1 2 × ( c 2 b 2 + d 2 a 2 ) (29) β 2 = ( d 2 L C L 1 ) 2 ( c 2 b 2 + d 2 a 2 ) × ( L C L 2 L C L 1 + d 2 c 2 ) (30) Type 3: β 3 = A I N 3 S 3 = 1 ( L C L 2 b 3 ) 2 ( a 3 L C L 1 + L C L 2 b 3 ) ( c 3 b 3 + d 3 a 3 ) (31) Type 4: β 4 = 1 (32) Type 5: β 5 = U C L 3 b 5 + U C L 4 a 5 d 5 a 5 + c 5 b 5 (33) Type 6: β 6 = ( U C L 4 a 6 ) 2 ( d 6 a 6 + c 6 b 6 ) ( b 6 U C L 3 + U C L 4 a 6 ) (34) Type 7: β 7 = 0 (35)

The process control determination is shown as follows:

  • β j  = 1, the process is in control;

  • β j  = 0, the process is out of control;

  • β j  ≥ β, the process is relatively in control;

  • β j  ≤ β, the process is relatively out of control.

4 Simulation analysis of fuzzy single variable control chart performance

This section shows the performance of the control chart by MATLAB simulation. The first 25 sets of data in Section 5 are used to estimate the mean value of the population. Assuming the process mean under the controlled state: [ u a , u b , u c , u d ] = [ 38.48 , 42.14 , 44.52 , 49.57 ]

When a, b, c, d obeys a Poisson distribution, the process variance is: [ σ a 2 , σ b 2 , σ c 2 , σ d 2 ] = [ 38.48 , 42.14 , 44.52 , 49.57 ]

First, 25 groups of data from the Poisson distribution are randomly generated by MATLAB and recorded as follows: P (38.48), P (42.14), P (44.52), P (49.57). The first 25 groups of data are process stable data. The control limits of different types of control charts are calculated with 25 groups of randomly generated numbers. Then, random data with a sample mean offset ξ are generated randomly, and the simulation process is out of control. The statistics of the data are calculated, and the value of i when the No. i Sample point gives an alarm is output. The above process is repeated 5000 times and the average value of i is calculated as n = j = 1 5000 i 5000 (36)

The sensitivity of the control chart can be explained by the size of n. The simulation output results are shown in Tables 15.

Tables 15 show the following:

  • When the parameter is constant, DFCC control chart sensitivity is highest, the sensitivity of FCC-Mode control chart is second, and the sensitivity of FCC-Median control chart is lowest. The sensitivities of the four control charts increase with increasing migration volume.

  • The sensitivity of FCC-Mode control chart increases with increasing value, but this effect is insignificant.

  • When the offset ξ is constant, the sensitivity of FCC-Midrange control chart decreases with increasing value, but this effect is significant. It can be seen that the control diagram of FCC-Midrange is insensitive to small offsets ξ and cannot recognize small offsets ξ.

  • When the offset ξ is constant, the sensitivity of FCC-Median control chart increases with increasing value, but this effect is general. FCC-Median is insensitive to small offsets ξ and cannot recognize small offsets ξ.

  • When the offset ξ is constant, the sensitivity of DFCC control chart increases with increasing value, but this effect is general.

Table 1

α = 0.5,  β = 0.5, the relationship between n and ξ.

Table 2

The relationship between n and ξ when β is different (FCC-Mode control chart).

Table 3

The relationship between n and ξ when α is different (FCC-Midrange control chart).

Table 4

The relationship between n and ξ when α is different (FCC-Media control chart).

Table 5

The relationship between n and ξ When β is different (DFCC control chart).

5 Case study

The accurate measurement of energy metres is very important for production safety, maintenance, and supply with the legitimate interests of the three areas. The manufacturing process of a single-phase energy metre produced by an enterprise is shown in Figure 5. Assembly is the key process that affects the accuracy of energy metre measurements.

Key process parameters for the output assembly step: assembly clearance between the voltage and current cartridge assembly; the assembly gap has an important influence on the accuracy of the measurement. The component drawing after assembly is shown in Figure 6. The size specification after the assembly procedure is shown in Figure 7.

In the process design, the clearance gauge is a special clearance plug gauge. When the clearance plug gauge is used for inspection, the influence of tightness, measuring position and elastic clearance after assembly is considered, and the inspection results are expressed as linguistic data. The samples from energy metres are taken every 3 hours to control number of nonconformities. Because it is still in the trial production stage, the number of nonconformities may be large. The data collected from 21 subgroups are linguistic, and the linguistic expressions are represented by fuzzy numbers.

Table 6 shows the statistics and calculation table of unqualified numbers after fuzzy judgement.

The results of designing different fuzzy control charts by MATLAB software are shown in Figures 811.

  • Fuzzy control chart based on the fuzzy mode.

  • Fuzzy control chart based on the fuzzy interval value of the α cut set.

  • Fuzzy control chart based on the fuzzy median of the α cut set.

  • Direct Fuzzy Control Chart.

In Figures 811, the results shown in Table 7 are obtained when β is 0.8. Based on the judgement result of Table 7, we can draw the following conclusions:

  • The method of transforming fuzzy data into representative statistics and DFCC Control Chart is more sensitive than an attribute control chart, which is directly transformed into 0 or 1, and further utilizes different intermediate state information, so it has better sensitivity.

  • Because different statistics represent different data characteristics, the control charts designed based on different statistics have different effects. For example, the judgement results of FCC-Mode control chart, FCC-Midrange control chart and FCC-Median control chart at sample No. 3, sample No. 4, sample No. 10 and sample No. 11 are different, which further verifies the information loss problem of transforming fuzzy data into representative statistics; however, the converted statistics with different representativeness are easier to understand in practical use.

  • The sensitivity of DFCC control chart is highest, FCC-Mode control chart is second, and FCC-Median control chart is lowest, which is consistent with the simulation analysis conclusion.

  • DFCC control chart is judged based on a certain level and consistent with hypothesis testing. Different requirements can be selected according to different β in practice to make results more scientific.

thumbnail Fig. 5

Process flow diagram.

thumbnail Fig. 6

Component drawing after assembly.

thumbnail Fig. 7

Dimension requirement diagram after assembly.

Table 6

The number of unqualified statistical measurement gaps.

thumbnail Fig. 8

FCC-Mode control chart based on the fuzzy mode.

thumbnail Fig. 9

Fuzzy control chart based on the fuzzy interval value of the α cut set.

thumbnail Fig. 10

Fuzzy control chart based on the fuzzy median of the α cut set.

thumbnail Fig. 11

DFCC fuzzy control chart.

Table 7

Judgement results of different fuzzy control charts.

6 Conclusions

With the help of fuzzy theory, control charts for fuzzy quality characteristics are designed. The “applicability” standard of quality is expressed in the form of fuzzy sets. Taking the real number set or corresponding subset as the universe of discourse, the fuzzy membership function and its semantic rules are used to quantitatively describe the gradual change level of product or process characteristics. The fuzzy quality characteristics are transformed into typical statistics, and the characteristics of different statistics are analysed. On this basis, a fuzzy control chart is designed based on the Poisson distribution. This control chart uses the area ratio falling within the control limit to judge the relative controlled and relatively uncontrollable problem and solves the problem of low sensitivity when the fuzzy quality characteristic is applied in statistical process control technology.

Fuzzy control charts algorithm is designed by MATLAB programming.

The sensitivity of the control chart is analysed by MATLAB simulation. The sensitivity of DFCC control chart is highest, FCC-Mode control chart is second, and FCC-Median control chart is lowest.

Through the example of the energy metre assembly, the scientificity and effectiveness of the proposed method are further explained.

References

  1. S.H. Hou, S.H. Tong, Uncertain quality control chart and model selection based on fuzzy numbers, Comput. Integr. Manuf. Syst. 18 , 415–421 (2012) [Google Scholar]
  2. S.H. Hou, H.M. Zhu, Control chart abnormal pattern recognition based on Bayesian theory, Stat. Decis. 478 , 18–21 (2017) [Google Scholar]
  3. S.H. Hou, H.M. Zhu, Research on control chart of uncertain quality characteristics based on Fuzzy Statistics, Stat. Decis. 460 , 24–28 (2016) [Google Scholar]
  4. A. Faraz, M.B. Moghadam, Fuzzy control charts a better alternative for Shewhart average chart, Qual. Quant. 41 , 375–385 (2007) [Google Scholar]
  5. M.H. Shu, D.C. Dang, T.L. Nguyen, Fuzzy x and s control charts: a data-adaptability and human-acceptance approach, Complexity. 2017, 1–17 (2017) [Google Scholar]
  6. M. Gulbay, C. Kahraman, Fuzzy process control with intelligent data mining, Stud. Comput. Intell. 5 , 315–336 (2005) [Google Scholar]
  7. M. Gulbay, C. Kahraman, An alternative approach to fuzzy control charts: direct fuzzy approach, Inf. Sci. 177 , 1463–1480 (2007) [Google Scholar]
  8. W. Wibawati, M. Muhammad, P. Purhadi et al., A fuzzy bivariate poisson control chart, Symmetry-Basel 12 , 1–14 (2020) [Google Scholar]
  9. G. Shahram, N. Kazem, N. Rassoul, Developing a multivariate approach to monitor fuzzy quality profiles, Qual. Quant. 48 , 817–836 (2014) [Google Scholar]
  10. A. Hossein, N. Rassoul, Fuzzy multivariate exponentially weighted moving average control chart, Int. J. Adv. Technol. 48 , 1001–1007 (2010) [Google Scholar]
  11. I. Kaya, I. Colak, A literature review on fuzzy process capability analysis, J. Test. Eval. 48 , 3963–3985 (2020) [Google Scholar]
  12. M. Ahmadabadi, Y. Farjami, M. Moghadam, A process control method based on five-parameter generalized lambda distribution, Qual. Quant. 46 , 1097–1111 (2012) [Google Scholar]
  13. I. Kaya, A. Turgut, Design of variable control charts based on type-2 fuzzy sets with a real case study, Soft Comput. 25 , 613–633 (2021) [Google Scholar]

Cite this article as: Juan Zhou, Yuhang Huang, Zonghuan Wu, Research on fuzzy control charts for fuzzy multilevel quality characteristics, Int. J. Metrol. Qual. Eng. 12, 5 (2021)

All Tables

Table 1

α = 0.5,  β = 0.5, the relationship between n and ξ.

Table 2

The relationship between n and ξ when β is different (FCC-Mode control chart).

Table 3

The relationship between n and ξ when α is different (FCC-Midrange control chart).

Table 4

The relationship between n and ξ when α is different (FCC-Media control chart).

Table 5

The relationship between n and ξ When β is different (DFCC control chart).

Table 6

The number of unqualified statistical measurement gaps.

Table 7

Judgement results of different fuzzy control charts.

All Figures

thumbnail Fig. 1

Triangular membership function and trapezoidal membership function.

In the text
thumbnail Fig. 2

Correlation between fuzzy data concentration degree statistics.

In the text
thumbnail Fig. 3

Control limits of the fuzzy control charts.

In the text
thumbnail Fig. 4

Relationship between the direct fuzzy statistics and the control limit.

In the text
thumbnail Fig. 5

Process flow diagram.

In the text
thumbnail Fig. 6

Component drawing after assembly.

In the text
thumbnail Fig. 7

Dimension requirement diagram after assembly.

In the text
thumbnail Fig. 8

FCC-Mode control chart based on the fuzzy mode.

In the text
thumbnail Fig. 9

Fuzzy control chart based on the fuzzy interval value of the α cut set.

In the text
thumbnail Fig. 10

Fuzzy control chart based on the fuzzy median of the α cut set.

In the text
thumbnail Fig. 11

DFCC fuzzy control chart.

In the text

Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.

Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.

Initial download of the metrics may take a while.