HKU POP releases popularity figures of top 5 Hong Kong disciplinary forces and the PLA Hong Kong GarrisonBack

 
Press Release on December 9, 2014

| Special Announcement | Abstract| Background | Latest Figures |Commentary | Future Release (Tentative) |
| Detailed Findings (People's Satisfaction with the Discipilnary Force/People's Satisfaction with the Performance of the People's Liberation Army Hong Kong Garrison /People's Satisfaction with the Performance of the Hong Kong Police Force) |


Special Announcement

To facilitate academic study and rational discussion, The Public Opinion Programme (POP) of The University of Hong Kong has already released for public examination some time ago via the “HKU POP Site” (http://hkupop.pori.hk) the raw data of all 60 regular rating surveys of CE CY Leung, as well as the 181 regular rating surveys of former CE Donald Tsang and 239 regular rating surveys of former CE CH Tung, along with related demographics of respondents. Please follow normal academic standards when using or citing such data.



Abstract

POP conducted a double stage survey on people’s satisfaction with the top 5 disciplinary forces in late November 2014 by means of random telephone surveys conducted by real interviewers. The survey shows that compared to five months ago, the popularity ratings and net satisfaction rates of most disciplinary forces have increased except for Hong Kong Police Force. In terms of relative rankings of ratings, among the “top 5” Hong Kong disciplinary forces, Hong Kong Fire Services Department stays at the top. Hong Kong Immigration Department and Hong Kong Customs and Excise Department swap positions with each other to rank second and third. Civil Aid Service and Hong Kong Police Force stay at the fourth and fifth positions. In terms of absolute ratings, all “top 5” disciplinary forces get more than 60 marks, four of which are above 70, which is very good. In terms of net satisfaction, Hong Kong Fire Services Department registers positive 93 percentage points, and is definitely the most popular disciplinary force in Hong Kong. However, that of Hong Kong Police Force registers positive 29 percentage points, which is record low since July 1997. Meanwhile, both the popularity rating and net satisfaction rate of the PLA Hong Kong Garrison have slightly increased compared to the last survey, now at 63.1 marks and positive 35 percentage points respectively. The popularity drop of the Police is obviously due to the recent Occupy Movement, which has caught the Police in between different political forces. To overcome this problem, the Police will have to strengthen its professionalism in executing its duties, and also its affection and care for the society. It should not lean towards any political force, nor resort to improper means, just let political problems be resolved in political ways. As a methodological note, it should be noted that our list of “top 5” only includes disciplinary forces best known to the public, ranked according to their satisfaction ratings. Some of other disciplinary forces may well have very high or low satisfaction ratings, but because they are not the most well-known forces, they do not appear on the list by design. The maximum sampling error of all percentage figures is +/-4 percentage points, while that of rating figures is below +/-2.8 marks at 95% confidence level, and the sampling error of net values need another calculation. The response rate of the satisfaction survey is 67%.

Points to note:

[1] The address of the “HKU POP SITE” is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of the first stage naming survey on the disciplinary forces is 1,022 successful interviews, not 1,022 x 67.5% response rate, while that of the second stage satisfaction survey is 1,012 successful interviews, not 1,012 x 66.6% response rate. In the past, many media made this mistake.
[3]The maximum sampling error of percentages is +/-4 percentage points at 95% confidence level, while the sampling error of rating figure needs another calculation. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state “sampling error of rating not more than +/-2.8, that of percentages not more than +/-4%, and that of net values not more than +/-7% at 95% confidence level”. Because POP introduced “rim weighting” in 2014, during the transition period, whether changes in various figures are beyond sampling errors are based on tests using the same weighting methods. That is, to test whether the first set of figures collected in 2014 is significantly different from that of the previous survey, both sets of data are rim weighted before testing, instead of using simple computation of the published figures.
[4] Because of sampling errors in conducting the survey(s) and the rounding procedures in processing the data, the figures cannot be too precise, and the totals may not be completely accurate. Therefore, when quoting percentages of the survey(s), journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses “computerized random telephone survey” to camouflage its IVS operation, it should be considered unprofessional.



Background

Since its establishment in 1991, POP has been conducting different types of opinion studies on social and political issues. Shortly after the handover of Hong Kong in July 1997, POP began our regular surveys on people’s satisfaction with the performance of the Hong Kong Police Force and PLA Hong Kong Garrison. At the beginning, the surveys were conducted once every month. Then in September 2000 the frequency was changed to once every two months. Since October 2003, the surveys have been conducted once every three months to cope with the changing social conditions until December 2011 when the frequency was changed to once every six months. In 2012, as Hong Kong marks its 15th anniversary of the handover, POP again revised the design of this survey series, by splitting the survey into two stages. A naming survey of people’s most familiar disciplinary forces in Hong Kong would be conducted first, then a survey on people’s satisfaction with their top 6 most familiar disciplinary forces as well as the PLA Hong Kong Garrison would be conducted according to the results of the naming survey. All findings of these surveys are published regularly at the HKU POP Site.



Latest Figures

POP today releases on schedule via the POP Site the latest survey results. From 2014, POP enhanced the previous simple weighting method based on age and gender distribution to “rim weighting” based on age, gender and education (highest level attended) distribution. The latest figures released today have been rim-weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in 2014 mid-year and the educational attainment (highest level attended) distribution collected in the 2011 Census. Herewith the contact information for the latest survey:

 

Date of survey

Overall sample size

Response rate

Maximum sampling error of percentages/ratings[6]

17-19/11/2014 (First stage naming survey)

1,022

67.5%

+/-3%

25-28/11/2014 (Second stage satisfaction survey)

1,012

66.6%

+/-3% / +/-2.8

[6] Calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.

 

The research design of our “Top 5 Hong Kong disciplinary forces” satisfaction survey is similar to that of various “Top 10” series conducted by POP, it is explained in detail under “Survey Method” in our web page. The Hong Kong disciplinary forces listed in our latest survey are those which obtained highest unprompted mentions in our first stage naming survey conducted in mid-November. In that survey, respondents could name, unaided, up to 5 Hong Kong disciplinary forces which they knew best, with the following results:

 

Date of survey

22-29/11/2012

20-25/6/2013

22-28/11/2013

16-19/6/2014

17-19/11/2014

Latest change

Sample base[7]

1,013

1,047

1,030

1,018

1,022

--

Overall response rate

64.8%

66.9%

66.3%

68.4%

67.5%

--

Finding / Error

Finding

Finding

Finding

Finding

Finding & error[8]

--

Hong Kong Police Force

86%{1}[9]

78%{1}[9]

82%{1}[9]

82%{1}

84+/-3%{1}

+2%

Hong Kong Fire Services Department

75%{2}[9]

66%{2}[9]

69%{2}

68%{2}

73+/-3%{2}

+5%[9]

Hong Kong Customs and Excise Department

53%{3}

48%{3}[9]

51%{3}

43%{3}

45+/-4%{3}

+2%

Hong Kong Correctional Services Department

34%{5}

31%{5}

30%{5}

35%{4}[9]

42+/-4%{4}

+7%[9]

Hong Kong Immigration Department

43%{4}[9]

34%{4}[9]

38%{4}

33%{5}

36+/-4%{5}

+3%

Civil Aid Service

15%{6}[9]

9% [9] [10]

9%[11]

12%{6}

13+/-3%{6}

+1%

Government Flying Service

9%

7%

6%

6%

11+/-2%

+5%[9]

Auxiliary Medical Service

12%

8%

9%{6}[11]

9%[12]

9+/-2%

--

Independent Commission Against Corruption

10%

9%{6}[10]

7%

9%[12]

6+/-2%

-3%[9]

Don’t know / hard to say

12%[9]

18%[9]

15%

15%

12+/-3%

-3%

[7] The sub-sample size in the survey conducted in November 2012 was 684, June 2013 was 673, November 2013 was 602, June 2014 was 542 while that in November 2014 was 647.
[8] All error figures in the table are calculated at 95% confidence level. “95% confidence level”, meaning that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state “sampling error of percentages not more than +/-4% at 95% confidence level” when quoting the above figures. Numbers in square brackets { } indicates rankings in our naming survey.
[9] Such changes have gone beyond the sampling errors at the 95% confidence level under the same weighting method, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[10] The percentages of respondents who could name Independent Commission Against Corruption and Civil Aid Service were 9.3% and 8.6%, so Independent Commission Against Corruption ranked the 6th, while Civil Aid Service was not short-listed.
[11] The percentages of respondents who could name Auxiliary Medical Service and Civil Aid Service were 9.0% and 8.9%, so Auxiliary Medical Service ranked the 6th, while Civil Aid Service was not short-listed.
[12] The percentages of respondents who could name Independent Commission Against Corruption and Auxiliary Medical Service were 9.4% and 8.6%, both of them were not short-listed.

 

The naming survey conducted in mid-November showed that Hong Kong Police Force was named most frequently with a recognition rate of 84%. Hong Kong Fire Services Department, Hong Kong Customs and Excise Department, Hong Kong Correctional Services Department, Hong Kong Immigration Department and Civil Aid Service with recognition rate of 73%, 45%, 42%, 36% and 13%, ranked the 2nd to 6th. However, 12% could not name any disciplinary forces.

 

The 6 disciplinary forces which were named most frequently then entered into the second stage satisfaction survey. At the second stage satisfaction survey conducted in late November, respondents were asked to rate each of the 6 short-listed disciplinary forces in turn using a 0-100 scale, with 0 meaning very dissatisfied, 100 meaning very satisfied, and 50 meaning half-half. After calculation, the bottom disciplinary force in terms of recognition rate was dropped; the remaining 5 were then ranked according to their satisfaction ratings, then by satisfaction rates if they are the same, giving the following results for “top 5 disciplinary forces”:

 

Date of survey

4-12/12/2012

26/6-2/7/2013

29/11-3/12/2013

25-30/6/2014

25-28/11/2014

Latest change

Sample base

635-685

578-616

568-602

552-584

522-545

--

Overall response rate

66.9%

67.8%

70.7%

67.1%

66.6%

--

Finding/ Recognition rate

Finding

Finding

Finding

Finding

Finding and error[13]

Recog %

--

Satisfaction rating of Hong Kong Fire Services Department

79.8{1}

78.7{1}

77.3{1}[15]

77.0{1}

80.2+/-1.3{1}

100.0%

+3.2[15]

Satisfaction rate of Hong Kong Fire Services Department[14]

90%

89%

91%

90%

94+/-2%

 

+4%[15]

Dissatisfaction rate of Hong Kong Fire Services Department[14]

1%

2%

1%

1%

1+/-1%

 

--

Net satisfaction rate

89%

87%

90%

88%

93+/-2%

 

+5%[15]

Mean value [14]

4.3+/-0.1
(Base=637)

4.2+/-0.1
(Base=597)

4.2+/-0.1
(Base=567)

4.2+/-0.1
(Base=533)

4.4+/-0.1
(Base=541)

 

+0.2[15]

Satisfaction rating of Hong Kong Immigration Department

71.9{3}

73.5{3}[15]

71.4{4}[15]

70.6{3}

73.3+/-1.5{2}

97.8%

+2.7[15]

Satisfaction rate of Hong Kong Immigration Department[14]

75%

79%[15]

84%[15]

78%[15]

79+/-4%

 

+1%

Dissatisfaction rate of Hong Kong Immigration Department[14]

4%

4%

5%

3%

5+/-2%

 

+2%

Net satisfaction rate

71%

75%

79%

75%

74+/-5%

 

-1%

Mean value[14]

3.9+/-0.1
(Base=619)

4.0+/-0.1
(Base=558)

3.9+/-0.1
(Base=568)

3.9+/-0.1
(Base=545)

4.0+/-0.1
(Base=516)

 

+0.1

Satisfaction rating of Hong Kong Customs and Excise Department

72.3{2}

74.4{2}[15]

71.9{3}[15]

71.3{2}

73.0+/-1.5{3}

93.2%

+1.7[15]

Satisfaction rate of Hong Kong Customs and Excise Department[14]

77%

77%

81%[15]

74%[15]

79+/-4%

 

+5%[15]

Dissatisfaction rate of Hong Kong Customs and Excise Department [14]

4%[15]

3%

3%

4%

3+/-2%

 

-1%

Net satisfaction rate

73%

74%

78%

71%[15]

76+/-4%

 

+5%[15]

Mean value [14]

3.9+/-0.1
(Base=604)

4.0+/-0.1
(Base=551)

4.0+/-0.1
(Base=548)

3.9+/-0.1
(Base=558)

4.0+/-0.1
(Base=498)

 

+0.1

Satisfaction rating of Civil Aid Service

71.2{5}

--

--

69.7{4}

71.6+/-1.6{4}

76.8%

+1.9[15]

Satisfaction rate of Civil Aid Service[14]

58%

--

--

58%

64+/-4%

 

+6%[15]

Dissatisfaction rate of Civil Aid Service[14]

1%

--

--

1%

1+/-1%

 

--

Net satisfaction rate

57%

--

--

57%

63+/-4%

 

+6%[15]

Mean value [14]

3.9+/-0.1
(Base=509)

--

--

3.9+/-0.1
(Base=431)

4.0+/-0.1
(Base=428)

 

+0.1

Satisfaction rating of Hong Kong Police Force

67.0{4}[15]

66.4{4}

63.7{5}[15]

62.3{5}

61.0+/-2.4{5}

99.1%

-1.3

Satisfaction rate of Hong Kong Police Force [14]

66%[15]

59%[15]

64%[15]

56%[15]

56+/-4%

 

--

Dissatisfaction rate of Hong Kong Police Force [14]

9%[15]

13%[15]

13%

19%[15]

27+/-4%

 

+8%[15]

Net satisfaction rate

57%[15]

46%[15]

51%

36%[15]

29+/-7%

 

-7%

Mean value [14]

3.7+/-0.1[15]
(Base=626)

3.6+/-0.1
(Base=569)

3.6+/-0.1
(Base=567)

3.4+/-0.1[15]
(Base=567)

3.4+/-0.1
(Base=530)

 

--

Satisfaction rating of Hong Kong Correctional Services Department

67.7{6}

69.0{6}

67.7{6}

68.0{6}

71.1+/-1.7{6}

74.8%

+3.1[15]

Satisfaction rate of Hong Kong Correctional Services Department [14]

52%

56%

58%

57%

61+/-4%

 

+4%

Dissatisfaction rate of Hong Kong Correctional Services Department [14]

3%

4%

4%

2%

1+/-1%

 

-1%

Net satisfaction rate

49%

52%

54%

55%

60+/-4%

 

+5%[15]

Mean value [14]

3.7+/-0.1
(Base=495)

3.8+/-0.1
(Base=469)

3.8+/-0.1
(Base=469)

3.8+/-0.1
(Base=430)

3.9+/-0.1
(Base=433)

 

+0.1

Satisfaction rating of Auxiliary Medical Service

--

--

75.1{2}

--

--

--

--

Satisfaction rate of Auxiliary Medical Service[14]

--

--

79%

--

--

 

--

Dissatisfaction rate of Auxiliary Medical Service[14]

--

--

2%

--

--

 

--

Net satisfaction rate

--

--

78%

--

--

 

--

Mean value [14]

--

--

4.1+/-0.1
(Base=507)

--

--

 

--

Satisfaction rating of Independent Commission Against Corruption

--

63.7{5}

--

--

--

--

--

Satisfaction rate of Independent Commission Against Corruption[14]

--

47%

--

--

--

 

--

Dissatisfaction rate of Independent Commission Against Corruption[14]

--

22%

--

--

--

 

--

Net satisfaction rate

--

25%

--

--

--

 

--

Mean value[14]

--

3.3+/-0.1
(Base=544)

--

--

--

 

--

[13] All error figures in the table are calculated at 95% confidence level. “95% confidence level”, meaning that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state “sampling error of ratings not more than +/-2.4 marks, that of percentages not more than +/-4%, and that of net values not more than +/-7% at 95% confidence level” when quoting the above figures. Numbers in square brackets { } indicate the rankings.
[14] Collapsed from a 5-point scale. The mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of positive level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[15] Such changes have gone beyond the sampling errors at the 95% confidence level under the same weighting method, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

 

The satisfaction survey conducted in late November showed that Hong Kong Fire Services Department ranked first, attaining 80.2 marks, 94% of the citizens interviewed were satisfied with its performance, 1% were not satisfied, with a net satisfaction rate of positive 93 percentage points and a mean value of 4.4 marks, which is between “quite satisfied” and “very satisfied” in general. Hong Kong Immigration Department ranked the second with 73.3 marks, 79% were satisfied with its performance. Its net satisfaction rate stands at positive 74 percentage points, with a mean value of 4.0 marks, meaning “quite satisfied”. The 3rd and 4th ranks went to Hong Kong Customs and Excise Department and Civil Aid Service, with satisfaction ratings at 73.0 and 71.6 marks respectively. Their corresponding satisfaction rates obtained were 79% and 64%, their net satisfaction stand at positive 76 and 63 percentage points respectively, while their respective mean values registered were both 4.0, meaning “quite satisfied”. Meanwhile, Hong Kong Police Force ranked 5th, with a satisfaction rating at 61.0 marks, satisfaction rate at 56%, net satisfaction at positive 29 percentage points, and mean value at 3.4 marks, meaning between “half-half” and “quite satisfied” in general. In this survey, Hong Kong Correctional Services Department obtained a rating of 71.7 marks, 61% of the citizens interviewed were satisfied with its performance, but it was dropped due to its relatively low recognition rate.

 

Meanwhile, this survey series registered people’s satisfaction level of the PLA Hong Kong Garrison. Here are the results of the latest five surveys:

 

Date of survey

4-12/12/12

26/6-2/7/13

29/11-3/12/13

25-30/6/2014

25-28/11/2014

Latest changes

Sample base[16]

682

606

579

540

497

--

Overall response rate

66.9%

67.8%

70.7%

67.1%

66.6%

--

Finding / Error

Finding

Finding

Finding

Finding

Finding and error[17]

--

Satisfaction rating of PLA

66.0

65.9

61.4 [19]

62.5

63.1+/-2.8

+0.6

Satisfaction rate of PLA [18]

46%

45%

42%

39%

46+/-4%

+7%[19]

Dissatisfaction rate of PLA[18]

6%

8%

9%

8%

10+/-3%

+2%

Net satisfaction rate

40%

37%

33%

31%

35+/-6%

+4%

Mean value [18]

3.8+/-0.1
(Base=469)

3.7+/-0.1
(Base=411)

3.6+/-0.1
(Base=371)

3.6+/-0.1
(Base=365)

3.6+/-0.1
(Base=367)

--

[16] Starting from 2011, these questions only uses sub-samples of the tracking surveys concerned, the sample size for each question also varies.
[17] All error figures in the table are calculated at 95% confidence level. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state “sampling error of ratings not more than +/-2.8 marks, that of percentages not more than +/-4%, and that of net values not more than +/-6% at 95% confidence level” when quoting the above figures. The error margin of previous survey can be found at the POP Site. 
[18] Collapsed from a 5-point scale. The mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of positive level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[19] Such changes have gone beyond the sampling errors at the 95% confidence level under the same weighting method, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.


Results of survey conducted in late November showed that the satisfaction rating of PLA is 63.1 marks, 46% are satisfied with the performance of the PLA stationed in Hong Kong, only 10% are dissatisfied, giving a net satisfaction of positive 35 percentage points, and a mean scores of 3.6, meaning between “half-half” and “quite satisfied” in general.


Commentary

Robert Ting-Yiu Chung, Director of Public Opinion Programme, observed, “Our latest survey conducted in late November shows that compared to five months ago, the popularity ratings and net satisfaction rates of most disciplinary forces have increased except for Hong Kong Police Force. In terms of relative rankings of ratings, among the ‘top 5’ Hong Kong disciplinary forces, Hong Kong Fire Services Department stays at the top. Hong Kong Immigration Department and Hong Kong Customs and Excise Department swap positions with each other to rank second and third. Civil Aid Service and Hong Kong Police Force stay at the fourth and fifth positions. In terms of absolute ratings, all ‘top 5’ disciplinary forces get more than 60 marks, four of which are above 70, which is very good. In terms of net satisfaction, Hong Kong Fire Services Department registers positive 93 percentage points, and is definitely the most popular disciplinary force in Hong Kong. However, that of Hong Kong Police Force registers positive 29 percentage points, which is record low since July 1997. Meanwhile, both the popularity rating and net satisfaction rate of the PLA Hong Kong Garrison have slightly increased compared to the last survey, now at 63.1 marks and positive 35 percentage points respectively. The popularity drop of the Police is obviously due to the recent Occupy Movement, which has caught the Police in between different political forces. To overcome this problem, the Police will have to strengthen its professionalism in executing its duties, and also its affection and care for the society. It should not lean towards any political force, nor resort to improper means, just let political problems be resolved in political ways. As a methodological note, it should be noted that our list of ‘top 5’ only includes disciplinary forces best known to the public, ranked according to their satisfaction ratings. Some of other disciplinary forces may well have very high or low satisfaction ratings, but because they are not the most well-known forces, they do not appear on the list by design. As for the reasons affecting the differences as well as the ups and downs of these figures, we leave it to our readers to form their own judgment using the detailed records displayed in the ‘Opinion Daily’ of our POP Site.”


Future Release (Tentative)

  • December 16, 2014 (Tuesday) 1pm to 2pm: Popularity of CE and Principal Officials

| Abstract| Background | Latest Figures |Commentary | Future Release (Tentative) |
| Detailed Findings (People's Satisfaction with the Discipilnary Force/People's Satisfaction with the Performance of the People's Liberation Army Hong Kong Garrison /People's Satisfaction with the Performance of the Hong Kong Police Force) |