HKU POP SITE releases the results of the Policy Address second follow-up surveyBack

 
Press Release on October 28, 2010

| Abstract | Background | Latest Figures | Commentary | Future Release (Tentative) |
| Detailed Findings(Popularity of Chief Executive) |
| Detailed Findings(Second Follow-up Survey on the Sixth Policy Address of Donald Tsang Yam-kuen) |


Abstract

The Public Opinion Programme (POP) at the University of Hong Kong interviewed 523 Hong Kong people between 26 and 27 October by means of a random telephone survey conducted by real interviewers, in order to measure again people's reaction to this year's Policy Address. According to our Policy Address instant survey, among respondents who had some knowledge of the sixth Address of Donald Tsang, 41% said they were satisfied. However, in our first follow-up survey, the figure dropped to 31%, while dissatisfaction rate increased from 19% to 27%. After about two weeks, people's satisfaction rate remains the same, but their dissatisfaction rate continues to increase by 6 percentage points to 33%, giving a net satisfaction rate of negative 2 percentage points, which is the same as that of people's net satisfaction with Donald Tsang's policy direction. People's rating of the Policy Address now stands at 52.2 marks, down by 1.9 marks. In terms of the Address' theme and content, according to our latest follow-up survey, over 60% still agree that "Sharing Prosperity for a Caring Society" is an appropriate theme for the Address. There is a small drop, but the overall appraisal is still positive, with a net value of positive 40 percentage points. As for Donald Tsang's analysis of livelihood issues, and his suggested "My Home Purchase Plan", some drops in support are registered, but their net support rates still stand at positive 74 and positive 4 percentage points respectively. However, appraisal is becoming more and more negative in terms of effectiveness of CE's housing policies and the poverty alleviation measures, as their net values become negative 62 and negative 64 percentage points respectively. Net support for CE's decision not to kick off local legislation for Article 23 of the Basic Law stands at positive 52 percentage points. To sum up, after rounds of discussion, people's appraisal of this year's Policy Address can be considered as half and half. People do not seem to have too much objection against Donald Tsang's policy principles, but they are not optimistic of the outcome of his policy proposals. The maximum sampling error of all percentages is between +/-2 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figure is +/-1.7. The response rate of the survey is 64%.

Points to note:
[1] The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of this survey is 523 successful interviews, not 523 x 64.0% response rate. In the past, many media made this mistake.
[3] The maximum sampling error of all percentages is between +/-2 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figures needs another calculation. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error of various ratings not more than +/-1.7 and sampling error of percentages not more than +/-4% at 95% confidence level".
[4] When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.



Background

Since 1992, POP has been conducting Policy Address instant surveys every year. From 1998 onwards, we expanded our instant surveys to cover the Budget Talks. In general, such surveys would be repeated some time later to measure people's more matured reactions. In 2008, we further enhanced our survey design by splitting our Policy Address instant survey into two. In our instant survey, we measure people's overall appraisal of the Policy Address, their rating of the Policy Address, their change in confidence towards Hong Kong's future, and CE's popularity. One to two days later, we started to conduct our first follow-up survey, which mainly studies people's reactions towards different government proposals, and any change in their satisfaction of the Policy Address. Our second follow-up survey would be conducted a short period later, to repeat our measurement of people's reactions towards different government proposals, and any change in their satisfaction of the Policy Address. We believe this is a better way to study public opinion on these issues: measuring people's instant reaction first, and then repeat our measurement some time later to check people's more matured reaction. Our Policy Address's instant and first follow-up surveys this year were released on October 14 and 19 respectively, while the findings of the second follow-up poll are released today.


Latest Figures

The findings of the second follow-up survey of Policy Address released by POP SITE today have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2010. Herewith the contact information of various surveys:

Survey series

Date of survey

Sample base

Overall response rate

Sampling error of percentages[6]

2010 Second follow-up

26-27/10/10

523

64.0%

+/-4%

2010 First follow-up

14-16/10/10

507

64.9%

+/-4%

2010 Instant

13/10/10

1,020

66.9%

+/-3%

2009 Second follow-up

20-26/10/09

513

72.1%

+/-4%

2009 First follow-up

15-17/10/09

508

70.6%

+/-4%

2009 Instant

14/10/09

1,007

71.9%

+/-3%

2008 Second follow-up

27-29/10/08

1,015

70.3%

+/-3%

2008 First follow-up

17-19/10/08

505

70.9%

+/-4%

2008 Instant

15/10/08

1,011

74.9%

+/-3%

[6] Calculated at 95% confidence level using full sample size."95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.

As different questions involve different sub-samples, the sample errors will vary accordingly. The table below briefly shows the relationship between sampling errors and sample size for the readers to capture the corresponding changes:
Sample size
(total sample or sub-sample)

Sampling error of percentages[7]
(maximum values)

Sample size
(total sample or sub-sample)

Sampling error of percentages[7]
(maximum values)

1,300

 +/- 2.8 %

1,350

 +/- 2.7 %

1,200

 +/- 2.9 %

1,250

 +/- 2.8 %

1,100

 +/- 3.0 %

1,150

 +/- 3.0 %

1,000

 +/- 3.2 %

1,050

 +/- 3.1 %

900

 +/- 3.3 %

950

 +/- 3.2 %

800

 +/- 3.5 %

850

 +/- 3.4 %

700

 +/- 3.8 %

750

 +/- 3.7 %

600

 +/- 4.1 %

650

 +/- 3.9 %

500

 +/- 4.5 %

550

 +/- 4.3 %

400

 +/- 5.0 %

450

 +/- 4.7 %

[7] Based on 95% confidence interval.

Results of the second follow-up survey of Policy Address, together with the instant and first follow-up surveys, for 2009 and 2010 are tabulated below:

 

2009

2010

 

Instant survey

First
follow-up
survey

Second
follow-up
survey

Change

Instant survey

First
follow-up
survey

Second
follow-up
survey

Latest
change

Date of survey

14/10/09

15-17/10/09

20-26/10/09

--

13/10/10

14-16/10/10

26-27/10/10

--

Sample base

1,007[10]

508

506-511

--

1,020[10]

507

523

--

Overall response rate

71.9%

70.6%

72.1%

--

66.9%

64.9%

64.0%

--

Policy Address: Satisfaction rate[9]

30+/-4%

19+/-3%

20+/-4%

+1%

41+/-3%

31+/-4%

31+/-4%

--

Policy Address: Dissatisfaction rate[9]

28+/-4%

31+/-4%

45+/-4%

+14%[11]

19+/-2%

27+/-4%

33+/-4%

+6%[11]

Mean Value[9]

3.0+/-0.1
(Base=434)

2.8+/-0.1
(Base=465)

2.5+/-0.1
(Base=469)

-0.3[11]

3.2+/-0.1
(Base=695)

3.0+/-0.1
(Base=467)

2.9+/-0.1
(Base=487)

-0.1

Rating of Policy Address (0 to 100 marks)

53.5+/-2.1

49.8+/-1.6

43.0+/-2.0

-6.8[11]

58.9+/-1.4

54.1+/-1.8

52.2+/-1.7

-1.9[11]

Satisfaction rate of Tsang's policy direction [9]

--

25+/-4%

25+/-4%

--

--

32+/-4%*

34+/-4%

+2%*

Dissatisfaction rate of Tsang's policy direction [9]

--

34+/-4%

41+/-4%

+7%[11]

--

28+/-4%*

36+/-4%

+8%[11]*

Mean Value[9]

--

2.8+/-0.1
(Base=495)

2.7+/-0.1
(Base=482)

-0.1

--

3.0+/-0.1
(Base=477)

2.9+/-0.1
(Base=501)

-0.1

[8] Errors are calculated at 95% confidence level using full sample size. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
[9] Collapsed from a 5-point scale, the mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[10] Excluding respondents who were not clear about the Policy Address. The sub-sample size in 2009 was 462 and that in 2010 was 747.
[11] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
* Erratum: The figures in the original release were mistyped, with regret.


Latest second follow-up survey revealed that 31% of the respondents were satisfied with the Policy Address and 33% were dissatisfied. The mean score is 2.9, meaning close to "half-half". The average rating registered for the Policy Address was 52.2 marks. As for people's satisfaction with Donald Tsang's policy direction, 34% of the respondents showed satisfaction while 36% were not satisfied. The mean score is 2.9, meaning close to "half-half".

Results of people's satisfaction with the Policy Address in previous similar surveys (follow-up survey of Policy Address in 1997, 1998 and 2000 – 2007 and second follow-up surveys of Policy Address in 1999, 2008 and 2009) are tabulated below:
Date of survey

Sub-sample base

Appraisal of Policy Address: Satisfaction[13]

Appraisal of Policy Address: Half-half

Appraisal of Policy Address: Dissatisfaction[13]

26-27/10/10

523**

31[14]+/-4%

30 +/-4%

33[14]+/-4%

20-26/10/09

506

20+/-4%

28[14] +/-4%

45[14] +/-4%

27-29/10/08

556

24[14] +/-4%

36% +/-4%

35 +/-4%

22-23/10/07

526

44[14] +/-4%

31[14] +/-4%

18[14] +/-3%

23-24/10/06

506

26[14] +/-4%

41[14] +/-4%

23[14] +/-4%

25-27/10/05

513

41[14] +/-4%

24[14] +/-4%

5[14] +/-2%

27-31/1/05

1,012

17[14] +/-2%

37[14] +/-3%

23[14] +/-3%

14-16/1/04

987

10[14] +/-2%

27[14] +/-3%

29[14] +/-3%

23-28/1/03

1,049

13[14] +/-2%

22[14] +/-3%

37[14] +/-3%

21-23/10/01

1,056

14 +/-2%

32[14]+/-3%

31[14] +/-3%

23-25/10/00

1,031

15 +/-2%

28 +/-3%

25 +/-3%

22/10/99

553

12 +/-3%

28 +/-4%

27 +/-4%

20/10/98

533

19[14] +/-3%

27 +/-4%

32[14] +/-4%

14-15/10/97

517

31[14] +/-4%

27 +/-4%

14 +/-3%

[12] Errors are calculated at 95% confidence level using full sample size. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[13] Collapsed from a 5-point scale.
[14] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
** Erratum: The sub-sample size in the original release was mistyped, with regret.


Compared to similar surveys conducted after the handover, people's satisfaction rate with this year's Policy Address is the third highest among Tsang's six addresses, while it is still higher than all those registered for Tung's second to eighth addresses.

Results of both first and second follow-up surveys of Policy Address 2010 are tabulated below:

 

First follow-up survey

Second follow-up survey

Change

Date of survey

14-16/10/10

26-27/10/10

--

Sample base

507

523

--

Overall response rate

64.9%

64.0%

--

The theme of this year's Policy Address "Sharing Prosperity for a Caring Society" concurs the current needs of the society

66+/-4%

63+/-4%

-3%

The theme of this year's Policy Address "Sharing Prosperity for a Caring Society" does not concur the current needs of the society

18+/-3%

23+/-4%

+5%[16]

Agree that livelihood issues are now the community's principal concerns, with housing, the wealth gap and elderly welfare drawing the greatest attention.

88+/-3%

84+/-3%

-4%[16]

Disagree that livelihood issues are now the community's principal concerns, with housing, the wealth gap and elderly welfare drawing the greatest attention.

6+/-2%

10+/-3%

+4%[16]

Regard the effect of the recommendations on housing policies in the Policy Address in solving the housing problems will be large

13+/-3%

8+/-2%

-5%[16]

Regard the effect of the recommendations on housing policies in the Policy Address in solving the housing problems will be small

59+/-4%

70+/-4%

+11%[16]

Support the "My Home Purchase Plan" to help sandwich class to purchase property

51+/-4%

43+/-4%

-8%[16]

Oppose the "My Home Purchase Plan" to help sandwich class to purchase property

29+/-4%

39+/-4%

+10%[16]

Regard the effect of the poverty alleviation measures in the Policy Address in bridging the wealth gap will be large

14+/-3%

6+/-2%

-8%[16]

Regard the effect of the poverty alleviation measures in the Policy Address in bridging the wealth gap will be small

63+/-4%

70+/-4%

+7%[16]

Support that legislation of Article 23 of the Basic Law will not be implemented in the current term of government.

66+/-4%

66+/-4%

--

Oppose that legislation of Article 23 of the Basic Law will not be implemented in the current term of government.

11+/-3%

14+/-3%

+3%

[15] Errors are calculated at 95% confidence level using full sample size. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[16] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.


Results showed that 63% thought the theme of the Policy Address "Sharing Prosperity for a Caring Society" concurred with the current needs of the society while 23% did not think so. Besides, Donald Tsang mentioned livelihood issues are now the community's principal concerns, with housing, the wealth gap and elderly welfare drawing the greatest attention, a respective of 84% and 10% agreed and disagreed with this. Regarding the effect of the recommendations on housing policies in the Policy Address in solving the housing problems, 8% said the effect would be large while 70% said the effect would be small. Findings also showed that a respective of 43% and 39% of respondents supported and opposed the "My Home Purchase Plan" to help sandwich class to purchase property. Meanwhile, regarding the effect of the poverty alleviation measures in the Policy Address in bridging the wealth gap, 6% and 70% said the effect would be large and small respectively. Finally, 66% supported that legislation of Article 23 of the Basic Law would not be implemented in the current term of government while 14% opposed this.


Commentary

Note: The following commentary was written by Director of POP Robert Chung.

According to our Policy Address instant survey, among respondents who had some knowledge of the sixth Address of Donald Tsang, 41% said they were satisfied. However, in our first follow-up survey, the figure dropped to 31%, while dissatisfaction rate increased from 19% to 27%. After about two weeks, people's satisfaction rate remains the same, but their dissatisfaction rate continues to increase by 6 percentage points to 33%, giving a net satisfaction rate of negative 2 percentage points, which is the same as that of people's net satisfaction with Donald Tsang's policy direction. People's rating of the Policy Address now stands at 52.2 marks, down by 1.9 marks.

In terms of the Address' theme and content, according to our latest follow-up survey, over 60% still agree that "Sharing Prosperity for a Caring Society" is an appropriate theme for the Address. There is a small drop, but the overall appraisal is still positive, with a net value of positive 40 percentage points. As for Donald Tsang's analysis of livelihood issues, and his suggested "My Home Purchase Plan", some drops in support are registered, but their net support rates still stand at positive 74 and positive 4 percentage points respectively. However, appraisal is becoming more and more negative in terms of effectiveness of CE's housing policies and the poverty alleviation measures, as their net values become negative 62 and negative 64 percentage points respectively. Net support for CE's decision not to kick off local legislation for Article 23 of the Basic Law stands at positive 52 percentage points.

To sum up, after rounds of discussion, people's appraisal of this year's Policy Address can be considered as half and half. People do not seem to have too much objection against Donald Tsang's policy principles, but they are not optimistic of the outcome of his policy proposals.


Future Release (Tentative)

  • November 2, 2010 (Tuesday) 1pm to 2pm: Popularity figures of CE, SAR Government and Executive Councilors

| Abstract | Background | Latest Figures | Commentary | Future Release (Tentative) |
| Detailed Findings(Popularity of Chief Executive) |
| Detailed Findings(Second Follow-up Survey on the Sixth Policy Address of Donald Tsang Yam-kuen) |