HKU POP SITE releases the results of Policy Address follow-up surveyBack

 
Press Release on October 19, 2010

| Abstract | Background | Latest Figures | Commentary | Future Release (Tentative) |
| Detailed Findings (Popularity of Chief Executive) |
| Detailed Findings (Follow-up Survey on the Sixth Policy Address of Donald Tsang Yam-kuen
) |


Abstract

The Public Opinion Programme (POP) at the University of Hong Kong interviewed 507 Hong Kong people between 14 and 16 October by means of a random telephone survey conducted by real interviewers. The survey finds that people's satisfaction with CE Donald Tsang's sixth Policy Address has dropped to 31% in our follow-up survey, while dissatisfaction rate increases from 19% to 27%. This situation has repeated itself for many years. In terms of satisfaction rate registered in follow-up surveys, people's appraisal of this year's Policy Address ranks third among Tsang's six Addresses. In terms of rating, our follow-up survey records a significant drop of 4.8 marks to 54.1, which is similar to previous years. All in all, after some initial discussions, people's appraisal of the Policy Address appears to have turned from positive to neutral. However, POP will conduct another round of follow-up survey in due course to map people's further reaction. Regarding the theme of the Address, 66% of respondents agree that "Sharing Prosperity for a Caring Society" meets the need of society. It is the fourth highest figure across Tsang's six Policy Addresses. Moreover, 88% support Tsang's view that livelihood issues are the community's biggest concern, with housing, disparity of wealth and elderly welfare drawing the greatest attention. However, 63% and 59% think the effect of the poverty alleviation measures and his proposed housing policies would be "small" in bridging the wealth gap and solving housing problems. Nevertheless, 51% and 66% respectively support Tsang's proposed "My Home Purchase Plan", and his decision not to kick off local legislation for Article 23 of the Basic Law. Finally, on our tracking question of people's satisfaction with Donald Tsang's policy direction, net satisfaction now stands at positive 4 percentage points, which is much better than this time last year. The sampling error of all percentages is between +/-1 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figure is +/-1.8. The response rate of the survey is 65%.

Points to note:
[1] The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there. [2] The sample size of this survey is 507 successful interviews, not 507 x 64.9% response rate. In the past, many media made this mistake.
[3] The maximum sampling error of all percentages is between +/-1 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figures needs another calculation. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error of various ratings not more than +/-1.8 and sampling error of percentages not more than +/-4% at 95% confidence level".
[4] When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.



Background

Since 1992, POP has been conducting Policy Address instant surveys every year. In 1998, we expanded our instant surveys to cover the Budget Talks. In general, such instant polls which measure people's instant reactions would be repeated weeks later by a follow-up survey which measure people's more matured reactions. We believe this is the correct way to study public opinion. In 2008, we further split our instant survey into two. In our first survey, we measure people's overall appraisal of the Policy Address, their rating of the Policy Address, their change in confidence towards Hong Kong's future, and CE's popularity. One to two days later, we would conduct our first follow-up survey to study people's reactions towards different government proposals, and any change in their satisfaction of the Policy Address. The findings of this year's instant survey were already released on October 14. Today, we release the results of our first follow-up survey.


Latest Figures

The findings of the Policy Address follow-up survey released by POP today have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2010. Herewith the contact information of various surveys:

Year of survey

Date of survey

Total sample size

Response rate

Sampling error of %[6]

2010 Follow-up

14-16/10/10

507

64.9%

+/-4%

2010 Instant

13/10/10

1,020

66.9%

+/-3%

2009 Follow-up

15-17/10/09

508

70.6%

+/-4%

2009 Instant

14/10/09

1,007

71.9%

+/-3%

2008 Follow-up

17-19/10/08

505

70.9%

+/-4%

2008 Instant

15/10/08

1,011

74.9%

+/-3%

2007 Instant

10/10/07

1,023

69.9%

+/-3%

2006 Instant

11/10/06

1,027

60.7%

+/-3%

2005 Instant

12/10/05

914

66.1%

+/-3%

2004 Instant

7/1/04

1,040

67.5%

+/-3%

2003 Instant

8-9/1/03

1,259

68.9%

+/-3%

2001 Instant

10/10/01

1,051

66.0%

+/-3%

2000 Instant

11/10/00

1,059

69.7%

+/-3%

1999 Instant

6/10/99

888

54.5%

+/-3%

1998 Instant

7/10/98

1,494

56.5%

+/-3%

1997 Instant

8/10/97

1,523

61.5%

+/-3%

[6] Calculated at 95% confidence level using full sample size. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Questions using only sub-samples would have bigger sample error. Sampling errors of ratings are calculated according to the distribution of the scores collected.

Results of the follow-up survey of Policy Address, together with the instant poll, for 2009 and 2010 are tabulated below:

 

2009

2010

 

Instant survey[9]

Follow-up survey

Change

Instant survey[10]

Follow-up survey

Latest Change

Date of survey

14/10/09

15-17/10/09

--

13/10/10

14-16/10/10

--

Sample base

1,007

508

--

1,020

507

--

Overall response rate

71.9%

70.6%

--

66.9%

64.9%

--

Latest finding

Finding

Finding and error[7]

--

Finding

Finding and error[7]

--

Appraisal of Policy Address: Satisfaction rate[8]

30%

19%

-11%[11]

41%

31+/-4%

-10%[11]

Appraisal of Policy Address: Dissatisfaction rate[8]

28%

31%

+3%

19%

27+/-4%

+8%[11]

Mean value[8]

3.0+/-0.1
(Base = 495)

2.8+/-0.1
(Base = 469)

-0.2[11]

3.2+/-0.1
(Base = 695)

3.0+/-0.1
(Base = 467)

-0.2[11]

Satisfaction rating of Policy Address (0 to 100 marks)

53.5

49.8

-3.7[11]

58.9

54.1+/-1.8

-4.8[11]

[7] Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
[8] Collapsed from a 5-point scale, the mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[9] Excluding respondents who did not answer this question because they had not heard of / did not know the details of the Policy Address. The sub-sample size was 462.
[10] Excluding respondents who did not answer this question because they had not heard of / did not know the details of the Policy Address. The sub-sample size was 747.
[11]  Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.


Our latest survey revealed that 31% of the respondents were satisfied with the Policy Address and 27% were dissatisfied. The mean score is 3.0, meaning close to "half-half" in general. The average rating registered for the Policy Address was 54.1 marks. With respect to people's specific reactions towards the contents of this year's Policy Address, relevant findings are summarized below:

Date of survey

14-16/10/10

Sample base

507

Overall response rate

64.9%

Latest finding

Finding and error[12]

 

Yes

Half-half

No

Don't know/ hard to say

Total

The theme of this year's Policy Address is "Sharing Prosperity for a Caring Society". Do you think this theme concurs with the current needs of the society?

66+/-4%

13+/-3%

18+/-3%

4+/-2%

100%

 

Agree/Support

Half-half

Disagree/Oppose

Don't know/hard to say

Total

Donald Tsang mentioned livelihood issues are now the community's principal concerns, with housing, the wealth gap and elderly welfare drawing the greatest attention. Do you agree or disagree with this statement?

88+/-3%

5+/-2%

6+/-2%

1+/-1%

100%

Donald Tsang suggested introducing a "My Home Purchase Plan", that is, "to rent before purchase" in order to help sandwich class to purchase property. Do you support or oppose to his proposal?

51+/-4%

13+/-3%

29+/-4%

8+/-2%

100%

Donald Tsang said legislation of Article 23 of the Basic Law will not be implemented in the current term of government. Do you support or oppose this?

66+/-4%

4+/-2%

11+/-3%

18+/-3%

100%

 

Large

Half-half

Small

Don't know/ hard to say

Total

Do you think the effect of the recommendations on housing policies in the Policy Address in solving the housing problems will be large or small?

13+/-3%

20+/-4%

59+/-4%

7+/-2%

100%

Do you think effect of the poverty alleviation measures in the Policy Address in bridging the wealth gap will be large or small?

14+/-3%

16+/-3%

63+/-4%

7+/-2%

100%

[12] Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.

Findings on people's opinion whether the theme of Policy Address concurred with the current needs of the society from 1997 till present are summarized as follows:
People's opinion whether the theme of Policy Address delivered by Donald Tsang concurred with
the current needs of the society from 2005 till 2010
[14]

Date of Survey

Sample / Sub
sample base[15]

Policy Address

Theme

Finding and error[13]

Yes

Half-half

No

Don't know/ hard to say

14-16/10/10

507

6th

Sharing Prosperity for a
Caring Society

66[16]+/-4%

13+/-3%

18[16]+/-3%

4[16]+/-2%

15-17/10/09

506

5th

Breaking New Ground Together

45[16]+/-4%

16[16]+/-3%

30[16]+/-4%

9+/-3%

17-19/10/08

503

4th

Embracing New Challenges

57[16]+/-4%

10+/-3%

24[16]+/-4%

9[16]+/-3%

10/10/07

512

3rd

A New Direction for Hong Kong

69+/-4%

8+/-2%

9[16]+/-3%

15[16]+/-3%

11/10/06

582

2nd

Proactive Pragmatic Always People First

71+/-4%

10+/-2%

14[16]+/-3%

5[16]+/-2%

12/10/05

913

1st

Strong Governance for the People

72+/-3%

10+/-2%

8+/-2%

10+/-2%

People's opinion whether the theme of Policy Address delivered by Tung Chee-hwa
concurred with the current needs of the society from 1997 till 2005[14]

Date of Survey

Sample / Sub
sample base[15]

Policy Address

Theme

Finding and error[13]

Yes

Half-half

No

Don't know/ hard to say

12/1/05

1,031

8th

Working Together for Economic Development and Social Harmony

77[16]+/-3%

7[16]+/-2%

10[16]+/-2%

6[16]+/-1%

7/1/04

1,031

7th

Seizing Opportunities for Development: Promoting People-based Governance

49[16]+/-3%

12[16]+/-2%

19+/-2%

20[16]+/-2%

8-9/1/03

1,250

6th

Capitalising on Our Advantages: Revitalizing our Economy

61[16]+/-3%

7[16]+/-1%

18[16]+/-2%

13[16]+/-2%

10/10/01

1,048

5th

Building on our Strengths, Investing in our Future

45[16]+/-3%

12[16]+/-2%

25[16]+/-3%

18[16]+/-2%

11/10/00

1,041

4th

Serving the Community, Sharing Common Goals

63[16]+/-3%

6+/-1%

17+/-2%

15[16]+/-2%

6/10/99

888

3rd

Quality People, Quality Home

69+/-3%

7+/-2%

15+/-2%

8+/-2%

7/10/98[17]

--

2nd

From Adversity to Opportunity

--

--

--

--

8/10/97[17]

--

1st

Building Hong Kong for a New Era

--

--

--

--

[13] Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[14] The question wordings were "The theme of this year's Policy Address is "XXXX". Do you think this theme concurs with the current needs of the society?"
[15] Excluding those respondents who refused to answer this question. Since 2006, this series of question only use sub-sample.
[16] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[17] This question was not covered in the instant Policy Address poll in 1997 and 1998.


Results showed that 66% thought the theme of the Policy Address "Sharing Prosperity for a Caring Society" concurred with the current needs of the society while 18% did not think so. Besides, 88% agreed with Donald Tsang's statement that livelihood issues are now the community's principal concerns, with housing, the wealth gap and elderly welfare drawing the greatest attention, while 6% disagreed. Regarding the "My Home Purchase Plan" proposed by Donald Tsang, that is, "to rent before purchase" in order to help sandwich class to purchase property, 51% supported while 29% held an opposite view. Donald Tsang also said legislation of Article 23 of the Basic Law will not be implemented in the current term of government. A total of 66% supported while 11% opposed to this. Moreover, regarding the effect of the recommendations on housing policies in the Policy Address, 13% said the effect would be large while 59% held an opposite view. On the other hand, as for the effect of the poverty alleviation measures in the Policy Address in bridging the wealth gap, 14% said the effect would be large while 63% expressed the effect would be small.

Respondents' appraisal of Donald Tsang's policy direction is summarized as follows:

Date of survey

16-18/2/09

18-24/8/09

15-17/10/09

20-26/10/09

14-16/10/10

Latest change

Sample base

1,001

1,020

508

513

507

--

Overall response rate

64.5%

66.7%

70.6%

72.1%

64.9%

--

Latest finding and error[18]

Finding

Finding

Finding

Finding

Finding and error[18]

--

Satisfaction rate of Tsang's policy direction[19]

28%

30%

25%[20]

25%

32+/-4%

+7%[20]

Dissatisfaction rate of Tsang's policy direction[19]

32%

25%

34%[20]

41%[20]

28+/-4%

-13%[20]

Mean value[19]

2.9+/-0.1
(Base = 632)

3.0+/-0.1
(Base = 1,007)

2.8+/-0.1[20]
(Base = 495)

2.7+/-0.1
(Base = 482)

3.0+/-0.1
(Base = 477)

+0.3[20]

[18] Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. The error margin of previous survey can be found at the POP Site.
[19] Collapsed from a 5-point scale, the mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[20] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.


As for people's satisfaction with Donald Tsang's policy direction, 32% of the respondents showed satisfaction while 28% were not satisfied. The mean score is 3.0, meaning close to "half-half" in general.


Commentary

Note: The following commentary was written by Director of POP Robert Chung.

According to our Policy Address instant survey, among respondents who had some knowledge of Donald Tsang's sixth Policy Address, 41% said they were satisfied. However, in our follow-up survey, the figure drops to 31%, while dissatisfaction rate increases from 19% to 27%. This situation has repeated itself for many years. In terms of satisfaction rate registered in follow-up surveys, people's appraisal of this year's Policy Address ranks third among Tsang's six Addresses. In terms of rating, our follow-up survey records a significant drop of 4.8 marks to 54.1, which is similar to previous years. All in all, after some initial discussions, people's appraisal of the Policy Address appears to have turned from positive to neutral. However, POP will conduct another round of follow-up survey in due course to map people's further reaction.

Regarding the theme of the Address, 66% of respondents agree that "Sharing Prosperity for a Caring Society" meets the need of society. It is the fourth highest figure across Tsang's six Policy Addresses. Moreover, 88% support Tsang's view that livelihood issues are the community's biggest concern, with housing, disparity of wealth and elderly welfare drawing the greatest attention. However, 63% and 59% think the effect of the poverty alleviation measures and his proposed housing policies would be "small" in bridging the wealth gap and solving housing problems. Nevertheless, 51% and 66% respectively support Tsang's proposed "My Home Purchase Plan", and his decision not to kick off local legislation for Article 23 of the Basic Law.

Finally, on our tracking question of people's satisfaction with Donald Tsang's policy direction, net satisfaction now stands at positive 4 percentage points, which is much better than this time last year.

POP will release another round of Policy Address survey findings in about two weeks' time. Whether public opinion would change around many rounds of discussion remains to be seen.


Future Release (Tentative)

  • October 26, 2010 (Tuesday) 1pm to 2pm: Ratings of Top 10 Legislative Councillors

| Abstract | Background | Latest Figures | Commentary | Future Release (Tentative) |
| Detailed Findings (Popularity of Chief Executive) |
| Detailed Findings (Follow-up Survey on the Sixth Policy Address of Donald Tsang Yam-kuen
) |