HKU POP SITE releases the results of Policy Address follow-up surveyBack

 
Press Release on October 20, 2009

| Abstract | Background | Latest Figures | Commentary | Next Release (Tentative)
| Detailed Findings (Popularity of Chief Executive/
Follow-up Survey on the Fifth Policy Address of Donald Tsang Yam-kuen
) |


Abstract

The Public Opinion Programme (POP) at the University of Hong Kong interviewed 508 Hong Kong people between 15 and 17 October by means of a random telephone survey conducted by real interviewers. The survey finds that people's satisfaction with CE Donald Tsang's fifth Policy Address has dropped significantly to 19%, while dissatisfaction rate increases from 28% to 31%. The situation is almost identical to last year. Regarding the Address' rating, worse than last year, our follow-up survey records a significant drop of 3.7 marks to 49.8. In other words, after some initial discussions, people's appraisal of the Policy Address has turned negative. Those who did not express an opinion before have become dissatisfied. In terms of its theme, 45% of respondents agree that "Breaking New Ground Together" meets the need of society. Although 15 percentage points higher than the negative figure, it is the lowest registered in similar surveys after the handover. On the other hand, 66% support Tsang's suggestion to reinforce the four traditional pillar industries and developing six more, 78% support his plan to conserve Central. Both reactions are positive. However, the fact that he did not mention helping the poor and the needy again in his Address invited 59% criticism. His simple treatment of constitutional development invited 41%, both being higher than their corresponding positive figures. Finally, on our tracking question of people's satisfaction with Donald Tsang's policy direction, compared to two months ago, the figure has dropped significantly by 5 percentage points, back to the level registered in late October last year. This year's Policy Address seems to have increased people dissatisfaction with CE's policy direction. The sampling error of all percentages is between +/-1 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figure is +/-1.6. The response rate of the survey is 71%.

Points to note:
* The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
* The sample size of this survey is 508 successful interviews, not 508 x 70.6% response rate. In the past, many media made this mistake.
* The maximum sampling error of all percentages is between +/-2 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figure is +/-1.6. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error of rating not more than +/-1.6 and sampling error of percentages not more than +/-4% at 95% confidence level".
* When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
* The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.


Background

Since 1992, POP has been conducting Policy Address instant surveys every year. From 1998 onwards, we expanded our instant surveys to cover the Budget Talks. Starting from 2008, we split up previous years' instant survey into two surveys. In our first survey, we measure people's overall appraisal of the Policy Address, their rating of the Policy Address, their change in confidence towards Hong Kong's future, and CE's popularity. One to two days later, we started to conduct our second survey, which mainly studies people's reactions towards different government proposals, and any change in their satisfaction of the Policy Address. The findings of our instant survey were already released on October 15. Today, we release the results of our follow-up survey.

 

Latest Figures

The findings of the follow-up survey of Policy Address released by POP SITE today have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2009. Herewith the contact information of various surveys:

Year of survey

Date of survey

Total sample size

Response rate

Sampling error of %*

2009 Follow-up

15-17/10/09

508

70.6%

+/-4%

2009 Instant

14/10/09

1,007

71.9%

+/-3%

2008 Follow-up

17-19/10/08

505

70.9%

+/-4%

2008 Instant

15/10/08

1,011

74.9%

+/-3%

2007 Instant

10/10/07

1,023

69.9%

+/-3%

2006 Instant

11/10/06

1,027

60.7%

+/-3%

2005 Instant

12/10/05

914

66.1%

+/-3%

2004 Instant

7/1/04

1,040

67.5%

+/-3%

2003 Instant

8-9/1/03

1,259

68.9%

+/-3%

2001 Instant

10/10/01

1,051

66.0%

+/-3%

2000 Instant

11/10/00

1,059

69.7%

+/-3%

1999 Instant

6/10/99

888

54.5%

+/-3%

1998 Instant

7/10/98

1,494

56.5%

+/-3%

1997 Instant

8/10/97

1,523

61.5%

+/-3%

* Calculated at 95% confidence level using full sample size. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Questions using only sub-samples would have bigger sample error. Sampling errors of ratings are calculated according to the distribution of the scores collected.

Results of the follow-up survey of Policy Address, together with the instant poll, for 2008 and 2009 are tabulated below:

 

2008

2009

 

Instant survey^

Follow-up survey

Change

Instant survey^^

Follow-up survey

Latest Change

Date of survey

15/10/08

17-19/10/08

--

14/10/09

15-17/10/09

--

Sample base

1,011

505

--

1,007

508

--

Overall response rate

74.9%

70.9%

--

71.9%

70.6%

--

Latest finding

Finding

Finding and error*

--

Finding

Finding and error*

--

Appraisal of Policy Address: Satisfaction rate**

31%

19% +/-3%

-12%#

30%

19% +/-3%

-11%#

Appraisal of Policy Address: Dissatisfaction rate**

26%

31% +/-4%

+5%#

28%

31% +/-4%

+3%

Satisfaction rating of Policy Address (0 to 100 marks)

53.8

52.4 +/-1.6

-1.4

53.5

49.8 +/-1.6

-3.7#

* Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
** Collapsed from a 5-point scale.
^ Excluding respondents who did not answer this question because they had not heard of / did not know the details of the Policy Address. The sub-sample size was 515.
^^ Excluding respondents who did not answer this question because they had not heard of / did not know the details of the Policy Address. The sub-sample size was 462.
# Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

Latest survey revealed that 19% of the respondents were satisfied with the Policy Address and 31% were dissatisfied. The average rating registered for the Policy Address was 49.8 marks. With respect to people's specific reactions towards the contents of this year's Policy Address, relevant findings are summarized below:

Date of survey

15-17/10/09

Sample base

508

Overall response rate

70.6%

Latest finding

Finding and error*

 

Yes

Half-half

No

Don't know/ hard to say

Total

The theme of this year's Policy Address is "Breaking New Ground Together". Do you think this theme concurs with the current needs of the society?

45% +/-4%

16% +/-3%

30% +/-4%

9% +/-3%

100%

 

Support

Half-half

Oppose

Don't know/ hard to say

Total

Donald Tsang emphasized reinforcing the four traditional pillar industries and developing the six industries. Do you support or oppose to his proposed direction?

66% +/-4%

16% +/-3%

12% +/-3%

6% +/-2%

100%

Donald Tsang also suggested a series of measures conserving Central, including reserving the Central Market and the Central Policy Station. Do you support or oppose to his suggestion?

78% +/-4%

9% +/-3%

10% +/-3%

3% +/-2%

100%

 

Satisfied

Half-half

Dissatisfied

Don't know/ hard to say

Total

Donald Tsang mentioned quality life and progressive society, but not helping the poor and the needy again. Are you satisfied with this handling method?

22% +/-4%

16% +/-3%

59% +/-4%

3% +/-2%

100%

Donald Tsang just simply said that the public consultations would be commenced next month regarding constitutional development. Are you satisfied with this handling method?

38% +/-4%

16% +/-3%

41% +/-4%

5% +/-2%

100%

* Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.

Findings on people's opinion whether the theme of Policy Address concurred with the current needs of the society from 1997 till present are summarized as follows,

People's opinion whether the theme of Policy Address delivered by Donald Tsang
concurred with the current needs of the society from 2005 till 2009^

Date of Survey

Sample/ Sub
sample base^^

Policy Address

Theme

Finding and error*

Yes

Half-half

No

Don't know/ hard to say

15-17/10/09

506

5th

Breaking New Ground Together

45%# +/-4%

16%# +/-3%

30%# +/-4%

9% +/-3%

17-19/10/08

503

4th

Embracing New Challenges

57%# +/-4%

10% +/-3%

24%# +/-4%

9%# +/-3%

10/10/07

512

3rd

A New Direction for Hong Kong

69% +/-4%

8% +/-2%

9%# +/-3%

15%# +/-3%

11/10/06

582

2nd

Proactive Pragmatic Always People First

71% +/-4%

10% +/-2%

14%# +/-3%

5%# +/-2%

12/10/05

913

1st

Strong Governance for the People

72% +/-3%

10% +/-2%

8% +/-2%

10% +/-2%

People's opinion whether the theme of Policy Address delivered by Tung Chee-hwa
concurred with the current needs of the society from 1997 till 2005^

Date of Survey

Sample/ Sub
sample base^^

Policy Address

Theme

Finding and error*

Yes

Half-half

No

Don't know/ hard to say

12/1/05

1,031

8th

Working Together for Economic Development and Social Harmony

77%# +/-3%

7%# +/-2%

10%# +/-2%

?6%# +/-1%

7/1/04

1,031

7th

Seizing Opportunities for Development: Promoting People-based Governance

49%# +/-3%

12%# +/-2%

19% +/-2%

20%# +/-2%

8-9/1/03

1,250

6th

Capitalising on Our Advantages: Revitalizing our Economy

61%# +/-3%

7% #+/-1%

18%# +/-2%

13%# +/-2%

10/10/01

1,048

5th

Building on our Strengths, Investing in our Future

45%# +/-3%

12%# +/-2%

25%# +/-3%

18%# +/-2%

11/10/00

1,041

4th

Serving the Community, Sharing Common Goals

63%# +/-3%

6% +/-1%

17% +/-2%

15%# +/-2%

6/10/99

888

3rd

Quality People, Quality Home

69% +/-3%

7% +/-2%

15% +/-2%

8% +/-2%

7/10/98##

--

2nd

From Adversity to Opportunity

--

--

--

--

8/10/97##

--

1st

Building Hong Kong for a New Era

--

--

--

--

* Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
^ The question wordings were "The theme of this year's Policy Address is "XXXX". Do you think this theme concurs with the current needs of the society?"
^^ Excluding those respondents who refused to answer this question. Since 2006, this series of question only use sub-sample.
# Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
# #This question was not covered in the instant Policy Address poll in 1997 and 1998.

Results showed that 45% thought the theme of the Policy Address "Breaking New Ground Together" concurred with the current needs of the society while 30% did not think so. Besides, 66% supported Donald Tsang's proposed direction of reinforcing the four traditional pillar industries and developing the six industries while 12% opposed. Regarding the series measures put forward by CE to conserve Central, like conserving the Central Market and the Central Policy Station, 78% gave a positive answer while 10% held an opposite view. Donald Tsang has also mentioned quality life and progressive society, but not helping the poor and the needy again. A total of 22% found it satisfactory while 59% were dissatisfied. Lastly, regarding the public consultations to be commenced next month on constitutional development, 38% were satisfied while 41% held an opposite view.

Respondents' appraisal of Donald Tsang's policy direction is summarized as follows:

Date of survey

17-19/10/08

27-29/10/08

16-18/2/09

18-24/8/09

15-17/10/09

Latest change

Sample base

505

1,015

1,001

1,020

508

--

Overall response rate

70.9%

70.3%

64.5%

66.7%

70.6%

--

Latest finding

Finding

Finding

Finding

Finding

Finding and error*

--

Satisfaction rate of Tsang's policy direction**

22%

25%

28%

30%

25% +/-4%

-5%#

Dissatisfaction rate of Tsang's policy direction**

32%

35%

32%

25%

34% +/-4%

+9%#

* Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. The error margin of previous survey can be found at the POP Site.
** Collapsed from a 5-point scale.
# Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

As for people's satisfaction with Donald Tsang's policy direction, 25% of the respondents showed satisfaction while 34% were not satisfied.

Commentary

Note: The following commentary was written by Director of POP Robert Chung.

According to our Policy Address instant survey, among the nearly 500 respondents who have some knowledge of the CE Donald Tsang's 5th Address, 30% said they were satisfied, 28% were not, and the Address scored 53.5 marks. These figures are very similar to those of last year, meaning that overall appraisal is not too positive, but nevertheless outweighs negative appraisal by just a little. Net satisfaction rate now stands at positive 2 percentage points.

As for CE Donald Tsang's popularity, after giving his Address, his support rating has dropped a bit, while his approval rate remains intact. This shows that the Address has no significant effect on his popularity. Looking back at the instant effect of CH Tung and Donald Tsang's Policy Addresses across the years, we found that Tung's Addresses usually have a stimulating effect, while Tsang's Addresses by and large have a dampening effect. However, because CE Tsang's popularity figures are consistently higher than those of CE Tung, such an effect seems to have set very little pressure on CE Tsang.

Furthermore, after excluding those who did not respond for various reasons, 27% said their confidence in the future of Hong Kong had increased after the Policy Address, 22% said their confidence had dropped, while 47% said "no change". This shows that the Address has little effect in boosting people's confidence, but is already more positive than last year, probably because the economy is recovering.

Our instant survey has shown people's instant reaction towards the Policy Address. How public opinion would change after CE and his officials explain their policies remains to be seen.

Next Release (Tentative)
  • October 20, 2009 (Tuesday) 1pm to 2pm: Follow-up survey of Policy Address
  • October 22, 2009 (Thursday) 1pm to 2pm: Ratings of Top 10 Legislative Councillors

| Abstract | Background | Latest Figures | Commentary | Next Release (Tentative)
| Detailed Findings (Popularity of Chief Executive/
Follow-up Survey on the Fifth Policy Address of Donald Tsang Yam-kuen
) |