HKU POP SITE releases the results of the Policy Address second follow-up surveyBack

 
Press Release on October 27, 2009

| Abstract | Background | Latest Figures | Commentary | Next Release (Tentative)
| Detailed Findings (Popularity of Chief Executive/Second Follow-up Survey on the Fifth Policy Address of Donald Tsang Yam-kuen) |


Abstract

The Public Opinion Programme (POP) at the University of Hong Kong interviewed 513 Hong Kong people between 20 and 26 October by means of a random telephone survey conducted by real interviewers. The survey finds that people's satisfaction with the Policy Address has gone up slightly by 1 percentage point, but their dissatisfaction rate jumps 14 percentage points to 45%. People's satisfaction with Donald Tsang's policy direction remains the same but their dissatisfaction rate increases significantly by 7 percentage points. People's rating of the Policy Address now stands at 43.0 marks, having plunged 6.8 marks, and the net satisfaction rate of the Address and that of Tsang's policy direction now stand at negative 25% and negative 16% respectively. Moreover, in terms of the Address' theme and content, according to our latest follow-up survey, over 40% still agree that 「Breaking New Ground Together」 is an appropriate theme for the Address, having dropped somewhat. Donald Tsang suggested reinforcing the four traditional pillar industries and developing six key industries, and also proposed measures to conserve Central. Although their support rates have dropped, their net values still stay high at positive 46 and positive 63 percentage points respectively. However, Tsang did not mention helping the poor and the needy in his Address, he also brushed aside constitutional development lightly. These earned him net satisfaction rates of negative 46 and negative 5 percentage points respectively. POP Director Robert Chung sums up, compared to similar surveys conducted after the handover, after rounds of discussion, people's appraisal of this year's Policy Address is the worst among Tsang's five addresses. Other than addressing the issues of governance and policy direction, it seems that Tsang also needs to address the issue of image and style. The maximum sampling error of all percentages is between +/-3 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figure is +/-2.0. The response rate of the survey is 72%.

Points to note:
* The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
* The sample size of this survey is 513 successful interviews, not 513 x 72.1% response rate. In the past, many media made this mistake.
* The maximum sampling error of all percentages is between +/-3 and +/-4 percentage points at 95% confidence level, while the sampling error of rating figure is +/-2.0. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error of rating not more than +/-2.0 and sampling error of percentages not more than +/-4% at 95% confidence level".
* When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
* The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.

Background

Since 1992, POP has been conducting Policy Address instant surveys every year. From 1998 onwards, we expanded our instant surveys to cover the Budget Talks. Starting from 2008, we split up previous years' instant survey into two surveys. In our first survey, we measure people's overall appraisal of the Policy Address, their rating of the Policy Address, their change in confidence towards Hong Kong's future, and CE's popularity. Two days later, we started to conduct our second survey, which mainly studies people's reactions towards different government proposals, and any change in their satisfaction of the Policy Address. There is no change for follow-up polls following weeks after the instant polls. We believe this is a better way to study public opinion on these issues: measure people's instant reaction to the policies, and then repeat in our follow-up surveys, which measure people's more matured reaction. Our Policy Address's instant and follow-up surveys this year were released on October 15 and 20 respectively, while the findings of the second round follow-up poll are released today.

Latest Figures

The findings of the second round survey of Policy Address released by POP SITE today have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2009. Herewith the contact information of various surveys:

Survey series

Date of survey

Sample base

Overall response rate

Sampling error of percentages*

2009 Second round

20-26/10/09

513

72.1%

+/-4%

2009 Follow-up

15-17/10/09

508

70.6%

+/-4%

2009 Instant

14/10/09

1,007

71.9%

+/-3%

2008 Second round

27-29/10/08

1,015

70.3%

+/-3%

2008 Follow-up

17-19/10/08

505

70.9%

+/-4%

2008 Instant

15/10/08

1,011

74.9%

+/-3%

* Calculated at 95% confidence level using full sample size."95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.

As different questions involve different sub-samples, the sample errors will vary accordingly. The table below briefly shows the relationship between sampling errors and sample size for the readers to capture the corresponding changes:

Sample size
(total sample or sub-sample)

Sampling error of percentages*
(maximum values)

Sample size
(total sample or sub-sample)

Sampling error of percentages*
(maximum values)

1,300

 +/- 2.8 %

1,350

 +/- 2.7 %

1,200

 +/- 2.9 %

1,250

 +/- 2.8 %

1,100

 +/- 3.0 %

1,150

 +/- 3.0 %

1,000

 +/- 3.2 %

1,050

 +/- 3.1 %

900

 +/- 3.3 %

950

 +/- 3.2 %

800

 +/- 3.5 %

850

 +/- 3.4 %

700

 +/- 3.8 %

750

 +/- 3.7 %

600

 +/- 4.1 %

650

 +/- 3.9 %

500

 +/- 4.5 %

550

 +/- 4.3 %

400

 +/- 5.0 %

450

 +/- 4.7 %

* Based on 95% confidence interval.

Results of the second round follow-up survey of Policy Address, together with the instant and follow-up surveys, for 2008 and 2009 are tabulated below:

 

2008

2009

 

Instant survey

Follow-up survey

Second round survey

Change

Instant survey

Follow-up survey

Second round survey

Latest
change

Date of survey

15/10/08

17-19/10/08

27-29/10/08

--

14/10/09

15-17/10/09

20-26/10/09

--

Sample base

1,011

505

512-615

--

1,007

508

506-511

--

Overall response rate

74.9%

70.9%

70.3%

--

71.9%

70.6%

72.1%

--

Appraisal of Policy Address: Satisfaction rate**

31%^ +/-4%

19% +/-3%

24% +/-4%

+5%#

30%^ +/-4%

19% +/-3%

20% +/-4%

+1%

Appraisal of Policy Address: Dissatisfaction rate**

26%^ +/-4%

31% +/-4%

35% +/-4%

+4%

28%^ +/-4%

31% +/-4%

45% +/-4%

+14%#

Satisfaction rating of Policy Address (0 to 100 marks)

53.8^ +/-2.0

52.4 +/-1.6

51.3 +/-1.6

-1.1

53.5^ +/-2.1

49.8 +/-1.6

43.0 +/-2.0

-6.8#

Satisfaction rate of Tsang's policy direction**

--

22% +/-4%

25% +/-4%

+3%

--

25% +/-4%

25% +/-4%

--

Dissatisfaction rate of Tsang's policy direction**

--

32% +/-4%

35% +/-4%

+3%

--

34% +/-4%

41% +/-4%

+7%#

* Errors are calculated at 95% confidence level using full sample size. 「95% confidence level」 means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
** Collapsed from a 5-point scale.
# Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

Latest survey revealed that 20% of the respondents were satisfied with the Policy Address and 45% were dissatisfied. The average rating registered for the Policy Address was 43.0 marks. As for people's satisfaction with Donald Tsang's policy direction, 25% of the respondents showed satisfaction while 41% were not satisfied.

Results of people's satisfaction with the Policy Address in previous similar surveys (follow-up survey of Policy Address in 1997, 1998 and 2000 – 2007 and second round follow-up survey of Policy Address in 1999, 2008 and 2009) are tabulated below:

Date of survey

Sub-sample base

Appraisal of Policy Address: Satisfaction **

Appraisal of Policy Address: Half-half

Appraisal of Policy Address: Dissatisfaction **

20-26/10/09

506

20%+/- 4%

28%#+/- 4%

45%#+/- 4%

27-29/10/08

556

24%# +/- 4%

36% +/- 4%

35% +/- 4%

22-23/10/07

526

44%# +/- 4%

31%# +/- 4%

18%# +/- 3%

23-24/10/06

506

26%# +/- 4%

41%# +/- 4%

23%# +/- 4%

25-27/10/05

513

41%# +/- 4%

24%#+/- 4%

5%# +/- 2%

27-31/1/05

1,012

17%# +/- 2%

37%# +/- 3%

23%# +/- 3%

14-16/1/04

987

10%# +/- 2%

27%# +/- 3%

29%# +/- 3%

23-28/1/03

1,049

13%# +/- 2%

22%# +/- 3%

37%# +/- 3%

21-23/10/01

1,056

14% +/- 2%

32%# +/- 3%

31%# +/- 3%

23-25/10/00

1,031

15% +/- 2%

28% +/- 3%

25% +/- 3%

22/10/99

553

12% +/- 3%

28% +/- 4%

27% +/- 4%

20/10/98

533

19%# +/- 3%

27% +/- 4%

32%# +/- 4%

14-15/10/97

517

31%# +/- 4%

27% +/- 4%

14% +/- 3%

* Errors are calculated at 95% confidence level using full sample size. 「95% confidence level」 means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
** Collapsed from a 5-point scale.
# Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

Compared to similar surveys conducted after the handover, people's satisfaction rate with this year's Policy Address is the lowest among Tsang's five addresses, while it is still higher than all those registered for Tung's second to eighth addresses.

Results of the second round follow-up survey of Policy Address 2009, together with the instant and follow-up surveys are tabulated below:

 

Follow-up survey

Second round survey

Change

Date of survey

15-17/10/09

20-26/10/09

--

Sample base

508

506-511

--

Overall response rate

70.6%

72.1%

--

Agree that he theme of this year's Policy Address is 「Breaking New Ground Together」

45% +/-4%

41% +/-4%

-4%

Disagree that he theme of this year's Policy Address is 「Breaking New Ground Together」

30% +/-4%

34% +/-4%

+4%

Support reinforcing the four traditional pillar industries and developing the six industries

66% +/-4%

60% +/-4%

-6%#

Object to reinforcing the four traditional pillar industries and developing the six industries

12% +/-3%

14% +/-3%

+2%

Support the measures conserving Central, including reserving the Central Market and the Central Police Station

78% +/-4%

75% +/-4%

-3%

Object to the measures conserving Central, including reserving the Central Market and the Central Police Station

10% +/-3%

12% +/-3%

+2%

Satisfied with Donald Tsang's handling method of mentioning quality life and progressive society, but not helping the poor and the needy again

22% +/-4%

18% +/-3%

-4%#

Dissatisfied with Donald Tsang's handling method of mentioning quality life and progressive society, but not helping the poor and the needy again

59% +/-4%

64% +/-4%

+5%#

Satisfied with Donald Tsang's handling method of just simply said that the public consultations would be commenced next month regarding constitutional development

38% +/-4%

35% +/-4%

-3%

Dissatisfied with Donald Tsang's handling method of just simply said that the public consultations would be commenced next month regarding constitutional development

41% +/-4%

40% +/-4%

-1%

* Errors are calculated at 95% confidence level using full sample size. 「95% confidence level」 means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
# Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

Results showed that 41% thought the theme of the Policy Address 「Breaking New Ground Together」 concurred with the current needs of the society while 34% did not think so. Besides, Donald Tsang suggested reinforcing the four traditional pillar industries and developing the six industries and proposed measures conserving Central, including reserving the Central Market and the Central Police Station, a respective of 60% and 75% supported his suggestions while 14% and 12% objected to these correspondingly. Findings also showed that a respective of 18% and 35% of respondents were satisfied with Donald Tsang's handling method of mentioning quality life and progressive society, but not helping the poor and the needy again and of simply mentioning the public consultations would be commenced next month regarding constitutional development, while 64% and 40% were dissatisfied.

Commentary

Note: The following commentary was written by Director of POP Robert Chung.

According to our Policy Address instant survey, among respondents who had some knowledge of the 5th Address of Donald Tsang, 30% said they were satisfied. However, in our first follow up survey, the figure dropped to 19%, while dissatisfaction rate increased from 28% to 31%. After another 5 days, people's satisfaction rate goes up slightly by 1 percentage point, but their dissatisfaction rate jumps 14 percentage points to 45%. People's satisfaction with Donald Tsang's policy direction remains the same but their dissatisfaction rate increases significantly by 7 percentage points. People's rating of the Policy Address now stands at 43.0 marks, having plunged 6.8 marks, and the net satisfaction rate of the Address and that of Tsang's policy direction now stand at negative 25% and negative 16% respectively.

Moreover, in terms of the Address' theme and content, according to our latest follow-up survey, over 40% still agree that 「Breaking New Ground Together」 is an appropriate theme for the Address, having dropped somewhat. Donald Tsang suggested reinforcing the four traditional pillar industries and developing six key industries, and also proposed measures to conserve Central. Although their support rates have dropped, their net values still stay high at positive 46 and positive 63 percentage points respectively. However, Tsang did not mention helping the poor and the needy in his Address, he also brushed aside constitutional development lightly. These earned him net satisfaction rates of negative 46 and negative 5 percentage points respectively.

To sum up, compared to similar surveys conducted after the handover, after rounds of discussion, people's appraisal of this year's Policy Address is the worst among Tsang's five addresses. Other than addressing the issues of governance and policy direction, it seems that Tsang also needs to address the issue of image and style.

Next Release (Tentative)
  • November 3, 2009 (Tuesday) 1pm to 2pm: Popularity figures of CE, the HKSAR Government, Executive Councilors, Under Secretaries and Political Assistants

| Abstract | Background | Latest Figures | Commentary | Next Release (Tentative)
| Detailed Findings (Popularity of Chief Executive/Second Follow-up Survey on the Fifth Policy Address of Donald Tsang Yam-kuen) |