HKU POP releases the results of Policy Address follow-up surveyBack

 
Press Release on January 22, 2013

| Abstract | Background | Latest Figures | Commentary | Future Releases (Tentative) |
| Detailed Findings (Follow-up Survey on the First Policy Address of Leung Chun-ying) |


Abstract

According to the Policy Address instant survey conducted by the Public Opinion Programme (POP) at the University of Hong Kong, among respondents who had some knowledge of CY Leung’s first Policy Address, 36% said they were satisfied. However, in our follow-up survey conducted between 17 and 18 January, the figure drops significantly to 27%, while dissatisfaction rate increases from 24% to 39%. This is similar to the past but the fluctuation is slightly bigger. In terms of rating, our follow-up survey records an average score of 48.2, a very significant drop of 8.2 marks compared to our instant poll. All in all, after some initial discussions, people’s appraisal of this year’s Policy Address has dropped remarkably. POP will soon conduct another round of follow-up survey to map people’s further reaction. Regarding the theme of the Address, 53% of respondents agree that “Seek Change Maintain Stability, Serve the People with Pragmatism” meets the need of society. In terms of key policy areas, 77% support the Government to uphold the principle of assisting grassroots families in moving into public housing, and helping the middle-income families to buy their own homes. Besides, 61% support the abolishment of all DC appointed seats from 2016 onwards, whereas 45% support the “no giveaway” practice in the Address. However, 44% consider the effect of the housing and land supply policies on tackling housing problems to be “small”, and as many as 52% consider that of setting poverty line in tackling poverty problems to be “small”. Finally, according to the results of our tracking question, people's net satisfaction with CY Leung's policy direction now stands at positive 3 percentage points, which is better than the corresponding figure for Donald Tsang after he delivered his Policy Address in 2011. POP will release another round of Policy Address survey findings in a little more than one week’s time. Whether public opinion would change after many rounds of discussion remains to be seen. The follow-up survey interviewed 530 Hong Kong people by means of a random telephone survey conducted by real interviewers. The maximum sampling error of all percentages is +/-4 percentage points at 95% confidence level, while that of rating figure is +/-2.1 and net value needs another calculation. The response rate of the survey is 66%.

Points to note:
[1] The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of this survey is 530 successful interviews, not 530 x 66.2% response rate. In the past, many media made this mistake.
[3] The maximum sampling error of all percentages is +/-4 percentage points at 95% confidence level, while the sampling error of rating figures and net values needs another calculation. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error of various ratings not more than +/-2.1, that of percentages not more than +/-4% and net values no more than +/-7% at 95% confidence level". 
[4] When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.


Background

Since 1992, POP has been conducting Policy Address instant surveys every year. In 1998, we expanded our instant surveys to cover the Budget Talks. In general, such instant polls which measure people's instant reactions would be repeated later by a follow-up survey which measure people's more matured reactions. We believe this is the correct way to study public opinion. In 2008, we further split our instant survey into two. In our first survey, we measure people's overall appraisal of the Policy Address, their rating of the Policy Address, their change in confidence towards Hong Kong's future, and CE's popularity. One to two days later, we would conduct our first follow-up survey to study people's reactions towards different government proposals, and any change in their satisfaction of the Policy Address. The findings of this year’s instant survey were already released on January 17. Today, we release the results of our first follow-up survey.


Latest Figures

The findings of the Policy Address follow-up survey released by POP today have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2012. Herewith the contact information of various surveys:

                               

Year of survey

Date of survey

Total sample size

Response rate

Sampling error of %[6]

2013 Follow-up

17-18/1/13

530

66.2%

+/-4%

2013 Instant

16/1/13

1,021

68.7%

+/-3%

2011 Follow-up

13-14/10/11

520

65.5%

+/-4%

2011 Instant

12/10/11

1,032

65.6%

+/-3%

2010 Follow-up

14-16/10/10

507

64.9%

+/-4%

2010 Instant

13/10/10

1,020

66.9%

+/-3%

2009 Follow-up

15-17/10/09

508

70.6%

+/-4%

2009 Instant

14/10/09

1,007

71.9%

+/-3%

2008 Follow-up

17-19/10/08

505

70.9%

+/-4%

2008 Instant

15/10/08

1,011

74.9%

+/-3%

2007 Instant

10/10/07

1,023

69.9%

+/-3%

2006 Instant

11/10/06

1,027

60.7%

+/-3%

2005 Instant

12/10/05

914

66.1%

+/-3%

2004 Instant

7/1/04

1,040

67.5%

+/-3%

2003 Instant

8-9/1/03

1,259

68.9%

+/-3%

2001 Instant

10/10/01

1,051

66.0%

+/-3%

2000 Instant

11/10/00

1,059

69.7%

+/-3%

1999 Instant

6/10/99

888

54.5%

+/-3%

1998 Instant

7/10/98

1,494

56.5%

+/-3%

1997 Instant

8/10/97

1,523

61.5%

+/-3%

[6] Calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Questions using only sub-samples would have bigger sample error. Sampling errors of ratings are calculated according to the distribution of the scores collected.


Results of the follow-up survey of Policy Address, together with the instant poll, for 2011 and 2013 are tabulated below:

 

2011

2013

 

Instant survey [9]

Follow-up survey

Change

Instant survey [10]

Follow-up survey

Latest Change

Date of survey

12/10/11

13-14/10/11

--

16/1/13

17-18/1/13

--

Sample base

1,032

520

--

1,021

530

--

Overall response rate

65.6%

65.5%

--

68.7%

66.2%

--

Latest finding

Finding

Finding and error[7]

--

Finding

Finding and error[7]

--

Appraisal of Policy Address: Satisfaction rate [8]

47%

43%

-4%

36%

27+/-4%

-9%[11]

Appraisal of Policy Address: Dissatisfaction rate [8]

18%

25%

+7%[11]

24%

39+/-4%

+15%[11]

Mean value[8]

3.3+/-0.1
(Base = 791)

3.2+/-0.1
(Base = 484)

-0.1

3.1+/-0.1
(Base = 717)

2.8+/-0.1
(Base = 487)

-0.3[11]

Satisfaction rating of Policy Address (0 to 100 marks)

59.1

56.1 [11]

-3.0[11]

56.4

48.2+/-2.1

-8.2[11]

[7] Errors are calculated at 95% confidence level. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
[8] Collapsed from a 5-point scale, the mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[9] Excluding respondents who did not answer this question because they had not heard of / did not know the details of the Policy Address. The sub-sample size was 816.
[10] Excluding respondents who did not answer this question because they had not heard of / did not know the details of the Policy Address. The sub-sample size was 759.
[11] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.


Our latest survey revealed that 27% of the respondents were satisfied with the Policy Address and 39% were dissatisfied. The mean score is 2.8, meaning close to “half-half” in general. The average rating registered for the Policy Address was 48.2 marks. With respect to people's specific reactions towards the contents of this year's Policy Address, relevant findings are summarized below:

Date of survey

17-18/1/13

Sample base

530

Overall response rate

66.2%

Latest finding

Finding and error[12]

 

Yes

Half-half

No

Don’t know/ hard to say

Total

The theme of this year’s Policy Address is “Seek Change Maintain Stability Serve the People with Pragmatism”. Do you think this theme concurs with the current needs of the society?

53+/-4%

12+/-3%

27+/-4%

8+/-2%

100%

 

Support

Half-half

Oppose

Don’t know/ hard to say

Total

CY Leung mentioned home ownership by the middle class is crucial to social stability, the Government is therefore determined to uphold the principle of assisting grassroots families in moving into public housing and the middle-income families in buying their own homes. Do you support or oppose this policy?

77+/-4%

9+/-2%

10+/-3%

5+/-2%

100%

CY Leung proposed to abolish all DC appointed seats from 2016 onwards. Do you support or oppose this proposal?

61+/-4%

7+/-2%

14+/-3%

17+/-3%

100%

There was no specific measure that provides instant benefits to the grassroots and middle class proposed in CY Leung’ Policy Address, i.e. “no giveaway”. Do you support or oppose this practice?

45+/-4%

15+/-3%

34+/-4%

7+/-2%

100%

 

Big

Half-half

Small

Don’t know/ hard to say

Total

Do you think the effect of the housing and land supply policies proposed by CY Leung on tackling housing problems would be big or small?

20+/-4%

25+/-4%

44+/-4%

11+/-3%

100%

Do you think the effect of setting poverty line to thoroughly investigate the causes of poverty proposed by CY Leung on tackling the poverty problems would be big or small?

17+/-3%

21+/-4%

52+/-4%

10+/-3%

100%

[12] Errors are calculated at 95% confidence level. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.


Findings on people’s opinion whether the theme of Policy Address concurred with the current needs of the society from 1997 up to this year are summarized as follows:

People’s opinion whether the theme of Policy Address delivered by CY Leung
concurred with the current needs of the society in 2013 [14]

Date of Survey

Sample/ Sub
sample base [15]

Policy Address

Theme

Finding and error [13]

Yes

Half-half

No

Don’t know/ hard to say

17-18/1/13

530

1st

Seek Change Maintain Stability Serve the People with Pragmatism

53+/-4%

12+/-3%

27+/-4%

8+/-2%

 

People’s opinion whether the theme of Policy Address delivered by Donald Tsang
concurred with the current needs of the society from 2005 till 2011 [14]

Date of Survey

Sample/ Sub
sample base [15]

Policy Address

Theme

Finding and error [13]

Yes

Half-half

No

Don’t know/ hard to say

13-14/10/11

520

7th

From Strength to Strength

43[16] +/-4%

9[16]
+/-3%

36[16] +/-4%

12[16] +/-3%

14-16/10/10

507

6th

Sharing Prosperity for a Caring Society

66[16]+/-4%

13+/-3%

18[16] +/-3%

4[16]
+/-2%

15-17/10/09

506

5th

Breaking New Ground Together

45[16] +/-4%

16[16]  +/-3%

30[16]  +/-4%

9
+/-3%

17-19/10/08

503

4th

Embracing New Challenges

57[16] +/-4%

10+/-3%

24[16] +/-4%

9[16]
+/-3%

10/10/07

512

3rd

A New Direction for Hong Kong

69+/-4%

8+/-2%

9[16]  +/-3%

15[16] +/-3%

11/10/06

582

2nd

Proactive Pragmatic Always People First

71 +/-4%

10 +/-2%

14[16] +/-3%

5[16]
+/-2%

12/10/05

913

1st

Strong Governance for the People

72 +/-3%

10 +/-2%

8 +/-2%

10 +/-2%


People’s opinion whether the theme of Policy Address delivered by Tung Chee-hwa
concurred with the current needs of the society from 1997 till 2005 [14]

Date of Survey

Sample/ Subsample base [15]

Policy Address

Theme

Finding and error [13]

Yes

Half-half

No

Don’t know/ hard to say

12/1/05

1,031

8th

Working Together for Economic Development and Social Harmony

77[16]  +/-3%

7[16]  +/-2%

10[16]  +/-2%

 6[16]  +/-1%

7/1/04

1,031

7th

Seizing Opportunities for Development: Promoting People-based Governance

49[16]  +/-3%

12[16]  +/-2%

19 +/-2%

20[16]  +/-2%

8-9/1/03

1,250

6th

Capitalising on Our Advantages: Revitalizing our Economy

61[16] +/-3%

7 [16]+/-1%

18[16]  +/-2%

13[16] +/-2%

10/10/01

1,048

5th

Building on our Strengths, Investing in our Future

45[16]  +/-3%

12[16]  +/-2%

25[16]  +/-3%

18[16]  +/-2%

11/10/00

1,041

4th

Serving the Community, Sharing Common Goals

63[16]  +/-3%

6 +/-1%

17 +/-2%

15[16]  +/-2%

6/10/99

888

3rd

Quality People, Quality Home

69 +/-3%

7 +/-2%

15 +/-2%

8 +/-2%

7/10/98[17]

--

2nd

From Adversity to Opportunity

--

--

--

--

8/10/97[17]

--

1st

Building Hong Kong for a New Era

--

--

--

--

[13] Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[14] The question wordings were “The theme of this year’s Policy Address is ‘XXXX’. Do you think this theme concurs with the current needs of the society?”
[15] Excluding those respondents who refused to answer this question. Since 2006, this series of question only use sub-sample.
[16] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[17] This question was not covered in the instant Policy Address poll in 1997 and 1998.


Results showed that 53% thought the theme of the Policy Address “Seek Change Maintain Stability Serve the People with Pragmatism” concurred with the current needs of the society while 27% did not think so. Besides, 77% supported CY Leung’s views that home ownership by the middle class was crucial to social stability, the Government was therefore determined to uphold the principle of assisting grassroots families in moving into public housing and the middle-income families in buying their own homes while 10% opposed. Besides, 61% supported the abolishment of all DC appointed seats from 2016 onwards while 14% opposed. Regarding the lack of specific measure that provides instant benefits to the grassroots and middle class proposed in CY Leung’ Policy Address, 45% supported this practice while 34% opposed. As for the effect of the housing and land supply policies on tackling housing problems, 20% said the effect would be big while 44% said it would be small. As for the effect of setting poverty line to thoroughly investigate the causes of poverty proposed by CY Leung on tackling the poverty problems, 17% said the effect would be big while 52% said it would be small.

Respondents’ appraisal of CY Leung’s policy direction, together with people’s appraisals of Donald Tsang’s policy direction at the same period in previous years, are tabulated below:

Date of survey

15-17/10/09

14-16/10/10

13-14/10/11

17-18/1/13

Latest change

Sample base

508

507

520

530

--

Overall response rate

70.6%

64.9%

65.5%

66.2%

--

Latest finding and error[18]

Finding

Finding

Finding

Finding and error [18]

 

Satisfaction rate of Tsang’s / Leung’s policy direction [19]

25%[20][21]

32%[20] [21]

33%[21]

35+/-4%

+2%

Dissatisfaction rate of Tsang’s / Leung’s policy direction [19]

34%[20] [21]

28%[20] [21]

36%[20] [21]

32+/-4%

-4%

Net value

-9%[20]

4%[20]

-3%

3+/-7%

+6%

Mean value [19]

2.8+/-0.1[20][21]
(Base= 495)

3.0+/-0.1[20] [21]
(Base= 477)

2.9+/-0.1[21]
(Base= 495)

3.0+/-0.1
(Base= 491)

+0.1

[18] Errors are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. The error margin of previous survey can be found at the POP Site.
[19] Collapsed from a 5-point scale, the mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[20] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[21] The ruling CE was Donald Tsang.


As for people's satisfaction with CY Leung's policy direction, 35% of the respondents showed satisfaction while 32% were not satisfied. The mean score is 3.0, meaning close to “half-half” in general.


Commentary

Note: The following commentary was written by Director of POP Robert Chung.

According to our Policy Address instant survey, among respondents who had some knowledge of CY Leung’s first Policy Address, 36% said they were satisfied. However, in our follow-up survey, the figure drops significantly to 27%, while dissatisfaction rate increases from 24% to 39%. This is similar to the past but the fluctuation is slightly bigger. In terms of rating, our follow-up survey records an average score of 48.2, a very significant drop of 8.2 marks compared to our instant poll. All in all, after some initial discussions, people’s appraisal of this year’s Policy Address has dropped remarkably. POP will soon conduct another round of follow-up survey to map people’s further reaction.

 

Regarding the theme of the Address, 53% of respondents agree that “Seek Change Maintain Stability, Serve the People with Pragmatism” meets the need of society. In terms of key policy areas, 77% support the Government to uphold the principle of assisting grassroots families in moving into public housing, and helping the middle-income families to buy their own homes. Besides, 61% support the abolishment of all DC appointed seats from 2016 onwards, whereas 45% support the “no giveaway” practice in the Address. However, 44% consider the effect of the housing and land supply policies on tackling housing problems to be “small”, and as many as 52% consider that of setting poverty line in tackling poverty problems to be “small”.

 

Finally, according to the results of our tracking question, people's net satisfaction with CY Leung's policy direction now stands at positive 3 percentage points, which is better than the corresponding figure for Donald Tsang after he delivered his Policy Address in 2011.

 

POP will release another round of Policy Address survey findings in a little more than one week’s time. Whether public opinion would change after many rounds of discussion remains to be seen.




Future Releases (Tentative)

  • January 24, 2013 (Thursday) 1pm to 2pm:  Popularity of Top Ten Legislative Councillors

  • January 29, 2013 (Tuesday) 1pm to 2pm:  Popularity of CE and SAR Government


| Abstract | Background | Latest Figures | Commentary | Future Releases (Tentative) |
| Detailed Findings (Follow-up Survey on the First Policy Address of Leung Chun-ying) |