HKU POP releases the results of the Policy Address second follow-up surveyBack

 
Press Release on January 31, 2013

| Special Announcement| Abstract| Background | Latest Figures | Commentary | Future Release (Tentative) |
| Detailed Findings (Second Follow-up Survey on the First Policy Address of Leung Chun-ying) |


Special Announcement

PopVote Civil Referendum Project” kicks off again and calls for public donations

 

The Public Opinion Programme (POP) at the University of Hong Kong and Centre for Social Policy Studies at the Hong Kong Polytechnic University jointly held a press conference some time ago to introduce the future development of the “PopVote Civil Referendum Project”, as well as to invite donations of HKD800,000 from public to construct and enhance the e-Voting system. The general public can log onto the "Donate Now" page of the "PopVote" website (http://popvote.hk) and leave their contact information if they wish to make a donation.



Abstract


POP interviewed 507 Hong Kong people between 22 and 24 January by means of a random telephone survey conducted by real interviewers, in order to measure again people’s reaction to this year’s Policy Address. According to our Policy Address instant survey, among respondents who had some knowledge of the first address of CY Leung, 36% said they were satisfied. However, in our first follow-up survey, the figure significantly dropped to 27%, while dissatisfaction rate increased from 24% to 39%. After another week, people’s satisfaction rate further drops by 5 percentage points to 22% while dissatisfaction rate continues to increase by 6 percentage points to 45%, sinking the net satisfaction rate to negative 23 percentage points. People’s net satisfaction with CY Leung’s policy direction now stands at negative 10 percentage points, representing a plunge of 13 percentage points from our first follow-up survey. People’s rating of the Policy Address now stands at 43.8 marks, significantly down by 4.4 marks as compared to that of the first follow-up survey. Moreover, people’s appraisal of various policy proposals has also turned negative, meaning that people’s response to CY Leung’s first Policy Address can be considered to have started high ended low. In other words, after many rounds of discussion, the positive effect of the address has vanished, and Leung’s administration may have to face the problems of a weak government again. The maximum sampling error of all percentages is +/-4 percentage points at 95% confidence level, while that of rating figure is +/-2.1 and net value needs another calculation. The response rate of the survey is 67%.


Points to note:
[1] The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of this survey is 507 successful interviews, not 507 x 66.6% response rate. In the past, many media made this mistake.
[3] The maximum sampling error of all percentages is +/-4 percentage points at 95% confidence level, while the sampling error of rating figures and net values needs another calculation. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error of various ratings not more than +/-2.1, that of percentages not more than +/-4% and net values no more than +/-7% at 95% confidence level". 
[4] When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.



Background

Since 1992, POP has been conducting Policy Address instant surveys every year. From 1998 onwards, we expanded our instant surveys to cover the Budget Talks. In general, such surveys would be repeated some time later to measure people's more matured reactions. In 2008, we further enhanced our survey design by splitting our Policy Address instant survey into two. In our instant survey, we measure people’s overall appraisal of the Policy Address, their rating of the Policy Address, their change in confidence towards Hong Kong's future, and CE’s popularity. One to two days later, we started to conduct our first follow-up survey, which mainly studies people’s reactions towards different government proposals, and any change in their satisfaction of the Policy Address. Our second follow-up survey would be conducted a short period later, to repeat our measurement of people’s reactions towards different government proposals, and any change in their satisfaction of the Policy Address. We believe this is a better way to study public opinion on these issues: measuring people's instant reaction first, and then repeat our measurement some time later to check people's more matured reaction. Our Policy Address’s instant and first follow-up surveys this year were released on January 17 and 22 respectively, while the findings of the second follow-up poll are released today.


Latest Figures

The findings of the second follow-up survey of Policy Address released by POP SITE today have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2012. Herewith the contact information of various surveys:

           

Survey series

Date of survey

Sample base

Overall response rate

Sampling error of percentages [6]

2013 Second follow-up

22-24/1/13

507

66.6%

+/-4%

2013 First follow-up

17-18/1/13

530

66.2%

+/-4%

2013 Instant

16/1/13

1,021

68.7%

+/-3%

2011 Second follow-up

17-20/10/11

518

73.9%

+/-4%

2011 First follow-up

13-14/10/11

520

65.5%

+/-4%

2011 Instant

12/10/11

1,032

65.6%

+/-3%

2010 Second follow-up

26-27/10/10

523

64.0%

+/-4%

2010 First follow-up

14-16/10/10

507

64.9%

+/-4%

2010 Instant

13/10/10

1,020

66.9%

+/-3%

2009 Second follow-up

20-26/10/09

513

72.1%

+/-4%

2009 First follow-up

15-17/10/09

508

70.6%

+/-4%

2009 Instant

14/10/09

1,007

71.9%

+/-3%

2008 Second follow-up

27-29/10/08

1,015

70.3%

+/-3%

2008 First follow-up

17-19/10/08

505

70.9%

+/-4%

2008 Instant

15/10/08

1,011

74.9%

+/-3%

[6] Calculated at 95% confidence level using full sample size."95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified

As different questions involve different sub-samples, the sample errors will vary accordingly. The table below briefly shows the relationship between sampling errors and sample size for the readers to capture the corresponding changes:

                   

Sample size
(total sample or sub-sample)

Sampling error of percentages[7]
(maximum values)

Sample size
(total sample or sub-sample)

Sampling error of percentages[7]
(maximum values)

1,300

 +/- 2.8 %

1,350

 +/- 2.7 %

1,200

 +/- 2.9 %

1,250

 +/- 2.8 %

1,100

 +/- 3.0 %

1,150

 +/- 3.0 %

1,000

 +/- 3.2 %

1,050

 +/- 3.1 %

900

 +/- 3.3 %

950

 +/- 3.2 %

800

 +/- 3.5 %

850

 +/- 3.4 %

700

 +/- 3.8 %

750

 +/- 3.7 %

600

 +/- 4.1 %

650

 +/- 3.9 %

500

 +/- 4.5 %

550

 +/- 4.3 %

400

 +/- 5.0 %

450

 +/- 4.7 %

[7] Based on 95% confidence interval.


Results of the second follow-up survey of Policy Address, together with the instant and first follow-up surveys, for 2011 (Donald Tsang’s final Policy Address) and 2013 (CY Leung’s first Policy Address) are tabulated below:

 

 

2011

2013

 

Instant survey

First follow-up survey

Second follow-up survey

Change

Instant survey

First follow-up survey

Second follow-up survey

Latest
change

Date of survey

12/10/11

13-14/10/11

17-20/10/11

--

16/1/13

17-18/1/13

22-24/1/13

--

Sample base

1,032[10]

520

518

--

1,021[10]

530

507

--

Overall response rate

65.6%

65.5%

73.9%

--

68.7%

66.2%

66.6%

--

Latest Finding

Finding and error[8]

Finding and error[8]

Finding and error[8]

--

Finding and error[8]

Finding and error[8]

Finding and error[8]

--

Policy Address: Satisfaction rate [9]

47+/-3%

43+/-4%

33+/-4%

-10%[11]

36+/-3%

27+/-4%[11]

22+/-4%

-5%[11]

Policy Address: Dissatisfaction rate [9]

18+/-3%

25+/-4%

32+/-4%

+7%[11]

24+/-3%

39+/-4%[11]

45+/-4%

+6%[11]

Net value

29+/-5%

18+/-7%

1+/-7%

-17%[11]

12+/-6%

-12+/-7%

-23+/-7%

-11%[11]

Mean Value[9]

3.3+/-0.1
(Base=791)

3.2+/-0.1
(Base=484)

2.9+/-0.1
(Base =501)

-0.3[11]

3.1+/-0.1 (Base=717)

2.8+/-0.1[11]
(Base = 487)

2.6+/-0.1
(Base=482)

-0.2[11]

Rating of Policy Address (0 to 100 marks)

59.1+/-1.4

56.1+/-1.9[11]

51.3+/-1.8

-4.8[11]

56.4+/-1.7[11]

48.2+/-2.1[11]

43.8+/-2.1

-4.4[11]

Satisfaction rate of Tsang’s / Leung’s policy direction [9]

--

33+/-4%[12]

29+/-4%[12]

-4%

--

35+/-4%

29+/-4%

-6%[11]

Dissatisfaction rate of Tsang’s / Leung’s policy direction [9]

--

36+/-4%[12]

41+/-4%[12]

+5%[11]

--

32+/-4%

39+/-4%

+7%[11]

Net value

 

-3+/-7%

-12+/-7%

-9%[11]

 

3+/-7%

-10+/-7%

-13%[11]

Mean Value[9]

--

2.9+/-0.1[12]
(Base = 495)

2.8+/-0.1[12]
(Base =500)

-0.1

--

3.0+/-0.1
(Base= 491)

2.8+/-0.1
(Base=488)

-0.2[11]

[8] Errors are calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Sampling errors of ratings are calculated according to the distribution of the scores collected.
[9] Collapsed from a 5-point scale, the mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance level, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[10] Excluding respondents who were not clear about the Policy Address. The sub-sample size in 2011 was 816 and that in 2013 was 759.
[11] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[12] The ruling CE was Donald Tsang.


Latest second follow-up survey revealed that 22% of the respondents were satisfied with the Policy Address and 45% were dissatisfied, giving net satisfaction of negative 23 percentage points. The mean score is 2.6, which is between "quite dissatisfied" and "half-half" in general. The average rating registered for the Policy Address was 43.8 marks. As for people's satisfaction with CY Leung's policy direction, 29% of the respondents showed satisfaction while 39% were not satisfied, giving net satisfaction of negative 10 percentage points. The mean score is 2.8, meaning close to “half-half”.

 

Results of people’s satisfaction with the Policy Address in previous similar surveys (follow-up survey of Policy Address in 1997, 1998 and 2000 – 2007 and second follow-up surveys of Policy Address in 1999, 2008 – 2013) are tabulated below:

 

Date of survey

Sub-sample base

Appraisal of PA: Satisfaction [14]

Appraisal of PA: Half-half

Appraisal of PA: Dissatisfaction [14]

Net value
(Satisfaction minus dissatisfaction)

Finding & error[13]

Finding & error[13]

Finding & error[13]

Finding & error[13]

22-24/1/13

506

22 +/-4%

29+/-4%

45 +/-4%

-23+/-7%

17-20/10/11

517

33+/-4%

32+/-4%

32+/-4%

1+/-7%

26-27/10/10

517

31[15] +/-4%

30 +/-4%

33[15] +/-4%

-2[15]+/-7%

20-26/10/09

506

20+/-4%

28[15] +/-4%

45[15] +/-4%

-25[15]+/-7%

27-29/10/08

556

24[15]+/-4%

36%[15] +/-4%

35[15] +/-4%

-11[15]+/-6%

22-23/10/07

526

43[15] +/-4%

31[15] +/-4%

18[15] +/-3%

25+/-6%

23-24/10/06

506

26[15] +/-4%

41[15] +/-4%

23[15]+/-4%

3[15]+/-6%

25-27/10/05

511

41+/-4%

24+/-4%

5+/-2%

36+/-5%

27-31/1/05

1,012

17+/-2%

37[15] +/-3%

23[15] +/-3%

-6[15]+/-4%

14-16/1/04

987

10[15] +/-2%

27[15] +/-3%

29[15] +/-3%

-19[15]+/-4%

23-28/1/03

1,049

13 +/-2%

22[15] +/-3%

37[15] +/-3%

-24[15]+/-4%

21-23/10/01

1,056

14 +/-2%

32[15] +/-3%

31[15] +/-3%

-16[15]+/-4%

23-25/10/00

1,026

15[15] +/-2%

28 +/-3%

25 +/-3%

-10[15]+/-4%

22/10/99

553

12[15] +/-3%

28 +/-4%

27[15] +/-4%

-15+/-5%

20/10/98

460

22[15] +/-4%

31 +/-4%

37[15]+/-5%

-15+/-7%

14-15/10/97

515

31[15]+/-4%

27 +/-4%

14 +/-3%

17+/-6%

[13] Errors are calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[14] Collapsed from a 5-point scale.
[15] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.

 

Compared to similar surveys conducted after the handover, people’s satisfaction rate with CY Leung’s first Policy Address is lower than all those registered for Tsang’s six addresses, while it is still higher than all those registered for Tung's third to eighth addresses.

 

Other results of both first and second follow-up surveys of Policy Address 2013 are tabulated below:


 

First follow-up survey

Second follow-up survey

Change

Date of survey

17-18/1/13

22-24/1/13

--

Sample base

530

507

--

Overall response rate

66.2%

66.6%

--

Latest Finding

Finding and error[16]

Finding and error[16]

--

The theme of this year’s Policy Address “Seek Change Maintain Stability Serve the People with Pragmatism” concurs the current needs of the society.

53+/-4%

48+/-4%

-5%[17]

The theme of this year’s Policy Address “Seek Change Maintain Stability Serve the People with Pragmatism” does not concur the current needs of the society.

27+/-4%

32+/-4%

+5%[17]

Support CY Leung’s views that home ownership by the middle class was crucial to social stability, the Government was therefore determined to uphold the principle of assisting grassroots families in moving into public housing and the middle-income families in buying their own homes.

77+/-4%

73+/-4%

-4%

Oppose to CY Leung’s views that home ownership by the middle class was crucial to social stability, the Government was therefore determined to uphold the principle of assisting grassroots families in moving into public housing and the middle-income families in buying their own homes.

10+/-3%

16+/-3%

+6%[17]

Support the abolishment of all DC appointed seats from 2016 onwards.

61+/-4%

53+/-4%

-8%[17]

Oppose to the abolishment of all DC appointed seats from 2016 onwards.

14+/-3%

22+/-4%

+8%[17]

Support the lack of specific measure that provides instant benefits to the grassroots and middle class proposed in CY Leung’ Policy Address.

45+/-4%

42+/-4%

-3%

Oppose to the lack of specific measure that provides instant benefits to the grassroots and middle class proposed in CY Leung’ Policy Address.

34+/-4%

39+/-4%

+5%[17]

Regard the effect of setting poverty line to thoroughly investigate the causes of poverty proposed by CY Leung on tackling the poverty problems to be large.

17+/-3%

19+/-3%

+2%

Regard the effect of setting poverty line to thoroughly investigate the causes of poverty proposed by CY Leung on tackling the poverty problems to be small.

52+/-4%

56+/-4%

+4%

Regard the effect of the housing and land supply policies proposed by CY Leung on tackling housing problems to be large.

20+/-4%

15+/-3%

-5%[17]

Regard the effect of the housing and land supply policies proposed by CY Leung on tackling housing problems to be small.

44+/-4%

58+/-4%

+14%[17]

[16] Errors are calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[17] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.


Results showed that 48% thought the theme of the Policy Address “Seek Change Maintain Stability Serve the People with Pragmatism” concurred with the current needs of the society while 32% did not think so. Besides, 73% supported CY Leung’s views that home ownership by the middle class was crucial to social stability, the Government was therefore determined to uphold the principle of assisting grassroots families in moving into public housing and the middle-income families in buying their own homes while 16% opposed. Besides, 53% supported the abolishment of all DC appointed seats from 2016 onwards while 22% opposed. Regarding the lack of specific measure that provides instant benefits to the grassroots and middle class proposed in CY Leung’ Policy Address, 42% supported this practice while 39% opposed. As for the effect of setting poverty line to thoroughly investigate the causes of poverty proposed by CY Leung on tackling the poverty problems, 19% said the effect would be big while 56% said it would be small. As for the effect of the housing and land supply policies on tackling housing problems, 15% said the effect would be big while 58% said it would be small.



Commentary

Note: The following commentary was written by Director of POP Robert Chung.

 

According to our Policy Address instant survey, among respondents who had some knowledge of the first address of CY Leung, 36% said they were satisfied. However, in our first follow-up survey, the figure significantly dropped to 27%, while dissatisfaction rate increased from 24% to 39%. After another week, people’s satisfaction rate further drops by 5 percentage points to 22% while dissatisfaction rate continues to increase by 6 percentage points to 45%, sinking the net satisfaction rate to negative 23 percentage points. People’s net satisfaction with CY Leung’s policy direction now stands at negative 10 percentage points, representing a plunge of 13 percentage points from our first follow-up survey. People’s rating of the Policy Address now stands at 43.8 marks, significantly down by 4.4 marks as compared to that of the first follow-up survey. Moreover, people’s appraisal of various policy proposals has also turned negative, meaning that people’s response to CY Leung’s first Policy Address can be considered to have started high ended low. In other words, after many rounds of discussion, the positive effect of the address has vanished, and Leung’s administration may have to face the problems of a weak government again.



Future Release (Tentative)

  • February 5, 2013 (Tuesday) 1pm to 2pm: Ratings of top 5 Executive Councillors


| Special Announcement| Abstract| Background | Latest Figures | Commentary | Future Release (Tentative) |
| Detailed Findings (Second Follow-up Survey on the First Policy Address of Leung Chun-ying) |