HKU POP releases findings on people’s expectation of CE CY Leung’s Policy AddressBack
Press Release on January 17, 2017
| Detailed Findings (Policy Address Feature Page) |
Special Announcements
1. As in previous years, Public Opinion Programme (POP) at The University of Hong Kong will conduct an instant survey after the Chief Executive delivers his policy address tomorrow (January 18, 2017, Wednesday). Results will be announced as soon as possible, after which POP will conduct follow-up surveys. Media interested in sponsoring these surveys can contact POP.
2. To facilitate academic study and rational discussion, POP has already released for public examination some time ago via the “HKU POP Site” (http://hkupop.pori.hk) the raw data of all 112 regular rating surveys of CE CY Leung, as well as the 181 regular rating surveys of former CE Donald Tsang and 239 regular rating surveys of former CE CH Tung, along with related demographics of respondents. Please follow normal academic standards when using or citing such data.
Abstract
POP conducted a double stage survey on people’s expectation of CE CY Leung’s Policy Address in early January 2017 by means of random telephone surveys conducted by real interviewers. We use a two-stage design to study both the absolute and relative importance of different policy items. In our latest surveys, when asked to name only one issue unaided, most people considered “housing” the most pressing policy area to be handled in CE CY Leung’s Policy Address. In terms of absolute percentage of importance, 85% said CE should tackle housing problems, with a mean score of 4.5, in between “very important” and “quite important”. Both figures are the highest across all items. The second to fifth items in terms of mean score are “medical policy”, “social welfare”, “economic development” and “political development”. Among them, only the mean score of importance of “political development” has dropped significantly. All five items are the same as those one year ago, although their degree and order have changed. The maximum sampling error of the survey is +/-4 percentage points at 95% confidence level, response rates of the first stage and second stage survey being 57% and 69% respectively.
Points to note:
[1] The address of the “HKU POP SITE” is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of the first stage survey is 1,004 successful interviews, not 1,004 x 56.7% response rate, while the sample size of the second stage survey is another 1,005, not 1,005 x 69.3% response rate. In the past, many media made this mistake.
[3] “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state “sampling error of all percentages not more than +/-4% at 95% confidence level”.
[4] Because of sampling errors in conducting the survey(s) and the rounding procedures in processing the data, the figures cannot be too precise, and the totals may not be completely accurate. Therefore, when quoting percentages of the survey(s), journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses “computerized random telephone survey” to camouflage its IVS operation, it should be considered unprofessional.
Latest Figures
POP today releases the latest findings on people’s expectation of the fifth Policy Address of CE CY Leung. From 2014, POP enhanced the previous simple weighting method based on age and gender distribution to “rim weighting” based on age, gender and education (highest level attended) distribution. The latest figures released today for both the first and second stage surveys have been rim-weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in 2016 mid-year and the educational attainment (highest level attended) distribution collected in the 2011 Census. Herewith the contact information for the latest survey:
|
Date of survey |
Overall sample size |
Response rate |
Maximum sampling error of percentages[6] |
|
3-5/1/2017 (First Stage) |
1,004 |
56.7% |
+/-3% |
|
9-12/1/2017 (Second Stage) |
1,005 |
69.3% |
+/-3% |
[6] Errors are calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Questions using only sub-samples would have bigger sampling error.
According to our first stage survey conducted in early January 2017, when
asked to name unaided one issue that CE CY Leung should focus on in his
fifth Policy Address to be announced this Wednesday, 45% of the respondents
wished he would take “housing” as his first priority, while 11%, 9% and 8%
respectively chose “economic development”, “social welfare” and “political
development”. Besides, “medical policy”, “labour and employment” and
“education” took up 6%, 3% and 3% respectively, while 11% of the
respondents failed to give a specific answer. Please refer to the “HKU POP
SITE” for detailed figures.
In order to further study people’s expectation, another survey was then conducted whereby respondents were asked to evaluate each of the 5 top priority items individually, on a 5-point scale, how important it is for each item to be tackled in the Policy Address. Results compared to those of last 2 years are summarized below in descending order of mean values:
|
Date of survey |
2-9/1/15 |
4-6/1/16 |
9-12/1/17 |
Latest Change |
|
Sample base |
519-645 |
563-639 |
548-632 |
-- |
|
Overall response rate |
65.7% |
63.9% |
69.3% |
-- |
|
Latest findings |
Finding |
Finding |
Finding & error [7] |
-- |
|
Perceived housing issues as “very important” |
74% |
70% |
70+/-4% |
-- |
|
Perceived housing issues as “quite important” |
16% |
21%[9] |
15+/-3% |
-6%[9] |
|
“Very” + “quite” important[8] |
90% |
91% |
85+/-3% |
-6%[9] |
|
Mean value[10] |
4.6 (Base=598) |
4.6 (Base=622) |
4.5+/-0.1 (Base=607) |
-0.1 |
|
Perceived medical policy issues as “very important” |
49%[9] |
55%[9] |
62+/-4% |
+7%[9] |
|
Perceived medical policy issues as “quite important” |
31% |
30% |
22+/-4% |
-8%[9] |
|
“Very” + “quite” important[8] |
80%[9] |
85%[9] |
84+/-3% |
-1% |
|
Mean value[10] |
4.3[9] (Base=585) |
4.4 (Base=563) |
4.4+/-0.1[11] (Base=536) |
-- |
|
Perceived social welfare issues as “very important” |
43%[9] |
51%[9] |
58+/-4% |
+7%[9] |
|
Perceived social welfare issues as “quite important” |
30%[9] |
33% |
24+/-3% |
-9%[9] |
|
“Very” + “quite” important[8] |
73%[9] |
84%[9] |
82+/-3% |
-2% |
|
Mean value[10] |
4.1[9] (Base=630) |
4.3[9] (Base=558) |
4.4+/-0.1[11] (Base=618) |
+0.1 |
|
Perceived economic development issues as “very important” |
55% |
54% |
50+/-4% |
-4% |
|
Perceived economic development issues as “quite important” |
26% |
27% |
24+/-3% |
-3% |
|
“Very” + “quite” important[8] |
81% |
81% |
74+/-4% |
-7%[9] |
|
Mean value[10] |
4.4 (Base=478) |
4.3 (Base=557) |
4.2+/-0.1 (Base=571) |
-0.1 |
|
Perceived political development issues as “very important” |
54%[9] |
45%[9] |
40+/-4% |
-5%[9] |
|
Perceived political development issues as “quite important” |
18%[9] |
24%[9] |
23+/-4% |
-1% |
|
“Very” + “quite” important[8] |
72% |
68% |
64+/-4% |
-4% |
|
Mean value[10] |
4.3 (Base=457) |
4.1[9] (Base=501) |
3.9+/-0.1 (Base=498) |
-0.2[9] |
[7] All error figures in the table are calculated at 95% confidence level. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state “sampling error of percentages not more than +/-4% at 95% confidence level” when quoting the above figures.
[8] Percentages in these rows may not be equal to the sum of percentages shown in the rows of “very” and “quite important” due to rounding off.
[9] Such changes have gone beyond the sampling errors at the 95% confidence level under the same weighting method, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[10] The mean value is calculated by quantifying all individual responses into 1, 2, 3, 4, 5 marks according to their degree of importance, where 1 is the lowest and 5 the highest, and then calculate the sample mean.
[11] In one decimal place, the respective mean values of “medical policy issues” and “social welfare issues” are 4.41 and 4.35. Thus, they are ranked 2nd and 3rd respectively.
When asked to evaluate the importance of each item individually, 85% said CE CY Leung needed to tackle housing issue in the coming Policy Address, including 70% regarded it as “very important” and 15% “quite important”. Meanwhile, medical policy, social welfare, economic development and political development were perceived by 84%, 82%, 74% and 64% respectively to be important. The mean scores of the five issues are 4.5, 4.4, 4.4, 4.2 and 3.9 respectively, meaning close to “quite important” in general.
Commentary
Edward Chit-Fai Tai, Senior Data Analyst of Public Opinion Programme, observed, “More than ten years ago we began to use a two-stage design to study people’s expectation of the upcoming Policy Address in order to study both the absolute and relative importance of different policy items. In our latest surveys, when asked to name only one issue unaided, most people considered ‘housing’ the most pressing policy area to be handled in CE CY Leung’s Policy Address. In terms of absolute percentage of importance, 85% said CE should tackle housing problems, with a mean score of 4.5, in between ‘very important’ and ‘quite important’. Both figures are the highest across all items. The second to fifth items in terms of mean score are ‘medical policy’, ‘social welfare’, ‘economic development’ and ‘political development’. Among them, only the mean score of importance of ‘political development’ has dropped significantly. All five items are the same as those one year ago, although their degree and order have changed.”
Future Releases (Tentative)
- January 19, 2017 (Thursday) 1pm to 2pm: Policy Address Instant Poll
- January 24, 2017 (Tuesday) 1pm to 2pm: Policy Address First Follow-up Survey
