HKU POP releases the latest ratings of the top 10 Legislative Councillors Back
Press Release on July 17, 2018
| Detailed Findings Rating of Top Ten Legislative Councillors|
Special Announcements
1. From July 2017, apart from sampling landline numbers to conduct opinion surveys, the Public Opinion Programme (POP) of The University of Hong Kong has also added mobile numbers to the sampling frame. After three months of testing, in October 2017, POP formalized the use of mixed samples as its standard for regular opinion surveys using a landline and mobile sample ratio of 4 to 1. Starting from April 2018, POP further increased the proportion of mobile sample, which the landline and mobile sample ratio became 2 to 1. The figures released today by POP have already incorporated landline and mobile samples.
2. In September 2017, POP started to use “effective response rate” to report surveys’ contact information. In July 2018, POP further revised the calculation of effective response rate. Thus, the response rates before and after the change cannot be directly compared.
3. To facilitate academic study and rational discussion, POP has already released for public examination some time ago via the “HKU POP SITE” (http://hkupop.pori.hk) the raw data of regular rating surveys of current CE Carrie Lam, former CEs CH Tung, Donald Tsang and CY Leung, along with related demographics of respondents. Please follow normal academic standards when using or citing such data.
Abstract
POP conducted a two-stage survey on the Legislative Councillors in June and July, by means of random telephone surveys conducted by real interviewers. The survey shows that, compared to four months ago, in terms of familiarity, Andrew Leung has replaced Paul Tse to enter the “top 10” list. In terms of absolute ratings, out of the 9 Councillors in the “top 10” list who were also rated last time, 6 have gone up while 3 have gone down. Among them, only the increase in the rating of Tanya Chan has gone beyond sampling errors, up by 3.4 marks. In terms of relative rankings, Michael Tien continues to rank first, now for 3 consecutive times since November 2017. James To goes up two positions to rank second. Tanya Chan goes up three positions to rank third. Regina Ip and Eddie Chu go down two positions to rank fourth and fifth respectively. Claudia Mo goes up two positions to rank sixth. Starry Lee goes down two positions to rank seventh. Andrew Leung enters the list for the first time and ranks eighth. Priscilla Leung and Chiang Lai-wan remain in the same positions and rank ninth and tenth respectively. It should be noted however that our list of “top 10” only includes LegCo members who are best known to the public, ranked according to their support ratings. Some of the other councillors may well have very high or low support ratings, but because they are not the most well-known councillors, they do not appear on the “top 10” list by design. The maximum sampling error of the ratings registered is +/-2.6 marks at 95% confidence level, while the response rate of the rating survey is 49%.
Points to note:
[1] The address of the “HKU POP SITE” is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of the first stage naming survey is 1,000 successful interviews, not 1,000 x 59.6% response rate, while that of the second stage rating survey is 1,001 successful interviews, not 1,001 x 49.5% response rate. In the past, many media made this mistake.
[3] The maximum sampling errors of various ratings are not more than +/-2.6. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state “sampling errors of various ratings not more than +/-2.6 at 95% confidence level”.
[4] Because of sampling errors in conducting the survey(s) and the rounding procedures in processing the data, the figures cannot be too precise, and the totals may not be completely accurate. Therefore, when quoting percentages of the survey(s), journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses “computerized random telephone survey” to camouflage its IVS operation, it should be considered unprofessional.
Latest Figures
POP today releases the latest popularity figures of the top ten Legislative Councillors. From July 2017, POP enhanced the previous weighting method that has been used for quite a few years. Apart from age, gender and education, economic activity group is now also taken into account when adjusting data. The latest figures released today have been rim-weighted according to figures collected in the 2016 by-census regarding the gender-age distribution of the Hong Kong population and the 2017 educational attainment (highest level attended) distribution and economic activity status distribution obtained from the Census and Statistics Department. In the past, the mobile sample would be rim-weighted according to the basic Public Sentiment Index (PSI) figures collected in the landline sample. In July 2018, POP further refined the weighting method. The landline sample and the mobile sample would no longer be processed separately. The mobile would also no longer be adjusted using the basic PSI figures collected in the landline sample. The overall effect is that the importance of the mobile sample would be increased. Herewith the contact information for the latest survey:
|
Date of survey |
Sample size |
Effective response rate |
Maximum sampling error[6] |
|
14-21/6/2018 (Naming survey) |
1,000 |
59.6% |
+/-3% |
|
3-5/7/2018 (Rating survey) |
1,001 |
49.5% |
+/-2.6 |
[6] Errors are calculated at 95% confidence level using full sample size. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
The research design of our “Top 10 Legislative Councillors” has been explained in detail under “Survey Method” in our corresponding web page. The top councillors listed in our latest survey were all those who obtained the highest unprompted mentions in our first stage naming survey conducted from June 14 to 21. In that survey, respondents could name, unaided, up to 10 councillors whom they knew best. Tanya Chan, Starry Lee, James To, Claudia Mo and Regina Ip were the top 5 councillors mentioned most frequently. Please refer to the relevant table for the rest of the list. Those 12 who were named most frequently then entered into the second stage rating survey. During the second stage rating survey conducted from July 3 to 5, respondents were asked to rate each legislator in turn using a 0-100 scale, where 0 indicates absolutely no support, 100 indicates absolutely support, and 50 means half-half. After calculation, the bottom 2 legislators in terms of recognition rate were dropped; the remaining 10 were then ranked according to their support ratings attained to become the top 10 Legislative Councillors. For easy reference, the POP Site has already displayed the results of all naming surveys conducted since the year 1998. Recent ratings of top 10 Legislative Councillors are summarized below:
|
Date of survey |
10-13/7/2017 |
14-16/11/2017 |
1-6/3/2018 |
3-5/7/2018 |
Latest change |
|
|
Sample base[7] |
431-569 |
525-707 |
562-682 |
525-575 |
-- |
|
|
Response rate* |
72.0% |
62.8% |
64.7% |
49.5% |
-- |
|
|
Latest finding |
Finding |
Finding |
Finding |
Finding & error[8] |
Recognition rate |
-- |
|
Michael Tien |
-- |
57.3{1} |
56.8{1} |
57.7+/-1.7{1} |
96.3% |
+0.9 |
|
James To |
56.2{1}[9] |
51.4{3}[9] |
48.9{4}[9] |
51.3+/-2.3{2} |
91.1% |
+2.4 |
|
Tanya Chan |
49.8{4}[9] |
46.9{6}[9] |
46.8{6} |
50.2+/-2.5{3} |
89.7% |
+3.4[9] |
|
Regina Ip |
53.0{2}[9] |
52.7{2} |
51.4{2} |
50.0+/-2.2{4} |
98.3% |
-1.4 |
|
Eddie Chu |
52.0{3} |
46.3{7}[9] |
51.2{3}[9] |
49.5+/-2.4{5} |
89.8% |
-1.8 |
|
Claudia Mo |
47.1{5} |
44.6{8} |
46.4{8} |
48.2+/-2.5{6} |
89.4% |
+1.8 |
|
Starry Lee |
46.3{6} |
48.4{5} |
47.6{5} |
45.9+/-2.6{7} |
89.9% |
-1.7 |
|
Andrew Leung |
-- |
-- |
-- |
43.4+/-2.4{8} |
87.1% |
-- |
|
Priscilla Leung |
-- |
43.2{9} |
40.2{9}[9] |
41.6+/-2.5{9} |
87.7% |
+1.4 |
|
Chiang Lai-wan |
41.6{8}[9] |
40.0{10} |
36.8{10}[9] |
37.9+/-2.6{10} |
88.9% |
+1.1 |
|
Alvin Yeung |
53.2[10] |
52.7[10] |
51.1[10] |
52.2+/-2.4[10] |
80.3% |
+1.1 |
|
Raymond Chan |
-- |
-- |
42.9[10] |
46.3+/-2.6[10] |
79.9% |
+3.4 |
|
Paul Tse |
-- |
48.5{4} |
46.7{7} |
-- |
-- |
-- |
|
Elizabeth Quat |
-- |
38.4[10] |
-- |
-- |
-- |
-- |
|
Lau Siu-lai |
41.6{7}[9] |
--[11] |
--[11] |
--[11] |
-- |
-- |
|
Leung Kwok-hung |
37.5{9} |
--[11] |
--[11] |
--[11] |
-- |
-- |
|
Holden Chow |
36.6{10} |
-- |
-- |
-- |
-- |
-- |
|
Nathan Law |
42.5[10] |
--[11] |
--[11] |
--[11] |
-- |
-- |
* “Overall response rate” was used before September 2017, thereafter, “effective response rate” was used. In July 2018, POP revised the calculation of effective response rate. Thus, the response rates before and after the change cannot be directly compared.
[7] These questions only use sub-samples of the tracking surveys concerned, with variable sub-sample size for each question. In latest survey, the sub-sample size of the questions varies between 525 and 575, and its effect has already been reflected in the sampling errors.
[8] All error figures in the table are calculated at 95% confidence level. “95% confidence level” means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state “sampling error of various ratings not more than +/-2.6 at 95% confidence level” when quoting the above figures. Numbers in square brackets { } indicates rankings. The error margin of previous survey can be found at the POP Site.
[9] Such changes have gone beyond the sampling errors at the 95% confidence level, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant is not the same as whether they are practically useful or meaningful, and different weighting methods could have been applied in different surveys.
[10] Ratings with recognition rates not reaching top 10 in the rating stage of survey are not counted.
[11] Not a Legislative Councillor during the survey period.
The latest survey showed that Michael Tien was the most popularly supported councillor attaining 57.7 marks. James To, Tanya Chan and Regina Ip ranked the 2nd to 4th with 51.3, 50.2 and 50.0 marks correspondingly. The 5th to 7th ranks went to Eddie Chu, Claudia Mo and Starry Lee who attained 49.5, 48.2 and 45.9 marks respectively. Andrew Leung, Priscilla Leung and Chiang Lai-wan ranked the 8th to 10th, attaining 43.4, 41.6 and 37.9 marks respectively. The mean score obtained by the top 5 councillors was 51.7 marks, while that for the top 10 was 47.6 marks. For this latest survey, Alvin Yeung and Raymond Chan obtained support ratings of 52.2 and 46.3 marks respectively, but they were dropped due to their relatively low recognition rates. The overall ratings ranked according to results obtained over the past four surveys are tabulated as follows:
|
Date of survey |
10-13/7/17 |
14-16/11/17 |
1-6/3/18 |
3-5/7/18 |
No. of times on top 10 |
Average rating [12] |
Overall ranking [13] |
|
James To |
56.2 |
51.4 |
48.9 |
51.3 |
4 |
52.0 |
1 |
|
Regina Ip |
53.0 |
52.7 |
51.4 |
50.0 |
4 |
51.8 |
2 |
|
Eddie Chu |
52.0 |
46.3 |
51.2 |
49.5 |
4 |
49.7 |
3 |
|
Tanya Chan |
49.8 |
46.9 |
46.8 |
50.2 |
4 |
48.4 |
4 |
|
Starry Lee |
46.3 |
48.4 |
47.6 |
45.9 |
4 |
47.0 |
5 |
|
Claudia Mo |
47.1 |
44.6 |
46.4 |
48.2 |
4 |
46.6 |
6 |
|
Chiang Lai-wan |
41.6 |
40.0 |
36.8 |
37.9 |
4 |
39.1 |
7 |
|
Michael Tien |
-- |
57.3 |
56.8 |
57.7 |
3 |
57.2 |
8 |
|
Priscilla Leung |
-- |
43.2 |
40.2 |
41.6 |
3 |
41.7 |
9 |
|
Paul Tse |
-- |
48.5 |
46.7 |
-- |
2 |
47.6 |
10 |
|
Andrew Leung |
-- |
-- |
-- |
43.4 |
1 |
43.4 |
11 |
|
Lau Siu-lai |
41.6 |
--[14] |
--[14] |
--[14] |
1 |
41.6 |
12 |
|
Leung Kwok-hung |
37.5 |
--[14] |
--[14] |
--[14] |
1 |
37.5 |
13 |
|
Holden Chow |
36.6 |
-- |
-- |
-- |
1 |
36.6 |
14 |
[12] “Average rating” is the average of all ratings obtained by Legislative Councillors over the past four surveys.
[13] “Overall ranking” is first determined by their number of times on top 10, and then their average ratings.
[14] Not a Legislative Councillor during the survey period.
The overall rankings in the past four surveys showed that seven Legislative Councillors have been on the list for four times. They are James To at the top rank achieving an average rating of 52.0 marks, Regina Ip, Eddie Chu, Tanya Chan, Starry Lee, Claudia Mo and Chiang Lai-wan who ranked the 2nd to 7th and attained 51.8, 49.7, 48.4, 47.0, 46.6 and 39.1 marks correspondingly. Michael Tien and Priscilla Leung have been on the list for three times and ranked the 8th to 9th with 57.2 and 41.7 marks correspondingly. Paul Tse has been on the list twice and ranked the 10th with 47.6 marks. Andrew Leung, Lau Siu-lai, Leung Kwok-hung and Holden Chow have been on the list once and ranked the 11th to 14th with 43.4, 41.6, 37.5 and 36.6 marks correspondingly.
Opinion Daily
In January 2007, POP opened a feature page called “Opinion Daily” at the “POP Site”, to record significant events and selected polling figures on a day-to-day basis, in order to let readers judge by themselves the reasons for the ups and downs of different opinion figures. In July 2007, POP collaborated with Wisers Information Limited whereby Wisers supplies to POP each day starting from July 24, a record of significant events of that day, according to the research method designed by POP. These daily entries would be uploaded to “Opinion Daily” as soon as they are verified by POP.
For the polling items covered in this press release, the previous survey was conducted from March 1 to 6, 2018, while this survey was conducted from July 3 to 5, 2018. In between these two surveys, herewith the significant events selected from counting newspaper headlines and commentaries on a daily basis and covered by at least 25% of the local newspaper articles. Readers can make their own judgment if these significant events have any impacts to different polling figures.
|
3/7/18 |
China Light and Power and Hong Kong Electric are to raise their tariffs and the government will subsidize each household with $3,000. |
|
28/6/18 |
The Executive Council approves three new initiatives on housing. |
|
14/6/18 |
The Legislative Council passes the third reading of the Guangzhou-Shenzhen-Hong Kong Express Rail Link (Co-location) Bill. |
|
11/6/18 |
Edward Leung Tin-kei is sentenced for 6 years for rioting in Mong Kok during the Lunar New Year in 2016. |
|
6/6/18 |
Dishonest practices were exposed in the coupling of steel bars in Hung Hom Station at the Shatin to Central Link. |
|
3/5/18 |
Chief Executive Carrie Lam attends the Legislative Council question-and-answer session. |
|
26/4/18 |
The Task Force on Land Supply commences public consultation. |
|
25/4/18 |
Democratic Party legislator Ted Hui Chi-fung snatches the phone of an Executive Officer in the Legislative Council. |
|
23/4/18 |
Director of the Liaison Office Wang Zhimin attends a LegCo luncheon and delivers a speech. |
|
12/3/18 |
The pro-democracy camp and the pro-establishment camp win two seats each in the Legislative Council by-election. |
Commentary
Note: The following commentary was written by Research Manager of POP, Frank Lee.
The latest survey of the top 10 Legislative Councillors show that compared to four months ago, in terms of familiarity, Andrew Leung has replaced Paul Tse to enter the “top 10” list. In terms of absolute ratings, out of the 9 Councillors in the “top 10” list who were also rated last time, 6 have gone up while 3 have gone down. Among them, only the increase in the rating of Tanya Chan has gone beyond sampling errors, up by 3.4 marks. In terms of relative rankings, Michael Tien continues to rank first, now for 3 consecutive times since November 2017. James To goes up two positions to rank second. Tanya Chan goes up three positions to rank third. Regina Ip and Eddie Chu go down two positions to rank fourth and fifth respectively. Claudia Mo goes up two positions to rank sixth. Starry Lee goes down two positions to rank seventh. Andrew Leung enters the list for the first time and ranks eighth. Priscilla Leung and Chiang Lai-wan remain in the same positions and rank ninth and tenth respectively. It should be noted however that our list of “top 10” only includes LegCo members who are best known to the public, ranked according to their support ratings. Some of the other councillors may well have very high or low support ratings, but because they are not the most well-known councillors, they do not appear on the “top 10” list by design. As for the reasons affecting the ups and downs of various figures, readers are welcome to make their own judgment using the detailed records displayed in our “Opinion Daily”.
Future Release (Tentative)
