HKU POP releases the latest ratings of the Top 10 Legislative CouncillorsBack

The Public Opinion Programme (POP) of the University of Hong Kong conducted a double stage survey on the ratings of Legislative Councillors in early to mid-January, by means of random telephone surveys conducted by real interviewers. The survey shows that compared to three months ago, in terms of familiarity, Alan Leong who ranked fourth last time has dropped out of the 'top 10' list and replaced by Michael Tien. In terms of absolute ratings, the scores of 5 out of the 9 who stayed on the list have gone up, 4 have gone down. Among them, those registered changes in ratings beyond sampling errors include Albert Ho and Regina Ip. In terms of relative rankings, Jasper Tsang and Regina Ip continue to rank first and second. Michael Tien re-enters the list and ranks third. James Tien goes down one position to rank fourth. Albert Ho goes up two positions to rank fifth. Lee Cheuk-yan and Emily Lau each goes down one position to rank sixth and seventh. The positions of Albert Chan, Leung Kwok-hung and Wong Yuk-man remain the same at the eighth to tenth places. It should be noted however that our list of "top 10" only includes Legco members who are best known to the public, ranked according to their support ratings. Some of the other 60 councillors may well have very high or low support ratings, but because they are not the most well-known councillors, they do not appear on the "top 10" list by design. The maximum sampling errors of the ratings registered fall between +/-1.6 and +/-2.3 at 95% confidence level, while the response rate of the rating survey is 69%.

Points to note:
[1] The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
[2] The sample size of the first stage naming survey is 1,009 successful interviews, not 1,009 x 69.2% response rate, while that of the second stage rating survey is 1,026 successful interviews, not 1,026 x 68.7% response rate.
[3] The maximum sampling errors of various ratings are not more than +/-2.3. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling errors of various ratings not more than +/-2.3, at 95% confidence level". Because POP introduced "rim weighting" in 2014, during the transition period, whether changes in various figures are beyond sampling errors are based on tests using the same weighting methods. That is, to test whether the first set of figures collected in 2014 is significantly different from that of the previous survey, both sets of data are rim weighted before testing, instead of using simple computation of the published figures.
[4] Because of sampling errors in conducting the survey(s) and the rounding procedures in processing the data, the figures cannot be too precise, and the totals may not be completely accurate. Therefore, when quoting percentages of the survey(s), journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used.
[5] The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.

POP today releases on schedule via the "POP SITE" the latest popularity figures of the top ten Legislative Councillors. From 2014, POP enhanced the previous simple weighting method based on age and gender distribution to "rim weighting" based on age, gender and education (highest level attended) distribution. The latest figures released today have been rim-weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-year 2013 and the educational attainment (highest level attended) distribution collected in the 2011 Census. Herewith the contact information:

[6] Errors are calculated at 95% confidence level using full sample size. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified.
[7] The figures shown in the "latest change" column of this press release have been tested after "rim weighting" data collected in this and last surveys. The structural effect of using the new weighting method is small, around -1.0 to +0.7 for rating figures, while statistical significance tests are not affected.

The research design of our "Top 10 Legislative Councillors" has been explained in detail under "Survey Method" in our corresponding web page. The top councillors listed in our latest survey were all those who obtained the highest unprompted mentions in our first stage naming survey conducted in early January. In that survey, respondents could name, unaided, up to 10 legislators whom they knew best. As a result, Leung Kwok-hung, Wong Yuk-man, Emily Lau, Regina Ip and Albert Ho were mentioned most frequently. Please refer to the relevant table for the rest of the list. Those 12 who were named most frequently then entered into the second stage rating survey. During the second stage rating survey conducted in mid-January, respondents were asked to rate each legislator in turn using a 0-100 scale. 0 indicates absolutely no support, 100 indicates absolute support, and 50 means half-half. After calculation, the bottom 2 legislators in terms of recognition rate were dropped; the remaining 10 were then ranked according to their support ratings attained to become the top 10 Legislative Councillors. For easy reference, the POP Site has already displayed the results of all naming surveys conducted since the year 1998. Recent ratings of top 10 Legislative Councillors are summarized below:

[8] All error figures in the table are calculated at 95% confidence level. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state "sampling error of various ratings not more than +/-2.3 at 95% confidence level" when quoting the above figures. Numbers in square brackets { } indicates rankings. The error margin of previous survey can be found at the POP Site. Starting from 2011, these questions only use sub-samples of the tracking surveys concerned, with variable sub-sample size for each question. In latest survey, the sub-sample size of the questions varies between 545 and 655, and its effect has already been reflected in the sampling errors.
[9] Such changes have gone beyond the sampling errors at the 95% confidence level under the same weighting method, meaning that they are statistically significant prima facie. However, whether numerical differences are statistically significant or not is not the same as whether they are practically useful or meaningful.
[10] Ratings with recognition rates not reaching top 10 in either stage of survey are not available.
[11] In two decimal places, the rating of Wong Yuk-man is 35.62 and that of Leung Kwok-hung is 35.58.
[12] In two decimal places, the rating of Regina Ip is 56.45 and that of Michael Tien is 56.35.
[13] In two decimal places, the rating of James Tien is 53.13 and that of Alan Leong is 53.08.

The latest survey showed that Jasper Tsang was the most popularly supported councillor attaining 59.4 marks. Regina Ip, Michael Tien and James Tien ranked the 2nd to 4th with 52.7, 52.6 and 52.2 marks correspondingly. The 5th to 7th ranks went to Albert Ho, Lee Cheuk-yan and Emily Lau who attained 48.1, 48.0 and 47.4 marks respectively. Albert Chan, Leung Kwok-hung and Wong Yuk-man ranked the 8th to 10th, attaining 38.8, 34.4 and 34.0 marks respectively. The mean score obtained by the top 5 councillors was 53.0 marks, while that for the top 10 was 46.8 marks. For this latest survey, James To and Tam Yiu-chung obtained support ratings of 52.4 and 47.9 marks respectively, but they were dropped due to their relatively low recognition rates. The overall ratings ranked according to results obtained over the past 12 calendar months are tabulated as follows:

[14] "Average rating" is the average of all ratings obtained by Legislative Councillors over the past 12 months.
[15] "Overall ranking" is first determined by their number of times on top 10, and then their average ratings.

The overall rankings in the past 12 months showed that 7 Legislative Councillors have been on the list for four times. They are Jasper Tsang at the top rank achieving an average rating of 58.1 marks, Regina Ip, Lee Cheuk-yan, Emily Lau, Albert Ho, Leung Kwok-hung and Wong Yuk-man who ranked the 2nd to 7th and attained 55.2, 49.9, 49.8, 47.7, 35.9 and 35.1 marks correspondingly. Alan Leong and James Tien have been on the list for three times and ranked the 8th and 9th, with 53.5 and 53.2 marks. Michael Tien and Albert Chan have been on the list twice and ranked the 10th and 11th, with 54.5 and 38.3 marks. Chan Yuen-han and James To have been on the list once and ranked the 12th and 13th attaining 55.5 and 54.6 marks.

In January 2007, POP opened a feature page called "Opinion Daily" at the "POP Site", to record significant events and selected polling figures on a day-to-day basis, in order to provide readers with accurate information so that they can judge by themselves the reasons for the ups and downs of different opinion figures. In July 2007, POP collaborated with Wisers Information Limited whereby Wisers supplies to POP since July 24 each day a record of significant events of that day, according to the research method designed by POP. These daily entries would be uploaded to the "Opinion Daily" feature page as soon as they are verified by POP.

For the polling items covered in this press release, the previous survey was conducted from 27 September to 3 October, 2013, while this survey was conducted from 16 to 19 January, 2014. In between these two surveys, herewith the significant events selected from counting newspaper headlines and commentaries on a daily basis and covered by at least 25% of the local newspaper articles. Readers can make their own judgment if these significant events have any impacts to different polling figures.

Robert Ting-Yiu Chung, Director of Public Opinion Programme, observed, "The latest survey of top 10 Legislative Councillors shows that compared to three months ago, in terms of familiarity, Alan Leong who ranked fourth last time has dropped out of the 'top 10' list and replaced by Michael Tien. In terms of absolute ratings, the scores of 5 out of the 9 who stayed on the list have gone up, 4 have gone down. Among them, those registered changes in ratings beyond sampling errors include Albert Ho and Regina Ip. In terms of relative rankings, Jasper Tsang and Regina Ip continue to rank first and second. Michael Tien re-enters the list and ranks third. James Tien goes down one position to rank fourth. Albert Ho goes up two positions to rank fifth. Lee Cheuk-yan and Emily Lau each goes down one position to rank sixth and seventh. The positions of Albert Chan, Leung Kwok-hung and Wong Yuk-man remain the same at the eighth to tenth places. It should be noted however that our list of 'top 10' only includes Legco members who are best known to the public, ranked according to their support ratings. Some of the other 60 councillors may well have very high or low support ratings, but because they are not the most well-known councillors, they do not appear on the 'top 10' list by design. We leave it for our readers to figure out the reasons for the ups and downs of these popularity ratings using detailed records shown in our 'Opinion Daily' feature page."

• January 28, 2014 (Tuesday) 1pm to 2pm: Popularity of CE and HKSAR Government