HKU POP SITE releases the latest popularity figures of CE Donald Tsang and Principal OfficialsBack

The Public Opinion Programme at the University of Hong Kong interviewed 1,015 Hong Kong people between 2-3 January by means of a random telephone survey conducted by real interviewers. The survey finds that the popularity of CE Donald Tsang has stabilized, but the disapproval rate of Tsang Tak-sing as Secretary for Home Affairs has jumped 12 percentage points, that of Secretary for Constitutional and Mainland Affairs Stephen Lam increased by 8 percentage points, and that of Secretary for Development Carrie Lam increased by 6 percentage points. Those of other officials have all fluctuated within 5 percentage points. The sampling error of all approval and disapproval rates is below +/-2 to 4 percentage points at 95% confidence level, while the sampling error of rating figures needs another calculation. The response rate of the survey is 67%.

Points to note:

* The address of the "HKU POP SITE" is http://hkupop.pori.hk, journalists can check out the details of the survey there.
* The sample size of this survey is 1,015 successful interviews, not 1,015 x 66.8% response rate. In the past, many media made this mistake.
* The maximum sampling error of all approval and disapproval rates is below +/-2 to 4 percentage points at 95% confidence level, while the sampling error of rating figures needs another calculation. "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. When quoting these figures, journalists can state "sampling error below +/-3% at 95% confidence level". 
* When quoting percentages of this survey, journalists should refrain from reporting decimal places, but when quoting the rating figures, one decimal place can be used, in order to match the precision level of the figures.
* The data of this survey is collected by means of random telephone interviews conducted by real interviewers, not by any interactive voice system (IVS). If a research organization uses "computerized random telephone survey" to camouflage its IVS operation, it should be considered unprofessional.

POP today releases on schedule via the POP Site the latest figures of CE Donald Tsang and Principal Officials under the accountability system. All figures have been weighted according to provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population in mid-2007. Herewith the contact information for the latest survey:

As different questions involve different sub-samples, the sample errors will vary accordingly. The table be briefly shows the relationship between sample size and maximum sampling errors for the readers to capture the corresponding changes:

"Maximum sampling errors" occur when survey figures are close to 50%. If the figures are close to 0% or 100%, the sampling error will diminish accordingly. The sampling errors of ratings, however, will depend on the distribution of the raw figures. Since January 2007, POP lists out the sampling errors of all survey figures in detail and explain them in due course. Recent popularity figures of Donald Tsang are summarized as follows:

* "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state "sampling error of ratings +/-1.2, sampling error of percentages not more than +/-3% at 95% confidence level" when quoting the above figures.

Figures on the latest popularity ratings of the three Secretaries of Departments under the accountability system are summarized below:

* The frequency of this series of questions is different for different questions, and also different from that of CE popularity ratings. Comparisons, if made, should be synchronized using the same intervals.
** "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state "sampling error of various ratings not more than +/-1.4, sampling error of percentages not more than +/-3% at 95% confidence level" when quoting the above figures.

Figures on the latest popularity ratings of Directors of Bureaux under the accountability system are summarized below:

* Starting from 2006, these questions only uses sub-samples of the tracking surveys concerned, the sample size for each question also varies.
** "95% confidence level" means that if we were to repeat a certain survey 100 times, using the same questions each time but with different random samples, we would expect 95 times getting a figure within the error margins specified. Media can state "sampling error of percentages not more than +/-4% at 95% confidence level" when quoting the above figures.

The latest survey showed that, CE Donald Tsang scored 61.7 marks, and 57% supported him as the Chief Executive. Meanwhile, the corresponding ratings of CS Henry Tang Ying-yen, FS John Tsang Chun-wah and SJ Wong Yan-lung were 61.0, 54.1 and 65.0 marks, and 57%, 35% and 69% would vote for their reappointment correspondingly. As for the Directors of Bureaux, results revealed that the top approval rate fell to Secretary for Security Ambrose Lee Siu-kwong, attaining 71%. Secretary for Development Carrie Lam Cheng Yuet-ngor and Secretary for Food and Health York Chow Yat-ngok shared the 2nd rank, both achieving 45%. Secretary for Labour and Welfare Matthew Cheung Kin-chung, Secretary for Commerce and Economic Development Frederick Ma Si-hang, Secretary for Education Michael Suen Ming-yeung and Secretary for the Civil Service Denise Yue Chung-yee occupied the 4th to 7th rank with respective support rates of 44%, 42%, 38% and 38%. The 8th rank to 12th went to Secretary for Constitutional and Mainland Affairs Stephen Lam Sui-lung, Secretary for Financial Services and the Treasury Ceajer Chan Ka-keung, Secretary for Transport and Housing Eva Cheng Yu-wah, Secretary for Home Affairs Tsang Tak-sing and Secretary for the Environment Edward Yau Tang-wah as they gained 33%, 30%, 29%, 26% and 21% vote of confidence from the public respectively. In other words, only Ambrose Lee Siu-kwong scored approval rates of over 50% among all Directors of Bureaux.

In January 2007, POP opened a feature page called "Opinion Daily" at the "POP Site", to record significant events and selected polling figures on a day-to-day basis. Our purpose is to provide readers with accurate information so that they can judge by themselves the reasons for the ups and downs of different opinion figures. When "Opinion Daily" began to operate on January 17, 2007, it only contained significant events and popularity figures of the Chief Executive over the past few months. As of today, it contains a chronology of events starting from May 1, 2006, and many poll figures registered since January 1, 2006. Readers can now check on the results of 9 different polling items compiled by POP, including the popularity of the Chief Executive, the HKSAR government, and the Secretaries of Departments under the accountability system. In near future, the content of "Opinion Daily" will continue to expand, in order to promote the science of opinion polling.

In July 2007, POP collaborated with Wisers Information Limited whereby Wisers supplies to POP since July 24 each day a record of significant events of that day, according to the research method designed by POP. These daily entries would be uploaded to the "Opinion Daily" feature page as soon as they are verified by POP, in order to provide readers with swifter and more accurate information.

In August 2007, POP began to include in its regular press releases a list of significant events which happened in between two surveys, so that readers can make their own judgment on whether these events have any effect on the ups and downs of the polling figures. This press release is no exception.

For the polling items covered in this press release, using the previous survey as a reference point for comparison, our "Opinion Daily" for this release starts on December 3, 2007, because the previous survey of some items was conducted from December 3 to 7, 2007 while this survey was conducted from January 2 to 3, 2008. During this period, herewith the significant events selected from counting newspaper headlines and commentaries on a daily basis and covered by at least 25% of the local newspaper articles. Readers can make their own judgment if these significant events have any impacts to different polling figures.

Commentary

Robert Ting-Yiu Chung, Director of Public Opinion Programme, observed, 「After a significant drop in middle to late December, the support rating of CE Donald Tsang has recently stabilized, so are the approval rates of most principal officials compared to a month ago. It should be noted, however, that the disapproval rate of Tsang Tak-sing as Secretary for Home Affairs shot up by 12 percentage points, that of Secretary for Constitutional and Mainland Affairs Stephen Lam increased by 8 percentage points, and that of Secretary for Development Carrie Lam increased by 6 percentage points. Those of other officials all fluctuated within 5 percentage points. According to the benchmarks set by us quite some time ago, the performance of Ambrose Lee and Wong Yan-lung can continue to be labeled as "ideal", that of Henry Tang and Donald Tsang can continue to be labeled as "successful", that of Carrie Lam, York Chow, Matthew Cheung, Frederick Ma, Michael Suen, Stephen Lam and Tsang Tak-sing can be labeled as "mediocre", and that of Denise Yue, John Tsang, Ceajer Chan, Eva Cheng and Edward Yau can be labeled as "inconspicuous". No official falls under the categories of "depressing" or "disastrous". As for the reasons affecting the popularity change of these officials, readers can make their own judgment using detailed records shown in our "Opinion Daily" feature page. However, the verbal attack on the newly elected Legislative Councillor Anson Chan by the Secretary for Home Affairs Tsang Tak-sing in Legco should be an important factor affecting Tsang's popularity.」

The following table summarizes the grading of the principal officials for readers' easy reference:

Regarding the grading system of these officials, Robert Chung further explained, "A new grading system was adopted for 2007 HKCEE Chinese Language and English Language, whereby the old 'pulling curve' system using a six-grade norm reference approach was replaced by a standard-referenced approach with six grades from Level '1' to '5*'. This should have deepened people's understanding of the standard-referenced approach, which is fairly similar to POP's grading system of principal officials. We therefore would not object to community members using Level '1' to '5*' to describe the popularity of principle officials."

News about POP

POP's normal practice is to release the results of our regular surveys every Tuesday afternoon via our POP Site, except during public holidays, each time with a forecast of the items to be released in the next 7 days. According to schedule, we will release the latest findings of people's appraisal of society's current conditions on January 10, 2008, Thursday, between 1pm and 2pm. Then on January 15, 2007, Tuesday, between 1pm and 2pm, POP will release the latest results of subjective freedom indicators.

Our general practice is to answer all questions on the research design of the surveys published in the POP Site as soon as we receive them, but we will not further comment on the findings. We welcome questions for fol-up purpose, please email them to us at <[email protected]>. We will keep such an arrangement under constant review, suggestions most welcome. Please note that everything carried in the POP Site does not represent the stand of the University of Hong Kong. Dr Robert Ting-Yiu Chung, Director of POP, is responsible for everything posted herewith, except for column articles which represent the stand of their authors.

Since January 2006, we have included in our regular press releases a small educational section for the purpose of sharing our research experience with the readers and the general public, and the subject of our education section today is "About HKUPOP". In the near future, we will keep on stepping up our effort in promoting general civic education to enhance our POP Site accordingly.

About HKUPOP

Popularity surveys of CE and principal officials

In advanced democratic countries, the popularity of top leaders and principal officials is the crux of all opinion polls. Shortly after HKUPOP was established, we started to conduct surveys on these aspects. We have explained the development of these surveys in our press releases of October 31, 2006, January 16 and 31, February 8, March 13, June 12, August 14, September 11, October 16, November 13 as well as December 11, 2007. Today, we post it again, so that readers can have a more comprehensive picture of such development.

(1) Development of CE's popularity survey

• From its establishment to the handover of Hong Kong, POP has continually conducted surveys to measure the popularity rating of Governor Chris Patten. After the handover when Tung Chee-hwa became the first Chief Executive in 1997, we began our popularity survey of CE Tung Chee-hwa. After Tung resigned and Donald Tsang succeeded, POP has begun to measure Tsang's popularity. The frequency of our surveys was at least once every month during the Patten era. It was then increased to three times per month when Tung became CE, until the end of 1997. From January 1998 onwards, it was reduced to twice every month.
  
  

• The question wordings used in "popularity of Governor or CE" survey are: "Please use a scale of 0-100 to rate your extent of support to the Governor/ the Chief Executive XXX, with 0 indicating absolutely not supportive, 100 indicating absolutely supportive and 50 indicating half-half. How would you rate the Chief Executive XXX?" and "If a general election of the Chief Executive were to be held tomorrow, and you had the right to vote, would you vote for XXX?".
  
  

• Before April 2000, the sample size of our regular surveys was set at slightly over 500. After that, it was increased to at least 1,000.

(2) Development of CE's popularity (performance) survey

• The frequency of our surveys was once every two months since August 2002. From February 2004 onwards, it was reduced to once every six months.
  
  

• The question wordings used in "CE popularity (performance)" survey are: "Do you think XXX is doing a good or bad job as CE?".
  
  

• Regarding the sample size, ever since the beginning, the sample size of surveys has been set at slightly over 1,000.

(3) Development of the survey for Secretaries of Departments:

• For the rating survey of the Secretaries of Departments, in between January to November 2001, the survey was conducted at an irregular basis. From January 2002 onwards, the survey is conducted once every month. For the support rates of the Secretaries based on people's hypothetical vote of confidence, it was surveyed once every three months from September 2002 to December 2003. Then it was changed to once every two months from February 2004 to December 2005. From January 2006 onwards, the survey is conducted once every month.
  
  

• The wordings used in the questionnaire are: "Please use a scale of 0-100 to rate your extent of support to Chief Secretary for Administration XXX/Financial Secretary YYY/Secretary for Justice ZZZ, with 0 indicating absolutely not supportive, 100 indicating supportive and 50 indicating half-half. How would you rate XXX/YYY/ZZZ?". For the support rates of Secretaries, the wordings are "If you had the right to vote on the reappointment or dismissal of XXX/YYY/ZZZ as the Chief Secretary for Administration/Financial Secretary/Secretary for Justice tomorrow, how would you vote?"
  
  

• Regarding the sample size, ever since the beginning, the sample size of surveys has been set at slightly over 1,000. 

(4) Development of the survey for Directors of Bureaux:

• For the rating survey of the Directors of Bureaux, in between June 2002 to December 2005, the frequency was once every month. From January 2006 to June 2007, the survey is conducted once every two months. For the support rates of Directors of Bureaux, the frequency was once every three months from September 2002 to December 2003. Then from February 2004 to June 2007, the survey was conducted once every two months. In July 2007, with the beginning of CE's new term of office and the appointment of new principal officials, the frequency of support rate survey of the Directors of Bureaux was increased to once every month, while the frequency of rating survey was reduced to once every three months. Moreover, although all survey results are uploaded onto the POP Site in detail, POP no longer analyze the result of rating surveys. This is to better match the evolvement of the accountability system as well as the pace of democratic development.
  
  

• Similar to the popularity survey of the Secretaries of Departments, that of the Directors of Bureaux also includes the questions of rating and hypothetical voting. The wordings used in the questionnaire are: "Please use a scale of 0-100 to rate your extent of support to XXX, with 0 indicating absolutely not supportive, 100 indicating supportive and 50 indicating half-half. How would you rate XXX?" and "If you had the right to vote on the reappointment or dismissal of XXX as YYYYYYYYY tomorrow, how would you vote?" However, the two questions are may not be asked in different the same surveys separately.
  
  

• Regarding the sample size, from the beginning to December 2005, the sample size of the surveys was set at slightly over 1,000. However, from 2006 onwards, this series of questions only uses sub-samples of the tracking surveys concerned, and the sample size for each question also varies.

All the findings from our surveys on "popularity of principal officials" have been released online through our HKU POP Site.