Research designBack

POP Panel

 

“POP Panel” is a new way of sampling and survey system designed by POP, after making reference to the research designs of some research studies using panel study in other countries. It was started in the second half of 2013 and officially launched in 2014 as a new trend of social research. POP will recruit household members into the POP Panel by random sampling, then sample these household members into different research projects under this framework. All qualified members within a household will have the chance to be invited to enroll in particular research projects. The raw data of each survey will be weighted in accordance with the latest population statistics obtained from the Census and Statistics Department in order to increase the representativeness of figures.

 

As for opinion collection, POP will contact panel members through multiple channels so that citizens’ opinion on different topic can be efficiently and accurately collected to promote social development. Apart from traditional telephone interview, it also includes modern electronic media, such as online questionnaire, smartphone app, text messages, email, as well as facsimile, mail questionnaire and physical forum, etc.

 

Panel members will receive invitations to join various research activities from POP irregularly after enrollment in POP Panel which the initial validity is 1 year. Subject to availability of resources, incentives would be given to the respondents upon completing of survey each time as a token of appreciation.

 

Public Survey on TVB Jade Solid Gold Music Awards 2014 (Selection Part 1)

 

“Public Survey on TVB Jade Solid Gold Music Awards 2014 (Selection Part 1)” is the second POP Panel research project of the same type. The target population of this survey was Cantonese-speaking citizens in Hong Kong of age 12 or above who have listened to local pop songs in the past 12 months. It was conducted by self-administered questionnaire and telephone interview. POP invited citizens to enroll as POP Panel members by telephone, with panel members’ consent, POP then randomly selected one household member of each qualified household to participate in this survey. Invitation letter, ballot, background of study and voting rules were sent to the invited panel members by post or email. This survey mainly used online ballot to collect opinion, panel members can fill in the online ballot by logging in the survey website with unique password. Panel members can also choose to fill in the paper ballot, and then submit it to POP by mail, email or fax. A serial number was printed on the questionnaire for the issue of chasers and follow-up actions. Apart from online ballot and paper ballot, panel members can also participate in this survey by telephone interview, which were conducted by interviewers under close supervision. Interviewers recorded down panel members’ answers by phone and submitted the ballot for them. The same panel member can vote repeatedly or change his/her answers within the survey period, but POP would only take the most recent record as a valid choice of songs.

 

The survey was conducted from May 30, 2014 to June 10, 2014. A total of 1,102 ballots were received, out of the 1,400 invitation letters and ballots distributed (see Table 1). Amongst them, 30 were void as the voters’ identity could not be verified. Another 30 were invalid because of zero songs or more than 20 songs selected. The final number of valid ballots was 1,042 (see Table 2). The response rate of this survey is 74.4%, calculated as the number of valid votes divided by the number of ballots distributed. For the overall sample, the sampling error of percentages is less than plus/minus 3.0 percentage points at 95% confidence level.

 

Table 1  Invitations and reminders information

 

 

Invitation letters and ballots for
target panel members

Reminders for
target panel members[1]

Email

Postal mail

Telephone[2]

Email

Telephone

30/5/14

69

4

--

--

--

3/6/14

568

8

--

--

--

4/6/14

67

177

--

--

--

5/6/14

149

18

--

--

--

6/6/14

166

83

--

--

--

7/6/14

--

--

35

--

491

8/6/14

--

--

16

--

423

9/6/14

--

--

31

408

260

10/6/14

--

--

9

--

199

Total

1,019

290

91

408

1,373

 

Table 2  Submission channels of valid ballots

 

 

Online ballot

Telephone interview

Paper ballot (including postal mail, email and fax))

30/5/14

3

0

0

31/5/14

5

0

0

1/6/14

2

0

0

2/6/14

3

0

0

3/6/14

9

0

0

4/6/14

79

0

1

5/6/14

61

0

0

6/6/14

31

0

0

7/6/14

80

211

2

8/6/14

60

165

0

9/6/14

65

118

14

10/6/14

33

90

10

Total

431
(41.4%)

584
(56.0%)

27
(2.6%)

 

To increase the representativeness of the samples, the raw data collected in this survey have been weighted. Since there is no information on the Hong Kong population aged 12 or above who have listened to local pop songs in the past 12 months published by the government, all the figures have been rim-weighted according to gender-age distribution of the 5,234 panel members reached from 1,883 POP Panel household, based on the provisional figures obtained from the Census and Statistics Department regarding the gender-age distribution of the Hong Kong population aged 12 or above in 2013 year-end and the educational attainment (highest level attended) distribution collected in the 2011 Census. Figures in the report are prevailed according to the “weighted” sample.

 

[1] POP would send out one or more reminders to individual panel members if they have not submitted their ballot.
[2] There are 40 panel members that did not provide any email or postal address, thus telephone mode is used for sending invitation letters and ballots.