Survey Question Development
The total survey consisted of 118 questions. Thirty-three of these questions tested for respondents’ civic knowledge, while the remaining questions secured information on their public philosophy (39 questions), civic behavior (29), and demographics (17). Drs. Kenneth Dautrich, Richard Brake, and Gary Scott coordinated the development of these questions through a rigorous process of independent consultation, validity analyses, and scholarly review.
Thirteen of the 33 knowledge questions are taken from previous ISI surveys developed by ISI faculty advisors from universities around the country. Nine of the civic knowledge questions are taken from the U.S. Department of Education’s 12th grade NAEP test, and six from the U.S. naturalization exam. Two new knowledge questions were developed especially for this new survey and three are drawn from an “American History 101” exam posted online by www.InfoPlease.com.
Additional consultation and scholarly review concerning survey question development and final formulation were secured from members of the National Civic Literacy Board, and members of ISI’s professional staff.
Interview Technique and Sample Size
The research approach used to conduct this survey features a national random-digit-dial (RDD) sampling design. A total of 2,508 American adults were included in the sampling. They were interviewed by telephone from April 17 to May 10, 2008.
The margin of error for the sample of 2,508 adults is +/- 2.0 percentage points at the 95% level of confidence. When reporting on subgroups of adults (e.g., men, women, college graduates, etc.), the sampling error is higher. The sampling and interview methodology was designed by Dr. Kenneth Dautrich at the University of Connecticut.
Survey Population
The telephone survey data can be taken to represent a probability sample of all individuals who reside in households with residential telephone service in the United States.
Randomized Sample Selection
The RDD telephone component generated random samples of telephone households in the United States. Within each telephone household, one respondent was chosen utilizing the modified Trodahl/Carter in-house selection technique. We asked for the youngest male first, then if not available, the youngest female. This technique removes the control of the person answering the telephone deciding who participates in the survey.
For this study, Braun Research, Inc., was commissioned to conduct the telephone data collection utilizing RDD sampling through Survey Sampling International (SSI). Using SSI’s standard RDD methodology, a sample was drawn with a sample size equal to the number of completed interviews.
Weighting
In order to make appropriate projections to the survey population, weight has been applied to the data. Weight represents a compound probability that adjusts a sample to match the population characteristics of the civilian noninstitutionalized population of the United States. The weighting process adjusts for error inherent in the sampling methodology. The frame of the general population was aligned to the national population, as taken from the 2006 American Community Survey, and a weight was applied based on age, gender, education, and race. The full weighting calculations are detailed on the opposite page.
Analyses and Report Writing
The various diagnostics and statistical analyses of the raw data matrix, including statistical inferences based upon multiple regression analyses, were independently conducted and then jointly corroborated by Dr. Kenneth Dautrich at the University of Connecticut and Dr. Gary Scott at ISI. ISI visiting fellow Terence Jeffrey provided the technical writing for this report.
Weighting Calculations | ||||||||
Total U.S. | Total Survey | Weight | ||||||
---|---|---|---|---|---|---|---|---|
NO. | % | NO. | % | White | Black | Other | ||
Total | 225,663,342 | 2,508 | ||||||
Male 18 to 24 years | 15,326,044 | 6.79% | ||||||
Less than HS or HS Graduate | 8,714,397 | 3.86 | 80 | 3.19% | 1.1 | 1.8 | 1.2 | |
Some College or Associates | 5,571,125 | 2.47 | 41 | 1.63 | 1.4 | 2.22 | 1.5 | |
Bachelor’s Degree | 976,599 | 0.43 | 19 | 0.76 | 0.55 | 0.01 | 0.57 | |
Graduate Degree | 63,923 | 0.03 | 3 | 0.12 | 0.23 | 0 | 0.24 | |
Male 25 to 34 years | 20,249,512 | 8.97 | ||||||
Less than HS or HS Graduate | 9,520,735 | 4.22 | 57 | 2.27 | 1.7 | 2.7 | 1.8 | |
Some College or Associates | 5,542,208 | 2.46 | 48 | 1.91 | 1.2 | 1.9 | 1.2 | |
Bachelor’s Degree | 3,818,398 | 1.69 | 49 | 1.95 | 0.83 | 1.3 | 0.87 | |
Graduate Degree | 1,368,171 | 0.61 | 32 | 1.28 | 0.01 | 0.02 | 0.48 | |
Male 35 to 44 years | 21,948,874 | 9.73 | ||||||
Less than HS or HS Graduate | 9,997,142 | 4.43 | 47 | 1.87 | 2 | 3.25 | 2 | |
Some College or Associates | 5,709,650 | 2.53 | 47 | 1.87 | 1.3 | 2 | 1.3 | |
Bachelor’s Degree | 4,019,304 | 1.78 | 83 | 3.31 | 0.03 | 0.05 | 0.54 | |
Graduate Degree | 2,222,778 | 0.99 | 48 | 1.91 | 0.02 | 0.03 | 0.51 | |
Male 45 to 64 years | 36,554,880 | 16.2 | ||||||
Less than HS or HS Graduate | 15,702,808 | 6.96 | 134 | 5.34 | 1.2 | 1.9 | 1.3 | |
Some College or Associates | 9,821,354 | 4.35 | 90 | 3.59 | 1.1 | 1.8 | 1.2 | |
Bachelor’s Degree | 6,432,329 | 2.85 | 103 | 4.11 | 0.04 | 1 | 0.69 | |
Graduate Degree | 4,598,389 | 2.04 | 79 | 3.15 | 0.03 | 0.05 | 0.65 | |
Male 65 years & older | 15,606,675 | 6.92 | ||||||
Less than HS or HS Graduate | 8,683,778 | 3.85 | 80 | 3.19 | 1.1 | 1.8 | 1.2 | |
Some College or Associates | 3,082,484 | 1.37 | 52 | 2.07 | 0.02 | 0.03 | 0.66 | |
Bachelor’s Degree | 2,031,268 | 0.9 | 51 | 2.03 | 0.02 | 0.03 | 0.44 | |
Graduate Degree | 1,809,145 | 0.8 | 55 | 2.19 | 0.02 | 0.03 | 0.37 | |
Female 18 to 24 years | 14,374,474 | 6.37 | ||||||
Less than HS or HS Graduate | 6,684,718 | 2.96 | 68 | 2.71 | 0.03 | 1.5 | 1 | |
Some College or Associates | 6,172,281 | 2.74 | 43 | 1.71 | 1.5 | 2.22 | 1.6 | |
Bachelor’s Degree | 1,400,582 | 0.62 | 17 | 0.68 | 0.01 | 0.01 | 0.92 | |
Graduate Degree | 116,893 | 0.05 | 3 | 0.12 | 0 | 0 | 0.43 | |
Female 25 to 34 years | 19,656,087 | 8.71 | ||||||
Less than HS or HS Graduate | 7,214,157 | 3.2 | 49 | 1.95 | 1.5 | 2.22 | 1.6 | |
Some College or Associates | 6,119,037 | 2.71 | 44 | 1.75 | 1.4 | 2.22 | 1.5 | |
Bachelor’s Degree | 4,485,475 | 1.99 | 50 | 1.99 | 0.02 | 1.5 | 1 | |
Graduate Degree | 1,837,418 | 0.81 | 28 | 1.12 | 0.01 | 1.1 | 0.73 | |
Female 35 to 44 years | 21,943,757 | 9.73 | ||||||
Less than HS or HS Graduate | 8,410,784 | 3.73 | 61 | 2.43 | 1.4 | 2.22 | 1.5 | |
Some College or Associates | 6,772,537 | 3 | 42 | 1.67 | 1.7 | 2.45 | 1.7 | |
Bachelor’s Degree | 4,524,048 | 2.01 | 57 | 2.27 | 0.02 | 1.3 | 0.88 | |
Graduate Degree | 2,236,388 | 0.99 | 46 | 1.83 | 0.02 | 0.03 | 0.54 | |
Female 45 to 64 years | 38,388,710 | 17.01 | ||||||
Less than HS or HS Graduate | 16,582,096 | 7.35 | 161 | 6.42 | 0.06 | 1.75 | 1.1 | |
Some College or Associates | 11,414,003 | 5.06 | 133 | 5.3 | 0.05 | 1.4 | 0.95 | |
Bachelor’s Degree | 6,280,367 | 2.78 | 107 | 4.27 | 0.04 | 0.07 | 0.65 | |
Graduate Degree | 4,112,244 | 1.82 | 87 | 3.47 | 0.03 | 0.05 | 0.53 | |
Female 65 years & older | 21,584,329 | 9.57 | ||||||
Less than HS or HS Graduate | 14,258,549 | 6.32 | 122 | 4.86 | 0.05 | 1.9 | 1.3 | |
Some College or Associates | 4,210,607 | 1.87 | 59 | 2.35 | 0.02 | 1.2 | 0.79 | |
Bachelor’s Degree | 1,904,998 | 0.84 | 51 | 2.03 | 0.02 | 0.03 | 0.42 | |
Graduate Degree | 1,210,175 | 0.54 | 31 | 1.24 | 0.01 | 0.02 | 0.43 |