Maternal & Child Health Bureau - Needs Assessment Report - Close Window

Click here to download the PDF Version
Pages 1-10
Pages 11-16
Pages 17-23
Pages 24-34
Pages 35-45
Pages 46-66
Pages 67-83: Needs Assessment Survey

PURPOSE OF THE NEEDS ASSESSMENT

The U.S. health care system has seen major changes over the last decade and has become increasingly complex. Resultantly, innovative policy, programmatic and service approaches will be essential to assure that there are adequate services and well-trained service providers available to meet the needs of the maternal and child health (MCH) population. In order to address the training needs brought about by these changes, the Maternal and Child Health Bureau (MCHB), HRSA, DHHS, currently allocates approximately $35.8 million annually to support training in a variety of areas relevant to the educational needs of professionals responsible for the MCH population in the United States. Graduate education (GE) programs receiving funding from MCHB support both uni-disciplinary and interdisciplinary studies in academic, clinical, and public health practice areas. In addition to conference-based training sessions, short-term continuing education (CE) efforts supported from MCHB include distance-learning and technology-based courses.

The Maternal and Child Health Bureau, supporting its strategic plan related to long-term graduate and short-term continuing education of the MCH workforce, asked the MCH Leadership Skills Training Institute (MCH-LSTI) to conduct a national assessment of graduate and continuing education needs. The purpose of this assessment was to provide current and critically needed information to help guide future strategic decisions regarding MCHB training initiatives. In an attempt to assure input from agencies and organizations focusing on MCH populations, information compiled for this needs assessment included responses to questions regarding the importance of and need for supporting training in specific skill and content areas and the preferred modalities for training. A copy of the needs assessment data collection form used for this project is provided in Appendix A.

METHODS

With the guidance of MCHB, the MCH-LSTI assembled an Advisory Committee for the project and organized a meeting of the committee in December of 1999. The Advisory Committee was convened to guide the project in:

  1. Determining the target audience(s) for MCH continuing and long-term graduate education and, by extension, this assessment of those needs;

  2. Planning for and developing needs assessment forms designed to assess the MCH continuing and long-term graduate education needs of each target audience;

  3. Assessing current MCH-related CE and GE efforts;

  4. Interpreting the results of the surveys; and,

  5. Developing recommendations for a strategic plan for continuing and long-term graduate education in MCH.

In addition to MCHB representatives, the committee included representatives of public and private agencies, organizations and professional disciplines involved in MCH-related activities at the local, state and national levels, e.g., AMCHP, NCEMCH, ATMCH, MOD, local and state public health departments, NACCHO, CityMatCH, etc. Representation also reflected managed care and other health care plan organizations, health care providers, advocacy groups, special education, day care and families/consumers of MCH services. The agenda for the Advisory Committee meeting and a list of committee members are provided in Appendices B and C.

After reviewing alternatives, the Advisory Committee concluded that soliciting information directly from the wide range of professional specialty groups involved in MCH-related agencies was not feasible, given the resources available to this project. Instead, it was decided that the needs assessment should focus on soliciting information from the major employers of MCH professionals, rather than soliciting information directly from the individual professionals themselves. Therefore, the main target of this needs assessment was the directors of state MCH and CSHCN agencies and the MCH-related program directors of Medicaid programs and local public health departments. Input from state March of Dimes agencies was also seen as desirable in order to better understand the training needs of private, non-profit MCH-related organizations. Once the information from the above groups has been compiled and analyzed, Children’s Hospitals and managed care organizations are also seen as possible future target respondents for any subsequent phase of this needs assessment.

During the early months of 2000, further input toward the development of the needs assessment form and methodology was obtained through the conduct of telephone interviews with MCH experts, who were identified by the Advisory Committee. Once the needs assessment methodology was approved in the early Spring 2000, work started on the development of the needs assessment form. In order to allow for temporal comparisons, a decided effort was made to include questions contained in a previous MCH training needs assessment survey form used by the Association of MCH Programs’ Committee on Professional Education and Staff Development in 1992. A copy of their report on continuing and long-term graduate education needs, entitled "Meeting Needs - Building Capacities: State Perspectives on Graduate Training and Continuing Education Needs of Title V Programs, is provided in Appendix D.

The draft needs assessment forms were distributed for comment in the Spring of 2000 and finalized for use in May 2000. The distribution of the needs assessment forms was delayed until Summer 2000, in recognition of the pressing deadlines and workload faced by states related to their MCH Block Grant applications. The needs assessment forms were sent to the following MCH-related agencies:

  • All State Medicaid offices (Medicaid);
  • A 20% random sample of Local Health Departments (Local);
  • All State and Territory Maternal and Child Health agencies (State MCH);
  • All State and Territory Children with Special Health Care Needs agencies (State CSHCN);
  • HRSA Regional Offices;
  • National Office of the March of Dimes.

While the HRSA Regional Offices and March of Dimes key informants were included in our information-gathering phase, the data collected from these groups are not included in this report, as the responses were not seen to necessarily be representative of their respective organizations or agencies. Therefore, all results presented in this reflect the following four respondent categories: local health departments and State MCH, CSHCN and Medicaid agencies. A twenty percent random sample of all local health departments (Local) was selected by NACCHO, who then provided MCH-LSTI with contact information for each local health department contained in the sample. The State MCH and CSHCN contact information was obtained from the AMCHP membership list. HRSA Regional Office contact information was provided by MCHB. The national office of the March of Dimes identified several key informants at the state level. These key informants were sent the needs assessments forms by their national office, which collected the responses and then provided them to MCH-LSTI.

Each individual needs assessment form was marked with a unique identifier, with the numbers grouped according to agency type. All needs assessment forms were mailed in August 2000. In order to increase the response rate, State MCH, CSHCN and Medicaid agencies received follow-up calls after 6 and 10 weeks.

STUDY LIMITATIONS

As will be indicated in the following Results section, the response rate from Local health department agencies was low (24%) and represents a major limitation to this study. Although the response rate is not atypical of mailed surveys and would be difficult to increase without a substantial investment, the Local respondents may not be representative of local health departments in general.

The data provided in the next section will also reveal that the response rate for the State MCH agencies was the highest among the agency types. After taking into account the predominance of missing responses from territorial offices, the MCH agency response rate probably does reflect a close representation of MCH agencies in general. The response for State CSHCN agencies was lower than that of MCH agencies and was more variable across the regions. Regions III, IV and IX were conspicuous in their low response and generalizing these results to those regions should be undertaken with due caution. Similarly, lower response rates from Medicaid offices in Regions VIII, IX, and X limits generalizability to those regions.

RESULTS

Respondents and Response Rate

Table 1 provides information on the number of needs assessment forms distributed and returned by agency type. Overall, 871 needs assessment forms were mailed, the majority to local health departments. The return rate varied markedly by type of respondent agency. State MCH and CSHCN agencies had the highest return rates among the respondent categories, at 79.3% and 54.4% respectively. Medicaid agencies followed closely at 53.6%. Local agency response rates were significantly lower (23.7%). Overall, 274 surveys were returned, representing a 31.5% response rate. This overall response rate largely reflects that of the Local agencies, which composed 80 percent of the original target respondents.

Table 1 Response Rate By Agency Type

Graduate and Continuing Education Assessment
Agency Type # Forms Mailed # Forms Returned Percentage Returned
MCH* 58 46 79.3%
CSHCN* 53 31 54.4%
Locals 704 167 23.7%
Medicaid 56 30 53.6%
Totals 871 274 31.5%

(*): 9 returned forms indicated a combined response for MCH and CSHCN [Data Source: MCH Leadership Skills Training Institute Year 2000-1 Assessment of MCH Training Needs]

Response rates by region are provided in Table 2. For CSHCN and MCH agencies, Region IX had a response rate considerably lower than other regions, while there was a 100% response from Region VIII. Regions VIII, IX and X had relatively lower (<50%) response rates for Medicaid agencies compared to the rest of the country. The highest response rate for Local agencies was 46 percent in Region IX. Of the Local agencies, the heaviest sampling occurred in Regions I, IV and V. However, the highest response rates occurred in Regions IX, X and V. No territorial offices were included in the Local sample, whereas these territorial offices were included with the target State MCH and CSHCN agencies. It should be noted that this project had greater difficulty in following up with MCH and CSHCN territorial offices due to time zone differences and other factors.

Table 2 Response Rates by Agency Type and Region

REGION State MCH State CSHCN Local Medicaid
Region I 83.3% 66.7% 5.6% (142) 66.7%
Region II 75.0% 75.0% 23.7% (38) 50.0%
Region III 100% 33.3% 28.6% (56) 83.3%
Region IV 75.0% 37.5% 27.1% (129) 75.0%
Region V 83.3% 66.7% 35.5% (110) 66.7%
Region VI 100% 60.0% 10.8% (83) 60.0%
Region VII 100% 50.0% 34.9% (66) 50.0%
Region VIII 100% 100% 23.7% (38) 33.3%
Region IX 30.0% 10.0% 45.8% (24) 20.0%
Region X 75.0% 75.0% 44.4% (18) 0.0%

[Data Source: MCH Leadership Skills Training Institute Year 2000-1 Assessment of MCH Training Needs]

In order to better understand the point of view of the individual who responded for their agency, the needs assessment form inquired of the respondent’s professional staff level. The majority of those completing the form classified themselves as “Director” or “Program Manager” (Table 3).

Table 3 Staff Level of Respondents by Agency Type

STAFF LEVEL State MCH State CSHCN Local Medicaid
Director 61.9% 52.4% 54.5% 27.6%
Program Manager 23.8% 42.9% 29.1% 41.4%
Program Staff 2.4% 3.6% 17.2%
Other 11.9% 4.8% 12.7% 13.8%

[Data Source: MCH Leadership Skills Training Institute Year 2000-1 Assessment of MCH Training Needs]

 

As it was viewed as relevant to ascertain the size of the workforce of these agencies, respondents were asked to indicate the number of employees in their agency. The majority of State MCH agencies had less than 250 employees (Table 4). However, the majority of respondents in other agencies (i.e., CSHCN, Local, and Medicaid) reported less than 50 full-time employees. Over 80% of Local respondents reported less than 50 employees.

Table 4 Number of Full-Time Employees By Agency Type

State MCH State CSHCN Local Medicaid
Mean 118.16 49.00 145.00 205.67
Median 85.5 29.00 9.20 17.00
Range 3 – 686 2 - 180 0 - 1400 1 - 2000
25% - 75% 40 –130 (90) 9 – 75 (66) 4 – 30 (26) 6 – 165 (159)
% < 50 employees 28.6% 66.7% 82.8% 68.9%
% 50 – 100 employees 28.7% 11.2% 5.6% 4.3%
%100 – 250 employees 33.6% 22.3% 4.9% 8.6%
%250 – 500 employees 7.2% 4.2%
%> 500 employees 2.4% 2.8% 17.2%

[Data Source: MCH Leadership Skills Training Institute Year 2000-1 Assessment of MCH Training Needs]

Back to the top of the page.