Top
Search UCEA
Monday
Oct242011

Staffing vs. Retention: A summary of Darleen Opfer's “Defining and Identifying Hard-to-Staff Schools: The Role of School Demographics and Conditions” 

One assumption in education today is that no teacher wants to work at a “difficult” school, so we must figure out how to get teachers into the urban or rural schools.  Money is spent and programs are developed for the very purpose of feeding teachers into the pipeline of “hard-to-staff” schools.  In Dr. Darleen Opfer’s research entitled, “Defining and Identifying Hard-to-Staff Schools: The Role of School Demographics and Conditions,” published in the October 2011 volume of Educational Administration Quarterly, she questions whether finding teachers that want to fill the positions in these schools is as difficult as some people would like to have you believe.  This study explored 3,371 vacancies in 1,040 schools and tried to determine what demographic factors and work conditions were related to a school being hard-to-staff.  The term “hard-to-staff” dealt specifically with the hiring process and treated attrition as a separate issue.  The demographic characteristics considered were location (rural or urban), high-poverty population, high-minority population, and low-achieving schools with high attrition.  The work conditions were defined as central office help or hindrance, quality of the applicant pool, level of school resources, and opportunities for career development.  The methodology was a survey designed to elicit information on vacancies in Ohio Schools for the 2004-2005 school year as well as the factors that influenced the filling of the vacancies.

In Dr. Opfer’s literature review, she highlights the lack of empirical studies that have been conducted on the topics of teacher recruitment, teacher retention, teacher attrition, and hard-to-staff schools.  However, she argues that there are often claims of causation made regarding staffing and certain demographics, such as race and poverty level, when there has merely been some level of correlation.  Another criticism she raises is that the reasons schools struggle to hire teachers has been coupled with the reasons they struggle to keep teachers whereas those problems are distinct.  Also, she critiques the labor markets conceptual framework, which uses opportunity cost to explain whether individuals will stay in teaching.  Opfer (2011) states:

Because of the predominance of the labor market/opportunity costs conceptualization of teacher recruitment, retention, and attrition, most writings on hard-to-staff schools and state hard-to-staff policies assume that attrition, in combination with school-level demographics associated with high attrition, are proxies for a school being hard-to-staff. (P.587)

Researchers have made the mistake of not only looking at recruitment and retention as similar problems, but they have also assumed that they could generalize the decisions of individuals to describe the circumstances of the organization.

Instead, the author argues for an organizational conceptual framing because she feels that it can more accurately explain why schools are hard to staff and possibly even allow researchers to shift the problem from staffing to retaining teachers.  This restructuring allows the author to draw new conclusions about the problems of teacher recruitment, retention, and attrition.  For instance, she says, “It may not be that teachers are leaving urban, low-SES schools per se but, rather, that they are leaving schools with poor working conditions or ones whose conditions were not what their initial perceptions indicated” (Opfer, 2011, p. 589).  She highlights two studies that have used this approach to study attrition, the work of Ingersoll in 2001 and Loeb et al. in 2005.  She believes that in order to investigate school level problems, you must have school level measures. 

This study was survey-based with a two-part analysis, both descriptive and explorative. The surveys that were filled out by school administrators described the hiring process and the factors affecting the process.  There was a 67% response rate, but she determined that the responders and non-responders were similar in terms of demographics and rates of vacancies.  The author found that the demographics of high poverty, student ethnicity, and school location were not as closely associated with staffing as organizational factors such as the central office role in hiring.  Schools were divided in to the categories of high-minority, urban, high-poverty, and average.  The high-minority, high-poverty, and urban schools all filled their open positions faster and high minority and urban schools had more applicants per position.  On the other hand, high-poverty, high-minority, and urban schools all reported having difficulty hiring teachers that could teach all students, including those students who are struggling.  In order to figure out what school characteristics were associated with hard-to-staff outcomes and whether they were the same across schools, Opfer used three regression models to explore the relationship between the dependent variables of demographic characteristics, school conditions, and school achievement and their relationship to staffing.   

In this study, Dr. Opfer found that high-poverty and high-minority schools do not have trouble hiring teachers and that those teachers are often certified and in-field teachers.  Across all the schools, however, the principals felt that the quality of the applicant pool needed to be improved.  This research can help to lay the groundwork for understanding that the factors making it hard to staff schools are not outside the realm of the school district, and there can be changes made to create a better pool of applicants.  Too often the problem of staffing is explained using demographics, which masks the real problems. 

Having been a teacher in a high poverty, high-minority school with low achievement and high attrition in an urban, high crime neighborhood, I can confirm that the school’s demographics did not play a part in whether most of the teachers choose to work there.  In fact, many teachers were drawn to the high needs situation because they felt like they would have greater chance to make an impact.  I attended several hiring fairs in New York City on behalf of my school, and many of the candidates would have taken a job offer on the spot.  Unfortunately, the greater problem was that most of those teachers couldn’t give answers to interview questions that showed they were prepared to deal with the large portion of students who were struggling with literacy and basic math skills much less how they would deal with disruptive classroom behavior.  All of those factors are building blocks to being able to have a learning environment where you can push high-level thinking and truly prepare students to achieve.  It seems to me that when looking at the staffing problem, we need to make sure we are looking at the right issues.  Schools often aren’t having trouble getting applicants; they are having trouble getting the right candidates in the right jobs.  There needs to be more research in this area of recruitment and retention so that we can move past the common belief that teachers don’t want to work in schools deemed “difficult” and begin to understand what makes teachers successful in those school environments.

 

 

 

 

 

Thursday
Aug042011

Value Added for Principals?

Graduate students of UCEA member institutions enter a wide variety of professions upon graduation. Some enter the professoriate, others the public school system, the policy world, and so on. The world of educational administration is vast, as is the circumference of our collective research. That being said, there are few of us who will not be interested in the evolution of principal evaluation.

The purpose of this column entry is to expose graduate students to modern research exploring value added measures of principal effectiveness. By now we are all familiar with value added modeling (VAM) for classroom teachers, but few are knowledgeable of the inner-workings of VAM for principals. The remainder of this column begins with a brief description of the extant research on principal effects and concludes with a request for reader feedback on which article or authors you’d like to see interviewed in this space.

Empirical approaches to quantifying principal contribution to student achievement are not entirely new. According to my literature review, the first attempt to quantify principal impact on student achievement was done by Eberts & Stone (1988). Using data from over 14,000 students across 300 school districts, the authors regressed 4th grade mathematics achievement upon a selection of principal characteristics, controlling for prior achievement and a variety of other school and classroom factors. Amongst other conclusions, the authors found that principal involvement with school instruction (instructional leadership) was significantly associated with higher gains in student achievement.

Brewer (1993) sought to confirm the findings of Eberts & Stone with a data set of 2,070 high school students containing math and reading achievement data along with information about the schools and administrators to whom the students are tied. Brewer conducted similar regressions (although modeled to include additional factors) and concluded that principals influence student achievement through teacher selection and goal-setting (human resource leadership and vision). Interestingly, Brewer found that neither principal experience as a teacher or administrator is significantly related to student achievement.

The past few years have seen an explosion in research around principal contributions to student achievement. Most studies look at principals who move across multiple campuses and try to determine the effect those administrators had on student achievement during their stay. Some of these works have created value added estimates for individual administrators. Below are citations for each of the articles I’ve reviewed, along with a very brief description of their content and findings.

Branch, G. F., Hanushek, E., & Rivkin, S. G. (2010). Estimating Principal Effectiveness. Working Paper 32. National Center for Analysis of Longitudinal Data in Education Research. Retrieved from http://www.caldercenter.org/publications.cfm

In this CALDER center  working paper, Branch, Hanushek, & Rivkin use Texas data to explore principal contributions to school-wide achievement. Additional factors explored include the relationship between principal quality and student absenteeism. The authors find that variation in principal quality is greatest in low-income schools and that principal mobility between schools is most common for individuals with the highest and lowest value added measures.

Clark, D., Martorell, P., & Rockoff, J. (2009). School Principals and School Performance. Working Paper 38. National Center for Analysis of Longitudinal Data in Education Research. Retrieved from http://www.caldercenter.org/publications.cfm

In contrast to Brewer (1993) this CALDER publication finds that principal experience is positively correlated with student achievement. Using New York City administrative data, the authors use information about principals' educational background, training, and work experience in addition to a variety of school and student variables to calculate principal value added measures. The authors make the argument that the sorting of less-experienced administrators into already low-achieving schools can further expand educational inequity.

Coelli, M., & Green, D. (2009). Leadership Effects: School Principals and Student Outcomes. Preliminary paper. Retrieved from http://sites.google.com/site/mickcoelli/academics

This paper explored the relationship between principal effectiveness and the academic achievement and graduation rate of high school seniors in British Columbia. The authors conclude that principal effects are stronger with regards to academic achievement (as measured by a standardized ELA exam) than for graduation rates. One interesting finding from the article is that principal effects take time to show up in achievement data. In other words, it takes time for a principal to reorganize the school to match her vision.

Dhuey, E., & Smith, J. (2010). How Important Are School Principals in the Production of Student Achievement? Preliminary paper. Retrieved from http://homes.chass.utoronto.ca/~edhuey/index.php/home/page/research

This is another study using administrative data from British Columbia. Here the authors find significant, measurable principal effects on student achievement in both math and reading at the elementary level. The authors suggest that a one standard deviation increase in principal quality relates to a roughly 0.2 standard deviation increase in student performance.  In this study, the authors find no relationship between principal experience and principal value added.

Lipscomb, S., Teh, B., Gill, B., Chiang, H., & Owens, A. (2010). Teacher and Principal Value-Added: Research Findings and Implementation Practices. Mathematica Policy Research, Inc.!

This publication from Mathematica research explores the difficulties associated with assigning value added measures to principals. For an excellent review of various methdological approaches to VAM for both teachers and principals, look no further than this publication.

One piece of research recently brought to my attention is a working paper by Cannon, Figlio, and Sass (2011). Their works is particularly fascinating in that it explores the effect of principal policy choices on student achievement. Their data set contains three periods of survey responses over five years, which, “asked principals to identify a variety of policies and resource-use areas along a variety of lines, including policies to improve low-performing students, lengthening instructional time, reduced class size for subject, narrowing of the curriculum, scheduling systems, policies to improve low-performing teachers, teacher resources, teacher incentives, and teacher autonomy information” (p. 7). Tying survey response data to achievement data has allowed to the authors to match principal policy choices to changes in principal value added measures. The paper is very detailed in its consideration of assumptions and explanations of the statistical models employed. I highly suggest you check it out.

Educational researchers and UCEA have long been interested in the effects that principals have on student achievement. The vast majority of the works cited in this post represent approaches to understanding principal effects from outside schools of education; work primarily done by economists. Future research on principal effects will depend on scholars to have a firm foundation in the deep, established knowledge base constructed by the tireless efforts of Leithwood, Hallinger, Heck, and Murphy (to name only a few), but also a clear understanding of the methodology employed by researchers at the helm of modern educational policy development, whom increasingly are not coming from schools of education.

Finally, giving credit where credit is due, I would like to thank Dr. Li Feng of Texas State University in San Marcos for bringing the Cannon, Figlio, & Sass paper to my attention. It was the Cannon, Figlio, & Sass piece that brought to my attention the work of Clark, Martorell, & Rockoff (2009) as well as another article I have elected not to discuss in this space (Beteille, Kalogrides, & Loeb, 2009); therefore I wish to thank Sarah Cannon, David Figlio, & Tim Sass for their contributions to the above literature review.

 

References:

Beteille, T., Kalogrides, D., & Loeb, S. (2009). Effective Schools: Managing the recruitment, development, and retention of high-quality teachers. Working Paper 37. National Center for Analysis of Longitudinal Data in Education Research. Retrieved from http://www.caldercenter.org/publications.cfm

Branch, G. F., Hanushek, E., & Rivkin, S. G. (2010). Estimating Principal Effectiveness. Working Paper 32. National Center for Analysis of Longitudinal Data in Education Research. Retrieved from http://www.caldercenter.org/publications.cfm

Brewer, D. J. (1993). Principals and student outcomes: Evidence from U.S. high schools. Economics of Education Review, 12(4), 281-292. doi:10.1016/0272-7757(93)90062-L

Cannon, S., Figlio, D., & Sass, T. (2010). The Policy Choices of Effective Principals. preliminary paper. Retrieved from http://myweb.fsu.edu/tsass/Papers/

Clark, D., Martorell, P., & Rockoff, J. (2009). School Principals and School Performance. Working Paper 38. National Center for Analysis of Longitudinal Data in Education Research. Retrieved from http://www.caldercenter.org/publications.cfm

Coelli, M., & Green, D. (2009). Leadership Effects: School Principals and Student Outcomes. Preliminary paper. Retrieved from http://sites.google.com/site/mickcoelli/academics

Dhuey, E., & Smith, J. (2010). How Important Are School Principals in the Production of Student Achievement? Preliminary paper. Retrieved from http://homes.chass.utoronto.ca/~edhuey/index.php/home/page/research

Eberts, R. W., & Stone, J. A. (1988). Student achievement in public schools: Do principals make a difference? Economics of Education Review, 7(3), 291-299. doi:10.1016/0272-7757(88)90002-7

Lipscomb, S., Teh, B., Gill, B., Chiang, H., & Owens, A. (2010). Teacher and Principal Value-Added: Research Findings and Implementation Practices. Mathematica Policy Research, Inc.

 

 

Wednesday
Jun012011

Graduate Student Profiles

Part of understanding how best to take part in an organization is by learning from those ahead of you. As part of our goal to increase graduate student participation with UCEA we will be profiling exceptional graduate students from UCEA member institutions. We hope to spread knowledge by sharing stories of their experiences and research as graduate students. If you or someone you know is an ideal candidate, please let us know - we would love to share you story.

Stay tuned for our next column entry - we'll be profiling an active UCEA graduate student who has just attained her PhD - stop by next week to hear her story!

Wednesday
Mar302011

Transitioning from Graduate Student to Professional

Approaching the transition to the job market can be a taxing and overwhelming period in the life of a graduate student. This does not have to be the case, as the intelligent use of various resources and strategies can alleviate much of the anxiety and difficulty that comes with finding one’s place in the professional world. Therefore, this particular column entry seeks to provide said resources and strategies by offering a review of hiring trends in higher education and educational administration, looking at recently released rankings of graduate schools of education and their composite programs, sharing resources which regularly announce job openings in educational administration, and by suggesting an oft-overlooked strategy for helping one’s self stand out amongst a larger pool of job applicants.

Hiring Trends

For the first time since the start of the recession, overall hiring trends for college graduates began to make a positive turn late in 2010. Several sources project continued growth over the coming year. The College Employment Research Institute at Michigan State University predicts a 5% increase in the number of PhD students entering the job market over the coming year. Similar projections are offered by the National Association of Colleges and Educators.

More specific information on job markets of particular interest to UCEA graduate students can be found in a review of the Bureau of Labor Statistics’ Occupational Outlook Handbooks for 2010-2011. The Occupational Outlook reports for both post-secondary teachers (TAs, GRAs, clinical instructors, & college professors) and educational administrators (principals, superintendents, college administrators) are very positive. Post-secondary teaching positions are projected to grow by 15% while educational administration positions are expected to grow by 8% in the aggregate. Please visit the full reports for post-secondary teachers and educational administrators.

Graduate Schools of Education Rankings

While college rankings are of little use to some, they are often seen as an important information source for prospective graduate students, recent graduates, and those wishing to enter higher education as a profession. Last week, US News and World Report released their 2011 rankings for education schools which can be disaggregated by specialty area (e.g. Administration & Supervision, Education Policy, etc.).

Resources for Job Openings

We have compiled a list of must-view links for graduate students ready to make the transition to educational administration and higher education. The first place to start out is UCEA’s Job Search Handbook. At the bottom right of the handbook homepage, you will find a variety of links providing invaluable information for every step of the job search from planning your application to negotiating your contract.

Each of the links below leads to regularly updated listings of job openings in higher education and educational administration:

http://www.ucea.org/edleadershipjobs/ - UCEA’s compilation of ed leadership jobs

http://www.aera.net/Default.aspx?id=498 – AERA divisional listserv signups

http://chronicle.com/section/Jobs/61/ - Chronicle of Higher Education

http://www.insidehighered.com/career/seekers/search - Inside Higher Education

http://www.topschooljobs.org/jobseekerx/SearchJobsForm.asp - Education Week

Finally, please visit UCEA’s publications page where you will find a compilation of RSS links for all of the information feeds that UCEA has to offer - http://www.ucea.org/publications/            (If you happen to be unfamiliar with RSS feeds, Google Reader is a free and easy to use interface. Microsoft Outlook can be used as well, just click on the feed links)

An Oft-Overlooked Strategy

Regardless of what stage of your program you might be in, whether you are a first semester graduate student or an ABD, it would be wise to get into the habit of reading job openings as they are posted. This will allow you to better formulate the area in which you wish to specialize. Being cognizant of the types of applicants that universities are looking for will allow you to direct your graduate courses and research in a direction that will set you apart from your peers. Think about what can be done with your course selection, independent studies, conference participation, and published work that will make you more attractive to potential employers. Waiting to review job openings until halfway through your dissertation provides little opportunity to craft a body of work reflective of a specialty.

In conclusion, we hope that the information and resources provided in this, our first Graduate Student Column post, are helpful in your journey from grad student to professional. Don’t forget to check out the Graduate Student Blog, follow UCEA on Twitter, and like us on Facebook. We look forward to your feedback on all entries and any ideas you might have for future topics. Until then, good luck in your studies!