Contractor Incentives Improve Performance of Weatherization Program

09/01/2023
Featured in print Digest

This figure is a two-panel vertical bar graph titled, Incentives and Contractor Performance in Weatherization Assistance Program. The following description is for the left-side panel. The panel is labeled, Building Envelope tightness.  The y-axis is labeled, additional reductions in CFM50 relative to untreated jobs. It ranges from 0 to 120, increasing in increments of 20.  There are two bars: high treat and low treat. The high treat bar has a value of around 115 while the low treat is around 65.  The following description is for the right-side panel.  The panel is labeled, Monthly Gas Usage. The y-axis is labeled, savings in gas usage, MMBTU, Relative to untreated jobs. It ranges from 0 to 0.40, increasing in increments of 0.10. There are two bars: high treat and low treat. The high treat bar has a value of 0.40 while the low treat has a value close 0.35.  The following applies to both panels. The note line reads, Low treat ($0.40) and high treat ($1.00) refer to piece-rate bonuses per 50 cubic feet per minute reductions. The source line reads, Source: Researchers’ calculations using data from the IHWAP and inspection reports from multiple agencies

In a program designed to save energy by promoting home weatherization among low-income households, compensating contractors based on the amount of natural gas saved increased the average benefit by 24 percent. Peter ChristensenPaul Francisco, and Erica Myers report this finding in Incentive Pay and Social Returns to Worker Effort in Public Programs: Evidence from the Weatherization Assistance Program (NBER Working Paper 31322).

The researchers partnered with the Illinois Home Weatherization Assistance Program and studied projects that were undertaken in 2018 and 2019. Jobs were randomly assigned contracts of three types: high incentive, low incentive, and as a control, no incentive. Projects in Cook County, which includes Chicago, were excluded because the city had a performance-based pay system already in place.

Offering bonuses to contractors who exceeded a target effectiveness level resulted in improved performance whether the bonuses were large or small.

Under the program, an energy specialist establishes a baseline for each project by installing a large fan in the frame of one of the home’s outside doorways. The fan draws air out of the home, reducing the air pressure inside. Leakier homes require that more air be sucked out to achieve the same amount of depressurization. Based on these test results, the weatherization program calculates the target for the potential benefits of air sealing.

The extent to which a home is “sealed” against the weather depends on its condition and the skill and motivation of contractors to seek out leaks in attics, walls, basements, chimneys, crawl spaces, and other places. Bonuses for each project were tied to the amount by which contractors exceeded the minimum leakage reduction goal for the home.

Although jobs awarded the higher bonuses achieved better results than those awarded smaller ones, the difference between the two groups was not statistically significant. Both large and small bonuses decreased the probability of a callback, when the contractor must correct deficiencies, by about a third. The higher-bonus group appeared to have fewer deficiencies than the lower-bonus one, but once again the difference was not statistically significant.

Using gas bills, the researchers estimate that pay-for-performance incen­tives for contractors reduced gas consumption by 20 to 25 percent. Contractors considered high quality based on pre-study performance achieved twice the reduction in leakage of their lower-quality counterparts. The researchers conclude that their low incentive option, which offers only a modest payment to contractors, yields greater returns per dollar than their higher incentive option.

— Steve Maas