Review February 2018 | Volume 126 | Issue 2
Community-Led Total Sanitation: A Mixed-Methods Systematic Review of Evidence and Its Quality
1The Water Institute at University of North Carolina, Department of Environmental Sciences and Engineering, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
PDF Version (774 KB)
- Community-led total sanitation (CLTS) is a widely applied rural behavior change approach for ending open defecation. However, evidence of its impact is unclear.
- We conducted a systematic review of journal-published and gray literature to a) assess evidence quality, b) summarize CLTS impacts, and c) identify factors affecting implementation and effectiveness.
- Eligible studies were systematically screened and selected for analysis from searches of seven databases and 16 websites. We developed a framework to appraise literature quality. We qualitatively analyzed factors enabling or constraining CLTS, and summarized results from quantitative evaluations.
- We included 200 studies (14 quantitative evaluations, 29 qualitative studies, and 157 case studies). Journal-published literature was generally of higher quality than gray literature. Fourteen quantitative evaluations reported decreases in open defecation, but did not corroborate the widespread claims of open defecation–free (ODF) villages found in case studies. Over one-fourth of the literature overstated conclusions, attributing outcomes and impacts to interventions without an appropriate study design. We identified 43 implementation- and community-related factors reportedly affecting CLTS. This analysis revealed the importance of adaptability, structured posttriggering activities, appropriate community selection, and further research on combining and sequencing CLTS with other interventions.
- The evidence base on CLTS effectiveness available to practitioners, policy makers, and program managers to inform their actions is weak. Our results highlight the need for more rigorous research on CLTS impacts as well as applied research initiatives that bring researchers and practitioners together to address implementation challenges to improve rural sanitation efforts. https://doi.org/10.1289/EHP1965
Received: 30 March 2017
Revised: 21 November 2017
Accepted: 24 November 2017
Published: 2 February 2018
Address correspondence to V. Venkataramanan, 806 Sherman Ave., Apt. 2., Evanston IL 60202 USA. Telephone: (513) 652-1521. Email: firstname.lastname@example.org
Supplemental Material is available online (https://doi.org/10.1289/EHP1965).
The authors declare they have no actual or potential competing financial interests.
Note to readers with disabilities: EHP strives to ensure that all journal content is accessible to all readers. However, some figures and Supplemental Material published in EHP articles may not conform to 508 standards due to the complexity of the information being presented. If you need assistance accessing journal content, please contact email@example.com. Our staff will work with you to assess and meet your accessibility needs within 3 working days.
Supplemental Material PDF (296 KB)
Supplemental Code and Data Zip File (91 KB)
Note to readers with disabilities: EHP has provided a 508-conformant table of contents summarizing the Supplemental Material for this article (see below) so readers with disabilities may determine whether they wish to access the full, nonconformant Supplemental Material. If you need assistance accessing journal content, please contact firstname.lastname@example.org. Our staff will work with you to assess and meet your accessibility needs within 3 working days.
Supplemental Table of Contents PDF (64 KB)
Related EHP Article
An estimated 946 million people in the world practiced open defecation in 2015, 90% of whom lived in rural areas (UNICEF and WHO 2015). Open defecation adversely affects human health, contributing to diarrheal diseases and childhood stunting (Clasen et al. 2014; Spears et al. 2013; Vyas et al. 2016). Poor sanitation also has an adverse economic impact (DeFrancis 2011), and disproportionately affects the safety, health, and dignity of women (Hulland et al. 2015; Jadhav et al. 2016; Khanna and Das 2016; Kulkarni and O’Reilly 2014).
For decades, governments and nongovernmental organizations (NGOs) provided free or subsidized latrines to households, but practitioners widely believe that this approach was unable to guarantee regular latrine use. This recognition led to a focus on hygiene and health education programs, often combined with latrine subsidies, such as the Participatory Hygiene and Sanitation Transformation approach (WHO 1997). Lessons learned from implementing these programs led many sanitation professionals to conclude that while the infrastructure-heavy approach may have increased access to latrines and educational approaches may have increased awareness of health benefits, these strategies were largely insufficient to generate demand for latrines and change sanitation behavior (Jenkins and Sugden 2006).
As a response, the community-led total sanitation (CLTS) approach was developed, aiming to create open defecation–free (ODF) communities (Kar and Chambers 2008). This approach signified a fundamental shift from a focus on individual or household sanitation to a community-level concern for open defecation. CLTS facilitators attempt to trigger collective behavior change by encouraging and motivating people to confront the impact of community-wide open defecation. CLTS comprises three stages:
- Pretriggering: selecting communities, training facilitators, collecting baseline information, and coordinating community entry.
- Triggering: organizing a community-wide meeting where facilitators conduct participatory exercises intended to trigger shame and disgust. Attendees are expected to be motivated to change their sanitation situation.
- Posttriggering: conducting routine follow-up visits, with the goal of verifying and certifying ODF status in communities.
Since the first pilot projects in Bangladesh in 2000, CLTS has been adopted by many international NGOs involved in rural sanitation and has been incorporated into national policy by many governments. It is arguably now the predominant rural sanitation behavior change approach.
Most literature on CLTS is contained on websites and knowledge bases in the form of gray literature, primarily produced by practitioners to share insights from their implementation experiences. It has often been noted that there is limited rigorous evidence on CLTS impacts. Governments and organizations implementing CLTS face the challenge of navigating a vast and cluttered body of literature to inform their decisions.
We identified 41 published systematic reviews relating to sanitation interventions. Most study the impact of sanitation on health outcomes. A handful look at behavior- or demand-related topics, such as factors affecting sustained adoption of water and sanitation technologies (Hulland et al. 2015), behavioral research relating to point-of-use-water treatment technologies (Fiebelkorn et al. 2012), behavioral models for water and sanitation (Dreibelbis et al. 2013; Dwipayanti et al. 2017), and water, sanitation, and hygiene (WaSH) social marketing approaches (Evans et al. 2014). No reviews were found that concentrate on CLTS or related interventions.
To address this gap, we conducted a mixed-methods systematic review of journal-published and gray literature on CLTS to characterize the state of the evidence. For the purpose of this review, journal-published refers only to peer-reviewed journals, with literature in other journals being classified as gray literature. The main objectives of the review were to: a) assess the quality of evidence, b) summarize evidence on the effectiveness and impact of CLTS on sanitation and health outcomes, and c) identify factors affecting CLTS implementation and effectiveness. We aimed to comprehensively document current understanding on CLTS from a variety of sources, including researchers, practitioners, and donors.
We searched seven online peer-reviewed databases (Cochrane Library, Embase, Global Health, Web of Science, PubMed, Proquest, and Scopus) and the websites of 15 international organizations or sanitation knowledge hubs that document literature on CLTS. When expanding the scope of our search using Google Scholar, we observed considerable overlap between these search results and results from the 15 other websites already included in our search strategy. A previous study recommended focusing on the first 200 to 300 results from Google Scholar to find the most relevant results for systematic reviews of gray literature (Haddaway et al. 2015); therefore, we used this rationale to search the first 200 results from Google Scholar. A variety of search terms were employed to comprehensively search journal-published and gray literature, including combined keywords related to CLTS, open defecation, and demand-led and participatory approaches (see Table S1 for the full search strategy and list of databases). Documents were also reviewed from bibliographic hand searches and expert consultations. Searches were first conducted in December 2015 and updated in March 2017.
Document Selection and Eligibility Criteria
A multistep screening process was conducted for both journal-published and gray literature (Figure 1). Titles and abstracts of search results were screened independently by two authors (V.V. and A.K.), and they discussed any discrepancies in the selection of documents to reach a consensus on the final list before full-text review. Research studies, conference proceedings, evaluations, dissertations, reports, working papers, and organizational learning notes published between January 2000 (the year that CLTS was first piloted) and March 2017 were included. Guidelines, manuals, publicity material, news stories, slide presentations, workshop minutes, blog posts, reviews, and commentaries were excluded. In the case of multiple documents reporting data and findings from the same intervention or study, only the most recent document was included. Because the aim was to assess the quality of literature, no documents were excluded based on quality.
Interventions labeled as CLTS are likely to contain a variety of adaptations, and several total sanitation strategies share characteristics with CLTS [e.g., School-led Total Sanitation, Community Approaches to Total Sanitation (CATS), Community-based Total Sanitation, and India’s variations on total sanitation campaigns (TSC)]. To be inclusive, interventions that met all of the following criteria were reviewed:
- Mentioned sanitation behavior change as a key component of implementation.
- Aimed to reduce or end open defecation.
- Mobilized entire communities for sanitation rather than targeting households or specific populations.
- Included participatory activities such as triggering, village mapping, or transect walks in the decision-making and data-gathering process.
Although the Handbook on CLTS describes it as a no-subsidy approach (Kar and Chambers 2008), there is considerable debate about the role of latrine subsidies as part of, or following CLTS activities (Papafilippou et al. 2011). Therefore, interventions that met the above criteria and provided subsidized latrine hardware were also considered for inclusion in this review.
We classified literature as quantitative evaluations, qualitative studies, and case studies and project reports, adapting an approach used in a systematic review of cook stoves (Rehfuess et al. 2014). For this review, quantitative evaluations were defined as studies designed to attribute outcomes to a CLTS or CLTS-like intervention. Studies had to include primary data collection of outcomes and an experimental comparison group (controlled trials, quasi-experimental designs, and before–after comparisons). Quantitative studies that did not meet these criteria or did not have a comparison group were classified as case studies. Qualitative studies were those that used qualitative data collection methods and analytical techniques. Case studies and project reports included mixed-methods studies, cross-sectional studies, and literature that described practitioner experiences or reports and evaluations of specific CLTS projects. Papers that shared general lessons or reflections without references to primary data were classified as commentaries and were excluded from the review.
To characterize the quality of evidence on CLTS across journal-published and gray literature, we developed a quality appraisal framework for each of the three study types by reviewing and adapting questions from previously used protocols (Jack et al. 2010; Harden 2010; Heale and Twycross 2015; Loevinsohn 1990; Pluye et al. 2011; Puzzolo et al. 2013; Spencer et al. 2003; Thomas et al. 2004). Our framework comprises three categories: quality of reporting, minimizing risk of bias, and appropriateness of conclusions. Table 1 presents our quality appraisal framework, with questions to assess each criterion for the three study types. Most criteria in the quality appraisal could receive a score of 0, 0.5, or 1; the remaining, such as whether there was evidence of external peer review, could only receive a score of zero or one (see Table S2 for detailed scoring guidelines). Similar questions were asked about quality of reporting (with a maximum possible score of 6) and appropriateness of conclusions (with a maximum possible score of 3) across all three study types. However, because of differences in study design and intent, questions to assess the risk of bias differed by study type; in this category, case studies and projects reports could receive a maximum possible score of 4, qualitative studies a maximum possible score of 5, and quantitative evaluations a maximum possible score of 7 (see Table S2). Scores within each of the three categories were converted into percentages. Documents with the maximum possible score for each category were assigned a value of 100% for that category. The percentage scores for all documents within a particular subgroup (e.g., the 10 quantitative evaluations from gray literature) were then averaged to derive the mean percentage to assess differences by type of study and type of literature (journal-published vs. gray literature). An aggregate quality score was not computed for each document, as this would not allow for a nuanced discussion of quality by category, and could lead to misinterpretation of scoring. All documents were scored by the first author (V.V.), and 20% of the documents were subjected to independent quality control by the second or third authors (J.C. and A.K.).
|Category and criteria||Questions to guide quality appraisala,b,c|
|Quality of reporting|
|Objectives||For all study types: Were the objectives and purpose of the study, program, or intervention described?|
|Context||For all study types: Was sufficient detail provided on the context and setting of the study, program, or intervention?|
|Process||For all study types: Was the process of the program or intervention described thoroughly?|
|Study design||For quantitative evaluations: Was sufficient detail provided on how households or individuals were assigned to interventions?|
|For qualitative studies: Was sufficient detail provided on the sampling approach?|
|For case studies/project reports: Is there evidence of a sampling approach?|
|Data collection||For quantitative evaluations and qualitative studies: Was sufficient detail provided on data collection methods and procedures?|
|For case studies/project reports: Is there evidence of a systematic data collection process?|
|Analysis||For quantitative evaluations and qualitative studies: Was sufficient detail provided on analytical methods used in the study?|
|For case studies/project reports: Is there description of data analysis?|
|Minimizing risk of bias|
|Assignment to intervention||For quantitative evaluations: Indicate the study design (randomized controlled trial, quasi-experimental design, natural experiment, or pre+post in single group).|
|For qualitative studies and case studies/project reports: Not scored.|
|Appropriateness of sampling||For quantitative evaluations: Was sampling representative at the household level (did the survey represent the study population?)|
|For qualitative studies and case studies/project reports: Was sampling appropriate given stated objectives?|
|Independence of data collection||For all study types: Was data collection conducted by an independent and trained source?|
|For quantitative evaluations: Auditing procedures are also considered.|
|Rigor in data collection||For quantitative evaluations: Were the indicators measured in the study relevant to the research question, and were they consistent with prior work and/or thoroughly justified? Was validity of data collection tools (testing/piloting) reported?|
|For qualitative studies: Were there attempts to establish the credibility, neutrality, consistency, and/or transferability of data collection tools?|
|For case studies/project reports: Were appropriate measures taken to provide rigor to the execution of the study (includes data collection and analysis)?|
|Analytical rigor||For quantitative evaluations: Were appropriate analytical methods used (RCTs and non-RCTs)?|
|For qualitative studies: Were there attempts to establish the credibility, neutrality, consistency, and/or transferability of data analysis methods?|
|For case studies/project reports: Scored alongside data collection (see previous question).|
|External peer-review||For all study types: Is there evidence of the document being subjected to external/independent review?|
|Appropriateness of conclusions|
|Interpretation||For all study types: Is there a discussion and interpretation of the main findings?|
|Limitations||For all study types: Were study limitations described?|
|Conclusions||For all study types: Were stated conclusions and implications within the scope of the study design and data collection methods?|
Note: RCT, randomized controlled trial.
aWe developed this framework after reviewing and adapting questions from several previously used protocols (Jack et al. 2010; Harden 2010; Heale and Twycross 2015; Loevinsohn 1990; Pluye et al. 2011; Puzzolo et al. 2013; Spencer et al. 2003; Thomas et al. 2004).
bSee Table S2 for quality appraisal tools by study design and detailed scoring guidelines.
cDefinitions: Quantitative evaluations were defined as studies with an experimental comparison group designed to attribute outcomes to a community-led total sanitation (CLTS) or CLTS-like intervention; qualitative studies were defined as those that used qualitative data collection methods and analytical techniques; and case studies and project reports included mixed-methods studies, cross-sectional studies, and practitioner experiences, reports, or evaluations of CLTS projects.
Data Extraction and Analysis
Descriptive data on study type, author, project year, study design, countries of focus, country of publication, and methods were entered into a Microsoft Excel database. The main outcomes from quantitative evaluations were extracted and summarized. Qualitative content analysis was conducted for all included literature, regardless of study type, using Atlas.ti (version 7.0; Atlas.ti Scientific Softare Development). Documents were coded in two cycles (each cycle by one author) for the following: enablers and barriers to successful implementation in different stages of CLTS, key themes discussed, and indicators of success measured by programs and researchers. The first cycle of coding identified 150 factors reported as enabling or constraining CLTS. By combining similar factors, we narrowed this list to 43 factors in the second cycle. A similar process was conducted for indicators of success. Based on this inductive analysis, factors that enabled or constrained CLTS were grouped under three implementation-related domains (policy environment, implementation quality, and administrative context) and four community-related domains (environment, capacity, participation patterns, and behavior). Indicators of success were grouped under the following domains: WaSH outcomes, CLTS process, behavioral outcomes, extended impact, and motivators for behavior change.
We identified 5,884 documents from databases, websites, Google Scholar, and hand searches (Figure 1). After screening for duplicates and excluding documents that did not meet our inclusion criteria, we reviewed the full texts of 855 documents for further assessment. Of these, we further excluded documents that did not describe and analyze primary data, documents that referenced identical data and findings, and documents in which the interventions were not described sufficiently to determine their similarity to CLTS. In total, 200 out of the 5,884 documents were included in this review.
The results are organized into four sections: broad characteristics of the literature, quality appraisal, summary of quantitative outcomes and indicators from the literature, and qualitative analysis of factors influencing CLTS implementation.
Characteristics of Included Literature
Table 2 presents broad characteristics of the 200 documents included in the review (see Excel Tables S1–S5 for detailed study-level information and Table S3 for a full list of included documents). One hundred and sixty-two (81%) documents were gray literature. Ten of the 14 (71%) quantitative evaluations were journal-published literature. One hundred and twenty-seven (64%) documents were based exclusively on CLTS interventions, 47 (23%) included CLTS interventions as part of a larger WaSH project, and 26 (13%) documents were based on CLTS-like interventions. The top three publishers of gray literature were the United Nations Children’s Fund (UNICEF); the Water, Engineering, and Development Centre at the University of Loughborough; and the Institute of Development Studies at the University of Sussex.
|Characteristica (n=200)||No. of documents (%)|
|Journal-published literature||38 (19%)|
|Gray literature||162 (81%)|
|Quantitative evaluation||14 (7%)|
|Qualitative study||29 (14%)|
|Case study/project report||157 (79%)|
|Community-led total sanitation (CLTS) only||127 (64%)|
|CLTS+other water, sanitation, and hygiene intervention||47 (23%)|
|CLTS-like interventions (e.g. Community Approaches to Total Sanitation, Total Sanitation Campaign)||26 (13%)|
|World regions representedb|
|South Asia||60 (30%)|
|East and Southeast Asia||33 (17%)|
|Pacific Islands||3 (2%)|
|Latin America and the Caribbean||3 (2%)|
aSee Excel Tables S1–S3 for individual study-level information.
bThe sum of documents for world regions is greater than 200 because some documents covered multiple world regions (two world regions, n=6; three world regions, n=6; four world regions, n=2).
Fifty-three countries were represented across the literature. Twenty-seven documents reported experiences from more than one country and often multiple regions of the world. Most documents reported experiences from Africa (n=125, 63%), followed by South Asia (n=60, 30%), and Southeast Asia (n=33, 17%) (Table 2). The most represented countries were India (n=29, 15%), Kenya (n=26, 13%), Nepal (n=19, 10%), Indonesia (n=19, 10%), Ethiopia (n=15, 8%), and Bangladesh (n=15, 8%). More than three-fourths of the literature was published after 2010.
Quality of the Literature
Figure 2 shows quality scores in each category by literature type (journal-published vs. gray) and study type (quantitative evaluations vs. qualitative studies vs. case studies and project reports). Scores are presented as a percentage.
The average score for quality of reporting was higher for journal-published literature than for gray literature overall (80% vs. 58%, respectively), as well as for each study type (Figure 2A). No document scored zero on quality of reporting, and 13 of the 200 documents received a full score (6 points, 100%). There was greater variability in quality of reporting scores for gray literature than for journal-published literature. Case studies and project reports received the lowest average score (57% for both literature types combined).
On average, journal-published literature scored better than gray literature in minimizing risk of bias across all study types (Figure 2B). Quantitative evaluations had the highest average score of 69% across all literature types (average values of 85% for journal-published vs. 55% for gray literature). Three quantitative evaluations scored below 50% (i.e., <3.5 points out of 7 possible), and one study scored 100% in this category. Qualitative studies had an average score of 48% across all literature types (average values of 60% for journal-published vs. 41% for gray literature). Case studies and project reports had an average score of 20% (average values of 53% for journal-published vs. 15% for gray literature). Seventy-two of the 157 case studies and projects reports (71 of which were gray literature) scored zero points on minimizing risk of bias, 22 (13 of which were gray literature) scored ≥50% (raw score ≥2), and one received the maximum score (4, 100%). Sixty-two percent of the 200 documents received a score of zero for the independence of data collection criterion.
We used the appropriateness of conclusions category to assess interpretation of findings, description of limitations, and whether conclusions were within the scope of the study design. Appropriateness of conclusion scores were generally higher across all study types than the other two categories, and there was less variation between journal-published and gray literature within each study type (Figure 2C). Case studies and project reports had the lowest average score in this category of 61% for journal-published and 62% for gray literature. Seven of the 14 quantitative evaluations (two of which were gray literature) received a maximum score of 3 (100%), as did 13 of the 29 qualitative studies (10 of which were gray literature), and 27 of the 157 case studies and project reports (23 of which were gray literature). No quantitative evaluations received a score of zero, whereas two qualitative studies and three case studies and project reports received a score of zero. Study limitations were not described in 128 of the 200 documents (64%), including 17 of 38 documents from journal-published literature (45%) and 111 of 162 gray literature documents (69%). However, 63% of all 200 documents received a full score for the conclusions criterion, indicating that stated conclusions and implications were within the scope of study design and data collection methods.
Measuring the Effectiveness of Community-Led Total Sanitation
The main characteristics of the 14 quantitative evaluations and the main outcomes of the interventions they evaluate are presented in Table 3. Through qualitative coding of all documents, we also aggregated a list of commonly used indicators grouped under WaSH outcomes, CLTS process, behavioral outcomes, extended impact, and motivators for behavior change (Table 4). The following section reports quantitative outcomes from the 14 evaluations as well as indicators used across all 200 documents. Because of differences in study designs, it was not possible or appropriate to calculate pooled estimates of health impacts.
|Country||Reference||Intervention description||Intervention time frame||Main outcomes|
|Latrine ownership||Latrine quality||Open defecation practice||Health impacts|
|Study design: longitudinal randomized controlled trial|
|Ghana||Crocker et al. 2016a||CLTS+training natural leaders vs. CLTS||2012–2014||+18.3 pp vs. conventional CLTS||Latrines in both CLTS groups less durable than preexisting latrines||−19.9 pp in CLTS+training natural leaders group|
|India||Pattanayak et al. 2009||TSC with IEC vs. control||2006||+29%; +34% for subsidy group and +21% for no-subsidy group vs. control|
|India||Patil et al. 2014||TSC with IEC vs. control||Not reported||+19 pp vs control (41% vs. 23% control)||−9 to 10 pp among adults||No significant difference in diarrhea, HCGI, anemia, or growth outcomes|
|India||Dickinson et al. 2015||TSC with IEC vs. control||2006||+27 pp (35% vs. 15% control)||Reduction in self-reported diarrhea not significant|
|Indonesia||Cameron et al. 2013||CLTS+sanitation marketing vs. control||2008–2011||+4.0 pp vs. baseline; +31% vs. control||+6 pp (−17%) in nonpoor households||−1.4 pp (−30%) in diarrhea; decrease in parasitic infection; increases in height and weight among nonpoor households without sanitation at baseline|
|Indonesia||Borja-Vega 2014||CLTS+sanitation marketing (subgroup analysis) vs. control||2008–2011||−20.6% in some ethnic groups; not significant among female-headed households||−5.8% diarrhea (children <5 y) in female-headed households; significant increase, height for age, head circumference in Madurese ethnic group; other impacts not significant|
|Mali||Pickering et al. 2015||CLTS vs. control||Not reported||+32 pp vs. control group||CLTS latrines >2 times more likely to have cover, less likely to have ﬂies||−23 pp among adult women (−71%); −24 pp (−71%) among adult men; −43 pp (−49%) among children 5–10 y; −43 pp (−51%) among children <5 y||No difference in diarrheal prevalence; +0.18 height-for-age z-score; lower likelihood of childhood stunting (35% vs. 41%); 22% children under-weight vs. 26% control|
|Mozambique||Godfrey et al. 2014||CLTS+safe water vs. control||2008–2013||1 million new users||−29% Self-reported water-related diseases between 2008–2010|
|Tanzania||Briceño et al. 2015||CLTS vs. CLTS+handwashing vs. control||2009–2011||+12.4 pp (+33%) vs. control||No difference across groups||−12 pp (−52%)||No significant impacts|
|Study design: longitudinal quasi-experimental design|
|Ethiopia||Crocker et al. 2016b||Teacher-facilitated vs. health extension worker–facilitated CLTS||2012–2014||+9.0 pp in conventional CLTS vs. teacher-facilitated CLTS||Both interventions improved floors, superstructure, cleanliness, handwashing materials||−9.2 pp in teacher-facilitated CLTS|
|Study design: single group, baseline vs. end line|
|Kenya||Schlegelmilch et al. 2016||CLTS+other WaSH components||2007–2010||+24 pp (43% vs. 19% baseline)|
|Philippines||UNICEF 2016||PhATS||2014–2016||+12.6 pp (76.3% end line vs. 63.7% baseline) using improved nonshared facility||No significant change vs. baseline (15.2%)|
|Study design: comparative cross-sectional|
|Ethiopia||BDS-Center for Development Research 2016||CLTSH vs. control||2012–2015||60.8% latrine use in intervention vs. 58% in control||27.4% in intervention vs. 33.0% in control||24.8% self-reported diarrhea prevalence in children in intervention vs. 30% in control|
|Kenya||Makotsi et al. 2016||CLTS vs. control||Not reported 6.7% in intervention vs. 74.6% in control||11.1% two-week diarrhea prevalence in intervention vs. 21.6% in control|
Abbreviations: CLTS, community-led total sanitation; CLTSH, CLTS+hygiene; IEC, information education and communication; pp, percentage point; PhATS, Philippines Approach to Total Sanitation; TSC, Total Sanitation Campaign; WaSH, Water, sanitation, and hygiene.
|Indicator (n=200)||No. of documents (%)|
|Water, Sanitation, and Hygiene (WaSH) outcomes|
|No. (%) of people with access to latrines||124 (62%)|
|No. of communities declared/certified open defecation–free (ODF)||113 (57%)|
|No. (%) of people using latrines||52 (26%)|
|Quality of latrine (various measures)||52 (26%)|
|Health outcomes/impact (various measures)||51 (26%)|
|Type of latrine constructed||44 (22%)|
|Change in environmental sanitation (various measures)||44 (22%)|
|Presence of handwashing station||41 (21%)|
|No. (%) of people with access to water||34 (17%)|
|No. of beneficiaries affected by intervention||31 (16%)|
|No. (%) of people practicing open defecation||31 (16%)|
|No. (%) of people reverting to open defecation||14 (7%)|
|Presence of cleaning materials near latrine (soap or ash)||10 (5%)|
|Distance from latrine to water source||3 (2%)|
|Water quality||1 (1%)|
|Distance from latrine to home||1 (1%)|
|No. of training events held/people trained||63 (32%)|
|No. of communities triggered||52 (26%)|
|Costs of CLTS activities and/or latrine hardware||36 (18%)|
|Presence of WaSH/CLTS Committee||35 (18%)|
|Collection of baseline data||33 (17%)|
|Provision of community rewards for ODF||19 (10%)|
|Presence of government champions||17 (9%)|
|No. of follow-up visits||17 (9%)|
|Attendance at triggering events||16 (8%)|
|Presence of sanctions/enforcement mechanisms||14 (7%)|
|Observation of latrine upgrading during posttriggering||13 (7%)|
|No. of natural leaders identified||10 (5%)|
|Sustainability of ODF status||11 (6%)|
|Provision of incentives or rewards to volunteers||9 (5%)|
|Awareness of consequences of open defecation||38 (19%)|
|Change in handwashing behavior||35 (18%)|
|Satisfaction with latrine (including time savings)||17 (9%)|
|Change in social norms||14 (7%)|
|Child feces disposal practices||4 (2%)|
|Positive nonsanitation outcomes resulting from CLTS||27 (14%)|
|Diffusion of CLTS message to neighboring communities||24 (12%)|
|Influence of intervention on sanitation policy||15 (8%)|
|Intervention influence on women and girls||13 (7%)|
|No. of natural leaders that became CLTS facilitators||8 (4%)|
|Sense of ownership||5 (3%)|
|Motivators for behavior change|
|Improved health||35 (18%)|
|Dignity or pride||29 (15%)|
|Shame or embarrassment||16 (8%)|
|Upgraded social status||5 (3%)|
Abbreviations: CLTS, community-led total sanitation; ODF, open defecation–free.
Nine evaluations were randomized controlled trials (RCTs), one used a quasi-experimental design, two used cross-sectional designs with a comparison group, and two were baseline to end-line evaluations of a single intervention group (Table 3). The RCTs comprised evaluations of the following interventions and comparison groups: CLTS vs. a control group in Mali (Pickering et al. 2015); a four-arm intervention of CLTS, CLTS plus handwashing, handwashing only, and a control group in Tanzania (Briceño et al. 2015); CLTS with sanitation marketing vs. a control group in Indonesia (Cameron et al. 2013; Borja-Vega 2014); TSC in India combining behavior change activities with the option of subsidies vs. control groups (Patil et al. 2014; Pattanayak et al. 2009; Dickinson et al. 2015); the One Million Initiative in Mozambique that included CLTS vs. a control group (Godfrey et al. 2014); and a comparison of conventional CLTS to CLTS plus training natural leaders in Ghana (Crocker et al. 2016a). The quasi-experimental study compared conventional CLTS in Ethiopia facilitated by Health Extension Workers (HEWs) to teacher-facilitated CLTS (Crocker et al. 2016b). Of the two single-group evaluations, one was a baseline to end-line evaluation of the Philippines Phased Approach to Total Sanitation (UNICEF 2016), and the other was a baseline to end-line evaluation of CLTS and other WaSH components in Kenya (Schlegelmilch et al. 2016). Finally, of the two comparative cross-sectional studies, one evaluated CLTS and Hygiene in Ethiopia to a control group (BDS-Center for Development Research 2016), and the other assessed health outcomes in a CLTS group vs. a control group in Kenya (Makotsi et al. 2016).
Latrine ownership, use, and quality indicators were identified in most of the 200 documents, but diverse measures were used (Table 4). A few documents contained definitions of the types of latrine that would be acceptable, and others outlined latrine quality indicators such as a cover, superstructure, handwashing facility with soap, and evidence of use. Of the 14 quantitative evaluations, all but two measured either private or household latrine ownership or latrine use after CLTS, and four evaluations also reported some measure of latrine quality, such as the presence of a cover, concrete slab, superstructure, or availability of handwashing materials (Table 3). Overall, the quantitative evaluations reported a statistically significant increase in private or shared latrine construction in intervention groups compared to comparison groups. The Mali CLTS evaluation reported a 32-percentage-point (pp) increase in latrine use in intervention villages and no statistically significant increase in the control group (Pickering et al. 2015) 18 mo after the intervention. In Orissa, India, a 29-pp increase in ownership 4 to 6 mo after the intervention was attributed to the subsidy and behavior change intervention, with two-thirds of the overall treatment effect due to the CLTS-like component compared to the subsidy component of the intervention (Pattanayak et al. 2009). The CLTS studies from Ghana and Ethiopia differed slightly from other included studies in that they compared changes in sanitation outcomes between conventional CLTS in that country and a modification of the approach. The Ghana study reported an increase in private latrine ownership of 18.3 pp from training natural leaders (Crocker et al. 2016a), and the Ethiopia study reported that where HEWs facilitated CLTS, latrine ownership increased by 9 pp more than where teachers facilitated CLTS soon after the interventions (Crocker et al. 2016b).
Declaration or certification of ODF status was the second most common indicator in the literature after latrine access, but no consistent definition was reported for ODF (Table 4). Latrine coverage was the most widely used proxy measure of ODF status. Status was measured at the community level, most often by CLTS facilitators or local government. Most documents that attempted to define ODF wrote about the absence of open defecation in the environment, but few described criteria or frequency for verifying this observation. There was some recognition that “the process of maintaining an open defecation free community is not static and communities cannot simply be checked off and assumed to be ODF, without systems in place that monitor and assist households to repair/replace/rebuild their latrines” (Haq and Bode 2009). In one program in the Philippines, ODF included the “enactment of local legislation at the village level supporting CLTS activities” and the “implementation of other local government activities that supported the maintenance of ODF status” (Belizario et al. 2015). Of the 14 quantitative evaluations summarized in Table 3, two reported the status of ODF certification conducted by the government. In Ethiopia, four of the six kebeles (subgovernmental units) were certified as ODF in the first year, and the remaining two were certified during the follow-up stage (Crocker et al. 2016b). In Mali, 97% of 60 villages in the treatment group were certified as ODF (Pickering et al. 2015).
Two other indicators relating to open defecation identified in the literature were the number of people practicing open defecation (n=31, 16%) in a community, and the number reverting to open defecation after a community had achieved ODF status (n=14, 7%) (Table 4). Change in open defecation practice was reported in ten quantitative evaluations, measured at the household or individual level. As shown in Table 3, results varied considerably, from no statistically significant change between baseline and end line (15.2%) in the Philippines (UNICEF 2016), to a statistically significant 6-pp (17%) decrease in open defecation by nonpoor households in Indonesia (Cameron et al. 2013), to a 23- to 24-pp (71%) decrease in open defecation by adults in Mali (Pickering et al. 2015). The study from Maharashtra reported a 9- to 10-pp decrease in open defecation by adults; reductions were greater in below-poverty-line households or households that did not have latrines at baseline compared to wealthier households or those with latrines at baseline (Patil et al. 2014).
Fifty-one (26%) documents reported some measure of change in health status in communities after CLTS, often comprising anecdotal reports of changes in diarrhea after achieving ODF status (Table 4). Nine quantitative evaluations measured potential health impacts through self-reported changes in diarrhea prevalence or anthropometric measures in children (Table 3). The study from Mali reported no differences in childhood diarrheal prevalence between CLTS and comparison villages, but reported modest statistically significant improvements in child height, stunting, and weight (Pickering et al 2015). One study from Indonesia reported a 1.4-pp (30%) reduction in diarrhea in CLTS communities, decreases in the intensity of parasitic infection, and increases in height and weight among nonpoor households that had no sanitation at baseline (Cameron et al. 2013). A comparative cross-sectional study from Kenya reported lower diarrhea prevalence in the CLTS group vs. a control group (Makotsi et al. 2016). Four other studies did not find statistically significant evidence of health impacts due to the intervention (Borja-Vega 2014; Briceño et al. 2015; Patil et al. 2014; Dickinson et al. 2015), and one evaluation did not report statistically significant health outcomes (BDS-Center for Development Research 2016).
In addition to quantitative sanitation and health indicators, some documents described qualitative measures of CLTS success, such as influence on sanitation policy (n=15, 8%), influence of the intervention on women and girls, particularly with regard to participation and leadership in CLTS activities (n=13, 7%), diffusion of CLTS messages to other communities (n=24, 13%), and positive nonsanitation outcomes resulting from CLTS, such as community mobilization for other development activities (n=27, 14%) (Table 4).
Factors Affecting Community-Led Total Sanitation Implementation and Outcomes
Table 5 presents enabling and constraining factors that emerged inductively from a qualitative content analysis of themes discussed in the 200 documents, as well as the stage of CLTS in which they occur. The 21 implementation-related factors fall under three domains: policy environment, implementation quality, and administrative context. The 22 community-related factors fall under four domains: environment, capacity, participation patterns, and behavior.
|Implementation and community-related factors (n=200)a||No. of documents (%)||Stage of CLTSb|
|National government awareness and buy-in for CLTS||41 (21%)||X||X||X|
|National sanitation policy vis-à-vis CLTS implementation||37 (19%)||X||X|
|Ambitious national ODF and/or sanitation targets||26 (13%)||X||X|
|History of latrine subsidy provision in the country||21 (11%)||X||X||X|
|Ongoing latrine subsidy programs near triggered communities||20 (10%)||X|
|Triggering quality||80 (40%)||X|
|Frequency and effectiveness of follow-up activities in villages||54 (27%)||X|
|Facilitator skill||45 (23%)||X||X|
|Provision of technical support on latrine construction||44 (22%)||X|
|Community enforcement measures for noncompliance||39 (20%)||X|
|Provision of incentives or rewards to villages for ODF status||32 (16%)||X|
|Provision of latrine subsidies in triggered communities||25 (13%)||X|
|Provision of incentives to community volunteers||13 (7%)||X||X|
|Presence of exchange visits between community leaders||12 (6%)||X|
|Local government ownership of CLTS||84 (42%)||X||X|
|Institutional capacity of implementers||66 (33%)||X||X||X|
|Administrative and financial arrangements||60 (30%)||X||X||X|
|Presence and functioning of M&E system||42 (21%)||X|
|Coordination between implementing organizations||37 (19%)||X||X||X|
|Presence/functioning of sanitation working groups||14 (7%)||X|
|Climate conditions||33 (17%)||X||X|
|Soil or groundwater conditions||28 (14%)||X||X|
|Access to water in community||23 (12%)||X||X|
|Remoteness of community||13 (7%)||X||X|
|Access to supply of latrine hardware||62 (31%)||X|
|Availability of financial resources||54 (27%)||X|
|Technical knowledge of latrine construction||24 (12%)||X|
|Availability of land or land ownership||18 (9%)||X||X|
|Availability of time to construct latrines||11 (6%)||X|
|Awareness of benefits of stopping open defecation||10 (5%)||X||X||X|
|Community participation in CLTS||82 (41%)||X||X|
|Presence of village-level leadership||50 (25%)||X||X||X|
|Initiative of “natural leaders”||29 (15%)||X|
|Social cohesion||27 (14%)||X||X||X|
|Sense of community responsibility||25 (13%)||X||X|
|Traditional beliefs about women and children’s role in society||9 (5%)||X||X|
|Expectation of subsidy for latrines||29 (15%)||X|
|Preference for open defecation||20 (10%)||X||X|
|Traditional beliefs regarding open defecation||19 (10%)||X||X|
|Alternative priorities (other than sanitation)||14 (7%)||X||X||X|
|Community’s trust in implementers’ motives||11 (6%)||X||X|
|Preference for a better latrine||10 (5%)||X|
Abbreviations: CLTS, community-led total sanitation; M&E, monitoring and evaluation; ODF, open defecation–free.
aThe factors listed in this table emerged inductively from qualitative coding and analysis of all included literature. Percentages provided are out of all 200 documents, and are meant to illustrate how frequently the respective factor was mentioned in the CLTS literature that was reviewed.
bThe pretriggering stage comprises community selection, facilitator training, baseline information, and community entry; the triggering stage comprises a community-wide meeting with participatory exercises to trigger shame and disgust; and the posttriggering stage includes routine follow-up visits to verify and certify ODF status in communities.
Eighty-four (42%) documents referred to the influence of the policy environment on CLTS activities, often about policies regarding latrine subsidies and latrine quality (Table 5). The national sanitation policy (n=37, 19%) was reported more often as a constraint than as an enabler. Policy that promoted specific national latrine standards was perceived to conflict with the CLTS message of building a latrine with whatever means available. Policy that encouraged hardware subsidies—most often targeted to the poor—often conflicted with the no-subsidy approach of many CLTS projects. A history of latrine subsidies in communities that were to be triggered with CLTS, or current provision of subsidies near CLTS communities, were cited as constraints, and were often a result of policy decisions beyond the control of CLTS implementers.
A few documents mentioned latrine subsidy policy being used to the advantage of CLTS, such as in Nigeria, where WaterAid Nigeria prioritized follow-up activities on households that had hardware available from previous subsidy programs, “as these households are easiest targets” (Bawa and Ziyok 2013). They reported that this approach led to faster latrine construction because households did not need to think about technology options or financing. A study in Cambodia also reported that “ODF has been reached regularly in the dry season” in villages with subsidy programs, although they also reported that “proximity to on-going subsidized programmes erodes the effectiveness of CLTS” (Kunthy and Catalla 2009).
As shown in Table 5, setting national targets for sanitation was described in 26 (13%) documents and was a constraint in all but one case, where it created an incentive for local government officers in Kenya (Musyoki 2010). Most documents that referred to this factor noted that setting targets created a sense of top-down policy making that conflicted with the community-led nature of CLTS (Crocker et al. 2016c; Davis 2012; De Silva 2013; UNICEF WCARO 2011), led to a focus on rapid latrine construction rather than behavior change (AAN Associates 2013; Dyalchand et al. 2009; Haq and Bode 2009; Jha 2007; Kar and Bongartz 2006; Pardeshi et al. 2008; USAID 2014), led to community triggering outpacing capacity to follow-up (Toft and Onabolu 2012; UNICEF 2014), and created an incentive for implementers to misrepresent data (Mukherjee et al. 2012).
Factors relating to implementation quality were reported in 149 (75%) documents (Table 5). Adequate preparation and planning in the pretriggering stage, including the importance of systematic community selection, was emphasized in 30 (15%) documents. Some mentioned the need to target specific types of communities rather than using CLTS everywhere (Burton 2007; Crocker et al. 2016b; Evans et al. 2009; Global Sanitation Fund 2015; Kunthy and Catalla 2009), but one suggested that targeting certain communities leaves behind those communities with unfavorable conditions (Bawa and Ziyok 2013).
The importance of the facilitators’ skills (n=45, 23%) and quality of triggering events (n=80, 40%) were identified as determinants of CLTS success, with an underlying theme of adaptation (Table 5). A practitioner account from Zimbabwe emphasized the “need to be culturally insensitive during facilitation” by not being afraid to use bold terminology and to prioritize creative adaptations of triggering tools based on the context, with the aim to “create a sense of shame, fear and disgust” without “teaching, preaching or prescribing” (Chimhowa 2010). On the other hand, a study critical of CLTS in Indonesia concludes that “the use of shaming and taunting both disqualiﬁes it as an empowerment approach and is likely to undermine its effectiveness in promoting long-term behaviour change. Even if shaming were shown to be effective, the morality of punishing the poor for their circumstances requires deeper consideration” (Engel and Susilo 2014).
Eight of the ten implementation quality factors presented in Table 5 were referred to primarily in the context of posttriggering activities. Fifty-four (27%) documents provided examples of frequent follow-up activities by NGOs or local government helping, or poor follow-up hurting CLTS outcomes. As part of follow-up, the theme of improving monitoring and evaluation of programs was mentioned in 48% of the literature. Many expressed a need for more systematic evaluations of CLTS projects and better use of data that are already being collected by practitioners. In one study, authors observe: “Several nongovernment organizations in the WASH sector worldwide have developed different protocols for deﬁning, declaring, and certifying ODF status in communities, yet no protocol has been recognized as the global standard” (Belizario et al. 2015). Based on their experience with CLTS in Indonesia, authors from the Water and Sanitation Program of the World Bank recommended that “post-triggering processes should be given a verifiable structure by establishing and periodically checking for desired progress quality indicators/milestones for success in triggered communities in order to improve institutional accountability for and the quality of follow-up” (Mukherjee et al. 2012). This need for a reporting structure was echoed in reports from Kenya (Tiwari 2011) and Ghana (Magala and Roberts 2009), among others.
Technical support (n=44, 22%) was often cited as an enabler in projects that provided guidance directly to communities on latrine construction or trained masons to improve toilet design (Evans et al. 2009; Huda 2009; Kalimuthu 2008; Magala and Roberts 2009; SEED Madagascar 2016; Shayamal et al. 2008; WaterAid India 2008). Technical support and subsidies were both contentious in the literature, with several practitioner accounts defending a strictly no-subsidy implementation of CLTS, whereas others advocated for greater flexibility, such as this evaluation of a UNICEF program: “Many implementers share the opinion that more work on the technical standards together with targeted subsidies are unavoidable to help reach the households build latrines and reach the ODF status in such areas” (Hydroconseil et al. 2014).
The presence of enforcement mechanisms or sanctions on open defecation or latrine construction was described in 39 (20%) documents (Table 5). One study in Nepal reported that “coercive methods … did not always bring out tangible results” (Jha 2007), and in Bangladesh, enforcement led some people to “construct toilets out of fear of being fined without understanding the reasoning for doing so or the best methods for construction. This in turn leads to poor use of the latrines” (Kar and Bongartz 2006). An evaluation of CLTS in West Africa found that “such punitive measures seem out of line with the CLTS spirit of self-help and dignity. However, community enforcement may be considered as an appropriate additional measure [if] it is implemented in a real participatory and community-based way, with a collective decision” (UNICEF WCARO 2011). Local by-laws were described as effective in several settings; an evaluation of CATS reported that “in many countries, the strongest evidence of a change in social norms is the genuine adoption and the enforcement of formal and informal rules/bylaws at the level of the community, accepted by all the community members and recognized as collective rules which cannot be transgressed without consequences” (Hydroconseil et al. 2014).
Over half of the literature (n=112, 56%) contained factors relating to the administrative context (Table 5). This domain included institutional capacity to implement CLTS (n=66, 33%), administrative or financial arrangements (n=60, 30%), and coordination between implementing organizations (n=37, 19%). Concerns were documented relating to time availability, technical experience, skilled human resources, and the capacity to plan, budget, and allocate resources for CLTS. Some adaptations were also documented, such as “peer-to-peer accountability mechanisms” for government health surveillance assistants in Malawi (Kennedy and Meek 2013) and village-level microplanning exercises for local government in Kenya (Singh and Balfour 2015). More documents described existing administrative and financial arrangements as constraints rather than enablers of CLTS activities.
Eighty-four (42%) documents cited local government ownership of CLTS as an important factor for success, scale-up, or sustainability (Table 5). The most effective level and type of local government involvement was unclear. In an evaluation from Zambia, authors state: “The level of support given to CLTS in certain districts is obvious, with a high level of involvement from everyone from Town Clerks and Chiefs to government representatives across sectors, knowing and understanding what the CLTS approach means. This level of understanding surely forms the basis for sustainability in an institutional sense” (Morris-Iveson and Siantumbu 2011). On the other hand, in Moroto, Uganda, “support for better sanitation and hygiene from political leadership was reported as lacking or weak in most respects … and served to undermine efforts of the extension staff as the latter strive to promote ODF villages” (Asingwire 2012). Local government ownership was often related to decentralization as well. For example, in Cambodia, decentralization helped transfer financial responsibility to the local government, creating a local source of funds for district and commune activities (Kunthy and Catalla 2009). On the other hand, it created uncertainty in Kenya (Crocker et al. 2016c), and was not matched with sufficient institutional capacity in Indonesia (Engel and Susilo 2014).
Across 66 (33%) documents, environmental, geographical, and climate-related factors were cited, such as poor soil conditions and floods destroying latrines (Table 5). However, remoteness of a village (n=13, 7%) was sometimes an enabler, as remote villages were less likely to have been exposed to subsidy projects and might therefore be more receptive to the CLTS message. Access to clean water in triggered communities (n=23, 12%) was described as an enabler in several documents. For example: “one of the key entry processes is access to water. In the project communities water points were rehabilitated and in few cases new ones were installed. Communities clearly associated the effectiveness of CLTS to availability of water” (Burton 2007). Adeyeye also noted that WaterAid Nigeria “holds that access to water is a necessary prerequisite to access to adequate sanitation” (Adeyeye 2011).
Ninety-seven documents (49%) cited at least one community capacity factor (Table 5). The most frequently identified factors related to building latrines were access to supply of latrine hardware (n=62, 31%), availability of financial resources (n=54, 27%), and technical knowledge of latrine construction (n=24, 12%). Studies often reported community members’ desire for more guidance from implementers on how to build a high-quality latrine to avoid costly maintenance and repairs that could result in reversion to open defecation. There were examples of local mechanisms to address financial constraints, such as creating access to credit through village savings and loans associations (Adhikari et al. 2008; De Silva 2013; Global Sanitation Fund 2015; Magala and Roberts 2009; Mwanzia and Misati 2013; Tremolet et al. 2010) or collective community efforts to build latrines (Mukherjee et al. 2012; Priyono 2009). Nevertheless, poor latrine quality and resulting sustainability challenges emerged as important themes.
Community participation patterns.
A key participant in CLTS is the natural leader, typically a community member who emerges in the triggering process as someone particularly motivated to improve sanitation. Eighty-two (41%) documents broadly referred to natural leaders (Table 5). Twenty-nine (15%) documents specifically noted the initiative of natural leaders as an enabler or barrier to CLTS, but only a few gave concrete examples, such as the challenge in identifying natural leaders or how training natural leaders in latrine construction or mobilization techniques proved to be effective. One study reported that training led to greater participation and better sanitation outcomes in Ghana (Crocker et al. 2016a), and practitioners in Madagascar reported that training helped motivate natural leaders to be more active in their communities (SEED Madagascar 2016).
Broader mobilization, participation, and motivation of community members in triggering and posttriggering activities was reported in 82 (41%) documents as an important reason for success or failure of CLTS (Table 5). A sense of community responsibility (n=25, 13%) and social cohesion (n=27, 14%) emerged in several documents. Smaller, homogeneous communities tended to be more successful (e.g., Evans et al. 2009; Haq and Bode 2009; Mukherjee et al. 2012; Tyndale-Biscoe et al. 2013; USAID 2014; Venkataramanan 2016), and greater cohesion was also connected with greater likelihood of self-help initiatives, for example, gotong rayong in Indonesia (Mukherjee et al. 2012).
Expectation of subsidies for latrine construction was the most commonly cited behavioral constraint in the literature (n=29, 15%) (Table 5). Preference for open defecation was also an important behavioral factor (n=20, 10%) that related to slow progress or no change in sanitation behavior after triggering. Part of this was reported to be due to cultural or religious beliefs regarding open defecation or latrine use, which were often cited as either enablers and barriers to CLTS. For example, speaking about defecation was considered to be a private matter in several settings (Dittmer 2009; Evans et al. 2009; Shayamal et al. 2008). There are also taboos around different members of the household using or sharing a latrine (Bulaya et al. 2015; Burton 2007; Kappauf 2011; Mukherjee et al. 2012; Zombo 2010) or superstitions around latrine use (Dittmer 2009). Dittmer (2009) gave an example of an ethnic group in Burkina Faso with the tradition that “if someone gives you food, you are expected to defecate in his field (and fertilize the crops), as the act of giving entitles the giver to receive something in return.” These traditional beliefs were used to adapt triggering in several programs (n=19, 10%) by engaging religious leaders or using passages from the Bible or Quran during triggering events.
Fourteen (7%) documents noted that priorities other than sanitation can affect the response to CLTS (Table 5). For example, Engel and Susilo document one village chief’s observation in Indonesia that “despite the supposedly participatory approach of the CLTS, the villagers did not want a sanitation project and would have preferred an adequate irrigation system for their farmland and a programme for replanting an area of cleared forest located near their farmland” (Engel and Susilo 2014).
In our systematic review of CLTS and related interventions, we comprehensively characterize the state of evidence through a detailed quality appraisal, summary of quantitative outcomes, and qualitative analysis of factors affecting CLTS implementation and outcomes.
Quality of the Literature
Our quality appraisal indicates that evidence available to practitioners and policy makers is of variable quality, particularly regarding the ability to estimate the impact of CLTS on sanitation, health, or other community outcomes. Overall, we found that the journal-published literature was of higher quality than gray literature. We show that case studies and project reports—which were primarily found in the gray literature—did not adequately describe their study design, data collection, or data analysis. Poor reporting of study characteristics makes it difficult to judge the objectivity and quality of information presented. Minimizing risk of bias was the weakest link in the quality of CLTS literature across all study types, but particularly in the case of qualitative studies, and case studies and project reports, which rarely described sampling methods, quality control in data collection, or analysis appropriate for the respective study design. Nearly two-thirds of all literature lacked independent data collection; improving this metric alone would minimize the risk of bias of all study types. Although nearly all documents gave context for their findings, there were large gaps in the description of limitations, preventing the reader from understanding the extent to which findings may be generalized. Furthermore, more than one-fourth of the literature overstated conclusions by attributing outcomes to their intervention without an appropriate study design or by making claims about impact using unverified data sources or anecdotes.
CLTS is one of the most common rural sanitation behavior change approaches. It is increasingly being tested in urban settings as well (Murigi et al. 2015; Mwanzia and Misati 2013; Myers 2016; Prabhakaran et al. 2016). Therefore, there is an urgent need to better understand its effectiveness by improving the rigor of the evidence base. By reviewing the literature as a whole, we are able to compare the quality of different study types and identify specific areas for improvement. Case studies and project reports—which have the potential to detail processes and share lessons learned—can be improved through more systematic data collection and analysis, and more thorough reporting to determine the extent of transferability of findings. Quantitative cross-sectional designs—a subset of studies we classified as case studies and project reports—can describe outcomes on a large scale, but can be improved through more detailed descriptions of context and intervention processes. Qualitative studies can provide rich contextual descriptions, perceptions of different stakeholders, and reasons for success or failure, but researchers and implementers using these methods must improve the rigor of data collection and analytical techniques in order for findings to have sound policy and practice implications. Finally, well-designed quantitative evaluations have the potential to attribute outcomes and impact to interventions, but the quality of quantitative evaluations can be improved through more rigorous data collection methods and better descriptions of context, process, and study limitations.
Measuring the Effectiveness of Community-Led Total Sanitation
We found few rigorous quantitative evaluations of sanitation and health impacts of CLTS and related interventions. The 14 that we included evaluated interventions from nine countries, whereas CLTS is now practiced in at least 53 countries. These studies reported increases in latrine ownership and decreases in open defecation, but did not corroborate the widespread claims of ODF villages reported in case studies and project reports. As Evans et al. note: “Like many terms in development, [ODF] has become de-linked from its true semantic meaning and become more of a milestone or marker in programme development” (Evans et al. 2009). The term ODF may serve as a motivator for communities to improve sanitation behavior, but is a poor indicator to compare across studies, programs, or countries, given the variety of definitions (see Thomas and Bevan 2014 for a review of various ODF protocols in sub-Saharan Africa). Household-level latrine outcomes, while imperfect, are a better measure of sanitation progress. For research purposes, pairing these with more robust measures of the defecation practices of individual people is a further improvement. To avoid the pitfall of simply counting latrines, programs could add routine measures of open defecation behavior, latrine use, and cleanliness through community monitoring initiatives (Coombes 2011).
One of the primary aims of sanitation is improved health, but measuring these changes is difficult if the sanitation intervention did not result in a sufficient reduction in open defecation or exposure to fecal contamination. Our synthesis of health outcomes from CLTS and related interventions supports findings of previous reviews (Garn et al. 2016; Sclar et al. 2016; Taylor et al. 2015; Wolf et al. 2014) and underscores the challenge of attributing health impacts to sanitation, particularly over a short follow-up. Furthermore, our review supports prior observations that self-reported diarrhea is an unreliable measure of impact (Schmidt 2014), even though one-fourth of the literature contained anecdotal reports of perceived health impact through self-reported reduction in diarrhea. While more studies that consider a variety of sanitation-related health outcomes, including measures of nutritional status, may be beneficial, they tend to be expensive, require the intervention itself to be sufficiently successful to change sanitation outcomes, and require a long enough follow-up period to observe a noticeable change in health outcomes (Cairncross et al. 2010; Gertler et al.2015).
Many programs are unlikely to have the resources or technical expertise to incorporate health impact into monitoring and evaluation systems or to commission such studies. Nevertheless, our review reveals an opportunity for researchers and practitioners to work together to address more immediate implementation and operational research questions by leveraging a variety of study designs. Given the participatory nature of CLTS activities and emphasis on sustained behavior change, such research would be strengthened using mixed methods, including qualitative indicators of participation and perceptions and better measures of social norms for a thorough picture of CLTS effectiveness and impact.
Factors Affecting Community-Led Total Sanitation Implementation and Outcomes
We identified 43 implementation and community-related factors from the literature affecting CLTS. Many were context-specific enablers or constraints to CLTS implementation and outcomes. Other factors, such as local government ownership of CLTS, institutional capacity, importance of facilitators’ skills, and community participation in CLTS, were described in a similar manner across much of the literature. We suggest four important considerations from this qualitative analysis of the literature.
First, our review confirms the narrative of CLTS as a highly adaptable approach. Like Sigler et al. (2015)’s finding that multiple behavior change frameworks are employed in CLTS, we found that shame and disgust, although popular, were not reported as universal motivators that triggered communities; instead, improved health, dignity, and pride were cited more often. Skilled facilitators adapted their triggering techniques based on cultural considerations. However, finding such facilitators was described in the literature as an important constraint. Less-skilled facilitators resorted to either lecturing communities on health benefits or falling back on conventional shaming or disgust-inducing triggering techniques, regardless of their appropriateness in that context (Venkataramanan 2016). We did not find any studies in our review that evaluated the relative effectiveness of different triggering adaptations, despite calls for a closer analysis of the potential human rights implications of CLTS and related techniques (Bardosh 2015; Bartram et al. 2012; Engel and Susilo 2014; Galvin 2015).
Second, although a high degree of flexibility is expected during triggering, lack of structure in posttriggering activities may be less beneficial. The Handbook on CLTS—the de facto manual that most CLTS programs use as a starting point—does not detail the structure of the posttriggering stage, acknowledging that activities are likely to depend on the context and characteristics of the specific community (Kar and Chambers 2008). Our analysis suggests, however, that certain elements of posttriggering activities routinely challenge programs around the world. For example, there was no clear evidence on the effectiveness or appropriateness of providing incentives or subsidies to some communities or on the role of enforcement and sanctions for noncompliance. Our review confirms Bartram et al.’s observation that there continues to be minimal debate or critical review of the effectiveness or humans rights consequences of posttriggering punitive measures (Bartram et al. 2012).
Another set of posttriggering challenges relates to the supply of durable and affordable latrine hardware and technical support on latrine construction. Notably, we identified a debate over the nature of technical support that should be provided to communities for latrine construction. CLTS programs do not follow uniform guidance on technical support, as communities are supposed to identify their own solutions to stop open defecation. Whereas some programs provided detailed technical support on latrine options, trained masons, or attempted to improve the supply chain for hardware, follow-up in other programs simply meant monitoring latrine construction. However, our analysis of the literature suggests a need for additional guidance, as substantive concerns were expressed from both community and implementer perspectives about the quality of latrines built because of CLTS, potentially discouraging sustained behavior change and possibly explaining the minimal effects seen in health impact studies (Papafilippou et al. 2011). We argue that programs should routinely incorporate technical support into the posttriggering stage, particularly when communities prefer durable latrines and express a need for this kind of support. An eight-country evaluation of CLTS in Africa similarly recommended that in the absence of a sanitation marketing program, “the post-ODF approach should include a set of ‘second-phase’ interventions designed to provide advice on how to upgrade and improve sanitation and handwashing facilities using local materials” (Robinson 2016).
Third, we suggest that communities should be selected for triggering based on community characteristics and resources available to maintain routine follow-up activities, including local government ownership. We reveal conflicting views on the scope for application of CLTS, with practitioners often suggesting that it is appropriate in all rural settings, whereas evaluations and studies of CLTS point to more deliberate targeting. This is particularly relevant when community members express priorities other than sanitation.
What interventions should be implemented, then, in places where CLTS is not likely to be successful? While there are some settings where CLTS is never going to be an appropriate intervention, there are also likely to be settings where CLTS may not be successful on its own, but can result in sustained changes when combined or sequenced with other demand-generating or demand-fulfilling approaches, such as sanitation marketing or other WaSH interventions. Further research is needed to understand the most effective combination and sequencing of WaSH interventions. Our review revealed that several programs install water supply projects simultaneously with or following CLTS projects to try to ensure that anticipated gains from sanitation behavior change were not lost due to limited water supply. Several programs also measured total sanitation practices in their CLTS programs such as handwashing, water and food safety, and garbage disposal as opposed to focusing solely on open defecation. Some practitioners consider this lack of standardization of CLTS as a problem for scalability and sustainability (SNV Uganda 2014), but we suggest that it can instead be viewed as an opportunity to expand the conversation to consider CLTS as part of a total WaSH strategy to achieve the WaSH Sustainable Development Goals by 2030 (United Nations General Assembly 2015).
Although we present findings from 53 countries, we did not specifically search for non-English documents and may have missed experiences from some countries. Because gray literature is, by definition, not published in peer-reviewed journals, and because it is produced so rapidly, we may not have captured all the available literature. However, we believe we reached saturation and have captured the vast majority of the CLTS evidence base by scanning 5,884 documents from diverse sources and reviewing 200 in detail. Finally, although the content analysis was conducted systematically in two stages by two authors, it is possible that our frequency counts were slightly underestimated, and we were unable to capture every factor and indicator presented across all documents.
This is the first comprehensive systematic review, to our knowledge, of the state of the CLTS evidence base. Most literature on CLTS is on websites and knowledge bases rather than in peer-reviewed journals; this gray literature is more extensive and more accessible. Therefore, the large and inclusive scope of this review offers one of the first aggregate views of the evidence currently available for decision-makers as they consider whether and how to test, adopt, or scale-up CLTS worldwide. By including a variety of literature types (journal-published and gray) and study designs (quantitative, qualitative, and case studies and project reports), we were also able to identify their strengths or weaknesses and compare their relative contribution to the evidence base.
The quality appraisal framework we developed serves as a practical tool for assessing the quality of evidence from sources as varied as NGO reports, qualitative studies, and RCTs. To our knowledge, this is the first tool of its kind that enables a combined assessment of such literature on water and sanitation to develop specific recommendations for improving the evidence base.
The mixed-methods analysis of the quality and content of literature enabled us to pool findings in a much richer way than a meta-analysis of one particular study type would have allowed. By and large, there is substantive room for improvement in the quality of evidence on CLTS. We found that CLTS has been rolled out with minimal rigorous evidence on its effectiveness and impact on sanitation and health outcomes. While quantitative evaluations show reductions in open defecation and increases in latrine coverage, they do not mirror practitioner accounts of widespread elimination of open defecation. There is little evidence for sustained sanitation behavior change as a result of CLTS, and there has been minimal systematic research of the CLTS implementation process and its adaptations. We also provide evidence for the need to improve the structure of CLTS activities and the need to consider CLTS as part of a larger WaSH strategy rather than as a singular solution to changing sanitation behavior.
The research–practice gap can be narrowed if researchers work more closely with implementers to design implementation and operational research studies to address specific challenges relating to sustainable behavior change and change in social norms, as well combining and sequencing of different sanitation or WaSH approaches. Donor agencies and national governments should support researcher–practitioner initiatives to improve the evidence base and provide policy makers opportunities to make more informed decisions to improve sanitation outcomes.
This research is a result of a subagreement to the University of North Carolina at Chapel Hill from Plan International USA, which was a recipient of a grant from the Bill & Melinda Gates Foundation (OPP1028953). Additional funding from a National Institute of Environmental Health Sciences Training grant (T32ES007018) supported the primary author and second author’s time. Neither funder had any role in study design, execution, or article preparation. We thank E. Rehfuess for advice on quality appraisal, and D. Saywell, P. Kolksy, and E. Ojomo for comments on the paper.
AAN Associates. 2013. UNICEF WASH Pakistan End of Programme Evaluation for Rural Sanitation in Flood-Affected Districts (RuSFAD Phase III) 2011–12. New York:UNICEF. http://www.unicef.org/evaldatabase/index_73521.html [accessed 10 January 2016].
Adeyeye A. 2011. Gender and Community-Led Total Sanitation: a Case Study of Ekiti State, Nigeria. Trop. Resour. Bull. Yale Trop. Resour. Inst. 30:1–27. https://environment.yale.edu/tri/uploads/AAdeyeye2011.pdf [accessed 10 May 2016].
Adhikari S, Shrestha NL, Malla M, Shrestha GR. 2008. Nepal School-Led Total Sanitation Seems Unstoppable. Sanitation and Hygiene Case Study #7. New York:UNICEF. http://www.communityledtotalsanitation.org/resource/school-led-total-sanitation-seems-unstoppable-nepal [accessed 15 December 2015].
Asingwire N. 2012. WASH Initiative for the Rural Poor in 21 Districts in Uganda. “End of Term Evaluation Final Report.” Uganda:SWSA Dept. Makerere University, European Commission, and UNICEF. https://www.unicef.org/evaldatabase/files/30-08-12_WASH_Project_Evaluation_Report_Revised.pdf [accessed 10 January 2016].
Bardosh K. 2015. Achieving “total sanitation” in rural African geographies: poverty, participation and pit latrines in eastern Zambia. Geoforum 66:53–63, 10.1016/j.geoforum.2015.09.004.
Bartram J, Charles K, Evans B, O’Hanlon L, Pedley S. 2012. Commentary on community-led total sanitation and human rights: should the right to community-wide health be won at the cost of individual rights?. J Water Health 10(4):499–503, PMID: 23165706, 10.2166/wh.2012.205.
Bawa K, Ziyok I. 2013. Implementing CLTS in areas with a history of subsidised sanitation programmes. Briefing Paper 1674. Proceedings of the 36th WEDC International Conference, Nakuru, Kenya. Loughborough, UK:Water, Engineering, and Development Centre, https://wedc-knowledge.lboro.ac.uk/details.html?id=20597 [accessed 10 October 2016].
BDS-Center for Development Research. 2016. Outcome Evaluation of Community-Led Total Sanitation and Hygiene (CLTSH) Program in Ethiopia from 2012-2015. Addis Ababa, Ethiopia:UNICEF, https://www.unicef.org/evaldatabase/files/Final_Report_of_CLTSH_Outcome_Evaluation-Designed_Ethiopia_2016-012.pdf [accessed 15 March 2017].
Belizario VY, Liwanag HJC, Naig JRA, Chua PLC, Madamba MI, Dahildahil RO. 2015. Parasitological and nutritional status of school-age and preschool-age children in four villages in Southern Leyte, Philippines: Lessons for monitoring the outcome of Community-Led Total Sanitation. Acta Trop 141(Pt A):16–24, PMID: 25255966, 10.1016/j.actatropica.2014.09.008.
Borja-Vega C. 2014. The effects of the Total Sanitation and Sanitation Marketing programme on gender and ethnic groups in Indonesia. Waterlines 33(1):55–70, 10.3362/1756-3488.2014.007.
Briceño B, Coville A, Martinez S. 2015. Promoting Handwashing and Sanitation: Evidence from a Large-Scale Randomized Trial in Rural Tanzania. World Bank Policy Res. Work. Pap. 7164. Washington, DC:World Bank. http://ssrn.com/abstract=2550526 [accessed 15 December 2016].
Bulaya C, Mwape KE, Michelo C, Sikasunge CS, Makungu C, Gabriel S, et al. 2015. Preliminary evaluation of Community-Led Total Sanitation for the control of Taenia solium cysticercosis in Katete District of Zambia. Vet Parasitol 207(3-4):241–248, PMID: 25591408, 10.1016/j.vetpar.2014.12.030.
Burton S. 2007. “An Evaluation of the WaterAid’s CLTS Programme in Nigeria.” Abuja, Nigeria:WaterAid. http://www.communityledtotalsanitation.org/resource/community-led-total-sanitation-clts-evaluation-wateraid-s-clts-programme-nigeria [accessed 10 January 2016].
Cairncross S, Hunt C, Boisson S, Bostoen K, Curtis V, Fung IC, et al. 2010. Water, sanitation and hygiene for the prevention of diarrhoea. Int. J. Epidemiol 39(suppl 1):i193–i205, PMID: 20348121, 10.1093/ije/dyq035.
Cameron L, Shah M, Olivia S. 2013. Impact Evaluation of a Large-Scale Rural Sanitation Project in Indonesia. World Bank Policy Res. Work. Pap. 6360. Washington, DC:World Bank. 10.1596/1813-9450-6360.
Chimhowa HK. 2010. Freeing the imagination: innovations in CLTS facilitation in Zimbabwe. In: Participatory Learning and Action 61: Tales of Shit: Community-Led Total Sanitation in Africa. Bongartz P , Musyoki SM , Milligan A , Ashley H , eds. London, UK:IEED, 65–72. https://www.iied.org/pla-61-tales-shit-community-led-total-sanitation-africa [accessed 10 October 2016].
Clasen T, Boisson S, Routray P, Torondel B, Bell M, Cumming O, et al. 2014. Effectiveness of a rural sanitation programme on diarrhoea, soil-transmitted helminth infection, and child malnutrition in Odisha, India: a cluster-randomised trial. Lancet Glob. Heal 2(11):e645–e653, PMID: 25442689, 10.1016/S2214-109X(14)70307-9.
Coombes Y. 2011. Utilizing Community-Based Registers to Monitor Improved Access to Sanitation and Hygiene in Tanzania. Washington, DC:The World Bank Water and Sanitation Program. https://openknowledge.worldbank.org/handle/10986/11688 [accessed 10 October 2016].
Crocker J, Abodoo E, Asamani D, Domapielle W, Gyapong B, Bartram J. 2016a. Impact evaluation of training natural leaders during a community-led total sanitation intervention: a cluster-randomized field trial in Ghana. Environ Sci Technol 50(16):8867–8875, PMID: 27428399, 10.1021/acs.est.6b01557.
Crocker J, Geremew A, Atalie F, Yetie M, Bartram J. 2016b. Teachers and sanitation promotion: an assessment of community-led total sanitation in Ethiopia. Environ Sci Technol 50(12):6517–6525, PMID: 27211881, 10.1021/acs.est.6b01021.
Crocker J, Shields KF, Venkataramanan V, Saywell D, Bartram J. 2016c. Building capacity for water, sanitation, and hygiene programming: training evaluation theory applied to CLTS management training in Kenya. Soc Sci Med 166:66–76, PMID: 27543683, 10.1016/j.socscimed.2016.08.008.
Davis B. 2012. Sanitation in Cambodia: a Review. Phnom Penh:ADRA Cambodia. http://genderandwater.org/en/other-resources/reports/rural-sanitation-evaluation-cambodia/ [accessed 10 October 2016].
De Silva P. 2013. Ex-post Evaluation of Water, Sanitation and Hygiene Programme in Eastern Indonesia. Evaluation Report. Indonesia:Government of Indonesia and UNICEF. https://www.unicef.org/evaldatabase/index_72934.html [accessed 10 January 2016].
DeFrancis MP , ed. 2011. Economic Impacts of Inadequate Sanitation in India. Washington, DC:The World Bank Water and Sanitation Program. http://www.wsp.org/sites/wsp.org/files/publications/wsp-esi-india.pdf [accessed 11 November 2016].
Dickinson KL, Patil SR, Pattanayak SK, Poulos C, Yang J-H. 2015. Nature’s Call: Impacts of Sanitation Choices in Orissa, India. Econ Dev Cult Change 64(1):1–29, 10.1086/682958.
Dittmer A. 2009. Towards Total Sanitation: Socio-Cultural Barriers and Triggers to Total Sanitation in West Africa. London, UK:WaterAid. http://www.wateraid.org/~/media/Publications/total-sanitation-socio-cultural-barriers-triggers-west-africa.pdf [accessed 10 October 2016].
Dreibelbis R, Winch PJ, Leontsini E, Hulland KR, Ram PK, Unicomb L, et al. 2013. The Integrated Behavioural Model for Water, Sanitation, and Hygiene: a systematic review of behavioural models and a framework for designing and evaluating behaviour change interventions in infrastructure-restricted settings. BMC Public Health 13:1015, PMID: 24160869, 10.1186/1471-2458-13-1015.
Dwipayanti NMU, Phung TD, Rutherford S, Chu C. 2017. Towards sustained sanitation services: a review of existing frameworks and an alternative framework combining ecological and sanitation life stage approaches. J Water Sanit Hyg Dev 7(1):25, 10.2166/washdev.2017.086.
Dyalchand A, Kale M, Vasudevan S. 2009. What Communication and Institutional Arrangements Influence Sanitation Related Social Norms in Rural India? http://www.communityledtotalsanitation.org/resource/what-communication-and-institutional-arrangements-influence-sanitation-related-social-norms [accessed 1 Dec 2015].
Engel S, Susilo A. 2014. Shaming and sanitation in Indonesia: a return to colonial public health practices? Dev Change 45(1):157–178, 10.1111/dech.12075.
Evans B, Colin J, Jones H, Robinson A. 2009. Sustainability and equity aspects of total sanitation programmes: A Study of Recent WaterAid-Supported Programmes in Three Countries. Global Synthesis Report. London, UK:WaterAid. www.wateraid.org/~/media/Publications/community-led-total-sanitation.pdf [accessed 1 September 2016].
Evans WD, Pattanayak SK, Young S, Buszin J, Rai S, Bihm JW. 2014. Social marketing of water and sanitation products: a systematic review of peer-reviewed literature. Soc Sci Med 110:18–25, PMID: 24704890, 10.1016/j.socscimed.2014.03.011.
Fiebelkorn AP, Person B, Quick RE, Vindigni SM, Jhung M, Bowen A, et al. 2012. Systematic review of behavior change research on point-of-use water treatment interventions in countries categorized as low- to medium-development on the human development index. Soc Sci Med 75(4):622–633, PMID: 22497845, 10.1016/j.socscimed.2012.02.011.
Galvin M. 2015. Talking shit: is Community-Led Total Sanitation a radical and revolutionary approach to sanitation? WIREs Water 2(1):9–20, 10.1002/wat2.1055.
Garn JV, Sclar GD, Freeman MC, Penakalapati G, Alexander KT, Brooks P, et al. 2016. The impact of sanitation interventions on latrine coverage and latrine use: a systematic review and meta-analysis. Int J Hyg Environ Health 220(2 Pt B):329–340, PMID: 27825597, 10.1016/j.ijheh.2016.10.001.
Gertler P, Shah M, Alzua M, Cameron L. 2015. How Does Health Promotion Work? Evidence from the Dirty Business of Eliminating Dirty Defecation. NBER Working Paper Series. Cambridge, MA:National Bureau of Economic Research. 10.3386/w20997.
Global Sanitation Fund. 2015. Sanitation and Hygiene Promotion in Madagascar. Geneva, Switzerland:WSSCC. http://wsscc.org/wp-content/uploads/2015/10/Mada-1-3.pdf [accessed 15 March 2017].
Godfrey S, Van Der Velden M, Muianga A, Vigh M, Gunning JW, Elbers C. 2014. Impact study of the One Million Initiative rural water and sanitation programme in Mozambique. Waterlines 33(1):35–44, 10.3362/1756-3488.2014.005.
Haddaway NR, Collins AM, Coughlin D, Kirk S. 2015. The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PLoS One 10(9):1–17, PMID: 26379270, 10.1371/journal.pone.0138237.
Haq A, Bode B. 2009. Hunger, Subsidies and Process Facilitation: Challenges for Community Led Total Sanitation in Bangladesh. A paper prepared for the Institute of Development Studies CLTS Write Shop held on May 19-23, 2008. Brighton, UK:Institute of Development Studies, University of Sussex. http://www.communityledtotalsanitation.org/resource/hunger-subsidies-and-process-facilitation-challenges-community-led-total-sanitation [accessed 15 December 2015].
Harden A. 2010. Mixed-Methods Systematic Reviews: Integrating Quantitative and Qualitative Findings. Focus Technical Brief No. 25. Austin, TX:National Center for the Dissemination of Disability Research. http://ktdrr.org/ktlibrary/articles_pubs/ncddrwork/focus/focus25/Focus25.pdf [accessed 15 October 2016].
Huda E. 2009. Natural Leaders Emerged through Community Led Total Sanitation (CLTS) Approach in Bangladesh (Profile and Market Promotion). Sussex, UK:CLTS Knowledge Hub, Institute for Development Studies (IDS). http://www.communityledtotalsanitation.org/resource/natural-leaders-emerged-through-clts-approach-bangladesh-profile-and-market-promotion [accessed 15 December 2015].
Hulland K, Martin N, Dreibelbis R, DeBruicker Valliant J, Winch P. 2015. What Factors Affect Sustained Adoption of Safe Water, Hygiene and Sanitation Technologies? A Systematic Review of Literature. London, UK:EPPI-Centre, Social Science Research Unit, UCL Institute of Fducation, University College London. 10.13140/RG.2.1.5031.4329
Hulland KR, Chase RP, Caruso BA, Swain R, Biswal B, Sahoo KC, et al. 2015. Sanitation, stress, and life stage: a systematic data collection study among women in Odisha, India. PLoS One 10(11):e0141883, PMID: 26551866, 10.1371/journal.pone.0141883.
Hydroconseil, Ecopsis, WEDC (Water, Engineering, and Development Center of Loughborough University). 2014. Evaluation of the WASH Sector Strategy: Community Approaches to Total Sanitation (CATS). Final Evaluation Report. New York NY:UNICEF. https://www.unicef.org/evaluation/files/Evaluation_of_the_WASH_Sector_Strategy_FINAL_VERSION_March_2014.pdf [accessed 10 January 2016].
Jack L, Hayes SC, Scharalda JG, Stetson B, Jones-Jack NH, Valliere M, et al. 2010. Appraising quantitative research in health education: guidelines for public health educators. Health Promot Pract 11(2):161–165, PMID: 20400654, 10.1177/1524839909353023.
Jadhav A, Weitzman A, Smith-Greenaway E. 2016. Household sanitation facilities and women’s risk of non-partner sexual violence in India. BMC Public Health 16(1):1139, PMID: 27821158, 10.1186/s12889-016-3797-z.
Jenkins M, Sugden S. 2006. Human Development Report 2006. Rethinking Sanitation: Lessons and Innovations for Sustainability in the New Millennium. Human Development Report Office Occasional Paper. New York:UNDP. http://hdr.undp.org/en/content/rethinking-sanitation-lessons-and-innovation-sustainability-and-success-new-millennium [accessed 1 November 2016].
Jha HB. 2007. An assessment of CLTS projects and formulation of the strategy on sanitation promotion. Dhobighat, Lalitpur, Nepal:Centre for Economic and Technical Studies Pvt. Ltd. http://www.communityledtotalsanitation.org/sites/communityledtotalsanitation.org/files/FINAL_CLTS_Report.doc [accessed 10 October 2016].
Kalimuthu A. 2008. Chapter 13: Sustainable Community Owned Total Sanitation. In: Beyond Construction: Use by All. Wickens J , Verhagen J , Sijbesma C , Da Silva C , Ryan P , eds. London and Delft, UK:WaterAid and IRC International Water and Sanitation Centre, 169–180. http://www.ircwash.org/resources/beyond-construction-use-all [accessed 10 January 2016].
Kappauf L. 2011. Opportunities and Constraints for more Sustainable Sanitation through Sanitation Marketing in Malawi: Case study from Mzimba and Lilongwe Districts [MS Thesis]. 8: 137. Loughborough, UK:Water, Engineering, and Development Centre, Loughborough University. http://wedc.lboro.ac.uk/resources/pubs/KAPPAUF_Leonie_-_Opportunities_and_Constraints_for_more_Sustainable_Sanitation_through_Sanitation_Marketing_in_Malawi.pdf [accessed 1 June 2016].
Kar K, Bongartz P. 2006. Update on Some Recent Developments in CLTS. Brighton, UK:Institute of Development Studies, University of Sussex. http://www.communityledtotalsanitation.org/sites/communityledtotalsanitation.org/files/CLTS_update_for_WP257_0.pdf [accessed 10 October 2016].
Kar K, Chambers R. 2008. Handbook on Community-Led Total Sanitation. Brighton, UK:Institute of Development Studies, University of Sussex. http://www.communityledtotalsanitation.org/resource/handbook-community-led-total-sanitation [acccessed 1 December 2015].
Kennedy M , Meek A . 2013. Extension agent reorganization into a ‘block’ system for CLTS implementation and monitoring in Salima and Zomba Districts, Malawi. Toronto, ON, Canada:Engineers Without Borders. https://www.ircwash.org/sites/default/files/kennedy_and_meek_block_system_for_clts_implementation_and_monitoring.pdf [accessed 15 December 2015].
Kulkarni S, O’Reilly K. 2014. Sanitation Vulnerability: Women’s Stress and Struggles for Violence-free Sanitation. https://www.gov.uk/dfid-research-outputs/sanitation-vulnerability-women-s-stress-and-struggles-for-violence-free-sanitation [accessed 1 November 2016].
Kunthy S, Catalla RNF. 2009. 2009 Cambodia: Evaluation of Community-Led Total Sanitation (CLTS). Draft Final Evaluation Report. New York, NY:UNICEF. https://www.unicef.org/evaldatabase/index_57963.html [accessed 10 January 2016].
Magala JM, Roberts L. 2009. 2009 Ghana: 2nd Evaluation of Strategy For Scaling Up Community Led Total Sanitation in Ghana. Final Report. New York, NY:UNICEF. https://www.unicef.org/evaldatabase/index_67844.html [accessed 10 January 2016].
Makotsi N, Kaseje D, Mumma J, Opiyo J, Lukorito L. 2016. Association of community led total sanitation to reduced household morbidity in Nyando District. Int J Sci Basic Appl Res 28(1):220–230. https://gssrr.org/index.php?journal=JournalOfBasicAndApplied&page=article&op=view&path%5B%5D=5825 [accessed 15 March 2017].
Morris-Iveson L, Siantumbu B. 2011. Community Led Total Sanitation in Zambia: An Evaluation of Experiences and Approaches to Date. Zambia:Government of the Republic of Zambia and UNICEF. https://www.unicef.org/evaldatabase/index_66788.html [accessed 10 January 2016].
Mukherjee N, Robiarto A, Saputra E, Wartono D. 2012. Achieving and Sustaining Open Defecation Free Communities: Learning from East Java. Washington, DC:The World Bank Water and Sanitation Program. https://www.wsp.org/sites/wsp.org/files/publications/WSP_Indonesia_Action_Research_Report.pdf [accessed 1 June 2016].
Murigi P, Stevens L, Mwanzia P, Pasteur K. 2015. Lessons learnt in urban community-led total sanitation from Nakuru, Kenya. Proceedings of the 38th WEDC International Conference. Loughborough, UK:Water, Engineering, and Development Centre. https://wedc-knowledge.lboro.ac.uk/details.html?id=22213 [accessed 15 March 2017].
Musyoki S. 2010. Scaling up CLTS in Kenya: opportunities, challenges and lessons. In: Participatory Learning and Action 61: Tales of Shit: Community-Led Total Sanitation in Africa. Bongartz P , Musyoki SM , Milligan A , Ashley H , eds. London, UK:IEED, 149–156. https://www.iied.org/pla-61-tales-shit-community-led-total-sanitation-africa [accessed 10 October 2016].
Mwanzia P, Misati W. 2013. Urban community-led total sanitation: a case study of Nakuru. Briefing Paper 1813. Proceedings of the 36th WEDC International Conference. Loughborough, UK:Water, Engineering, and Development Centre, Loughborough University. https://wedc-knowledge.lboro.ac.uk/details.html?id=20797 [accessed 10 October 2016].
Myers, J. 2016. Plan Netherlands’ Experience of Using a CLTS Approach in Urban Environments. Amsterdam: Plan Nederland. http://www.communityledtotalsanitation.org/sites/communityledtotalsanitation.org/files/Urban_CLTS_Plan.pdf [accessed 15 March 2017].
Papafilippou N, Templeton MR, Ali M. 2011. Technical note: is there a role for external technical support in the Community-Led Total Sanitation (CLTS) approach?. Int Dev Plan Rev 33(1):81–94, 10.3828/idpr.2011.5.
Patil SR, Arnold BF, Salvatore AL, Briceno B, Ganguly S, Colford JM Jr, et al. 2014. The effect of India’s total sanitation campaign on defecation behaviors and child health in rural Madhya Pradesh: a cluster randomized controlled trial. PLoS Med 11(8):e1001709, PMID: 25157929, 10.1371/journal.pmed.1001709.
Pattanayak SK, Yang JC, Dickinson KL, Poulos C, Patil SR, Mallick RK, et al. 2009. Shame or subsidy revisited: social mobilization for sanitation in Orissa, India. Bull World Health Organ 87(8):580–587, PMID: 19705007, 10.2471/BLT.08.057422.
Pickering AJ, Djebbari H, Lopez C, Coulibaly M, Alzua ML. 2015. Effect of a community-led sanitation intervention on child diarrhoea and child growth in rural Mali: a cluster-randomised controlled trial. Lancet Glob. Heal 3(11):e701–e711, 10.1016/S2214-109X(15)00144-8.
Pluye P, Robert E, Cargo M, Bartlett G, O’Cathain A, Griffiths F, et al. 2011. Proposal: A Mixed Methods Appraisal Tool for Systematic Mixed Studies Reviews. Montréal, Canada:McGill University. http://mixedmethodsappraisaltoolpublic.pbworks.com [accessed 15 October 2016].
Prabhakaran P, Kar K, Mehta L, Chowdhury SR. 2016. Impact of Community-led Total Sanitation on women’s health in urban slums: a case study from Kalyani municipality. Evidence Report No 194. Sussex, UK and Kolkata, India:Institute for Development Studies (IDS) and CLTS Foundation. http://www.ids.ac.uk/publication/impact-of-community-led-total-sanitation-on-women-s-health-in-urban-slums-a-case-study-from-kalyani-municipality [accessed 15 March 2017].
Priyono E. 2009. Institutional Dimensions of Scaling up of CLTS in Indonesia. Bekasi, Indonesia:AKADEMIKA-Center for Public Policy Analysis. http://waterwiki.net/images/0/0c/InstitutionalDimensionsScalingUpCLTSIndonesia.pdf [accessed 1 June 2016].
Puzzolo E, Stanistreet D, Pope D, Bruce N, Rehfuess E. 2013. Systematic review: Factors influencing the large-scale uptake by households of cleaner and more efficient household energy technologies. London UK:EPPI-Centre, Social Science Research Unit, Institute of Education, University of London. http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3426 [accessed 15 October 2016].
Rehfuess EA, Puzzolo E, Stanistreet D, Pope D, Bruce NG. 2014. Enablers and barriers to large-scale uptake of improved solid fuel stoves: a systematic review. Environ Health Perspect 122(2):120–130, PMID: 24300100, 10.1289/ehp.1306639.
Robinson A. 2016. Final Evaluation: Pan African CLTS program 2010–2015. Amsterdam, Netherlands:Plan Netherlands. http://www.communityledtotalsanitation.org/resource/final-evaluation-plans-pan-africa-programme [accessed 15 March 2017].
Schlegelmilch MP, Lakhani A, Saunders LD, Jhangri GS. 2016. Evaluation of water, sanitation and hygiene program outcomes shows knowledge-behavior gaps in Coast Province, Kenya. Pan Afr Med J 23:145, PMID: 27279970, 10.11604/pamj.2016.23.145.7546.
Sclar GD, Penakalapati G, Amato HK, Garn JV, Alexander K, Freeman MC, et al. 2016. Assessing the impact of sanitation on indicators of fecal exposure along principal transmission pathways: a systematic review. Int J Hyg Environ Health 219(8):709–723, PMID: 27720133, 10.1016/j.ijheh.2016.09.021.
SEED Madagascar. 2016. Learning from rural CLTS: SEED Madagascar’s experiences in south east Madagascar. Antananarivo, Madagascar:SEED Madagascar and ONG Azafady, http://www.communityledtotalsanitation.org/sites/communityledtotalsanitation.org/files/SEED_Madagas-car_Lessons_learned_rural_CLTS.pdf [accessed 15 October 2016].
Shayamal S , Kashem MA , Rafi SM. 2008. Moving up the sanitation ladder: A participatory study of the drivers of sustainability and progress in Community Led Total Sanitation. In: Beyond Construction: Use by All. Wickens J , Verhagen J , Sijbesma C , Da Silva C , Ryan P , eds. London and Delft, UK:WaterAid and IRC International Water and Sanitation Centre, 263–280. http://www.ircwash.org/resources/beyond-construction-use-all [accessed 10 January 2016].
Singh S , Balfour N . 2015. Micro-Planning for CLTS: Experience from Kenya. WASH Field Note. New York, NY:UNICEF. https://www.unicef.org/esaro/WASH-Field-Microplanning-low-res.pdf [accessed 15 March 2017].
SNV Uganda. 2014. Documenting Our Process: Facilitating Community-Driven Development. Kampala, Uganda:SNV Uganda.
Spears D, Ghosh A, Cumming O. 2013. Open defecation and childhood stunting in India: an ecological analysis of new data from 112 districts. PLoS ONE 8(9):e73784, PMID: 24066070, 10.1371/journal.pone.0073784.
Spencer L, Ritchie J, Lewis J, Dillon L. 2003. Quality in Qualitative Evaluation: A Framework for Assessing Research Evidence. London, UK:National Center for Social Research. http://dera.ioe.ac.uk/21069/2/a-quality-framework-tcm6-38740.pdf [accessed 15 October 2016].
Taylor DL, Kahawita TM, Cairncross S, Ensink JHJ. 2015. The impact of water, sanitation and hygiene interventions to control cholera: a systematic review. PLoS One 10(8):e0135676, PMID: 26284367, 10.1371/journal.pone.0135676.
Thomas A, Bevan J. 2014. Developing and Monitoring Protocol for the Elimination of Open Defecation in Sub-Saharan Africa. http://www.communityledtotalsanitation.org/sites/communityledtotalsanitation.org/files/Thomas_and_Bevan_Elimination_of_open_defecation_SSA.pdf [accessed 15 March 2017].
Thomas BH, Ciliska D, Dobbins M, Micucci S. 2004. A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. Worldviews Evid Based Nurs 1(3):176–184, PMID: 17163895, 10.1111/j.1524-475X.2004.04006.x.
Tiwari C. 2011. Role of District Level Reflection and Government Leadership in Scaling Up CLTS: Lessons on Process Monitoring in Kenya. Netherlands:SNV Netherlands Development Organisation.
Toft E, Onabolu B. 2012. Evaluation of the Government of Ghana-UNICEF Integrated Approach to Guinea Worm Eradication through Water Supply, Sanitation and Hygiene in Northern Region, Ghana (I-WASH). Final Report. New York, NY:UNICEF. https://www.unicef.org/evaldatabase/files/I-WASH_evaluation_report_2012_-_Final_31102012.pdf [accessed 10 January 2016].
Tremolet S, Kolsky P, Perez E. 2010. Financing On-Site Sanitation for the Poor: A Six Country Comparative Review and Analysis. Washington, DC:The World Bank Water and Sanitation Program. http://documents.worldbank.org/curated/en/165231468341112439/Financing-on-site-sanitation-for-the-poor-a-six-country-comparative-review-and-analysis [accessed 15 December 2015].
Tyndale-Biscoe P, Bond M, Kidd R. 2013. ODF Sustainability Study. London:Plan International. http://www.communityledtotalsanitation.org/sites/communityledtotalsanitation.org/files/Plan_International_ODF_Sustainability_Study.pdf [accessed 10 October 2016].
UNICEF (United Nations Children’s Fund). 2014. Evaluation of the “Community Led Total Sanitation” (CLTS) Approach. Final Report. Madagascar:UNICEF. http://wsscc.org/wp-content/uploads/2016/04/Fonds-Mondial-pour-l%E2%80%99Assainissement-Rapport-d%E2%80%99avancement-2014-WSSCC.pdf [accessed 15 December 2015].
UNICEF WCARO. 2011. Roll-Out Evaluation of “Community Led Total Sanitation” in West and Central Africa. Final Report. Dakar, Senegal:UNICEF. https://www.unicef.org/evaluation/files/WCARO_2010-005_CLTS_Final_Report_03_11.pdf [accessed 10 January 2016].
UNICEF, WHO (World Health Organization). 2015. 25 Years Progress on Sanitation and Drinking Water: 2015 Update and MDG Assessment. Geneva, Switzerland:WHO Press. files.unicef.org/publications/files/Progress_on_Sanitation_and_Drinking_Water_2015_Update_.pdf [accessed 26 February 2017].
UNICEF. 2016. Phased Approach to Total Sanitation (PhATS) in Haiyan-Affected Areas – End-line Assessment. New York, NY:UNICEF. http://www.reachresourcecentre.info/system/files/resource-documents/reach_phl_report_phats_endline_report_march_2016_0.pdf [accessed 15 March 2017].
United Nations General Assembly. 2015. Draft Resolution a/69/l.85: Transforming Our World: The 2030 Agenda for Sustainable Development. Gen. Assem. 70 Sess. 16301. New York:United Nations. 10.1007/s13398-014-0173-7.2.
USAID (U.S. Agency for International Development). 2014. Ghana WASH Project – Lessons Learned: Hybrid CLTS Approach to Improving Sanitation. Washington, DC:USAID. http://pdf.usaid.gov/pdf_docs/PA00JR3J.pdf [accessed 10 October 2016].
Venkataramanan V. 2016. CLTS Learning Series: Lessons from CLTS Implementation in Seven Countries. Chapel Hill, NC:The University of North Carolina at Chapel Hill. https://waterinstitute.unc.edu/files/2016/01/CLTS-Learning-Series-Final-Report_011416.pdf [accessed 1 March 2016].
Vyas S, Kov P, Smets S, Spears D. 2016. Disease externalities and net nutrition: Evidence from changes in sanitation and child height in Cambodia, 2005–2010. Econ Hum Biol 23:235–245, PMID: 27776300, 10.1016/j.ehb.2016.10.002.
WaterAid India. 2008. Feeling the Pulse: A Study of the Total Sanitation Campaign in Five States. New Delhi, India:India. http://www.wateraid.org/~/media/Publications/study-total-sanitation-campaign-india.pdf [accessed 1 February 2016].
WHO. 1997. Participatory Hygiene and Sanitation Transformation: a new approach to working with communities. Geneva, Switzerland:WHO. http://apps.who.int/iris/bitstream/10665/63260/1/WHO_EOS_96.11.pdf [accessed 1 February 2017].
Wolf J, Prüss-Ustün A, Cumming O, Bartram J, Bonjour S, Cairncross S, et al. 2014. Systematic review: Assessing the impact of drinking water and sanitation on diarrhoeal disease in low- and middle-income settings: systematic review and meta-regression. Trop Med Int Health 19(8):928–942, PMID: 24811732, 10.1111/tmi.12331.
Zombo MM. 2010. Walking down the forbidden lane: ‘shit talk’ promotes sanitation. In: Participatory Learning and Action 61: Tales of Shit: Community-Led Total Sanitation in Africa. Bongartz P , Musyoki SM , Milligan A , Ashley H , eds. London, UK:IEED, 73–80. https://www.iied.org/pla-61-tales-shit-community-led-total-sanitation-africa [accessed 10 October 2016].