Design and application of a meta-evaluation framework

Fernando Gonzalez Aleu, Heather Keathley

Research output: Contribution to conferencePaper

Abstract

One critical aspect of research is identifying the relevant literature and synthesizing this information to understand the current development of a field and frame opportunities for future research. A Systematic Literature Review (SLR) is a research method used to identify the literature through the application of a rigorous protocol that ensures transparency of the process and increases validity of the work. While a SLR identifies and characterizes the literature, the next step to comprehensively understanding the research area is to synthesize the content of relevant previous work. There are many approaches to research synthesis including meta-analysis and meta-synthesis. Both analysis methods have the same constraint - they are limited by characteristics of the current literature. In organizational research, this presents a significant challenge due to the variety of disciplines typically participating in this research and the lack of consistency in reporting research findings. In addition, the literature in these fields tends to include both qualitative and quantitative studies, further complicating the synthesis. The purpose of this work is to define a meta-evaluation framework to integrate the findings obtained from a quantitative meta-analysis and qualitative meta-synthesis. In this exploratory work, the framework is applied to the results from two recent SLRs.
Original languageEnglish
Pages1777-1786
Number of pages10
Publication statusPublished - 1 Jan 2015
Externally publishedYes
EventIIE Annual Conference and Expo 2015 -
Duration: 1 Jan 2015 → …

Conference

ConferenceIIE Annual Conference and Expo 2015
Period1/1/15 → …

Fingerprint

Transparency

Cite this

Aleu, F. G., & Keathley, H. (2015). Design and application of a meta-evaluation framework. 1777-1786. Paper presented at IIE Annual Conference and Expo 2015, .
Aleu, Fernando Gonzalez ; Keathley, Heather. / Design and application of a meta-evaluation framework. Paper presented at IIE Annual Conference and Expo 2015, .10 p.
@conference{6a474680eefd442d981316a816de7c1d,
title = "Design and application of a meta-evaluation framework",
abstract = "One critical aspect of research is identifying the relevant literature and synthesizing this information to understand the current development of a field and frame opportunities for future research. A Systematic Literature Review (SLR) is a research method used to identify the literature through the application of a rigorous protocol that ensures transparency of the process and increases validity of the work. While a SLR identifies and characterizes the literature, the next step to comprehensively understanding the research area is to synthesize the content of relevant previous work. There are many approaches to research synthesis including meta-analysis and meta-synthesis. Both analysis methods have the same constraint - they are limited by characteristics of the current literature. In organizational research, this presents a significant challenge due to the variety of disciplines typically participating in this research and the lack of consistency in reporting research findings. In addition, the literature in these fields tends to include both qualitative and quantitative studies, further complicating the synthesis. The purpose of this work is to define a meta-evaluation framework to integrate the findings obtained from a quantitative meta-analysis and qualitative meta-synthesis. In this exploratory work, the framework is applied to the results from two recent SLRs.",
author = "Aleu, {Fernando Gonzalez} and Heather Keathley",
year = "2015",
month = "1",
day = "1",
language = "English",
pages = "1777--1786",
note = "IIE Annual Conference and Expo 2015 ; Conference date: 01-01-2015",

}

Aleu, FG & Keathley, H 2015, 'Design and application of a meta-evaluation framework' Paper presented at IIE Annual Conference and Expo 2015, 1/1/15, pp. 1777-1786.

Design and application of a meta-evaluation framework. / Aleu, Fernando Gonzalez; Keathley, Heather.

2015. 1777-1786 Paper presented at IIE Annual Conference and Expo 2015, .

Research output: Contribution to conferencePaper

TY - CONF

T1 - Design and application of a meta-evaluation framework

AU - Aleu, Fernando Gonzalez

AU - Keathley, Heather

PY - 2015/1/1

Y1 - 2015/1/1

N2 - One critical aspect of research is identifying the relevant literature and synthesizing this information to understand the current development of a field and frame opportunities for future research. A Systematic Literature Review (SLR) is a research method used to identify the literature through the application of a rigorous protocol that ensures transparency of the process and increases validity of the work. While a SLR identifies and characterizes the literature, the next step to comprehensively understanding the research area is to synthesize the content of relevant previous work. There are many approaches to research synthesis including meta-analysis and meta-synthesis. Both analysis methods have the same constraint - they are limited by characteristics of the current literature. In organizational research, this presents a significant challenge due to the variety of disciplines typically participating in this research and the lack of consistency in reporting research findings. In addition, the literature in these fields tends to include both qualitative and quantitative studies, further complicating the synthesis. The purpose of this work is to define a meta-evaluation framework to integrate the findings obtained from a quantitative meta-analysis and qualitative meta-synthesis. In this exploratory work, the framework is applied to the results from two recent SLRs.

AB - One critical aspect of research is identifying the relevant literature and synthesizing this information to understand the current development of a field and frame opportunities for future research. A Systematic Literature Review (SLR) is a research method used to identify the literature through the application of a rigorous protocol that ensures transparency of the process and increases validity of the work. While a SLR identifies and characterizes the literature, the next step to comprehensively understanding the research area is to synthesize the content of relevant previous work. There are many approaches to research synthesis including meta-analysis and meta-synthesis. Both analysis methods have the same constraint - they are limited by characteristics of the current literature. In organizational research, this presents a significant challenge due to the variety of disciplines typically participating in this research and the lack of consistency in reporting research findings. In addition, the literature in these fields tends to include both qualitative and quantitative studies, further complicating the synthesis. The purpose of this work is to define a meta-evaluation framework to integrate the findings obtained from a quantitative meta-analysis and qualitative meta-synthesis. In this exploratory work, the framework is applied to the results from two recent SLRs.

M3 - Paper

SP - 1777

EP - 1786

ER -

Aleu FG, Keathley H. Design and application of a meta-evaluation framework. 2015. Paper presented at IIE Annual Conference and Expo 2015, .