Pakistan: Team Leader, Evaluation of Youth Workforce Development Projects

Team Leader, Evaluation of Youth Workforce Development Projects, Performance Management Support Contract (PERFORM), Pakistan

Company Description
MSI, a Tetra Tech Company, is a Washington, DC metro area international development firm with a 35-year history of delivering development results across the world. Our core expertise is in the fields of monitoring and evaluation (M&E), institutional development, public sector management, governance and anti-corruption. MSI implements nearly 100 projects in 90 countries around the world such as Jordan, Morocco, Lebanon, Syria, Pakistan, Afghanistan, Colombia, and Mexico. As one of the leading companies in our field, MSI has partnered with more than 80 organizations across all sectors of international development with clients ranging from large bilateral and multilateral donors such as USAID, the World Bank and the UNDP to national and local governments, NGOs, think tanks, foundations and universities. For more information on MSI, please visit our website at www.msiworldwide.com.

**
Project Summary **

In May 2015, the United States Agency for International Development (USAID) awarded a five-year contract to Management Systems International (MSI) to provide performance management support to USAID-sponsored development programs throughout Pakistan. The Performance Management Support Contract (PERFORM) will serve as a centralized management support mechanism supporting USAID/Pakistan’s mission to increase stability, democracy, and prosperity for the men and women of Pakistan through the implementation of the Mission Strategic Framework (MSF). PERFORM will provide data and information to help project managers improve project results through better implementation and design, as well as services that support the Mission’s learning and adaptive process, enabling it to better target its programming and achieve its goals and objectives. The performance components will include: (1) Monitoring Services; (2) Evaluation Services; (3) Assessment Services; and (4) Learning Support Services.

Position Summary
MSI will conduct a midterm evaluation of two USAID youth workforce development projects being implemented in Karachi. The evaluation will assess the extent to which the projects are effectively targeting localities and individuals that are consistent with the effect the projects have had on beneficiaries’ economic opportunities and status. Additionally the evaluation will assess the effect of the projects on levels of crime and violence, and perceptions of security in the neighborhoods from which the trainees were selected.

MSI is seeking a Team Leader with extensive experience evaluating projects in conflict prone areas with a focus on workforce development. Experience linking improved economic opportunities to individual attitudinal change and aggregate community wide effects would be an advantage.

The Team Leader will lead a six-person evaluation team that includes a subject-matter expert, a qualitative researcher, a statistician, data analysts, and the data collection team of a sub-contractor. The Team Leader will direct the planning process, including the preparation of data collection and analysis plans; pretesting, and finalizing data collection instruments; presenting the plan to USAID, and training subcontractor staff to conduct a survey. S/he will also conduct key informant interviews and oversee other aspects of data collection. S/he will lead the analysis of quantitative and qualitative data and take the primary responsibility for writing the report.

The evaluation will use a mixed methods approach, leveraging primary and secondary data to answer the evaluation questions. Qualitative data will be collected through semi structured interviews of key stakeholders. We expect to conduct at least 150 in depth interviews, the vast majority of these will be conducted across various neighborhoods in Karachi. The evaluation team will use MaxQDA for coding and analysis of qualitative data. A non-equivalent groups design is expected to be used for assessing project outcomes quantitatively. We envisage conducting a stratified random sample survey of about 2000 individuals. The evaluation team will use STATA or SPSS to collate and analyze survey data.

The position entails about 82 days of effort, with approximately 51 days in Pakistan working in Islamabad and Karachi.

Responsibilities

• The Team Leader will manage the activities of the team, drawing on the strengths of individual team members to produce the best possible evaluation report.


• In collaboration with MSI staff and team members, the Team Leader will take the lead in:
  
  • Refining the evaluation approach and methods.
  
  
  • Developing data collection instruments, a data collection plan, and a data analysis plan.
  
  
  • Leading a data rehearsal with USAID staff prior to field work.
  
  
  • Directing secondary data review and analysis.
  
  
  • Directing fieldwork and putting in place necessary mechanisms for data quality assurance.
  
  
  • Conducting semi-structured interviews with key stakeholders in Karachi.
  
  
  • Leading qualitative and quantitative data analysis and guiding the team of researchers and analysts throughout the process.
  
  
  • Presenting results to USAID and implementing partners.
  
  
  • Writing the evaluation report and briefing papers.
  
  


• The Team Leader is ultimately responsible for the preparation of all key deliverables including but not limited to the data collection instruments, USAID and implementing partner debriefing presentations, and the draft and final evaluation report.

Qualifications

• At least a Master’s degree in a relevant field and 10 years of professional experience.


• Demonstrated experience in evaluation, research, and team management. Experience leading USAID evaluations is preferred.


• An in-depth understanding and prior experience in issues related to youth development, technical and vocational skills development. Experience in peace and tolerance focused interventions will be very useful.


• Strong skills in quantitative and qualitative research methods.


• Familiarity with USAID programming and evaluation requirements.


• Excellent analytical and personal communication skills. Excellent English writing skills.


• Experience working in complex and conflict-affected environments. Previous work experience in Pakistan is preferred.

Only candidates who have been selected for an interview will be contacted. No phone calls, please.

MSI is an EEO/AA/ADA Veterans Employer.

PI93593595
Apply Here