Loading...
HomeMy WebLinkAboutAnalytic Insight Proposal - EQUITY INDICATORS AND GAPS ANALYSIS Submitted by: Analytic Insight 478 Sabattus St. Lewiston, ME 04240 (207) 221-3125 amy@analyticinsight.org EQUITY INDICATORS AND GAP ANALYSIS FOR THE CITY OF BOZEMAN Equity Indicators and Gap Analysis for the City of Bozeman i | P a g e TABLE OF CONTENTS A. TITLE PAGE ...................................................................................................................................................... 1 B. EXECUTIVE SUMMARY .................................................................................................................................... 2 C. FIRM PROFILE AND PROJECT PERSONNEL .......................................................................................................... 3 LOCATION, NUMBER OF EMPLOYEES AND OWNERSHIP ................................................................................................ 3 THE FIRM’S HISTORY ........................................................................................................................................... 4 BRIEF RESUMES ................................................................................................................................................. 5 AMY FLOWERS, PHD ....................................................................................................................................... 5 LESLIE OGILVIE, MPA ...................................................................................................................................... 6 ALISA RAYMOND, MPA ................................................................................................................................... 7 JOSHUA FLOWERS ............................................................................................................................................... 8 PRIMARY CONTACT INFORMATION .......................................................................................................................... 9 D. EXPERIENCE ..................................................................................................................................................... 10 EXPERIENCE COLLECTING DATA TO ADVANCE EQUITY ................................................................................................ 10 FIRM’S APPROACH TO ETHICAL DATA GOVERNANCE.................................................................................................. 12 FIRM’S APPROACH TO CONDUCTING INCLUSIVE PUBLIC ENGAGEMENT ........................................................................... 13 EXPERIENCE IN PERFORMING GAP ANALYSIS ............................................................................................................ 14 DEMONSTRATING EQUITY, DIVERSITY AND INCLUSION IN OUR WORK ............................................................................ 21 EXPERIENCING CRAFTING ENGAGING AND VISUAL REPRESENTATIONS OF DATA ................................................................ 22 E. SCOPE OF PROPOSAL ....................................................................................................................................... 23 DETAILED NARRATIVE OF THE SERVICES PROPOSED ................................................................................................... 23 METHODS AND TECHNICAL TOOLS TO REACH AND INCLUDE COMMUNITY MEMBERS ......................................................... 35 METHODS AND TIMELINE OF COMMUNICATION WITH THE PROJECT MANAGER AND OTHER PARTIES ..................................... 35 SCHEDULE FOR COMPLETING TASKS ...................................................................................................................... 36 SOFTWARE AND OTHER ANALYSIS TOOLS................................................................................................................ 38 SUBCONTRACTED WORK .................................................................................................................................... 38 F. BUDGET............................................................................................................................................................ 39 ESTIMATED HOURS BY TASK................................................................................................................................ 39 COST BY TASK .................................................................................................................................................. 40 SCHEDULE OF RATES.......................................................................................................................................... 40 DIRECT COSTS ................................................................................................................................................. 40 G. REFERENCES .................................................................................................................................................... 41 H. AFFIRMATION OF NONDISCRIMINATION (APPENDIX A) .................................................................................. 42 Equity Indicators and Gap Analysis for the City of Bozeman 1 | P a g e A. TITLE PAGE Name of Firm: Analytic Insight Address: 478 Sabattus Street Lewiston, ME 04240 Contact: Amy Flowers, PhD President Telephone Number: (207) 221-3125 Email Address: amy@analyticinsight.org Signature of Authorized Representative: Analytic Insight (AI) is pleased to submit our proposal to work with the City of Bozeman on a community-wide data collection process on how race, ethnicity and gender identity affect people’s ability to thrive in the Bozeman area. AI (www.analyticinsight.org) is a woman-owned small business that has provided needs assessments, public opinion research, strategic planning, and program evaluations since 2007. Our mission is to provide accurate, innovative and exemplary research. AI is well-versed in all aspects of data collection, qualitative and quantitative data analysis and reporting. AI has conducted numerous large and complex projects like the City’s need for equity indicators and gap analysis. AI recently conducted the Business Opportunity and Equity Study for the City of Denver, an examination of the equity, diversity and inclusion present in the city’s cannabis industry. We are currently working with the Colorado Department of Human Services to assess the Department’s assets, culture, processes and procedures through an EDI lens (Equity, Diversity and Inclusion). In this proposal, we express our firm commitment to providing the City with a nuanced understanding of the department’s assets culture, processes and procedures through an EDI lens. On behalf of all of us at Analytic Insight, thank you for the opportunity to present our proposal and we look forward to hearing from you soon. Sincerely, Amy Flowers, PhD President Analytic Insight Equity Indicators and Gap Analysis for the City of Bozeman 2 | P a g e B. EXECUTIVE SUMMARY AI understands the purpose of this study is to better understand how Bozeman residents experience the community as correlated to their identities, as well as how identity and life circumstances impact a person’s ability to thrive in Bozeman. The City also wants to understand the capacity for Bozeman institutions and community organizations to address the inequities uncovered through a gap analysis. We understand that the City seeks to collect community-wide data along various indicators such as mental health, educational attainment, employment, income, housing affordability, criminal justice, access to City services, current infrastructure gaps and more. AI will use a mixed-methods approach to collect this data and provide the City with a comprehensive community equity assessment and gap analysis report that includes recommendations for addressing gaps in services. AI will develop a list of equity indicators for the City to track progress over time. AI will be committed to extensive community engagement throughout the process. AI offers numerous opportunities for inclusive engagement with the project team and key stakeholders, as well as Bozeman community members which are detailed in this proposal. AI has developed a methodological approach to collect rich, meaningful data. The City will benefit from several unique qualities of our approach: ❖ Focus on What Matters: Our assessment is grounded in an initial meeting with the City and regular, ongoing communications with the City project team to ensure that every step of the assessment is guided by the needs and research questions of the City. This brings a practicality to the research design and the results, enabling AI to provide clear and practical recommendations that help build support and strengthen policy, program and service recommendations. ❖ Constituent Voice: Our plan is to engage the public through a dedicated, interactive website that will offer updates on the planning process, information on best practices, links to community participation opportunities, thoughtful discussion questions for respondents to answer and scroll through the anonymous (moderated) responses of other community members, as well as access to the community survey. ❖ An Asset to the City: Our experience includes collecting data to advance equity in several communities, as well as performing gap analysis and providing recommendation for communities to address the needs revealed. Our study is designed to improve and enhance the relationships between the City, key stakeholders and Bozeman community members. We hope to open the door to future collaboration addressing the areas for improvement, acknowledging the gaps, and implementing policies and programs that address the needs uncovered. ❖ Data Visualization and Reporting: Mixed-methods research that combines quantitative and qualitative requires skill in interpreting and visualizing the results. Our state-of-the-art graphics include word clouds and word trees, as well as quantitative assessments to enhance the visual appeal of the report and increase nuanced understanding of the data. We have included several examples throughout this proposal to demonstrate our skill and provide an example of the type of work product the City can look forward to if AI is selected for this project. Equity Indicators and Gap Analysis for the City of Bozeman 3 | P a g e C. FIRM PROFILE AND PROJECT PERSONNEL LOCATION, NUMBER OF EMPLOYEES AND OWNERSHIP Analytic Insight (www.analyticinsight.org) is a full-service research firm located in Lewiston, Maine since 2007. We are a HUBZone-certified, economically disadvantaged, woman-owned small business that provides public opinion research, strategic planning, needs assessments and program evaluations. Our DBE status is pending and is expected to be active at the time this contract would be awarded. Analytic Insight (AI) was founded by Dr. Amy Flowers, sole principle and owner of the company. AI’s seasoned research team is experienced in comprehensive needs assessments, program evaluation, survey and sampling design, as well as in the methods of qualitative interviewing and strategic planning, sophisticated data analysis, graphics production and reporting. Our organizational capacity exceeds that required for this project and our coordinated, collaborative approach ensures that no milestones or deliverables will be dependent on a single individual. Dr. Flowers will serve as project manager for this project and is skilled in both quantitative and qualitative methodologies and analysis. She is certified in qualitative interviewing techniques by the RIVA institute, the gold-standard in interviewer training, and is skilled in the use of NVIVO software for qualitative data analysis. Dr. Flowers has a BA from the University of California at Berkeley and earned her PhD at the University of Southern California in sociology. In addition to Dr. Flowers, our staff includes five professional staff, and several part-time interviewers and administrative assistants. For this project, our core team will include Ms. Leslie Ogilvie and Ms. Alisa Raymond. Ms. Ogilvie brings a Master’s in Public Administration and experience in all phases of the research. Ms. Raymond also brings a Master’s in Public Administration, with an emphasis on public health policy. Ms. Ogilvie and Ms. Raymond will assist Dr. Flowers on all aspects of the project and are responsible for managing additional AI staff who will support the team with data collection and analysis. ORGANIZATIONAL CHART Equity Indicators and Gap Analysis for the City of Bozeman 4 | P a g e THE FIRM’S HISTORY Analytic Insight (AI) brings extensive experience in conducting needs assessments of both general populations and vulnerable, hard-to-reach populations. We have a proven track record of successfully identifying gaps, barriers and needs in a variety of settings. To provide comprehensive assessments that guarantees the collection of both quantitative and qualitative data, AI generally uses a mixed- methodology approach, like the one offered in this proposal. AI is well-versed in all aspects of data collection, qualitative and quantitative data analysis and reporting. AI is located in the state of Maine where the quality of life is high, and the cost of living is low. This enables us to provide the City with exemplary customer service and client relations, as well as efficient, innovative and responsible work products at a very low cost. Our national experience provides a high level of expertise in questionnaire development, while our grounded objective approach ensures that the project is based on the local experience of Bozeman residents and stakeholders. Our position as outsiders allows us to provide the City with objective and unbiased results. Most of AI’s work is at the state and community level, where we take a project from the planning of a proposal to the presentation of results. AI prides itself on our ability to build partnerships with the local community to support our research projects. Our use of participatory action research techniques ensures that we engage relevant stakeholders throughout the research process. By establishing relationships and securing community buy-in from the start, our clients are able to build on those relationships for strategy implementation and other needed investments to mitigate inequities into the future. AI’s ability to work collaboratively with a variety of essential partners and community stakeholders will bring exceptional value to the City. AI’s current workload will not affect our ability to do this project. Our organizational capacity exceeds that required for the project, and our coordinated, collaborative approach ensures that no milestones or deliverables will be dependent on a single individual. To ensure that each deliverable is consistent with the timeline, AI has weekly meetings to check on the status and progress. AI will not use any subcontractors on this project. “Their position as outsiders enabled Analytic Insight to be objective, but informed. Analytic Insight was knowledgeable about the subject matter without being part of the internal politics and provided an external, neutral perspective.” -Santa Clara Project Manager Equity Indicators and Gap Analysis for the City of Bozeman 5 | P a g e BRIEF RESUMES AMY FLOWERS, PHD President of AI and Project Manager Dedicated to the issues of public health and social justice, Amy Flowers founded Analytic Insight in 2007 to help organizations make evidence-based decisions and develop more resilient, equitable and livable communities. Our work at AI is varied and includes efforts to address disparities in healthcare, housing and homelessness, alcohol, tobacco and drug use and other social issues. On each of these topics, Amy is committed to using the principles of program design, implementation and evaluation to help create inclusive community processes that facilitate the inclusion of all community members. EXPERIENCE • Analytic Insight, Lewiston, ME, President, 2007-present • Market Decisions, Portland, ME, Research Manager, 2005-2007 • The Hay Group, Jersey City, NJ, Consultant, 2001-2003 • Godbe Research & Analysis, Half Moon Bay, CA, Senior Research Analyst, 1999-2001 • California Polytechnic State University, Pomona, CA, Assistant Professor, 1996-1999 • Mattson & Sherrod Associates, Los Angeles, CA, Director of Research, 1992-1996 ADDITIONAL QUALIFICATIONS Dr. Flowers is a skilled speaker and presenter with invitations to speak at the Centers for Excellence in Disability Research (CEDR) conference, sponsored jointly by DHHS and Mathematica, as well as at the National Home and Community-Based Services Conference sponsored by the Administration on Aging (AoA) and the National Association of States United for Aging and Disabilities (NASUAD). Dr. Flowers has managed all AI projects detailed in this proposal. Qualifications • Over 20 years of experience in program evaluation and research methods • Projects focused on equity, diversity and inclusion, healthcare disparities in access, experience and outcomes • Experience evaluating organizations and systemic change Education and Training • PhD, University of Southern California, 1995 • MA, University of Southern California, 1992 • BA, University of California at Berkeley, 1981 Certifications • RIVA certification in Focus Group Moderation, 2008 • Certificate in Race and Gender in Society, USC 1995 • NIH Information Management Certificate, 2020 • NIH Information Security Awareness Certificate, 2020 Equity Indicators and Gap Analysis for the City of Bozeman 6 | P a g e LESLIE OGILVIE, MPA Senior Research Associate Leslie is dedicated to building resilient and equitable communities and addressing the needs of vulnerable populations through data-driven decision making. Leslie provides innovative assessment and planning services to local communities nationwide with a focus on homelessness, housing insecurity and disparities in healthcare and access to social services. Leslie is committed to providing effective recommendations that are feasible to implement and based on the knowledge and expertise of local stakeholders. EXPERIENCE Analytic Insight, Lewiston, ME, Senior Research Associate, 2017-present Cape Fear Public Utility Authority, Wilmington, NC, Assistant to the Executive Director, 2015-2017 The Law Offices of Kathleen Shannon Glancy, PA, Certified Paralegal, 2004-2014 SELECTED WORK In her work for AI, Leslie specializes in qualitative research, conducting numerous key informant interviews, as well as interviews of individuals who have suffered traumatic events such as homelessness. Leslie completed Human Subjects Research training from the Collaborative Institutional Training Initiative (CITI Program) in 2015. Leslie often assists Dr. Flowers moderating focus groups and facilitating community forums, documenting key themes and strategic solutions to develop recommendations that are feasible to implement and supported by the local community. Leslie has developed action plans to reduce and end homelessness for many communities across the United States including Oklahoma City, Oklahoma, Lexington, Kentucky, Licking County, Ohio, Santa Clarita, California and Chattanooga, Tennessee. The projects all included key informant interviews and planning sessions with service providers, key stakeholders and people experiencing homelessness, as well as analysis of secondary data and literature reviews of best practices used in similar communities to address disparities and identified needs. Qualifications • Over 5 years of experience in program evaluation and research methods • Projects focused on social equity, homelessness, housing insecurity and affordable housing needs, and access to social services and healthcare • Experience evaluating equity, diversity and inclusion Education and Training • MPA, University of North Carolina Wilmington, Public Administration, 2017 • BA, University of North Carolina Wilmington, Political Science, 2007 Certifications • Human Subjects Research training from the Collaborative Institutional Training Initiative (CITI Program) • NIH Information Management Certificate, 2020 • NIH Information Security Awareness Certificate, 2020 Equity Indicators and Gap Analysis for the City of Bozeman 7 | P a g e ALISA RAYMOND, MPA Research Associate Alisa Raymond serves as the research associate for Analytic Insight. Her areas of focus include healthcare policy, equity and disparities, as well as childcare, education and social service needs. Prior to her work at Analytic Insight, she worked as a case manager where she assessed, planned, implemented, monitored and evaluated actions to meet her 30 client’s health and human service needs, all while coordinating care with other health care professionals. In her time there, she managed several cases of abuse, neglect and restorative justice. She was trained on how to use a trauma-informed approach when communicating and working with individuals who have experienced traumatic events. EXPERIENCE Analytic Insight, Lewiston, ME, Research Associate, 2018- present SequelCare of Maine, Yarmouth, ME, Children’s Targeted Case Manager, 2017-2018 Cardiovascular Health Initiative, Inc., Boston, MA, Chief Operations Officer, 2017-present Institute for Public Services, Boston, MA, Graduate Research Fellow, 2016-2018 Suffolk University Language Lab, Boston, MA, Lab Technician/Office Assistant, 2013-2018 South Shore YMCA, Quincy, MA, Assistant Teacher, 2016-2017 Asian Entrepreneurship Foundation, Boston, MA, Director of Business Operations, 2015-2017 SELECTED WORK Alisa heavily assisted Dr. Amy Flowers on the comprehensive assessment of the health of children, mothers, and families in Maryland, to fulfill a requirement of the Title V Maternal & Child Health (MCH) Block Grant. Together with Dr. Flowers, Alisa co-moderated strategic planning sessions with stakeholders and co-facilitated public forums. Alisa also took the lead on the development of the draft Needs Assessment and Five-Year Action Plan. Qualifications • Over 5 years of experience in program evaluation and research methods • Outstanding verbal and written communication skills; experience includes a strong focus on healthcare disparities in access, experience and outcomes • Experience with trauma- informed care when working with individuals who have experienced traumatic events Education and Training • MPA, Suffolk University, Public Health Policy, 2018 • BA, Suffolk University, Biology and Psychology, 2016 Certifications • NIH Information Management Certificate, 2020 • NIH Information Security Awareness Certificate, 2020 Equity Indicators and Gap Analysis for the City of Bozeman 8 | P a g e JOSHUA FLOWERS Research Assistant For the past four years, Joshua has managed AI’s quantitative survey software, including programming surveys in CATI telephone interviewing software, SNAP survey software for written scannable surveys and Internet surveys, as well as printing, scanning, data cleaning and coding. He is responsible for testing survey software and preparing file sets and accompanying documentation. Joshua supports all our survey research data collection and processing operations. He is proficient in the protocols, processes, data collection instruments and collected data for a variety of studies. EXPERIENCE 2015 - present, Research Assistant, Analytic Insight, Lewiston, ME SELECTED WORK Cooperative Agreement to Benefit Homeless Individuals (CABHI). Constructed data sets using Census and HUD data, assisted with the development of grantee fact sheets, including data visualization charts and graphics. State of Wisconsin Aging and Disability Resource Evaluations. Review and creates multiple survey templates, programs mail and online surveys using specialized survey software, creates mailing lists and labels in MS Excel for mail survey distribution. AARP Age-Friendly Community Surveys. Data entry of mail survey returns, programed online surveys, performed calculations and produced data visualization charts in MS Excel, report development including detailed findings per survey question with correlating charts and graphs. Population Assessment of Tobacco and Health (PATH) Study. Reviews and edits qualitative data transcripts regarding elctronic smoking device use, formats transcripts for upload into NVivo, and coding based on respondent characteristics. Qualifications • Four years of experience in delivering high quality online surveys, CATI programming and SNAP survey development programming • Qualitative coding for the Population Assessment of Tobacco and Health (PATH) Study, the nation’s largest study of tobacco and health. • Knowledge of personally identifying information, confidentiality and IRB procedures Education and Training • BA, University of Maine at Farmington, English and Psychology, 2010-2014 Certifications • NIH Information Management Certificate, 2020 • NIH Information Security Awareness Certificate, 2020 Equity Indicators and Gap Analysis for the City of Bozeman 9 | P a g e PRIMARY CONTACT INFORMATION The primary contact information for AI is: Amy Flowers President 478 Sabattus Street Lewiston, ME 04240 (207) 221-3125 amy@analyticinsight.org Equity Indicators and Gap Analysis for the City of Bozeman 10 | P a g e D. EXPERIENCE AI has experience developing action plans for numerous communities, including a recent cannabis equity plan for the City of Denver. Our data collection activities engage key stakeholders throughout the assessment and planning process to identify and characterize inequities and other needs in each community. AI has conducted needs assessments, strategic planning and evaluations related to equity and diversity, poverty, homelessness, access to social services and systemic racism. EXPERIENCE COLLECTING DATA TO ADVANCE EQUITY AI has experience collecting data that is used to inform community-wide efforts to advance equity and inclusion. AI points to three studies, including our current equity, diversity and inclusion study with the Colorado Department of Human Services, the development of a cannabis equity plan for the City of Denver and our work on the Title V needs assessment and action plan for the State of Maryland. 1. COLORADO DEPARTMENT OF HUMAN SERVICES EQUITY, DIVERSITY AND INCLUSION STUDY The purpose of this study is to provide an objective assessment of the Colorado Department of Human Service’s (CDHS’s) assets, culture, processes and procedures through an EDI lens (Equity, Diversity and Inclusion). This baseline information will help assess any divergence between the vision, values and communications of CDHS and the perceptions of staff and residents of Colorado who are served by the Department. AI’s methodology includes three avenues for employees, staff and other key stakeholders to offer input and participate in data collection activities throughout the assessment process. These avenues include key informant interviews, a broadly distributed online survey and an interactive project website to provide ongoing project updates and additional opportunities for staff, employees, stakeholders and residents to participate and express their opinions. The final deliverables include both draft and final report on the assessment results, a facilitated virtual presentation of the assessment results, EDI plan of action, and recommendations of needed resources and success metrics, a template for office-level equity action plans and a visual of recommended organizational structure of EDI efforts at CDHS. 2. COLORADO EQUITY AND OPPORTUNITY IN THE CANNABIS INDUSTRY This project examined the need for a social equity program to help the Denver cannabis industry achieve equitable ownership and employment opportunities and to decrease disparities for marginalized communities and address the disproportionate impacts of the War on Drugs. The study was designed to address five primary research objectives: 1. Develop a point-in-time snapshot of the characteristics of firms, including ownership and employees within the cannabis industry, examining the status of the industry and identifying needs such as training and business technical assistance. 2. Examine business and employment outcomes and conditions to better understand how the city may be able to support and partner with these firms to increase their success and community outcomes. Equity Indicators and Gap Analysis for the City of Bozeman 11 | P a g e 3. Review any lasting challenges to equitable access and opportunity in ownership, management or employment within these businesses. 4. Identify existing challenges and changes as the cannabis industry matures and evolves; and 5. Analyze historical data of marijuana arrests and convictions to identify and understand possible carry-forward impacts of previous laws and policies, and how they may be impacting business and employments outcomes in the cannabis industry today. The report provided an overview of existing business and employment conditions in the Denver cannabis industry and a “playbook” with recommendations and guidance for any business assistance and programs for City agencies, non-profit partners, private businesses and stakeholders to help current and future residents, employees and businesses address disparities in equity and industry participation. Our study was based on key informant interviews of those working in the cannabis and related industries. Interviews also included social activists, neighborhood groups, education and recreation facility leaders and others. We conducted strategic planning sessions with industry leaders and those impacted by the industry. A series of public forums helped gather resident feedback concerned about the impact of cannabis sales and the disproportionate impact of the drug war. An online survey was broadly distributed with screening questions to establish respondents’ roles and interests guided the questions that were presented later in the survey. The online survey was used as a tool to gather feedback from a wide variety of participants, including impacted communities, industry employees, owners of cannabis businesses and residents with concerns about the industry. The full report is available at: https://www.analyticinsight.org/denver-equity-report 3. TITLE V NEEDS ASSESSMENT AND STRATEGIC PLANNING, STATE OF MARYLAND The Title V Maternal and Child Health Services Block Grant Program is funded by the U.S. Department of Health & Human Services, Health Resources and Services Administration (HRSA). The grant funding helps Maryland fund programs that promote and improve the health and well-being of mothers, children, including children and youth with special needs, and their families. Every five years, each state is required to complete a comprehensive assessment of the health of children, mothers, and families in the state, to fulfill a requirement of the Title V Maternal & Child Health (MCH) Block Grant. The purpose of this assessment is to review the health needs of mothers, children, including children and youth with special health care needs, and their families. The first step of the planning process was to assess the current health needs of the populations and establish priority areas to address. This was addressed through a meeting with the Steering Committee and key informant interviews conducted with service providers throughout the state. Each state is required to select a minimum of five National Performance Measures (NPMs) for programmatic focus based on identified priority needs. The selected priorities may address a single population group or multiple groups and should reflect the unique needs of the state. In addition, the identified priority needs should address areas in which a state believes that targeted interventions can result in needed improvements to its healthcare delivery systems. Before the onset of this project, Maryland had been instructed by HRSA to address racial disparities in health outcomes and to focus efforts on these disparities. The Needs Assessment was structured in six stages. The first stage was the Planning Stage and included the initial meeting with the Steering Committee and the development of a Research Plan. In Stage 2, we gathered existing data from a variety of data sources to better understand the population needs, Equity Indicators and Gap Analysis for the City of Bozeman 12 | P a g e available services and disparities in access or health. Stage 3 consisted of data collection, including key informant interviews and public forums. At this point in the research, we met with the Steering Committee to gather their feedback on the data gathered to date. Stage 4 focused on identifying priorities through strategic planning sessions with key stakeholders across the state and continuing to gather feedback from the public. Stage 5 was reserved for public comment and included an online survey, accessible through the Internet and optimized for access using any mobile device. The final stage, Stage 6 was report development. Several reports documented the findings:  Needs Assessment with Priority Areas and Recommendations  Summary Report  Five-Year Action Plan  Dissemination and Communication Plan The materials developed for this study are available at: https://www.analyticinsight.org/md-titlev FIRM’S APPROACH TO ETHICAL DATA GOVERNANCE We understand the importance of protecting client confidentiality. AI’s project team is experienced in handling sensitive data. Dr. Flowers has managed numerous research projects related to public health and safety. In her work with the Office of Juvenile Justice and Delinquency Prevention (OJJDP) studying gang involvement in cocaine trafficking and related homicides, Dr. Flowers coded qualitative homicide records to record instances of gang and illegal drug involvement in sampled cases. Dr. Flowers also provided entries for "Disclosure" and "Privacy" in the Encyclopedia of Social Science Research from Sage Publications. Ms. Ogilvie specializes in qualitative research, conducting numerous key informant interviews, as well as interviews of people and families experiencing homelessness, mental illness or substance abuse disorders. She completed Human Subjects Research training from the Collaborative Institutional Training Initiative (CITI Program) in 2015. In our federal work with the NIH and other federal agencies, AI staff participates in trainings and obtain certifications related to information security and privacy awareness, records management and cybersecurity. We point to our work as a subcontractor to Westat on the PATH study as another example of our experience ensuring client confidentiality. The PATH study is the nation’s largest study of tobacco and health. The identity of the participants in the study is sought by many who would like to influence policy around tobacco and electronic cigarette use. For this reason, and for HIPAA related concerns, participant identities are highly confidential. AI is entrusted by Westat, NIH and FDA to de-identify interview data for this study. Our staff is trained in data confidentiality and participates regularly in trainings and briefings related to confidentiality and privacy in data. Equity Indicators and Gap Analysis for the City of Bozeman 13 | P a g e FIRM’S APPROACH TO CONDUCTING INCLUSIVE PUBLIC ENGAGEMENT AI’s proposed methodological approach includes many opportunities for inclusive engagement with the project team and key stakeholders, as well as Bozeman community members. AI’s project manager, Amy Flowers, will hold a bi-weekly check-in meeting with the City’s project team to provide an update of the activities that have taken place during the previous two weeks, those planned for the upcoming period and any other discussion items. AI will hold survey development meetings with the project team as often as necessary to develop the proposed survey instrument. These meetings will ensure that the survey addresses all research questions to provide the City with a comprehensive community equity assessment, gap analysis and list of appropriate equity indicators. Bozeman community members and other key stakeholders will be engaged and encouraged to offer their feedback to the assessment in several ways. First, we will develop a representative community survey that will be broadly distributed and promoted. The survey will share some core questions and concepts across all survey participants for comparison purposes, but will also seek to shed light on the specific experiences of each key constituency related to equity and inclusion to best identify patterns and gaps across the Bozeman community. The second way we elicit participation from these constituencies is to provide a dedicated website with project updates, ways to participate, weekly feedback questions and other engagement opportunities. Finally, AI will host three community listening sessions that will offer community members an opportunity to express their experiences and ability to thrive in the Bozeman community as correlated to their identities and life circumstances. The details of our methodological approach are outlined in Section E. Scope of Proposal. Below we provide further examples of AI’s experience in providing inclusive public engagement with historically underrepresented populations and local government entities. 1. ALASKA SENIOR NEEDS ASSESSMENT Our study for the Alaska Mental Health Trust Authority focused on Native Alaskan elders and included qualitative key informant interviews, community forums and focus group sessions, and telephone and Internet surveys. Dr. Flowers worked with the Tanana Chiefs to arrange interviews with Alaska Native elders throughout the region. During this study, Dr. Flowers brought her young daughter as a way of humanizing the research and establishing rapport with native elder interview subjects. We also worked closely with the Alaska Commission on Aging and a project Advisory Board consisting of members of a variety of stakeholder organizations. Dr. Flowers presented the results to the community in a community feedback forum and at the Alaska Public Health conference in Anchorage. 2. FOCUS GROUPS OF BALTIMORE YOUTH ILLEGALLY USING TOBACCO PRODUCTS AI conducted eight focus groups around the greater Baltimore area of young adults who had illegally smoked tobacco or used electronic smoking devices while underage and in high school. The study included engaging African American youth to participate in several culturally specific focus groups. AI successfully used social media advertising to fully recruit these groups with an average of 12 participants per group. Our methods of using focused exercises to engage participants and offer opportunities for individuals to share written notes in addition to their verbal participation elicited in-depth information about illegal, underage tobacco procurement and use. Equity Indicators and Gap Analysis for the City of Bozeman 14 | P a g e EXPERIENCE IN PERFORMING GAP ANALYSIS AI has experience conducting needs assessment and gap analysis similar in scope. 1. OKLAHOMA CITY HOMELESSNESS PLAN AI developed a comprehensive homelessness action plan for the City of Oklahoma City, Oklahoma. The evaluation and planning process included approximately 50 key informant interviews with city staff, local homeless service providers, community-based providers, housing providers, faith-based organizations, health care professionals including mental health providers, education staff and administrators, as well as people experiencing homelessness. AI evaluated secondary data including HMIS, HUD and PIT counts. Dr. Flowers and Ms. Ogilvie facilitated 12 planning sessions with stakeholders to develop a homelessness plan for the City. AI has entered into a second contract with the City to adapt the plan to the needs and changing circumstances presented by the COVID-19 pandemic. 2. STRATEGIC PLANNING TO ADDRESS HOMELESSNESS IN CHATTANOOGA, TENNESSEE AI developed a comprehensive 2018 homelessness action plan for the City of Chattanooga, Tennessee, where we worked with the Chattanooga Interagency Council on Homelessness (CICH) to combat and end homelessness. To achieve this, AI conducted approximately 30 key informant interviews with city staff, local homeless service providers, community-based providers, faith-based organizations, homeless coalitions, health care professionals including mental health providers, education staff and administrators, as well as people experiencing homelessness. We also facilitated nine stakeholders focus group planning sessions with key stakeholders and City leaders. Additionally, AI held a public meeting to prioritize action items discussed throughout the focus group planning sessions and conducted a network analysis for the City. Together with a literature review of best practices, and successful action plans completed nationwide, we were able to provide a thorough and well-studied final action plan that highly satisfied our clients. Our final report started with a vision statement to end homelessness, to help set an optimistic mindset and positive outlook when looking at and reviewing the report. Next, we provided an executive summary with a short run through of our entire report, followed by an introduction and background section which included information about the point-in-time count for homeless individuals in Chattanooga. We then provided the meat of our report findings in the sections titled “Community Challenges, Needs and Assets,” and “the Network of Organizations,” which entailed the qualitative and quantitative data collected through our methodology as well as the social network analysis diagram. Lastly, AI presented the 2018 Chattanooga Community Action Plan which, as a result of our comprehensive methodology and analysis, was able to provide several recommendations and solutions. Charts and graphs were used heavily throughout the report to provide a visual understanding of the information being presented. Additionally, sprinkled throughout the report were case studies of similar actions and information snapshots of pertinent information. Furthermore, AI provided a logic model of the action items described. All of which was presented in an aesthetically and visually appealing way. The link below provides the entirety of our final homelessness action plan: https://www.analyticinsight.org/chattanooga-report Equity Indicators and Gap Analysis for the City of Bozeman 15 | P a g e This project demonstrates our ability to conduct key informant interviews with staff, service providers and community leaders, and includes similar methodologies to those proposed for the City in this proposal. CHATTANOOGA REPORT SAMPLES Equity Indicators and Gap Analysis for the City of Bozeman 16 | P a g e 3. STRATEGIC PLANNING TO ADDRESS HOMELESSNESS IN SANTA CLARITA, CALIFORNIA AI developed a comprehensive 2018 homelessness action plan for the City of Santa Clarita, California. To achieve this, AI conducted approximately 30 key informant interviews with city staff, local homeless service providers, community-based providers, faith-based organizations, homeless coalitions, health care professionals including mental health providers, and education staff and administrators including the local community colleges and school districts. Additionally, AI held a two-day planning event with these stakeholders to develop a homelessness plan for the City of Santa Clarita. AI also conducted a network analysis for the City. Furthermore, AI developed the planning document and presented it, with City staff, to the City Council at a public meeting. Our final report started with an introduction and planning context section which included the reason for the plan, information about our methodology and how it was carried out as well as the current challenges facing organizations. We then provided the bulk of our report findings in each of the topic area sections titled “Preventing Homelessness,” “Increasing Income,” “Subsidized Housing,” “Increase Affordable/Homeless Housing,” and “Create Local Coordination,” which included specific actions relevant to each topic that the community could take to combat and end homelessness within their jurisdictions. Charts and graphs were used throughout the report to provide a visual understanding of the information being presented. Additionally, AI provided several network analysis graphics to display the connections of different organizations and how well each of them communicate with each other. Furthermore, AI color coded each topic area to allow for the final report to be presented in an aesthetically and visually appealing way. The link below provides the entirety of our final homelessness action plan: https://www.santa-clarita.com/Home/ShowDocument?id=15984. This project compares to the services requested by the City by demonstrating our ability to conduct key informant interviews with City and County staff, service providers, advocates and community leaders. It includes a similar methodology to that presented in this proposal. A few pages of the report are provided on the following page. Equity Indicators and Gap Analysis for the City of Bozeman 17 | P a g e SANTA CLARITA REPORT SAMPLES Equity Indicators and Gap Analysis for the City of Bozeman 18 | P a g e 4. FAMILY NEEDS ASSESSMENT IN PALO ALTO, CALIFORNIA AI developed a comprehensive family needs assessment for the City of Palo Alto California. This project was to assess the personal, educational and childcare needs of families with young children (under 12). To achieve this, AI gathered data from stakeholder interviews with community leaders and stakeholders in childcare and education, interviews with childcare providers and a survey of Palo Alto families with at least one child under the age of 13. To ensure the feedback of three groups often underrepresented in surveys and needs assessments: families with children with special needs, lower income families and Asian families, focus groups were conducted with each of these participants. Our final report started with an executive summary which provided an overview of our most impactful findings. This section was followed by an introduction and background section which included information about our methodology and how it was carried out. We then provided detailed findings in the sections titled “Caring for Children in Palo Alto: Strengths, Needs and Challenges,” “Current Growth and Changing Demographic,” and “Cost, Accessibility, Availability and Quality of Child Care in Palo Alto,” which entailed the exploration of current obstacles, barriers and needs that are currently affecting families and how these are likely to impact future trends. Furthermore, AI investigated the use of a multigenerational center using a case study which provided evidence of success in similar communities. Lastly, AI recommended strategies for how to improve the quality of life for Palo Alto residents with young children. This included emphasizing how to increase interest in the field of childcare through recruitment and retention strategies. Charts and graphs were used heavily throughout the report to provide a visual understanding of the information being presented. Additionally, provided throughout the report were corresponding and relevant quotes from respondents of our interviews and survey, as well as participants of our focus groups. All of which was presented in an aesthetically and visually appealing way. The methodology for this project included key informant interviews and an online survey. Issues examined for the project included attracting, recruiting and retaining employees for childcare providers. Equity Indicators and Gap Analysis for the City of Bozeman 19 | P a g e PALO ALTO REPORT SAMPLES Equity Indicators and Gap Analysis for the City of Bozeman 20 | P a g e 5. FAMILY NEEDS ASSESSMENT IN AUGUSTA COUNTY, VIRGINIA In 2018, AI worked with the Central Shenandoah Valley Office on Youth and the Greater Augusta Prevention Partners Coalition. For this project, AI assessed the needs of youth in Augusta County, Virginia, including an analysis of negative youth behaviors and problems most frequently seen in the community, youth delinquency and resiliency, service gaps and possible solutions. The methodology for this project incorporated a mixed-methods approach that included key informant interviews of service providers and community organizations, a parent mail survey with an online survey component, parent and youth intercept interviews in the County, and a stakeholder forum. Extensive use of secondary data analysis and literature reviews included Census data, the Youth Assessment & Screening Instrument (YASI), the National Crime Victimization Survey (NCVS) and Bureau of Justice Statistics (BJS) data to provide a comprehensive portrait of the community in relation to the rest of the state and the country as a whole. This project demonstrates again, AI’s ability to conduct, synthesize and analyze data from secondary data sources, key informant interviews and online surveys to provide a comprehensive analysis of the dynamics of a community and their service needs. 6. CHILD ADVOCACY CENTER EVALUATION, STATE OF MARYLAND AI worked with the Maryland Department of Health on a Child Advocacy Centers (CACs) statewide needs assessment. For this project, AI conducted 23 interviews with a CAC representative from each of Maryland’s CACs to learn about each center’s resources for helping assess and address child maltreatment. This included assessing the CAC sources for funding and training medical providers, ascertaining the training needs for support staff and medical providers, and determining the number of children served per CAC, the number of exams performed per CAC and the number of hours each center needs for each medical provider. 7. COMPREHENSIVE STATEWIDE NEEDS ASSESSMENTS AI has conducted several Comprehensive Statewide Needs Assessments (CSNAs), including for the Pennsylvania Association for the Blind (PAB) and its network of 29-member agencies, the State of Kentucky Office for the Blind, and the Delaware Division for the Visually Impaired. In each of these three projects, AI used a mixed-methods, participatory approach. AI focused not only on the opinion, suggestions and feedback of the key stakeholders and providers, but also engaged blind or visually impaired individuals to obtain their opinions, suggestions and feedback on the needs of that specific population. Equity Indicators and Gap Analysis for the City of Bozeman 21 | P a g e DEMONSTRATING EQUITY, DIVERSITY AND INCLUSION IN OUR WORK In addition to our work related Equity, Diversity and Inclusion (EDI), Analytic Insight provides evidence- based planning to strengthen services and programs for people with disabilities, those experiencing homelessness, those who have disparate access to healthcare and other services and other populations that are marginalized or vulnerable. This work requires us to be aware of those individuals in our own community and beyond who are similarly marginalized or vulnerable. AI has taken several actions to ensure that our impact on our community is positive. There are several ways this has shaped our practice within AI. First, we lead by example. AI’s culture and values are supported by practices that include employee time off for volunteer activities, support of local non-profits, inclusive and equitable hiring and promotion practices and open dialogue about the important, often difficult topics like racism, discrimination and access. In our work for the Aging and Disability Resource Centers (ADRCs) in the state of Wisconsin, AI has conducted focus groups with clients, many of whom were elderly or have developmental or cognitive disabilities. Our work to develop action plans to address homelessness in numerous communities have all included key informant interviews with individuals and families experiencing homelessness, as well as focus groups and public forums that are designed to elicit direct participation of homeless and formerly homeless residents. These interviews are conducted with the upmost respect and consideration. We are careful to speak to people in their own language whenever possible. In our work for the City of Palo Alto, AI offered Spanish interpretation for our focus groups of low-income Hispanic families and we conducted several childcare provider interviews in Spanish. Although we did not have a Spanish speaker available for the groups, we hired a bilingual resident of the complex to provide translation. When conducting public forums across the State of Maryland to gather feedback on the Title V programs, we worked with interpreters to offer Spanish access and included American Sign Language interpretation. During these groups, Alisa Raymond, our Research Associate was able to greet several respondents in Korean. Dr. Flowers, who will serve as project manager for this project, has a BA from the University of California at Berkeley and earned her PhD at the University of Southern California in sociology. She has been certified in qualitative interviewing techniques by the RIVA institute, the gold-standard in interviewer training. With this training, she has successfully moderated many focus groups and community forums to gain the feedback and insights of low-income, minority, and vulnerable, hard-to-reach populations within a community. Ms. Leslie Ogilvie brings a Master’s in Public Administration and has, together with Dr. Flowers, moderated focus groups and facilitated public forums of low-income, minority, and vulnerable, hard-to- reach populations. Ms. Alisa Raymond has her Master’s in Public Administration, with an emphasis on public health policy. Ms. Raymond also serves as the Chief Operations Officer (COO) for Cardiovascular Health Initiative (CHI, Inc.). CHI, Inc. is a 501(c)(3) non-profit with the mission to help healthcare professionals reduce deaths related to heart disease through education, prevention, and intervention in medically underserved areas of developing African countries. Ms. Raymond speaks some Korean. Equity Indicators and Gap Analysis for the City of Bozeman 22 | P a g e EXPERIENCING CRAFTING ENGAGING AND VISUAL REPRESENTATIONS OF DATA AI takes pride in our ability to produce aesthetically pleasing visual tools and templates. AI has developed infographics and facts sheets for many our projects. We developed fact sheets for housing owners under our evaluation of Kansas City’s Community Transformation Grant, to educate them about the advantages of smoke-free policies. We recently developed fact sheets for grantees of SAMHSA’s Cooperative Agreement to Benefit Homeless individuals (CABHI), provided here. Our strategy is to develop report graphics to provide clear, interesting and accurate portrayals of the results. The images below provide an example of the fact sheets we developed for our homelessness study in Chattanooga. These fact sheets were distributed during stakeholder strategic planning sessions and each correlated with the action plan for the planning session. We provide further examples of our ability to craft engaging and visual representations of data throughout this proposal. Equity Indicators and Gap Analysis for the City of Bozeman 23 | P a g e E. SCOPE OF PROPOSAL AI understands the purpose of this study is to better understand how Bozeman residents experience the community as correlated to their identities, as well as how identity and life circumstances impact a person’s ability to thrive in Bozeman. The City also wants to understand the capacity for Bozeman institutions and community organizations to address the inequities uncovered through a gap analysis. We understand that the City seeks to collect community-wide data along various indicators such as mental health, educational attainment, employment, income, housing affordability, criminal justice, access to City services, current infrastructure gaps and more. AI will use a mixed-methods approach to collect this data and provide the City with a comprehensive community equity assessment and gap analysis report that includes recommendations for addressing gaps in services. AI will develop a list of equity indicators for the City to track progress over time. AI will be committed to extensive community engagement throughout the process. AI offers numerous opportunities for inclusive engagement with the project team and key stakeholders, as well as Bozeman community members which are detailed in the sections below. DETAILED NARRATIVE OF THE SERVICES PROPOSED Below we provide a detailed narrative of the services proposed for each phase of the study should AI be selected for this project. PHASE 1: DATA COLLECTION AND STAKEHOLDER MAPPING TASK 1.1: PROJECT INITIATION AI begins the project with a virtual kick-off meeting with the City’s project team to discuss the project goals, methodology, protocols and timeline. We will work with the project team to identify and acquire existing data from relevant sources including local agencies and organizations, as well as determining what publicly available data would be most useful for further analysis. AI will work with the project team to identify gaps in existing data and identify new data sources. We will also identify which previous efforts and studies should be evaluated, as well as the stakeholders, individuals and organizations who should be engaged throughout the process. TASK 1.2: BACKGROUND RESEARCH AI understands that the City wishes the data to be disaggregated by race, ethnicity and gender identity as the data allows. It should be noted that when using American Community Survey (ACS) census data the variables available using 2019 estimates are limited and to provide detailed analysis we may need to use the Census’ three- or five-year averages. In analyzing data from the City or partners, AI’s practice to provide data only on groups of five respondents or more. This protects the privacy of individuals who might be identifiable in a group of less than five. AI has extensive experience working with large, national data sources to create area profiles. For our family needs assessment in Waynesboro, Virginia for example, we used the Bureau of Juvenile Statistics and Department of Justice crime victimization data, along with detailed Census information, to understand the risk and protective factors impacting youth in that community. Equity Indicators and Gap Analysis for the City of Bozeman 24 | P a g e In our work on the Cooperative Agreement to Benefit Homeless Individuals (CABHI) Evaluation funded by SAMHSA, AI created profiles for 30 grantees. These profiles included information on the service provider’s demographic profile compared to national trends, veteran population, participation by area residents in mainstream benefits such as Social Security, SSI or SNAP benefits, and housing demographics. AI produces a variety of data visualizations to show results of quantitative data obtained from existing data sources. Below is an example from our needs assessment for the state of Maryland’s Title V program. We begin each section with an overview of the issue over time, provide detail of the issue by ethnicity and race, and highlight important information, such as counties with the highest percentage of low-risk cesarean deliveries. TASK 1.3: STAKEHOLDER ENGAGEMENT AI uses a stakeholder mapping process that harnesses the complex and comprehensive local knowledge of the Bozeman community, as well as seeks to expand the network and engage those who have not previously been engaged. AI’s robust stakeholder engagement approach includes up to 30 key informant interviews, a project website and community listening sessions. Key Informant Interviews We anticipate conducting approximately 30 structured interviews with a diverse range of stakeholders. AI will work with the City to develop an appropriate list of stakeholders, individuals and organization representatives. We recommend constructing a list of 40 or so individuals to provide back-ups for those who are unreachable or decline to be interviewed. We anticipate interviews to be approximately 30 minutes in length. AI uses Microsoft 365’s online scheduling platform to invite interview participants to schedule their own interview using our calendar Equity Indicators and Gap Analysis for the City of Bozeman 25 | P a g e system. This system enables participants to visit the booking page at their convenience, book the time they need and receive a confirmation email and calendar invitation. They can return to reschedule or cancel if needed. The email confirmation includes a meeting link so they can join via a web browser or phone dial-in. Participants do not need to log in or have a Microsoft account to join. We also offer our phone number for those who prefer to schedule the interview by phone, although we find that many interviewees prefer online scheduling. Development of the Interview Guide AI will work with the project team to ensure that the interview guide covers all topics of interest. We will provide a draft of a detailed interview guide for the project team to review and we suggest a telephone conference call to discuss and revise the draft. The City can also provide changes in writing. At this early stage, we anticipate that the interviews will focus on ways Bozeman residents experience the community and how their identity and life circumstances impact their ability to thrive in the community. AI’s detailed interview guides provide both quantitative and qualitative data for development of our subsequent data collection activities. In our work for the City of Palo Alto for example, we began by interviewing service providers and used the information gathered to develop surveys of parents and families regarding their needs and barriers to getting services. Similarly, in our work for the City of Santa Clarita, AI began the process of strategic planning and action plan development with key informant interviews of 30 service providers and other key stakeholders who provide services or resources to individuals and families experiencing homelessness in the community. These interviews guided our strategic planning efforts and in the development of feasible actions the City, service providers and other relevant stakeholders could take to prevent and combat homelessness in the Santa Clarita community. Snowball Sampling In order to assist the City in identifying and engaging new stakeholders, we will ask the key informants which other service providers, agencies or organizations are within the provider’s network that have not already been identified. AI will use a snowball sampling technique to recruit these additional relevant stakeholders from within the service provider’s social network to ensure those stakeholders receive an invitation to engage in a key informant interview, attend a community listening session or respond the community survey. Snowball sampling is a technique where known stakeholders recruit additional participants from among their acquaintances, co-workers and peers. Social Network Analysis We anticipate examining several social network descriptive characteristics to further understand the overall network of providers and stakeholders who contribute to advancing equity, diversity and inclusion in Bozeman. During our key informant interviews, we will ask stakeholders to name, for example, the three organizations or individuals they have worked with most closely on equity issues. This allows us to develop an understanding of the network of interrelated organizations working together to advance equity in the Bozeman community. AI will formulate additional questions for the network analysis. Typically, the frequency of interactions related to equity, the frequency and type of communication, sharing of resources and work on new initiatives are central to an analysis of this type. The results will give the City descriptions of the network, including measures of cohesiveness (how closely all organizations work together or if a few organizations work closely with small input from others), the direction of relationships, and whether the network is characterized by "reciprocated" ties Equity Indicators and Gap Analysis for the City of Bozeman 26 | P a g e where each directs a tie to the other. This is indicative of the degree of cohesion, trust, and social capital that is present among those working to advance equity in the community. The example chart below shows the network of organizations working on issues related to homelessness in the city of Santa Clarita, California. The graph was drawn based on answers to the question of how often an organization communicates with each other organization on a topic related to homelessness. Organizations are color-coded by type, so that red nodes (circles) indicate City departments and blue nodes indicate service providers and green nodes indicate school districts. Dark solid lines connecting organizations indicate that they communicate weekly or more often, as compared with the light blue that indicate organizations communicate at least monthly but less than weekly. The size of each node conveys important information. The size of the node indicates the level of “betweenness”, or the proportion of communication in which they connect two or more other nodes that do not communicate with each other directly. A high betweenness score indicates that removal of the organization would have a critical impact on a large sector of the network. As shown in the graph, the City, the Sherriff, a few service providers and a single school district are the most “between” organizations that are key to any network communication. The shape of the network is also important to note. Except for a few organizations (Department of Rehabilitation, Parents in Partnership and the Salvation Army), the network forms a circular, smooth shape. This indicates (with exceptions noted) a well-distributed, evenly dense network. The large amount of information contained in a single network analysis graphic and the large number of graphics that are made possible by a single survey question necessitates a strongly focused analysis. Graphics can be overly complex and include a great number of variables and information. Alternatively, when focused on a single question, they can be quite straight-forward. ACTION Family Counseling Assistance League Bridge to Home Child & Family Center City of Santa Clarita College of the Canyons/Student Health & Wellness Department of Rehabilitation Domestic Violence Center of SCV Family Promise SCVHelp the Children Henry Mayo Newhall Memorial Hospital Newhall School District Parents in Partnership PATH-Los Angeles Real Life Church St. Kateri Parish Salvation Army Samuel Dixon Family Health Center San Fernando Valley Coalition of Governments Santa Clarita Food Pantry Santa Clarita Public Library Santa Clarita Sheriff’s Station Saugus Union School District Sulphur Springs School District Single Mothers’ Outreach Valencia United Methodist Church William S. Hart School District County of Los Angeles Equity Indicators and Gap Analysis for the City of Bozeman 27 | P a g e The network analysis can reveal subgroups or cliques within the network. If the data indicate that cliques are formed based on factors other than participation in homelessness initiatives, those will be important to identify. If the network contains highly segregated subgroups who are not well integrated, it may point to the need for more communication or other efforts toward inclusion. If the network is integrated across naturally occurring divisions, such as organizational type or sector, that may indicate a strength of the initiative and call for analysis between groups or a specialized division of labor between organizations. AI uses UCINet software, which offers flexibility in exporting the matrices to produce visually stunning graphs. Nodes can be color coded according to any color palette, as well as scaled to size to represent an organization’s measure on other variables. AI, if selected for this project, will address the frequency of contact between stakeholders, the level of collaboration and the factors that define network ties. The focus of the analysis will be on identifying how existing resources can be maximized, identifying additional resources and partners from various sectors, ways to leverage untapped resources and partners. Project Website We propose including a website for the assessment, where residents, staff and any community member can review the purpose, methods and timeline of the study, find information on data collection activities such as the details of the community listening sessions or a link to the community survey. The website can provide additional updates such as the number of individuals who attended the listening sessions, the number of surveys completed to date, or preliminary results for a question of interest. This webpage can collect feedback on a “question of the week” such as “How has your understanding of diversity changed over time?” or “tell us about a time when you demonstrated leadership or commitment to equity in your community.” Responses are posted publicly, but anonymously. Visitors often enjoy scrolling through the comments and responses and it brings them back to participate again. Comments are carefully monitored to prevent spam, personal identifying information or other misuses. AI will host the website, which will have a short and easy to remember tiny URL. The link to the website should appear on all collateral, media releases and other promotional material about the assessment such as community listening sessions or survey invitations. We maximize the searchability for the page using search engines, ensure that while colorful and graphic, the site is fast-loading and easy to navigate. Like our key informant guide and all our deliverables, AI will provide the City with a draft website design and a link to the final page for your approval before it is launched. Community Listening Sessions AI will facilitate three community listening sessions that will provide Bozeman residents and other key stakeholders an opportunity to express their experiences and ability to thrive in the Bozeman community as correlated to their identities and life circumstances. AI’s participatory action research techniques ensure that the community listening sessions engage participants, provide meaningful and insightful data, and help AI develop feasible recommendations that will be supported by the community. Through this positive collaborative experience, the City will strengthen and enhance its relationship with community residents and other key stakeholders. Equity Indicators and Gap Analysis for the City of Bozeman 28 | P a g e We anticipate that these listening sessions will be held in person in Bozeman over the course of one week at a variety of times and locations. For example, the project team may consider the following: Day Session Time Proposed Location Tuesday 6:00 PM – 8:00 PM Bozeman Fire Station 3 Wednesday 12:00 PM – 2:00 PM Bozeman Public Library Thursday 6:00 PM – 8:00 PM Montana State University At this time, we anticipate that the community listening sessions can be conducted in person. However, the sessions can be conducted virtually through Microsoft 365 or Zoom should restrictions on large gatherings continue to be in place due to the ongoing COVID-19 pandemic. TASK 1.4: DATA COLLECTION AI proposes sending a mail survey to a sample of households in Bozeman. Survey questions will focus on their experiences in the community as correlated to their identities, how identity and life circumstances impact a person’s ability to thrive in Bozeman, as well as what needs they believe exist in the community to advance equity, diversity and inclusion. The mail survey will also be available for residents to take online. The survey can be promoted through social media or press releases by the City, key stakeholders and other local agencies. Community Survey Development and Sampling AI will work closely with the project team to ensure that the final survey questionnaire addresses all important data priorities. Our expertise in the art and science of survey design will ensure the final questionnaire will obtain valid and reliable data. Even when using established and tested questions, there are still many potential sources of measurement error (wording effects, question order effects, response category effects, etc.). The instrument will be reviewed and revised as needed to minimize and counterbalance these effects. The survey format can aid the response rate. Research shows that survey materials with a familiar logo, such as the City’s seal, can garner a response rate of 15 percent or higher. AI’s professionally designed survey instruments use color strategically on every page. Brief, well-written, easy-to-understand questions complement a range of literacy levels. Sampling Design AI will purchase a list of households with names and addresses for residents over the age of 18. Based on a conservatively estimated response rate of 12%, we will purchase a listing of 5,000 households to receive a statistically valid sample of 600 responses. This number of responses allows AI to conduct subgroup analysis based on race, ethnicity, gender identity, age, income, education level or any other variables of interest. AI is well versed in complex stratified sampling and data weighting. We conducted a Behavioral Risk Factor Survey (BRFS) for Santa Clara County California, working with U.S. Center for Disease Control (CDC) to design a complex sample with oversampling of low-income and Vietnamese residents, and weighted and analyzed the results to CDC specifications. This expertise allows us to talk with the County about strategic oversampling while ensuring statistically reliable results within subgroups such as minority or Hispanic households, low-income, or other demographics of interest to the County. Equity Indicators and Gap Analysis for the City of Bozeman 29 | P a g e Weighting the Survey Results An integral part of sampling is the weighting of the survey results. These two activities, sampling and weighting, are closely related. The weighting of results must consider the sample stratification including the number of strata, the number of sampling stages, the population and sample size. AI uses SPSS Complex Samples to estimate the error associated with a complex, stratified, multi-stage (households, then individuals within households) sampling methodology. We are familiar with both the traditional post stratification weighting, which we used in our Santa Clara County BRFSS work described above, as well as the newer method of raking data, which we used in our work for CDC’s Community Transformation Grant (CTG) evaluation. We anticipate making weighting adjustments for race, ethnicity and gender identity. Our sampling strategy (including selection of individuals within households) is designed to keep these weights at a minimum. The proper use of weighting is not to compensate for bad sampling design, but to correct for natural variations within the sample. For this reason, we monitor the sample closely throughout the survey to ensure that respondents are representative of the population and individual responses are not weighted so heavily that the margin of error increases. Mail Survey AI proposes a mail survey to a random sample of residents in Bozeman. In 2020, mail survey response rates are approximately equal or greater than that of telephone surveys due to caller ID, voicemail and reliance of cellphone service. For this printed, mailed survey, AI recommends using a single 11 by 17-inch sheet of paper, folded in half for a booklet-style, 8 ½ by 11-inch survey. We propose including a cover letter that introduces the survey and its objectives, and requests participation by the recipient and completion of the enclosed survey. This page usually incorporates the City’s logo or another design to establish its local origin. Each survey packet will include: 1. Cover letter requesting participation in the survey 2. Four-page survey for completion 3. Post-card to enter raffle drawing for $100 pre-paid VISA gift card 4. Self-addressed, stamped envelope to return the survey and raffle post-card We propose providing an incentive to improve response rates. We propose offering survey respondents a raffle drawing to win a $100 pre-paid VISA gift card by including their name on a separate ticket enclosed with the survey. The drawing will be held at the conclusion of the data collection period. We recently used a similar drawing for a mail survey of households with school-aged children and received a response rate of 17 percent, despite conducting the school-based survey during summer months. Online Survey To further supplement the response rate and to provide an inclusive process for community members to participate in the survey, AI proposes offering an online survey link that can be posted on the City’s social media or website, or widely distributed through email to residents, community groups and other lists at the discretion of the project team. AI uses our web-based survey software (SNAP) to administer the online survey instrument and can be used in conjunction with the mail survey administration. Equity Indicators and Gap Analysis for the City of Bozeman 30 | P a g e For example, the cover letter included with the mail survey provides the web address or a QR code to access the online survey. The letter provides instructions for the respondent to complete the survey online if the respondent so prefers. We often provide a graphic to advertise the online survey. This graphic includes a QR code, so that a participant can scan the survey invitation on paper or online, to be connected directly to the survey. An example from our recent project exploring the social equity in the cannabis industry is shown to the right. PHASE 2: DATA ANALYSIS Over the course of 20 years of experience working with state and local agencies, we have learned that it is critical to work closely with our client to dive deep analytically into the findings. When developing recommendations, we will work closely with the project team to ensure that the results are presented in a way that is informed by your history and mission. It is often after consultation with the client about key findings that we embark on multiple regression or factor analysis, as a way of answering specific, detailed questions about the findings and data. All our data collection activities including background research and existing data analysis, key informant interviews, community listening sessions and community survey results will contribute to the development of a nuanced understanding of the gaps and other factors impacting the findings. TASK 2.1: ANALYZE DATA SETS TO DETERMINE EQUITABILITY OF EXPERIENCE AI will analyze existing and newly collected data to determine any existing inequities or disparities in community experience. We will compile and disaggregate by race, ethnicity and gender identity. We will look at other equity indicators such as mental health burden, education, economic opportunity and inclusion, social inclusion and belonging, environmental justice, food security, housing affordability and stability, criminal justice, accessibility and access to City services. TASK 2.2: PERFORM GAP ANALYSIS AI offers advanced statistical techniques to provide additional insights and perform gap analysis to ascertain the City’s internal capacity and that of community partners to address any inequities that are uncovered through our data collection activities. The range of techniques enables us to explore underlying concepts and trends, model the effect of changes, and even project into the future. Our staff of research professionals is experienced in the use of such techniques to provide our clients with meaningful insights and policy actions. AI may perform some of these techniques in the data analysis phase, including: T-Tests of Statistical Significance This indicates whether the difference between two groups’ averages most likely reflects a “real” difference in the population from which the groups were sampled. Statistical significance is determined by the size of the difference between the group averages, the sample size, and the standard deviations of the groups. Equity Indicators and Gap Analysis for the City of Bozeman 31 | P a g e Regression Analysis This compares the effects of one or more variables or data points on another and is widely used for forecasting. Multiple regression seeks to understand the relationship between several independent or predictor variables and a dependent or criterion variable. This procedure produces a regression formula that can answer the question “what best predicts the outcome observed or answers to a specific question?” The linear regression formula tells you what factors best predict a given outcome and the degree to which each of these factors contributes to the prediction. For data structures that are not best predicted by linear function, non-linear regression analysis would provide the same answers. Factor Analysis This tool finds the underlying construct behind answers to a series of questions. For clients, it simplifies the interpretation of large datasets. It consolidates many variables into a few underlying factors which drive aspects like satisfaction, image or customer retention. Multidimensional Scaling and Perceptual Mapping This procedure is designed to detect meaningful underlying dimensions that allow the researcher to explain observed similarities or dissimilarities (distances) between the investigated objects. As a result, one can "explain" the distances in terms of underlying dimensions. The technique can assign meaning to these differences through the analysis of attributes or features. Objects are compared and a map is created that shows how respondents compare these objects. It can be used to compare companies, universities, products or services to understand positioning in your customers’ minds. Cluster Analysis Most clients want to know how the demographic characteristics of respondents relate to important questions so that they can segment their constituents. A general question facing researchers in many areas of inquiry is how to organize observed data into meaningful structures, that is, to develop meaningful groups. For example, one may want to understand what market segments exist within a specific region. Cluster analysis groups residents or voters into related clusters with similar attitudes or behaviors and demographics. In general, whenever one needs to classify respondents into meaningful groups, cluster analysis is a useful technique. Discriminant Analysis Discriminant function analysis is used to determine which variables discriminate between two or more naturally occurring groups and is akin to cluster analysis. Where cluster analysis identifies variables of factors that best group segments together, discriminant analysis helps define which variables best differentiate between groups. Discriminant analysis relies on previously defined groups whereas cluster analysis uses information to discover these groups. It is used to determine which variables are the best predictors of membership in a particular group. Equity Indicators and Gap Analysis for the City of Bozeman 32 | P a g e TASK 2.3: DRAFT FINAL REPORT In our final report, we strive to paint a portrait of the data with all its rich complexity and context. To accomplish this, we present the survey findings alongside well-designed charts and rich stakeholder quotes to illustrate key findings. We will provide a draft report and revise the draft considering the project teams’ feedback. We anticipate that our report will include: ❖ Executive Summary that describes the key findings and recommendations. ❖ Introduction providing the background, context and objectives of the project. ❖ Methodology section documenting our mixed methods approach, including data collection and public engagement methodology, framework and records. ❖ Detailed findings based on the data collection activities in visual and engaging formats. ❖ Results of the gap analysis. ❖ Appendices including data sources, interview guides, survey questionnaires, references and other documentation of the research methods and protocols. AI produces a variety of charts and graphs to show the results of an assessment. The example shown below is a logic model developed for the City of Denver, showing that there are three areas of the cannabis industry in which to address disparities in access to the opportunities of the industry: employment as an entry to the industry, ownership of businesses and community restoration for those communities disproportionately impacted by the war on drugs. For each of these areas, we show the existing barriers found through our needs assessment, the recommended criteria for assistance in each area (Application Requirements), recommended form of assistance (Plan Element), and the expected outcomes. Equity Indicators and Gap Analysis for the City of Bozeman 33 | P a g e AI will design a reporting template that enhances the professionalism and aesthetic quality of the reporting. We use: 1. A consistent color scheme throughout the report. 2. Appropriately scaled charts so results can be compared side by side. 3. Color coding of above or below average results for ease of comprehension. 4. Axis labels that are clearly defined within each graph. 5. Sample sizes clearly marked for each graph or table. 6. Word clouds, trees and other visualization for qualitative data analysis. Data visualization and the art of presenting qualitative data obtained through stakeholder interviews is something we take pride in at AI. For example, we recently moderated combined qualitative data obtained through focus groups with quantitative results in a report on how young adults and parents make decisions about the college planning process. AI used word clouds, participant quotations and a chart of quantitative results to demonstrate the results and justify recommendations. Example pages from this recent work are provided below. Presentation to City Staff AI will present the findings to City staff. In doing so, AI will prepare a PowerPoint presentation that includes the methodology, key findings, identified needs, recommendations for the future and aesthetically pleasing graphic visuals. Dr. Amy Flowers is a skilled speaker who has presented research results to national audiences for over 15 years. She conducted a workshop this year at the Global 360 qualitative conference in Amsterdam and has previously presented AI’s work at the Center of Excellence on Disability Research National Conference, sponsored by the Department of Health and Human Services in Washington, DC. Equity Indicators and Gap Analysis for the City of Bozeman 34 | P a g e Dr. Flowers has presented at most of the previous 10 Wisconsin Alliance of Information & Referral Systems (AIRS) annual training conferences and was the Keynote Speaker at the 2014 Annual Training Conference. Information and referral specialists who work with elders and adults with disabilities receive certification credits for attending Dr. Flowers’ sessions at the conference. She has also presented at the National Home and Community-Based Services Conference sponsored by the Administration on Aging and the National Association of States United for Aging and Disabilities (NASUAD). Ms. Leslie Ogilvie has presented the results of several projects on behalf of Analytic Insight, including presenting the results of AI’s study of the Maine School Breakfast Program to the statewide School Nutrition Conference, as well as several presentations to the public and policy makers in Chattanooga, Tennessee, Licking County, Ohio and Oklahoma City, Oklahoma. The slides below are from our recent presentation of a needs assessment and five-year strategic plan addressing homelessness, provided to the City of Chattanooga. PHASE 3: DEVELOP EQUITY INDICATORS AI will work with the project team to develop a list of equity indicators the City should track to monitor progress based on emergent themes from the data collection process and based on what the community has expressed an interest in tracking. AI has experience developing impact and performance indicators on a variety of topics. Each of the strategies recommended in our action plans to reduce and end homelessness include performance measures so the community can track progress and document success to leverage for future investment. Equity Indicators and Gap Analysis for the City of Bozeman 35 | P a g e METHODS AND TECHNICAL TOOLS TO REACH AND INCLUDE COMMUNITY MEMBERS AI’s proposed methodological approach includes many opportunities for inclusive engagement with Bozeman community members. First, the community survey is broadly distributed and promoted to encourage participation from many different residents. This allows us to receive the number of responses necessary to conduct sub-group analysis for special populations of interest. The survey will share some core questions and concepts across all survey participants for comparison purposes, but will also seek to shed light on the specific experiences of each key constituency related to equity and inclusion to best identify patterns and gaps across the Bozeman community. The second way we elicit broad public participation is to provide a dedicated website with project updates, information about the community listening sessions and a link to the community survey, weekly feedback questions and other engagement opportunities. Finally, AI will host three community listening sessions that will offer community members an opportunity to express their experiences and ability to thrive in the Bozeman community as correlated to their identities and life circumstances. Like many organizations, AI has needed to modify and innovate our community engagement strategies to accommodate virtual options in light of COVID-19 safety precautions. To facilitate large meetings and workshops, AI uses Microsoft Teams or Zoom online platforms. Both options offer “Breakout Rooms” that allow a meeting organizer to split participants into multiple online rooms for small group discussion and collaboration. Microsoft Teams and Zoom both provide a grid view of 7×7, which accommodates up to 49 participants at once on a single screen. Other features include the ability to chat and ask questions, as well as using the “Raise Hand” feature if a participant wishes to comment during the large group discussion. Most recently in Licking County, Ohio, AI facilitated a large group meeting using Zoom to present the community’s 2020 homelessness action plan. AI reviewed each of 13 strategy recommendations outlined in the plan with the meeting participants. At the conclusion of each strategy review, participants were asked to answer three poll questions to ascertain implementation efforts moving forward. The poll questions included how the strategy should be prioritized, how easy or difficult the strategy would be to implement, and whether the participant would be interested in working with a team to move forward with the steps necessary to implement the strategy. METHODS AND TIMELINE OF COMMUNICATION WITH THE PROJECT MANAGER AND OTHER PARTIES AI will hold bi-weekly check-in meetings with the project team for the duration of the assessment via telephone, Microsoft 365 Teams or Zoom. We will prepare an agenda for each meeting and distribute it the day before each meeting. The agenda will include an update for activities that have taken place during the previous two weeks, those planned for the upcoming period and any other discussion items. These agendas will provide a formal documentation of the progress of the project. AI will update the project website frequently to ensure that Bozeman community members have the information they need to attend a community listening session or access to the community survey through a link. AI can include weekly feedback questions or other engagement opportunities. AI uses Microsoft 365’s online scheduling platform to invite key informant interview participants to schedule their own interview using our calendar system. This system enables participants to visit the booking page at their convenience, book the time they need and receive a confirmation email and calendar invitation. They can return to reschedule or cancel if needed. Diversity, Equity and Inclusion Consultant for the City of Erie 36 | P a g e SCHEDULE FOR COMPLETING TASKS AI proposes about a 6-month timeframe to complete the assessment and report the results to City staff and other key stakeholders. AI can work to accommodate an alternate project schedule at the discretion of the City’s project team. TASKS AND DELIVERABLES DATES (2021) Kick-Off Meeting Week of January 4 Update meetings with the City’s project team Bi-weekly throughout project Secondary data gathering and background research January 11 – February 12 Develop Project Website and incorporate feedback from the City’s project team prior to launch Launch by February 12 Key informant interview guide development Draft by January 18 Final by January 25 Conduct 30 key informant interviews January 26 – February 19 Community listening session logistics and material development January 26 – February 19 Conduct 3 community listening sessions March 1 – 5 Community survey development and promotional material development Drafts by March 12 Finals by March 22 Survey programming, mailing and promotion March 22 – 31 Survey data collection period March 31 – April 28 All data, social network and gap analysis April 29 – May 22 Draft report Draft by June 15, 2021 Develop list of equity indicators Draft by June 30, 2021 Final report and list of equity indicators Final by June 30, 2021 Present findings in-person to City staff and other key stakeholders TBD Equity Indicators and Gap Analysis for the City of Bozeman 37 | P a g e AI anticipates an initial kick-off meeting in the beginning of January with the final report and list of equity indicators due by June 30, 2021. We anticipate the in-person presentations will be scheduled after the report is finalized. 1/1 1/28 2/24 3/23 4/19 5/16 6/12 7/9 Presentation Develop list of equity indicators Final Report Draft Report All data, social network and gap analysis Survey data collection period Survey programming, mailing and promotion Community survey development and promotional material development Conduct 3 community listening sessions Community listening session logistics and material development Conduct up to 30 key informant interviews Key informant interview guide development Project website development Secondary data gathering and background research Ongoing bi-weekly project update meetings Kick -Off Meeting Equity Indicators and Gap Analysis for the City of Bozeman 38 | P a g e SOFTWARE AND OTHER ANALYSIS TOOLS AI offers a range of quantitative analytical techniques, including complex sampling and weighting, tests of significance, data reduction techniques and measures of association. Our technical competence includes the ability to record, translate and analyze interview data. AI will use a Livescribe Smartpen, which is a pen with an embedded computer and digital audio recorder. When used with its digital notebook, the Smartpen records what we write, which we later upload to our computer, synchronizing our notes with the recorded audio. AI uses our web-based survey software (SNAP) to administer the online survey instrument and can be used in conjunction with the mail survey administration. To analyze qualitative data, AI uses ATLAS.ti software which offers a variety of tools for coding and summarizing data and creating data visualizations. AI can conduct statistical analysis using IBM SPSS Statistics version 23, which includes all analytic modules. Reports are generated using the full complement of Microsoft Office products. SUBCONTRACTED WORK AI staff will complete all work on this project. No work with be subcontracted. Equity Indicators and Gap Analysis for the City of Bozeman 39 | P a g e F. BUDGET Our budget for to provide the City of Bozeman with equity indicators and gap analysis totals $74,574. This is a fixed fee cost that includes all project team hours, materials, supplies and postage as needed, as well as any other costs associated with the services described herein. AI anticipates that Dr. Flowers and Ms. Ogilvie will attend the in-person community listening sessions and presentation to City staff at the conclusion of the project. Our fixed fee cost includes all travel expenses for these in-person events. ESTIMATED HOURS BY TASK The table below provides the estimated hours for each proposed task for each AI staff member, which are represented as follows: 1. AF=Amy Flowers, President and Project Manager 2. LO=Leslie Ogilvie, Senior Research Associate 3. AR= Alisa Raymond, Research Associate 4. JF= Joshua Flowers, Senior Research Assistant 5. SR= Shelia Russell, Research Assistant and Editor Phase Task AF LO AR JF SR Phase 1: Data Collection and Stakeholder Mapping Task 1.1: Project Initiation 12 10 - - - Task 1.2: Background Research 4 4 16 16 - Task 1.3: Stakeholder Engagement 24 66 48.5 56 - Task 1.4: Data Collection 11 18 16 36 30 Phase 2: Data Analysis Task 2.1: Analyze Data Sets to Determine Equitability of Experience 19 29 44 60 16 Task 2.2: Perform Gap Analysis 6 24 20 - - Task 2.3: Draft Final Report 18 76 32 - 32 Phase 3: Develop Equity Indicators Task 3: Develop Equity Indicators 8 24 16 - - TOTAL HOURS 102 251 192.5 168 78 Equity Indicators and Gap Analysis for the City of Bozeman 40 | P a g e COST BY TASK Phase Task Cost Phase 1: Data Collection and Stakeholder Mapping Task 1.1: Project Initiation $ 2,855.00 Task 1.2: Background Research $ 2,466.00 Task 1.3: Stakeholder Engagement $ 19,370.00 Task 1.4: Data Collection $ 18,048.00 Phase 2: Data Analysis Task 2.1: Analyze Data Sets to Determine Equitability of Experience $ 10,828.00 Task 2.2: Perform Gap Analysis $ 3,820.00 Task 2.3: Draft Final Report $ 13,215.00 Phase 3: Develop Equity Indicators Task 3: Develop Equity Indicators $ 3,972.00 TOTAL COST $ 74,574.00 SCHEDULE OF RATES Employee Job Title Rate Amy Flowers, PhD President and Project Manager $ 177.51 Leslie Ogilvie, MPA Senior Research Associate $ 72.50 Alisa Raymond, MPA Research Associate $ 50.75 Joshua Flowers Senior Research Assistant $ 40.85 Sheila Russell Research Assistant and Editor $ 35.50 DIRECT COSTS Direct Expense Cost Travel Expenses $ 5,075.00 Sample Procurement $ 1,500.00 Raffle Gift card $ 100.00 Postage $ 5,500.00 Printing and Materials $ 4,442.84 Community Listening Sessions- Facilities and Refreshments $ 2,250.00 Equity Indicators and Gap Analysis for the City of Bozeman 41 | P a g e G. REFERENCES 1 Colleen S. Wilburn, MPA Title V Manager Project Coordinator, MD Maternal Health Task Force Maternal and Child Health Bureau, Maryland Department of Health 201 W Preston Street, 314K Baltimore, MD 410.767.6716 colleen.wilburn@maryland.gov 2 Molly Duplechian Deputy Director, Policy and Administration Department of Excise and Licenses City and County of Denver 201 West Colfax Ave. Dept. 304, 11th Floor Denver, CO 80202 720.865.2739 molly.duplechian@denvergov.org 3 Amanda Robinson Equity, Diversity, & Inclusion Program Manager 1575 Sherman Street Denver, CO 80203 720.656.9464 amanda.robinson1@state.co.us Equity Indicators and Gap Analysis for the City of Bozeman 42 | P a g e H. AFFIRMATION OF NONDISCRIMINATION (APPENDIX A)