Coutts J&R

Evaluation is the foundation of strong decision making

Welcome to Coutts J&R — one of Australia’s leading evaluation companies. We have the experience and networks to meet your monitoring, evaluation and reporting needs.

Coutts J&R provides you with industry leading expertise and tools to collect, interpret and effectively use information to make the best decisions for your project and program. Our expertise is in establishing evaluation frameworks, planning and undertaking monitoring and evaluation (or mentoring your staff as they undertake the process) and measuring and reporting on impact. Our challenge is to make sure that you have the information you need to make the most informed decisions and meet your reporting requirements.

Contact Details

Phone:
+61 (0)438 361 153
Email:
jeff@couttsjr.com.au
Post:
PO Box 2681, Toowoomba Queensland 4350

Coutts J&R's Blog

Posted by Amy Samson

Many rural, NRM and agricultural organisations invest sometimes significant amounts on communication programs which we all agree can play a vital role in growing next and end user knowledge, awareness and understanding. Why then are these clearly important activities not always measured as rigorously as the research and adoption and extension programs, with communication outcomes clearly linked to and measured against higher level organisational objectives?

An excellent journal article arrived in my inbox this morning from the latest Public Relations Journal by Alexis Bajalia (volume 13, issue 2) – Where Are We Now? Public Relations Professionals Discuss Measurement and Evaluation. Alexis looks at the current state of measurement and evaluation in the PR (and by extension the communications) industry by reviewing excellence and role theories in literature and interviewing PR professionals across different organisations in the US about how they “view measurement and evaluation and the extent to which they use measurement and evaluation findings to influence organizational effectiveness”.  This article has some great takeaways for any comms professional.

I like how Alexis notes that output-level metrics (e.g. impressions, circulation, no. of articles etc) are a necessary first step but the important part for continuing to advance the PR profession, is to link outputs and outtakes (e.g. reaction, tone, click throughs, engagement, followers) with outcomes (e.g. awareness, impact, attitudes, advocacy). Executive level PR professionals she spoke to expressed a high level of awareness of the need for making these connections, particularly noting the management function of PR and the importance of outcome-level metrics, building relationships, and satisfying stakeholder needs.

It’s also interesting how Alexis found through her interviews that PR professionals at junior and executive levels were more likely to engage with and advocate for measurement and evaluation if they had strong relationships with higher level management.

The article is worth a read in full, particularly if you are in comms/PR or interested in measurement and evaluation at all, but I wanted to pull out a few points worth pondering raised in the article.

  • Professionals (executive and junior) who reported using Advertising Value Equivalent or AVE (a metric which equates coverage to equivalent advertising spend) said they do not think the metric is strong or even valid.
  • Executives interviewed pointed out measurement and evaluation challenges as being a need for staff trained in data analytics; the need to develop stronger, more creative ways to measure (beyond outputs); and the need to integrate measurement and evaluation.
  • The findings of the study recommend these steps for PR/Comms professionals who want to improve their measurement and evaluation:
    • determining what success looks like up front by initially defining objectives and key performance indicators;
    • increased planning for and implementation of evaluation research at the formative, process, and summative levels;
    • integration of measurement among departments and platforms to gain clearer, deeper insight about audiences;
    • determining correlations between outputs and outcomes, rather than relying on anecdotal measures or inferences;
    • and a willingness to be critical of what has been done in the past, making room for stronger ways to measure and evaluate public relations.

While this article is based on a relatively small sample and is US based, Alexis points out that her findings line up with decades of literature and contribute new knowledge about the current state of PR (and comms) measurement.  And I agree that this study has a lot to offer and makes good suggestions for continuous improvement, which is what we all should be doing!

The International Association for the Measurement and Evaluation of Communications (AMEC) has developed an integrated logical framework which is a great comms planning tool and extremely helpful for developing meaningful and impact based reporting at the organisational level (e.g. KPIs and objectives).

If you are outcomes and objectives focused when planning your comms program, integrate data collection activities across your organisation, and deliver impact based reports, you are well on your way. If you’re not and want to be able to better plan for and prove the value of your comms program, we’re more than happy to have a chat.

Read more blog posts

News Updates

GGBR project delivers Reef-wide results
QFF sent around a media release recently about the conclusion of the Growing the Great Barrier Reef (GGBR) project and what it had achieved. The release said that the “innovative GGBR project was a significant step in bringing together government, the agricultural sector and natural resource management organisations to proactively work together to minimise soil loss, optimise fertiliser application and pesticide applications, to safeguard the future of the Great Barrier Reef.”

Coutts J&R worked with QFF on the just released final reports and also undertook an independent evaluation of the project early 2019.

Journal of Agricultural Education and Extension webinar
This first webinar of the Journal of Agricultural Education and Extension has an interactive panel of authors who highlight research related to the current thematic issue of the journal: Agricultural Education & Extension Curriculum Innovation” The Nexus of Climate Change; Food Security and Community Resilience”. Watch the webinar here.

Client Project Updates/Newsletters
DCAP’s Northern Australia Climate Program produces a short-term weather forecast on a weekly basis targeted to the Queensland & Northern Australia region – you can view/subscribe to it here.

iMapPESTS: Sentinel Surveillance for Agriculture is a research project aimed at boosting on-farm pest management through rapid and accurate monitoring and reporting of airborne pests and diseases – updates and news about the project can be found here.

New Reef Regulations
The new Reef protections regulations started on 1 December 2019 and will be rolled out over the next three years in different regions based on improved water quality management priorities – more information on the regulations can be found on the Queensland Government website.

New website to support improved Reef water quality
Check out the new Reef 2050 Water Quality Improvement Plan website (www.reefplan.qld.gov.au) featuring videos, podcasts and content to explain the science and encourage land management changes that will improve the quality of water flowing to the Great Barrier Reef.

Agricultural Innovation—A national approach to grow Australia’s future
Following a collaborative stakeholder engagement process, Ernst and Young have developed the shared vision for agricultural innovation.
The vision report is titled Agricultural Innovation—a national approach to grow Australia’s future and was launched 5 March 2019. You can View the report here.

New paper published in The Journal of Agricultural Education and Extension
A paper title Evaluation of rural advisory and extension services has been co-authored by Dr Jeff Coutts. You can view the paper on the journal’s website.

Recent Projects

Coutts J&R worked with Qld Farmers’ Federation (QFF) on its final reports for the GGBR project. This included an in-depth report for project stakeholders including Reef Alliance partners and the Federal Government as well as a brochure for more widespread use.

AgSkilled is a $14.7million NSW Government funded and industry led workforce development strategy, aiming to ensure NSW’s Cotton and Grains industries have a skilled workforce, capable of meeting the challenges of the future. Coutts J&R undertook a mid-term evaluation of the program that reported on its impact and outcomes to date. The evaluation approach consisted of a broad web survey of program participants, stakeholder interviews with key partner organisations/training providers, case studies highlighting specific positive outcomes/practice change, and analysis of any evaluation data already captured by the program.

View more projects