Add and Edit Matrix Questions in Engagement Questionnaires

Shasa McCarogher
Shasa McCarogher
  • Updated

Efficiently collect structured feedback across multiple topics by adding matrix questions to your engagement questionnaires. Matrix questions allow respondents to evaluate several items using the same scale or response options, making them ideal for rating multiple services, comparing priorities, or gathering consistent feedback across related topics.

Quick Steps

  1. Navigate to Ask > Surveys > Build select your survey

    listing page.png
  2. Drag "Matrix" from the Content sidebar under "OTHER"
  3. Drop the question into your desired position in the questionnaire
  4. Configure question text, row labels, and column labels in the modal that opens automatically

    matrix.png
  5. Click "Save" to apply changes and see the in-builder preview

In-Depth Guide

Adding a New Matrix Question

Access the Questionnaire Builder Navigate to the Engage section and go to the Activities listing screen. Find your engagement questionnaire and select "Edit" to open the Questionnaire Builder interface.

Add the Matrix Question From the Content sidebar on the right, locate "Matrix" under the "OTHER" section. Drag the Matrix element and drop it into your questionnaire at the desired position.

The questionnaire builder will display a drop zone where you can position your new question. Release the Matrix element when the drop zone appears in your preferred location.

Configure Question Settings Once you drop the Matrix element into your questionnaire, the configuration modal automatically opens. Enter your question text in the main question field. Write clear questions that introduce the matrix format. For example, "Rate your satisfaction with each of the following city services" or "How important are these community improvement priorities to you?"

Add Support Text (Optional) Use the Support Text field to provide additional context, instructions, or clarification about how to complete the matrix. This text appears below the main question and can explain the rating scale, provide examples, or clarify evaluation criteria.

Create Row Labels In the "Row Labels" section, enter the items that respondents will evaluate. Each row represents a different topic, service, or item to be rated. Use the "Add Row" button to include additional row items as needed. Examples of row labels might include:

  • "Public transportation"
  • "Parks and recreation"
  • "Snow removal"
  • "Road maintenance"

Create Column Labels In the "Column Labels" section under "Options," configure the response scale that will apply to all rows. Enter the rating or response options that respondents can select for each row item. Use the "Add Column" button to include additional column options. Examples of column labels might include:

  • "Very Dissatisfied, Dissatisfied, Neutral, Satisfied, Very Satisfied"
  • "Not Important, Somewhat Important, Important, Very Important"
  • "Never, Rarely, Sometimes, Often, Always"

Use Suggested Options (Optional) Toggle the "Use Suggested" setting to access pre-built column label sets for common municipal feedback scenarios. This can save time when creating standard rating scales or response options.

Configure Advanced Settings Several toggle options allow you to customize the matrix behavior:

  • Include "Not Applicable" Option: Adds a "Not Applicable" column option for situations where respondents cannot evaluate certain row items
  • Allow Multiple Selections Per Row: Enables respondents to select multiple column options for each row instead of just one
  • Randomize Rows: Presents row items in random order to each respondent to reduce order bias

Mark as Required (Optional) Toggle the Required Question setting to make the matrix question mandatory for questionnaire submission. Required questions must be answered before respondents can proceed or submit their responses.

Save Your Configuration After configuring all settings, row labels, and column labels, click "Save" to apply your changes. The modal will close and you'll see an in-builder preview of your matrix question within the questionnaire.

Editing Existing Matrix Questions

Locate and Select the Question In the Questionnaire Builder, find the matrix question you want to modify. Click on the edit icon on the question block to open the configuration modal and access all editing options.

Modify Question Content Update the question text, support text, row labels, or column labels as needed. You can add, remove, or reorder rows and columns using the provided controls. Click "Save" to apply your changes and close the configuration modal. Once saved, you'll see an in-builder preview of your updated question.

Manage Matrix Structure Add new rows or columns, remove existing ones, or modify labels to ensure your matrix captures the feedback you need. Ensure that column labels work appropriately for all row items.

Adjust Response Settings Modify settings like multiple selections per row, "Not Applicable" options, or randomization based on how you want respondents to interact with the matrix. Consider how these changes might affect data analysis and interpretation.

Reorder Questions Reposition matrix questions within your questionnaire flow using two methods:

  • Drag-and-drop: Click and hold the question block, then drag it to a new position. The questionnaire will show drop zones indicating valid placement locations.
  • Toolbar: Use the reordering options available in the question's toolbar for precise positioning.

Remove Questions To delete a matrix question, use the delete option in the question's toolbar. The question will be removed immediately without a confirmation prompt.

Question Design Best Practices

Choose Consistent Row Items Select row items that can all be meaningfully evaluated using the same column scale. Mixing different types of items (services vs. priorities vs. demographics) in one matrix can confuse respondents.

Create Balanced Column Scales Use column labels that provide balanced, comprehensive response options. Ensure the scale is appropriate for all row items and offers sufficient granularity without overwhelming respondents.

Limit Matrix Size Keep matrices manageable with 3-8 rows and 3-7 columns. Very large matrices can become overwhelming and may not display well on mobile devices.

Consider "Not Applicable" Options Include "Not Applicable" when some respondents may not have experience with certain row items (e.g., services they haven't used).

Use Clear, Distinct Labels Ensure row and column labels are concise and clearly distinguishable. Avoid similar-sounding or overlapping categories that might confuse respondents.

Methodology

Matrix Response Collection Matrix responses are captured as individual selections for each row-column intersection. The system records which column option was selected for each row item, creating structured data for analysis.

Multiple Selection Processing When multiple selections per row are enabled, all chosen column options for each row are recorded and can be analyzed individually or in combination.

Row Randomization When randomization is enabled, each respondent sees row items in a different random order. Column labels maintain their original order while row presentation varies to reduce position bias.

Not Applicable Handling "Not Applicable" responses are recorded as distinct values and can be filtered or analyzed separately from substantive rating responses.

Language Support Matrix questions support multi-language engagement questionnaires when configured. Question text, support text, row labels, and column labels are all translated consistently across supported languages.

Edge Cases, Exceptions & Known Issues

Drag and Drop Functionality

  • Questions must be dropped in valid drop zones within the questionnaire area
  • Dropping questions outside the builder area will not add them to your questionnaire

Matrix Size Limitations

  • Very large matrices may not display optimally on mobile devices or smaller screens
  • Matrices with many columns may require horizontal scrolling on mobile devices
  • Complex matrices may affect questionnaire loading times and user experience

Row and Column Management

  • Deleting row or column labels after responses have been collected may affect data integrity
  • Empty or duplicate labels will trigger validation errors when saving
  • Very long label text may cause layout issues in the matrix display

Multiple Selections Behavior

  • Converting from single to multiple selections after data collection begins may confuse respondents who already completed the questionnaire
  • Multiple selection data requires different analysis approaches compared to single-choice matrices

Randomization Considerations

  • Row randomization applies to presentation order only; row labels and content remain unchanged
  • Some logical sequences (like chronological or hierarchical lists) should not be randomized
  • Randomization settings cannot be changed after significant data collection without affecting response patterns

Response Completion Requirements

  • Required matrices may need clarification about whether all rows must be completed or just some
  • "Not Applicable" options may affect completion requirements and should be considered in required question design

Was this article helpful?

/

Comments

0 comments

Article is closed for comments.