Survey Tool Guide

News

The Survey Tool is a web based tool for collecting CLDR data and includes various features that the contributors (vetters) should know before getting started.

Note: The exact appearance in screenshots may change as the tool is enhanced over time and based on your vetter level.

💡 Helpful Tips

Vetting Phase

At a point towards the end of a Survey Tool period, the Technical Committee will change the Survey Tool to “Vetting Mode”. In Vetting Mode, submitting new data/translations is no longer possible, but you can still change your votes and participate in the forum. (The exception is that you can submit new data if the currently winning value has generated an error or a warning.)

Login and Import of old votes

  1. Go to https://st.unicode.org/cldr-apps/survey/ and log in.

    Log In button in upper right hand corner of Survey Tool

  2. Import of old votes happens automatically the first time you log in and will import all your previous votes if they match the most recently released data. If you have voted previously, you will see a message showing the number of your votes that matched the currently winning votes that have been auto-imported.

    Note: Import of your old votes will take some time, but this will be done only at the first log-in for a new General Submission cycle.

    Notification of number of automatically imported votes

  3. Import old votes manually. You can still import your old voted data that DO NOT match the last released data.

    1. Go to the ☰ Menu, look under My Votes, and choose Import Old Votes.

      Import Old Votes option in menu

    2. You can choose to limit your import to specific items.

      Import selected items option

    3. Scroll to the bottom to see the category selection for bulk import.
    4. Select the categories that you want to import and click the Import selected items button at the bottom.
    5. Go to the data categories in the Survey Tool where you have imported your old votes, these will show up in the Others column with no votes.
    6. Review and add your vote. The best practice is to create a forum entry explaining why this data should be changed and drive to gain consensus with other vetters.

Picking Locales

  1. On the left sidebar, you will see the CLDR locale(s). Your default view will be the languages you have permissions for. All the locales that you have permission to contribute submissions to are marked with PENCIL icon. You can view the others but not submit contributions. For example, if you have permissions to the default language Afrikaans (af), you will not have permissions to Afrikaans (Namibia), and vice versa.

    Local search bar in left navigation bar

  2. Each language is followed by a list of regions that represent specific locales. The locale that is grayed out and preceded by an × is the default. The others are considered “sub-locales”. If you are working on the default locale, select the language name. For example, if you work on Spanish in general (default = Spain), you will see that that Spain is grayed out in the list below: choosing Spanish means that you are working on the default (Spanish for Spain).

    Example of parent language (Spanish) with the default region Spain and other child locales

  3. Only those of you working on a specific variant language (or “sub-locale”) will pick a non-default region. If you work on Mexican Spanish, pick Mexico. (This should already be pre-selected for you.)

If the Info Panel was turned off, click on the Open Info Panel button near the top right of the window.

Voting view

Image of the 7 columns in the voting view

  1. Once you have selected your locale, more options show up in the left sidebar. (The sidebar only shows if you mouse over the > character on the left.)
  2. If the locale is relatively new and not very complete, start working on the Core Data section and go through the rest of the sections. If the locale is mostly complete, then go to the Dashboard (below).
  3. Once you have selected a section, you’ll see a table to enter votes in. The main table has these columns:
    • Code: the code CLDR uses to identify this data point.
    • English: the plain English value of the data point (the text you are to translate).
    • Abstain: the default vote value for you. Only use abstain if you don’t know a good value to be used.
    • A: The value’s current status. A checkmark means it’s approved and is slated to be used. A cross means it’s a missing value. >[!Note:] > A cross is not necessarily bad for sub-locales. If the parent locale has a good value, the sub-locale will inherit it. Check the Winning column.
    • Winning: this is the currently winning value. If the Survey Tool would close now, this is the value we would publish. If the value has a blue star next to it, that means it’s also the value that was published in the previous version. Normally it takes at least two votes from two different organizations to change value: in some locales the bar is lower, and for some items it is higher. It is important to vote to confirm the best item, even if it already appears in the Winning column.
      • An approved value makes it clear to anyone using CLDR data — and to the CLDR-TC — that the value is correct for your locale.
      • An approved value is less likely to be accidentally overturned: Suppose that 3 organizations agree that a value is right, but don’t vote for it, leaving the winning value with a lower status. Later a fourth organization votes for a suboptimal alternative, which then wins, because the winning value was not approved.
    • Add: If the winning value is not correct and is not listed under Others, then use the plus button here to enter the correct value. If you enter a new value, your vote will be applied to it automatically.
      • If what you want is a variation of what is in Winning or Others, there are buttons you can click to copy over the English value or the currently winning value, so that you can have that as the base of your edit.
    • Others: other suggested values, not currently winning, but available to vote for.
  4. Click on one of the radio buttons to make your vote. The winning status changes in real-time so depending on vote requirements and existing votes, your vote may move your desired value to the winning column right away.
    1. Look at the Regional Variants to see if any should be changed: see Info Panel below.
  5. Once you are done with all the sections, go to Dashboard (below).
  6. Under the English column, look for ⓘ for additional information and ⓔ for an example.

Example where both the information and example icons are visible in the English column for an item

Icons

The main panel uses icons to indicate important information and possible problems. After clicking on the Code cell, look to the right-side info panel for more details.

List of icons used in the voting view

(Icons for the Dashboard are listed in the Dashboard Icons section below.)

Special Characters

Some items may use special characters, especially invisible characters.

These will be shown underneath the regular value in an additional box. For example:

h:mm:ss a z

h:mm:ss❰NBTSP❱a z

This indicates that there is a special character that was not visible in the upper line, in this case a no-break thin space, U+202F.

See Key to Escapes for a list with some of the escape characters.

Examples

An example with an ❌ shows a case where the pattern has an inappropriate placeholder substituted. That example should be ungrammatical; if it is grammatical, then either the translated unit or the minimal pair pattern itself is incorrect. The example will show in the Info Panel, and also if you hover over the item.

Info Panel

  1. If you hover over an item (including the English item), a tooltip will appear showing a sample value and usage of the item in context. The item itself will have a white background; other text in context will have a gray background.
  2. When you select an item (the text, NOT the radio button), additional information will show in the right-hand Info Panel. See screenshot below.
  3. Make sure you use a wide-screen monitor and enlarge your window until you can see it, something like the image below.
  4. The box at the top shows information about the code you are translating. It also has a link that you should click on the first type you encounter that kind of item that will explain any “gotchas”.
  5. If there is an error or warning for the item, you see that in the middle.
  6. Below that, you’ll see an example. This is the same as you get by hovering over the item in the center section.
  7. If there are votes, you’ll see a breakdown of them; you also see the number of votes required to change the value. Unicode organization members usually have 4 votes; vetters which are not representing a Unicode organization usually have 1 vote. Your vote value and the vote value required for change will show on the right navigation for the selected item as shown in this screenshot (4 and 8 respectively in this case).
  8. Near the bottom, you’ll see a pulldown menu that shows the values for different regional Variants. Here, you can quickly compare the values and go to different sub-locales to correct inconsistencies.
  9. You’ll also see the New Forum Post button (as shown in the screenshot to the right). This is the easiest way to post discussions for the selected item. Remember that the Forum posts are at language level and not at sub-locale level. For more information, see Forum.
  10. No Info Panel?
    • If you click on the Code cell and there is no Info Panel, you may have turned it off accidentally. Click on the Open Info Panel button near the top right of the window.

Example of what the Info Panel looks like Button to open Info Panel if the Info Panel is currently closed

Inheritance

There are three different ways a value can be inherited. You have the option of voting for an inherited value or entering a different one. For items which are inherited either from a different place in the locale, such as date formats, or from a parent locale you will see a “Jump to Original ⇒” option in the Info Panel which will take you to the place the value is being inherited from.

Inherited values are also highlighted with different colors to make it easier to know where an item is being inherited from.

| Color | Meaning |
| ———— |——– |
| Red | The value is inherited from Root. Only certain types of data can be inherited from Root. |
| Light purple | The value is inherited from somewhere else in the same locale. |
: A common place to see this is in Date & Time : | Blue | The value is inherited from a parent locale. See Regional Inheritance for more details. |

Image of the inheritance colors

Note: Voting on inheritance means “always use the inherited value, even if the value changes in the future.” An inheritance vote is recommended if there are no differences in spelling conventions and political relations between your locale and the parent locale. Voting for inheritance minimizes duplication of data.

Regional Variants (also known as Sub-locales)

Language variants by Region are differentiated as Parent-locale and sub-locales. For example:

Regional Inheritance

If you are voting in a sub-locale such as en_AU, es_MX, fr_CA etc., you can vote to use the translation from the locale you inherit from. You can do this by voting for the translation highlighted in blue box.

An inheritance vote is useful if there are no differences in spelling conventions and political relations between your locale and the parent locale. Abstaining from voting may appear to have the same effect, but if another vetter votes for something different, their vote may cause the winning vote to change. By voting for the blue inheritance value you make your opinion known to other vetters and the CLDR TC.

Whenever you vote for inheritance, you are saying “always use the inherited value, even if it changes in the parent value”. In the screenshot below, this is the case for the vote for “inglĂȘs”. If the parent value eventually changes, the value in your locale will also change. You can vote for a different value in your locale if the value in the parent locale later changes to be something that won’t work in your locale. You can find the list of items where the parent inheritance has changed by checking the Dashboard Inherited Changed category. New items may appear in the Inherited Changed category throughout the General Submission and Vetting phases as vetters in the parent locale vote for items.

Progress Widget

There is a progress widget that shows your voting progress on the page in the upper right corner of the Survey Tool next to the Info Panel toggle. You can see details of your progress when you hover over the widget, including what progress is being measured, and the total number of items remaining for you to vote on in that category. Your progress is measured based on the coverage level you have set, so make sure your coverage level is set correctly at the start of the new cycle.

[!Note:] The progress widget is currently only visible when you are signed in and the dashboard is open.

Page progress

Progress bar shows progress of items on page for your coverage level.

Page progress widget tooltip

Overall progress

Progress bar shows progress of items overall for your coverage level.

Overall progress widget tooltip

Dashboard

The Dashboard will show you a list of data items with warnings of different kinds. Some will require action, some may be false positives. At the top of the Dashboard is a header with a button for each section title (such as Missing) and the number of items. Below that header are a series of rows. The goal is that you should work the Dashboard down to show zero items, then review the Reports (below).

Dashboard option in left navigation bar

Dashboard Summary

There are two ways to clear items from the Dashboard list:

  1. Fix them (such as adding a translation for a missing item).
  2. Hide them (such as for an invalid warning or when the English has changed and you’ve verified that the current translation is still correct).

The first priority is to fix all the Missing items by supplying the correct translations.

Dashboard Columns

There are six columns in the Dashboard view that provide a summary of key information about that item.

Column Description
Dashboard category The first letter of the section name enclosed in a circle.
Data Type The section that the item belongs to.
Code This is a link to the field in the Survey Tool.
English The English value is highlighted in blue.
Winning XX The currently winning value is highlighted in green.
Hide checkbox For items that can be hidden a checkbox to hide that option appears on the far right.

example of the columns for a specific item in the dashboard

How to handle different categories

Following are guidelines on best practices for handling items under each category in Dashboard:

Category Priority Description
Error High The currently winning value has caused an error in validation that will have to be resolved before release. Fix the error. In some cases there is a conflict between items (such as two different items having identical translations) and you’ll need to fix the conflicting item, not the one showing the error.
Missing High These are items where there is no localization provided by any contributor. Click on the line to be taken to the item in the Survey Tool where items are highlighted and you can add a translation. When you fix a Missing item it will turn to Changed.
Losing Medium These are items that you have already voted on, but where your vote is not for the currently winning value. If you can live with the currently winning value — even if you don’t think it is optimal, but reasonable — change your vote to be for the winning item. Otherwise, click the Forum button in the Info Panel and give reasons for why your fellow vetters should change their vote. If others change their vote, the value may still be approved before the end of the cycle. Engage with others on the Forum discussions. Make sure to post good and verifiable arguments as to why others should change their votes and respond to others’ posts. Review all of the items to see if someone else’s item is better and read the forum, and whether you want to change your vote. Discuss in the forum, then use the Hide button to hide disputes you’ve addressed in the forum.
Changed Medium Items show up under Changed because the Winning translation has been changed, possibly due to a Missing item being resolved or just that the winning value changed.
English Changed High These are items where the English source has changed after the last change in translation. Items that are listed in this section indicates that you need to re-check them and assess the impact to your language and update as appropriate. (Sometimes English changes will have no impact to translations, such as changes in capitialization.)
Warnings Medium These are issues which appear after automatic checks. For example, a message could be “The value is the same as English”, which is a quite common warning for languages that are close to English in the spelling of languages or territories. If the value is actually valid, then click on the Hide button (crossed eye). If not, then vote for a fix, or post on the Forum for discussion. Any warnings you’ve hidden will remain hidden during an future CLDR cycles you participate in.
Inherited Changed High The translated value is inherited from another value, and that value has changed. Ensure that the value is still suitable for your locale.
Abstained High These are values where you and the org you represent have not provided any vote at all. It is best practice to have no abstained values for your language and coverage level to ensure high confidence in our release. If you voted for the item in the previous cycle and the same value is still winning but your previous vote didn’t import, please follow Reporting Survey Tool issues.

Example of a missing item in the dashboard

example of a warning in the dashboard for another locale

Reports

The reports show lists of items that need to be reviewed for consistency. Review these last, after you have voted for all the missing and provisional items this cycle, since they will not generate correctly with missing data. Reports can be found in both the dashboard as well as in the left navigation bar between the Dashboard and Forum options.

Left navigation bar view

Example of a section of the date time report:

Example of a section of the date time report

See Review Reports for more details.

Special cases

You may not make changes to this locale

You may see a message like the following when trying to modify a regional locale, like pt-BR.

Brazil is grayed out in left navigation bar example

→

Tooltip explanation of why it is grayed out

The reason that Brazil is grayed out is that it is the default content locale for Portuguese. So to modify pt-BR, you need to simply click on Portuguese. If you do click on Brazil, you will get to a page with the following at the top. Click on default content locale for more details.

warning at on main Survey Tool page when Portuguese (Brazil) is selected

Changing Protected Items

Some items have change-protection in place that will stop the item value from changing without the CLDR Technical Commmittee’s approval, but you can still advocate a change. This is indicated by the message shown below. This warning indicates that the item has particularly broad impact and changes should only be made if absolutely necessary.

Changing Protected Items warning

Request for Review

After hitting that Request button, you’ll see the following.

Request Justification

Steps to flag a protected item for CLDR TC review:

  1. Vote on or Add the item you want.
  2. Click on the “Flag for Review button”.
  3. On the new page, you’ll see a message box.
  4. Enter the change that you want to make, and add a justification for changing it.
    • Make sure that the justification is clear to people who don’t speak your language.
    • Cite sources (web pages) where possible.
  5. Then click “Post”.
  6. Encourage others to support your request by voting for the item you’re requesting.
  7. The Technical Committee will review the change request and
    • accept it, or
    • ask for more information, or
    • reject it with comments

[!Notes] * The Flag for Review button will be available only when the item is under change-protection and there is a vote for an alternative in the Others column. * If you change your vote, it removes the flag — so if you want for it still to be flagged, you have to redo the process above.

Forum

Forum is the place to discuss and collaborate with other vetters on questions and issues in your language. The forum is at Language level and not at sub-locale level; if you are talking about a translation in a sub-locale, be sure that you are clear about that.

It’s a best practice to create a Forum post whenever you propose a change to a previously approved value, and provide an explanation and links to references.

Forum Etiquette

While creating New Posts on Forum or participating in discussions please follow these general etiquette guidelines for best productive outcomes:

Forum post workflow

  1. Create a new Request
  2. Responses by other vetters in your language with Agree, Decline, or Comment.
  3. Once resolved, the creator of the the initial Request closes the post.

Note: Any posts where the requested value becomes the winning value by the end of the CLDR cycle will be automatically closed by the CLDR TC.

How to create a new forum post

A forum post can be specific to a particular data point or a general issue. In either case, create a new forum post to an item.

Create forum posts from the Info Panel in the voting window
  1. Vote on an item (or add new +) for the item you want to suggest changing.

Add a new item and vote for it

  1. In the Info Panel on the right, there are two buttons to indicate the type of forum posts:
    1. Request You have voted on a non-winning item, and you want to Request others to change their votes.
    2. Discuss - Currently only TC members can make discuss posts.
  2. Click Request button and fill out the details of your request. (Note: The Request button is disabled unless you have voted)

Request button

Request

  1. A precomposed text is included to help start your post. Important!: Request works WITH the item you voted for currently.
  2. Please consider voting for “{your voted-value}”. My reasons are: Complete the text by filling out your reasons and links to references.

Add your reasons to changing the value to the request post draft

  1. Then Submit.

Responding to Request posts

There are two ways to respond to forum posts:

Respond from the Info Panel in the voting window.

In the Info Panel, select the Comment button

Forum Post example from the Info Hub

Choosing your Response: Vote, or Comment

  1. When you make a vote on an item that already has a Request post by another vetter, then an Agree or Decline post will be made for you automatically. If you agree with the reasons for change, you aren’t required to add explanations for agreeing unless you believe it is important to add additional explanation for linguists or the CLDR TC so that the decision during this cycle is not accidentally overturned in a future cycle due to missing information about the original change.

  2. An Automated Agree post will be posted if you vote for the requested value with a precomposed reply: (Auto-generated:) I voted for “{requested-value}”

  3. If you later change your vote to something other than the requested value an automatic response will be be posted with the precomposed reply: (Auto-generated:) I changed my vote to “{requested-value}”, which now disagrees with the request.”

    Example of an automatically generated response by changing votes

  4. Comment: Use this option if you do not Agree, and you have other input to bring to the discussion or if you want to ask for more information.

View of comment button on a forum post

Responding to Discuss posts

Currently only the CLDR TC can post Discuss posts. They will post a Discuss post whenever feedback is needed from the linguists for a specific locale. Feedback is needed in two cases:

  1. Resolving errors during the Vetting and Resolution phases
  2. Resolving issues reported in the public CLDR Issue tracker in JIRA

Forum posts for CLDR JIRA ticket feedback

CLDR users can send in data feedback using JIRA. Tickets filed in JIRA will be processed as described below. Please expect to see posts by CLDR Technical Committee members (TCs) in Forums, and participate by providing your response to any tickets needing your input.

The goal is to bring it to the attention to all linguists contributing in a particular language, and gather their input, so an informed decision can be made and/or suggested.

  1. CLDR TC members accept JIRA tickets.
  2. For each ticket assigned to them, the TC member will post a forum topic in each language mentioned in the ticket, asking for vetters to look at the issue and either make the requested change, or explain in a forum post why changes should not be made.
  3. A reason for not changing could be for example that it is a reasonable change, but doesn’t exceed the ‘stability’ bar in the translation guidelines.
  4. TC members will monitor the forum discussion/change during the Submission phase, and will close the JIRA ticket after the forum discussion is concluded.

Working in the Forum view

In the Survey Tool Forum view, there are multiple filtering options available for you to work more effectively.

  1. The Forum view can be accessed from the left navigation Forum.

Forum option in the left Navigation bar

  1. By default, the filter is for Needing action.

Filter options drop down

  1. Filter options:
    • Needing action: Forum posts included in this filter are Requests and Discussion posts by someone in your language. You have not yet taken action on either agreed or declined or posted a discussion asking for additional information. For Discussion posts, these are where you are not the last poster.
    • Open requests by you: Forum posts included in this filter are Requests that you have posted that you have not closed yet.
    • All Open topics: All posts that are open. This includes both Request and Discussions that have not closed yet.
    • All topics: All topics, open or closed, including forum posts from previous releases.

Respond to forum posts in the Forum view

In the Forum view, you can respond to Request post by voting for the requested item. This will trigger an automatic post with the text: “(Auto-generated:) I voted for “REQUESTED ITEM”” or by clicking on the “Comment” button to explain why you disagree with the proposal.

See Responding to Request posts in Info Panel.

Example forum post

Forum email notifications

  1. Another way to check for posts that may need your attention is to review email notifications to the e-mail account for your locale. You can delete these notifications if they are for changes initiated by you. You can open the post directly from a link in the email.
  2. When you make a forum entry, it will be emailed to all other linguists working on locales with the same language, parent or sub-locale (i.e. forum is at Language level and not at sub-locale level). If you are talking about a translation in a sub-locale, be sure that you are clear about that.

Reporting Survey Tool issues

If you run into a problem with the Survey Tool functionalities or if the documentation doesn’t match the current Survey Tool experience, please see FAQ & Known Bugs to see whether it has already been reported (and whether there is a work-around).

If there is a PM (Project Manager) managing contributions for your organization, please report the issue to your PM. To get support for DDL locales check the DDL: Help Center for instructions.

Advanced Survey Tool Features

  1. Users familiar with CLDR XML format can upload votes (and submissions) for multiple items at once. See Bulk Data Upload.
  2. Organization managers can manage users for their organization (add, remove, send passwords, set locales, etc.). For more information, see Managing Users.
    1. Some users may want to reset their Coverage Level, with the menu that looks like the image to the right.
    2. The Coverage Level determines the items that you will see for translation: the minimal level has the highest priority items. You normally start with the level marked “Default” (which will vary by your organization and locale). Each successively higher level adds more items, at successively lower priorities. You will not normally go beyond “Modern”, unless you have special instructions for your organization.

[!Note:] Some companies won’t use the data until it is complete at a certain coverage level, typically_ Modern.

Coverage level menu