rapidpro / ureport

Dashboard module for UReport working against RapidPro data

RapidPro

RapidPro is a platform for visually building interactive messaging applications. To learn more, please visit the project site at http://rapidpro.github.io/rapidpro.

Stable Versions

The set of versions that make up the latest stable release are:

• RapidPro 8.0.1
• Mailroom 8.0.0
• Courier 8.0.2
• Archiver 8.0.0
• Indexer 8.0.0

Versioning

Major releases are made every 6 months on a set schedule. We target January as a major release (e.g. 9.0.0), then July as the stable dot release (e.g. 9.2.0). Unstable releases (i.e. development versions) have odd minor versions (e.g. 9.1.*, 9.3.*). Generally we recommend staying on stable releases.

To upgrade from one stable release to the next, you must first install and run the migrations for the latest stable release you are on, then every stable release afterwards. For example if you're upgrading from 7.4 to 8.0, you need to upgrade to 7.4.2 before upgrading to 8.0

Generally we only do bug fixes (patch releases) on stable releases for the first two weeks after we put out that release. After that you either have to wait for the next stable release or take your chances with an unstable release.

ureport's Issues

Country flag mismatch for different hosting providers

We were using settings.PREVIOUS_ORG_SITES to get country sites hosted on other providers, and each providers was responsible to customize that to have links of the other providers.

Now all the countries flags will be configured in settings.COUNTRY_FLAGS_SITES and those are the only that will be shown on the flags overlay and in a more consistent way across all hosting providers
We no longer use dynamic flags from Image model and we will rely on the flags in static/img/site_flags folder.

Each hosting provider will be responsible to check all sites are added properly with the right count link configured

Add Viber on U-Report

Hi everyone, I want to discuss the possibility to add Viber configurations on U-Report. Bulgaria UReport needs to use Viber because Viber on their country is more used than other social networks.

I want raise the impact to implement this, and how to implement this.

I studied the code, and I got it some points to implement.

1 - Add Viber fields on org_config_fields defined on settings
2 - Configure templates to support Viber fields. The templates to configure are:

• base_admin_dashboard.haml
• frame.haml
• public_base.haml

There are many points to do beyond these?

Thanks for help and attention.

Regards.

ImportError: cannot import name get_redis_connection

Traceback (most recent call last):
File "manage.py", line 8, in
execute_from_command_line(sys.argv)
File "/home/administrator/workspace/ureportenv/local/lib/python2.7/site-packages/django/core/management/init.py", line 338, in execute_from_command_line
utility.execute()
File "/home/administrator/workspace/ureportenv/local/lib/python2.7/site-packages/django/core/management/init.py", line 312, in execute
django.setup()
File "/home/administrator/workspace/ureportenv/local/lib/python2.7/site-packages/django/init.py", line 18, in setup
apps.populate(settings.INSTALLED_APPS)
File "/home/administrator/workspace/ureportenv/local/lib/python2.7/site-packages/django/apps/registry.py", line 85, in populate
app_config = AppConfig.create(entry)
File "/home/administrator/workspace/ureportenv/local/lib/python2.7/site-packages/django/apps/config.py", line 119, in create
import_module(entry)
File "/usr/lib/python2.7/importlib/init.py", line 37, in import_module
import(name)
File "/home/administrator/workspace/ureport/ureport/admins/init.py", line 1, in
from dash.orgs.models import Org
File "/home/administrator/workspace/ureportenv/src/dash/dash/orgs/models.py", line 18, in
from dash.api import API
File "/home/administrator/workspace/ureportenv/src/dash/dash/api/init.py", line 6, in
from redis_cache import get_redis_connection
ImportError: cannot import name get_redis_connection

Single widget pages

ureport/templates/v2/public/index.haml

Line 258 in a239263

if($(".social-media-blocks").children().length > 1) {

When a country uses only one widget its div isn't being displayed because it's missing open parameter.

Error on categories display when RTL language

Current:

How it should be:

One string is not internationalized

I found a string that is not internationalized.
https://github.com/rapidpro/ureport/blob/master/templates/public/index.haml#L101

Map on Each PollQuestion

Hi everyone, we have noted that the maps on each PollQuestion aren't available anymore. Some users asked for this feature, and the possibility, that we do rollback for this. For these users, this feature is very important, because they planning a map with many levels and this will enrich each PollQuestion especially with the location of the contacts. Is there a possibility to add this feature again?

Pie chart tooltip text is outside of tooltip box on right-to-left lang sites

Example from http://syria.ureport.in/

Website's FB chat widget needs update

The Facebook widget wasn't loading up anymore. Went though FB's doc and this is why:

Starting on January 8th, 2019, you will no longer be able to request the Customer Chat Plugin with the following URL: https://connect.facebook.net/en_US/sdk.js. If you do not switch to the URL stated below, the plugin will not render on your website.

Console message

The CustomerChat plugin is no longer part of the main Facebook SDK.
To continue using it please use the correct SDK URL, meaning replace sdk.js with sdk/xfbml.customerchat.js.
For more details see https://developers.facebook.com/docs/messenger-platform/discovery/customer-chat-plugin/sdk

Answered Question Counter

When a ruleset is set to continue after a long period without reply, a counter of answers informs that 0 people have answered this ruleset.

No response ruleset

Categories

Exemple at U-Report

Would be a project definition don´t show the counter when a ruleset continue without an answer, or it´s not a normal behavior and needs to be fixed?

See the line:

ureport/ureport/polls/models.py

Line 1033 in 916ed31

if category or (self.category is not None and self.category.lower() == 'no response' and text):

Size limit of characters alert

Hi guys,

Yesterday I got a feedback from France saying that would be good if we could implement a way to alert them when they are exceeding the numbers of characters during a flow construction, for example, the field Category that only allows them to use 35 characters, would be good if we could implement a counter, a red alert or just don´t allow them to write more.

What do you think?

Alpha Issues

Just starting a monster issue to track things that need doing:

• video on homepage needs to be country specific
• should use block (or config value) for join message
• use block for engagement page
• use block for photos title / content
• use blocks for join steps
• use block or config for engagement callout on bottom
• use block or config for opinions header
• use block or config for join header
• use block or config for stories header
• faq page needs max width treatment
• jobs page needs max width treatment
• scale font size on index poll, poll page, questions and story titles based on length
• another go at left angle on homepage
• change engagement page top to be all time stats
• engagement stats precalculated (say at midnight) and cached for 24 hours so we never have cache misses
• search styling
• search jumping on click
• search via year / month
• reduce GIANT circle numbers
• full theme colors

Adding all Org config fields to the edit org form form

A couple of configs like [reporter_group, born_label, gender_label, occupation_label, registration_label, state_label, district_label, male_label, female_label] are not of the edit org form /manage/org/edit/. Since there is also no documentation on this, this makes it quite hard for someone new to start up a ureport.

Although all the required fields are listed in ureport/settings_common.py as ORG_CONFIG_FIELD. I am wondering if there is any specific reason why these are not on that form, and if none, should I add them?

Update the results of polls

It is happening when the category changes in flow in the RapidPro, the results of the "old" category be forgotten and start counting from the new. This is normal?

Count poll participants based on unique contacts

Currently the response rate and figures shown for poll results (for example: "54% RESPONSE RATE 97 RESPONDED OUT OF 178 POLLED") are based on number of flow runs. This means that if the poll is restarted for a set of contacts, then they will have a second flow run and thus will be counted as two participants. This is misleading and calculates a lower response rate than the actual response rate.

Stories display

Hi guys,

Today the guys from Brazil asked us to hide the stories from the home page, however, it´s not possible unless if I remove them from the whole site, even from the story tab.

When I uncheck the box "Is featured" in my opinion, the story should be "removed" from the home page and should continue to be displayed on the story tab, however, it´s the opposite when I unselect the box, the story is removed only from the story tab and still available on the home page.

What do you think about this?

Right to Left Support

Still open issues here, just creating placeholder ticket.

"/sitestatic/" need to replace with "{{ STATIC_URL }}"

"/sitestatic/" in follow templates:
templates//404.html
templates//500.html
templates//public/index.haml
templates//public/org_chooser.haml

Add Google Tag Manager on UReport

Some customers have raised the idea and the need to use Google Tag Manager with UReport. They want to set up some UReport pages with Google Tag Manager to be able to track statistics on campaign launches and visitor engagement.

There is a possibility of integrating Google Tag Manager with UReport, and how could we do that?

Different age graphic display

The age chart is displayed differently in different pages. On the home page it is displayed with divergent data, since the U-Reporters page shows exactly the opposite of the homepage. This happens when we use the Arabic language (see screenshots).

Home page:

U-Reporters page:

Requesting code for South Africa uReport version

Hi,

We've been asked to setup the ureport site for South Africa . Would it be possible to get a code dump (or point us to the repo) for sa.ureport.in.

We have a site running on the new code base but need the templates used for the visual styling.

Thanks for your help with this.

Matt

Polls with results lower/higher than 100%

Hi guys,

We received a feedback from the guy from Syria that some polls results were lower/higher than 100%, and doing a search I saw that in Nigeria for example, they have the same "problem".

We were thinking that it could be the numbers after de comma (33,33%, 33,33% and 33,33% for example), and as we do not display these numbers the site only shows 99%/101% in some cases.

Do you have any issue opened about it before? Or have any idea what is causing this?

Allow administrators to configure additional registration data to display

In Nepal, for example, a 'referral source' is collected during registration
Thank you for registering on U-report, @contact. From where did you know about U-report? Answer with A B C or D A.Scout B.Child Club C.Radio D.Other

Would be nice for admins to be able to display registration stats in addition to the standard gender and age breakdowns

Label for States should be Customizable

We use "States" and "Districts" generically to refer to 1nd and 2nd level organization units. We should allow organizations to customize this so maps make sense in their context.

Romanian idiom

Hi guys, we are adding Moldova into the project and we need the Romanian idiom available. I saw that they already translated 99% of the strings, would be welcome a poll request with this new idiom?

Join & Engage steps - Using links or HTML tags not working!

On Join steps session (Link) typing URLs doesn't turn it into links on the website.

This is the editing opting using https://m.me/ureportromania?ref=triggerFacebook

That's displayed like this (the text Link session nor the URL typed works)

You can check that at https://brasil.ureport.in/join too

Tried using HTML tags, but it places tha tag code, not the link!

Nice to switch poll page stats to use PollStats data

Later on we can remove PollResultsCounter table

Can't create new poll, flow doesn't have attribute participants

file locate: ureport/utils/init.py, 237
statement: flow_json['participants'] = flow.participants

Cutting the chart description when displayed in Arabic

We note that in some cases the chart title, depending on the amount of characters, is cut only when it is used the Arabic language, see the following screenshot:

Squash poll stats

UReport doesn't load preview in SocialNetworks.

Hi everyone,

When we get a link from UReport like stories or home, the preview image don't load on external websites, like Facebook or LinkedIn.

I've made some tests, with the organization that has a subdomain, and with global UReport that doesn't have a subdomain.

With stories from global UReport works normally on Linkedin.

With subdomain doesn't load.

On Facebook with a subdomain on UReport, the preview load with the first

There are a configuration or something to deal with?

Automatic result feedback for ureport poll by admin boundary

IE, sending people in a state that these are the results in your state for this poll question.

Alignment of the last response box

Hi guys,

We have detected that the alignment of the last response box when the language is Arabic (right to left) is bigger than it should be to the left.

And as you can see, for the other languages (left to right), we don´t have this spacing so large.

We are thinking that it´s only a detail in the CSS code.

Importing Data with date

Hi guys,

I was trying to import an excel file with a date on it (DD/MM/YYYY) as set in the organization, however, the system does not accept this configuration, and only accepts the American format (MM/DD/YYYY).

I think that it should take the org configuration instead of having a standard for it, here in Brazil we do not use (MM/DD) and will be hard to ask our users to always change this before uploading a file.

Can we make it happen?

Mobile layout / responsiveness

Placeholder.

Missing main poll map data

Hello guys, we just identified that a few country maps are not presenting their data in the main poll, even after a few ureporters have been participated. The maps still showing 0 ureporters.
Countries identified:

• https://burkinafaso.ureport.in/v2/opinions/
• https://costarica.ureport.in/v2/opinions/
• https://congobrazzaville.ureport.in/v2/opinions/

We have been searching for the source of the problem, we’ve tried resyncing orgs locally forcing tasks like "results-pull-main-poll”. @norkans7 We have checked the function "pull_results(cls, poll_id)" inside models.py from the polls app, we also reviewed the code on these sync tasks looking for any implementation problem but we couldn't track the source of the problem. We suspect that this issue is related to character encoding.

Do you guys have any suggestion to point related to where probably lays the source of this problem?, we are open to help fixing this issue.

See the pictures below:

While upper country levels still empty, when we enter inside state/district levels the ureporters data becomes available.

Add level indicator field on Org to complement "Limit States"

Normally in a RapidPro Org, it has a map with a single country as level 0, so the states are with level 1 and cities with level 2. In our infrastructure we have some customers who have the need to contain several countries in one Rapidpro Org, in this case, the union of all countries on the map would be level 0, a specific country would be level 1, and then level 2 would be for states or districts.

Several of our U-Report instances can use a single API-Token from a RapidPro Org. So for each country where the map in Rapidpro represents level 1, can make the selection of the map using the "Limit States" filter, however, when using this limit, the query returns only the information that is at the level 1 (countries in this case), without state details (in this case, level 2). We need to list the states contained in the country limited (level 1), that is, list all those that have level 2 and that are children of the country specified by the "Limit States".

To solve this, we can add a new field for Org in settings_common.py, it would be required=False after that, to query the data in the render_to_response method, in ureport.public.views.BoundaryView, making 1 a value default, it would be used on line 488, representing the level value to be filtered, example:

• ureport.public.views.BoundaryView.render_to_response line 488

- location_boundaries = org_boundaries.filter(level=1)
+ location_boundaries = org_boundaries.filter(level=level_limit_states)

Make admin page available via both for old design and new

Currently the main public site is available in both the new design and old one via different URLs.

We want to allow the same to be true for the admin site so that users can opt in/out as they want.

Issue with running ureport

Hello!

I am trying to build a POC with ureport connected to a rapidpro instance. After following the instructions outlined in the , installing the requirements, migrating the database, and finally calling to the published address, all I'm getting is an exception:

Exception Type: | AttributeError
-- | --
'NoneType' object has no attribute 'get_gender_stats'
/opt/ureport_src/ureport/public/views.py in get_context_data, line 54

which is:
/root/opt/ureport_src/ureport/public/views.py in get_context_data
        context["gender_stats"] = org.get_gender_stats() 

Could you hint any possible causes for this?

Thank you in advance!

Error in location for participation chart

Current:

How it should be:

Improving map display

Hi guys,

Some countries are complaining that their map is not being displayed properly, usually, the south part of the country is being cut off. See some examples:

Are there any work in progress to fix this? If not, we are willing to work to solve this.

Permalinks to poll question results

Would be nice to be able to link to the results of a specific question in a poll (ideally even link to the map view rather than chart view)

Inline links for editing

Anywhere on the site where there is content on the site that can be edited and the user is logged in, we should add a quick edit link that appears when they hover over that content.

This should include: polls, quickblocks, admin text configs, stories etc..

Idea on presentation, circle button with fa-pencil

Some colors not appropriate for buttons

If a country office picks yellow as a color and we then use it as a button color, then white text on that color doesn't work well. We should figure out how to deal with this.

Options:

1. Allow picking of contrast color
2. Try to do something fancy where we detect if contrast is insufficient and deal with it
3. ???

@norkans7 if you can give some examples that would be useful.

Some words aren't appearing in the tag cloud

I have some words that aren't in the tag cloud, but they are in the database.
I confirmed this using the query below:

SELECT w.label, count(*) AS count 
FROM (SELECT regexp_split_to_table(LOWER(text), E'[^[:alnum:]_]') AS label 
FROM polls_pollresult WHERE polls_pollresult.org_id = my_org_id AND polls_pollresult.flow = 'my_flow_uuid' AND polls_pollresult.ruleset = 'my_ruleset_uuid' AND polls_pollresult.text IS NOT NULL AND polls_pollresult.text NOT ILIKE 'http%') w 
group by w.label
order by count DESC;

The "educación" word, for example, is returned about 72 times, but it isn't in the tag cloud.
In the code there a method to ignore some words, could it be the reason?

Localize Javascript Strings

The following strings need to be localized as well, they are in JS land so we need to build a new PO file for JS and use Django's mechanism to pull in the localized version on pages that use them.

polled
All States
Participation Level
Results
Responses
Reporters in All States
Other*
Other answers include
National
State
Registered in All States
% of the total
Registered

Twitter profile widget

Twitter made changes in the way to get the widget's user profile timeline.
You are now directing the user to the https://publish.twitter.com link and generating an embed code like <a class="twitter-timeline" href="https://twitter.com/TwitterDev">Tweets by TwitterDev</a> <script async src="//platform.twitter.com/widgets.js" charset="utf-8"></script>.
Someone is already working to solve this problem? How could I help solve it?

RSS feeds for stories

RSS isn't dead! would be nice to expose feeds for stories

String 286 from Transifex needs to be internationalized

On Transifex is the strings that says:

U-Report is a free program sponsored by UNICEF with help of Network Providers in . U-Report will not ask for any payments nor personal financial information, PLEASE disregard any messages which ask you for payment either on this number or on the Facebook and Twitter pages. All U-Report services (all msg on ) are free.

Displayed at

https://brasil.ureport.in/join

Beta Issues

All

• Button rollover states - what’s the easiest global change we can make? I’m thinking all rollovers fade background of button by like 20%?
• Can we be sure that all yellows, greens, blues, etc are the same? For example, you said Mexico has two yellows… I don’t think that should be the case. Can we confirm?

Home

Latest Opinion Section

• Add Margin entire above Latest Opinion section (basically just space between the header, and this would be the case for the landing pages as well. See the Invision for spacing.
• Related to above, add padding above the chart on the Latest Opinion background so the graph paper doesn’t perfectly line up with the top of the color block to the left, about 25-30px or so.
• Latest Opinion section - On the Mexico site for example, the green background to the left looks good, can we make the chart be the same color as the left always? Will help connect the question to the chart.
• There is a lot of empty space on the green background. Realize this is a tricky issue. Maybe we should center the question vertically?
• View Full Results button - left align to chart and closer to chart, cut that vertical space about in half.
• The graph paper background (this will relate to other areas site wide too, has a left or right border, lets lose that — want that to fade or just break away not be so rigid.

U-Reporters Section

• Ages on the chart, top line, reduce font size to 14px

Social Media Section

• some spacing below the buttons to make them stand out a bit more, about 25px or so
• Can/should the social media plugins be able to scroll…? Thinking out loud here… thoughts?

Photo Section

• Limit the box to 6 photos
• Can we add a button here on the left side below the content?

Pre-footer

• Read more button left align not centered

Select Your Country Dropdown

• Hover states on flags
• U-Report logo links to global (ureport.in)

Opinions Landing

• Add padding above graph paper (see notes on homepage Latest Opinion section, same details here).
• Reduce the font size of the Search dropdown items inside the accordion by about 25% and reduce line height.
• Reduce the amount of space between the Top charts / Map and the first question.
• In top left section above main title, add about 20px of spacing below the category box.
• Add about 20px of spacing below “Total Responses.”
• Reduct font size and circle size of question number by about 25%.
• XX Resonded out of XXX polled, change that font to Montserrat, same weight and size is good.
• Did we test the graphs on the chart? Can you send me a test screenshot?
• Can we reduce the number of colors on the word cloud? Maybe just top 2-3 (or even shades of one color?)

Footer

• Add more spacing between Opinions and Stories links on the right
• Need to move the Login button… lets put it to the right of the social icons and that scale instead on right side of the icons.

Stories Individual

• pull quote font change to same as body font
• Comments section too wide, lets make it the same width as content block above it.

Engagement

• This background color should go full width behind, don’t want the white gutters left and right please.
• Overall Statistics - change that title font to not be in Italics
• Bar chart box lines - no white background around the bars

About / Open Template

• On this content block, make the button of it touch the pre-footer (aka no graph paper or border below the content.

Join Now

• Add more padding top bottom in each section, about 40px each.
• Can these color bars go full width?

Updated / New assets or content JN to send you:

• Higher res video bkg logo
• Send Nic Content for the U-Report about section
• Update the map graphic
• Photos section content
• pre-footer U graphic low res
• pre-footer content tagline
• higher res U-Report logo in country dropdown
• individual Stories U graphic too large, low

Responsive

Header

• I realize this is the wrong logo, but still thinking its too large, lets reduce the size by 25% or so.
• Did you see my notes on the mobile menu?

Home

• U-Reporters section / Age — font/spacing/scale here is way off, please reference the Invision for scale and spacing. Ignore the orange of the bars, not needed.
• More padding top/bottom in the “Join” section, again see InVision
• Social plugins are extending into the feature story image below.
• Social plugins, if it scrolls…. This will create a scroll trap on mobile devices. Lets not have scroll if we can’t turn off on mobile, that make sense?
• Photos section, center the images, and like other list, reduce to 6 photos.

Prefooter/Footer

• Engagement section is messy. See the Invision, basically just lose the U graphic and that’ll fix the spacing.
• Footer doesn’t have to look just like the InVision but let’s add more spacing above and below the main links, reduce the font size of those main links by about 25%. Lets start there and we can tidy up the rest.
• Pre-footer section broken, stories should be full width and stacked. Again, please see the InVision.

New Punch List (Round 2, General)

• Home - Latest Opinion Section - add margin above the colored block (see screenshot)
• Header - add 1px border to the bottom of the header (see same screenshot as above)
• Homepage Latest Opinion section - reduce line height on Question Title to line-height: 2rem;
• Homepage social media button switching not working
• Let’s disable social media plugin scrolling on mobile
• Can we add the Select Your Country dropdown on mobile as well
• Whats the status of the mobile menu changes?
• Horizontal bar charts — can we reduce the space between lines by about 25%?
• Can we animate the Ages chart on homepage at scroll like the Opinions charts
• On the Opinions page, the export screenshot feature works great. Is there anyway we can remove a few of the items that appear in the image like the question number and the buttons?
• Age chart on Opinions, lets reduce the font size of the “0-14… 15-19” row by about 25%, make not bold like the line to the left of it below gender
• The button rollover state notes I gave you aren’t looking good, which is on me. I’m thinking the most consistent thing to do will be to make the button rollover states be exactly like the hover states on the charts (i.e. when you rollover a bar it highlights) can we borrow those same styles for buttons globally?
• Tablet view homepage Latest Opinion bug (see screenshot)
• On Individual Stories pages, reduce width of FB comments section to be same as content block above
• Please make sure full width dark background is on all the Engagement page including the top section (see screenshot, no white showing on sides)
• Is there a way to animate the map on load on the Engagement page? It loads late than abruptly displays? Maybe Loading icon before? Or animate fade in? Or both if needed?
• On Opinions buttons lockup we use the word “State”, on Engagement we use “Location”… is it always state? If so, lets use that word. If not, can you confirm?
• On Engagement can we have the lines/bars animate once you get to that section on scroll, not just the whole chart fade in? I think this is working on the first chart and looks great, but not the 3 below.
• On the Opinions and Engagement maps, can the highest response rate region be highlighted by default then change if hovered over another like it does now?

Polish List 1

• Black button rollover color: bg-gray700
• FYI still seeing the tablet bug on “Latest Opinion” homepage section
• Can we make the admin toolbar position: fixed when signed in fixed to header on scroll
• On pre-footer, can we add a height to the stories so that the “Read More” buttons always line up?
• On Opinions color blocks, add more padding above and below the question (in other words, make the color block taller, I tested with adding “padding: 14% 0;” to the bg-dark divs and liked it, and then like we did with the question, center the pill buttons and chart in the space too.
• Make the numbers of the questions to font-size: 1rem;
• Lets be sure the charts animate on scroll, not before, I’d like to see every chart animate once you get to it
• Did we test adding the graph paper-y background to the Opinions charts? Not sure I want to add just curious
• Add more padding to the top and bottom of the footer div, the equivalent of about 50px both top and bottom
• The Latest Opinion changes look good, though lets add a bit more margin above the color block (the spacing should be the same distance from “Opinions” to the gray line as the color block is to the gray line)
• Remove white overline on the “Select Your Country” flag hover
• On the Individual stories title, center the title in the dark div section
• Make the “U” graphic on individual story template smaller by 50%
• Engagement - the Overall Statistics and and map aren’t in the container, lets frame similarly as charts and filter bar below it
• Filter Results bar top and bottom - border-color: #777;
• On map, move “Top Region” to be inline with the region, so all one line “Top Region: Harare Province” so the map section doesn’t skip below it when it adds and removes