Covid19

India’s First Voice-Enabled CoVid19 Tracker

Why did we create a CoVid19 dashboard with Voice Search? Impact of adding Voice Search to it? How did we create this?

Vinayak Jhunjhunwala
slanglabs
Published in
6 min readApr 27, 2020

--

Slang Labs created a Voice-Enable Covid19 Dashboard to make sure emergent users like our parents and relatives can get trustworthy data on CoVid19 via voice in either English or Hindi.

The idea of Voice-Enabling CoVid19 dashboard originated from an internal hackathon we conducted at Slang Labs. It allows everyone to do a voice search for confirmed cases in any district in India. At a state level, people can even ask for active, recovered and death cases. We recently added support for getting data on testing and new cases in districts and state.

Image showing Voice Search working on covid19india.slanglabs.in
CoVid19India Dashboard with Voice Search — covid19india.slanglabs.in

The story behind our hackathon is not so interesting, but it’s definitely unique. All of us at Slang wanted to contribute to the battle against CoVid19. We provided monetary help but there is only so much we can do to even make a dent.

Here is the video we made for this project:

Video showing a person using the Voice Search feature on our dashboard.

To contribute to this battle, We decided to play to our strengths. We have a very strong engineering team and we wanted to leverage our engineering chops to help in this battle. We had a goal in mind — Use our existing technologies we built and understood to make a big impact.

To achieve this goal, we decided to organize an internal hackathon with one agenda- Focus on solving small issues which are often passed upon in these tough times but can make a big impact on people’s lives.

Two ideas that really shined, tackled two major issues -

  1. Getting trustworthy news around CoVid in the hands of our parents and relatives to stop fake news.
  2. Feeling lonely during social distancing. (The last paragraph is dedicated to what we did to solve this problem)

Why did we create a CoVid19 dashboard with Voice Search?

We saw the effects of the infamous “Whatsapp University” spreading fake rumours and news. We had a lot of anecdotal insights as well as well documented cases of the implication of fake news since the time this crisis emerged. This was clearly a big problem worth solving. We decided to do our part in solving this problem, by making trustworthy news accessible to all.

We wanted a way for our parents and relatives to search and verify the data they get via Whatsapp forwards. This has often been difficult because these emergent are often limited by linguistic and navigational barriers.

Our goal was to make sure emergent users like our parents and family members can search for trusted information via voice in either English or Hindi.

Impact of adding Voice Search to this dashboard?

We had over 800 people use the covid19india.slanglabs.in, in less than a week of launching this dashboard. The only marketing we did for this project was sharing it on our personal and Slang’s social media channels.

15.6% of the users were returning users
That’s not all, about 15.6% of the people were returning users.

We were overwhelmed by the kind of feedback we got. Here is a picture of some of the feedback we received when we shared this project with our friends and family.

Feedback received by us for the Voice Search in the Dashboard
Feedback received by us for the Voice Search in the Dashboard.

This is a small step in the right direction. If your parents, relatives or friends are deriving value out of doing voice search on this dashboard, please do record and send us a video. We will put it up on our social media channels.

How did we create this?

Team ‘404 Found’ members- Vinayak, Nissim, Ritinkar and Ved worked on this project. They forked the dashboard and used the data pipe built by the amazing folks at covid19india.org and added Slang’s WEB SDK to it, to voice-enable it quickly. Adding our SDK helped us to enable voice search in English and Hindi. We tweaked the dashboard UI a bit to make it better for smartphones and voila we had our prototype ready. We were able to complete the prototype overnight.

Getting prototype to production

This section has the nitty-gritty of solving issues that arose in the prototype. TL;DR- We solved most of these issues and went to production. Read this section if you want to understand, the challenges we faced and how we solved them.

We decided to dogfood our own project. We gave the dashboard to our team to use and soon saw a pattern that was breaking the voice search experience. The data from CoVid19 project gave us district-wise data, but people were asking for cities and prominent towns which differed from their district names. For example, Guhwati a prominent city actually lies in Kamrup Metropolitan district. Haldwani lies in the district of Nainital. Did you know ‘New Delhi’ is actually a district in the state of Delhi (that’s just weird)? (You get the gist, there are many such edge cases).

We tackled this problem in the old fashioned way. Putting manpower to collect prominent towns and cities in over 700+ districts to make this work. Sounds boring, tiring and draining? Yes, because it was. Believe it or not, there is no directory for this for us to scrape. (Believe me, I did scour the internet for it).

The whole team actually pulled together to solve this challenge. We got everyone on a video call to make this brain-draining work a little more bearable. Each member took a state they are most familiar with and got on to collect this information. After 2 hours of jokes, camaraderie, (astonishment on the lack of our knowledge of Geography) and Wikipedia searches we were done.

We added these towns and cities to their respective districts in the backend. Voila, v1 was ready to be released.

What’s next?

We have added this project to our regular sprints. We have been actively making this project better and adding more features. We recently added support for querying data on testing, new cases and countrywide information.

We also are working on building a very simple way of adding a similar ‘Voice Search for CoVid19 data’ for anyone to embed on their website with just a couple lines of code. Upon adding this you will get a button on the screen where users can query for CoVid data using Voice in English and Hindi. We call it ‘CoVid19 Slang Assistant’. We know we are super creative. Thanks. If you want to add it to your website just email us on 42@slanglabs.in. We will be more than happy to help you integrate it. It’s just a couple of lines of code, not much help needed.

We are working on adding support for querying data for all the countries. Adding support for more languages. We don’t have a definite timeline on these features but follow our social media handles. We update on new features over there.

That’s all folks for CoVid19 project. We briefly touched upon the other issue of loneliness we were working on tackling, here is a little bit about that. We will write another blog with more details on this.

Tackling Loneliness with Games

Some games we built with Voice. To play: www.slanglabs.in/hacks

A couple of other teams created two voice games to fight loneliness. One of these games, Elephantine is a memory game that you can play with your kids, and the other Orb Ball is a more interactive game that anyone can play. Both these games were enabled by using Slang’s Android & Web SDK. These games are in alpha releases. We built two more games. Here is the link: https://www.slanglabs.in/hacks for all the projects that we have built during our internal hackathons and in our free time.

Originally published on https://www.slanglabs.in/blog/india-first-covid19-tracker-with-voice-search

--

--