What Deep Learning Can Offer to Businesses

Sergii Shelpuk
Head of the Data Science Office at ELEKS

The last couple of years have seen a dramatic increase in the popularity of deep learning, an approach to artificial intelligence inspired by a human brain’s activity. To this day, deep learning models have introduced advanced solutions in the areas of computer vision, pattern recognition, natural language processing and other.

According to Gartner, deep learning is among the top 10 technology trends that will be strategic for most organizations in 2016. In other words, this is the technology trend with the potential for significant impact on an organization’s long-term plans, programs and initiatives. Gartner highlights the factors denoting the significant impact to include a high disruption potential for business, end-users or IT, the need for major investment, as well as the risk of being late to adopt. While this trend is evolving quickly, Gartner suggest the organizations must assess how they can apply these technologies to gain competitive advantage.

To create a better understanding of the potential this technology has, let’s review some successful use cases of deep learning applied in research and business.

Natural language processing

Deep learning itself is an extremely popular area in machine learning, artificial intelligence and data mining that creates multiple new opportunities in data-related research areas, such as signal processing, pattern recognition as well as natural language processing.

Typically, when working with languages, we are used to relying on dictionaries to get a definition of the particular word, as well as its grammatical features or the context of its use. Those dictionaries basically contain the encoding of human reasoning about words: the semantics, the synonymy, as well as the other grammatical characteristics. All this information has been gathered and arranged by people over the years.

With the capabilities of artificial intelligence, the way the words are processed and interpreted can be changed dramatically. It turns out we can define the meaning of the word based on its position in the text without the need of using a dictionary.

According to Richard Socher, we can learn how to represent words with numbers, getting all the required information directly from the text with no need to leverage any human knowledge at all. The resulting vectors of these numbers are representing the meaning of the word, while similar words are represented with similar vectors.

Deep machine learning Figure-1
Fig.1. An improved model of semantic similarity based on lexical co-occurrence, Rohde et al. 2005.
Source: Richard Socher, CS224d, Deep Learning for Natural Language Processing, Lecture 2: Word Vectors

Moreover, these vectors represent the relationships between words as shown in the picture below.

Deep machine learning Figure-2
Fig.2. Test for linear relationships, examined by Mikolov et al. (2014)
Source: Richard Socher, CS224d, Deep Learning for Natural Language Processing, Lecture 2: Word Vectors

Deep machine learning Figure-3
Fig.3. Glove Visualizations (с) Mikolov et al. (2014)
Source: Richard Socher, CS224d, Deep Learning for Natural Language Processing, Lecture 2: Word Vectors

Deep machine learning Figure-4
Fig.4. Glove Visualizations: Company -CEO. (с) Mikolov et al. (2014)
Source: Richard Socher, CS224d, Deep Learning for Natural Language Processing, Lecture 2: Word Vectors

These representations were later used to improve the accuracy of text classification, matching sentences, automatic categorization, question answering and other text-mining tasks.

Advanced image recognition

One of the most recent successful appliances of deep learning for image recognition came from Large Scale Visual Recognition Challenge, when Alex Krizhevsky applied convolutional neural networks to organize images from ImageNet, a dataset containing 1.2 million pictures, into 1,000 different classes. In 2012, Krizhevsky’s network, AlexNet, achieved a top-5 test error rate of 15.3%, outperforming traditional computer vision solutions with more than 10% accuracy.

The experience of Alex Krizhevsky changed the landscape of the data science and artificial intelligence field from the perspective of the research and business application. In 2012, AlexNet was the only deep learning model at ILSVRC (ImageNet Large Scale Visual Recognition Competition). Two years later, in 2014, there were no conventional computer vision solutions among the winners. And today, deep learning is, de-facto, a standard solution for computer vision tasks.

Deep-machine-learning-Figure-5
Fig.5. Li Fei-Fei: ImageNet Large Scale Visual Recognition Challenge, 2014
Source: http://image-net.org/

ELEKS’ experiment with deep learning for automatic colorization

Being early adopters by nature, we are continuously researching the capabilities of data-driven analytics and machine learning methods. One of our recent experiments featured deep learning neural networks applied for automatic colorization of old photos and videos. We have used residual autoencoder network suggested by Ryan Dahl and extended it to colorize a full-sized image.

Deep-machine-learning-Figure-6
Fig.6. Residual antoencoder network
Source: http://tinyclouds.org/colorize/

The model for automatic colorization has been trained on the ImageNet dataset using TensorFlow library with GPU.

In the images below, you can see the “before” and “after” pictures and the videos we have coloured. The photos display the city of Lviv of the beginning of the 20th century and an episode from the 1939 movie Włóczęgi (The Vagabonds).

Deep machine learning No Col-1
Deep-machine-learning-Col-1

Deep-machine-learning-No-Col-2
Deep-machine-learning-Col-2

Deep machine learning No Col-3 Deep machine learning No Col-4

Original video:

Colorized video:

Deep Learning Meets the Business World

After its prominent success in the academic area, deep learning has been finally introduced into the business world. The industry giants, including Microsoft and Facebook, started to successfully use the advantages of this approach. The technology began to spread among verticals, bringing in advanced capabilities for speech and image recognition, stock trade, medical diagnostics and other.

Businesses are well aware that in the modern world data is the key to well-informed, sound decisions and reliable predictions. Companies have been continuously looking for better ways of leveraging the data they collect in order to make better decisions. Deep learning today not only offers them better accuracy of data processing – when compared to conventional models – but also solutions to the problems that were previously unsolvable. Here are some recent cases of how deep learning provided a significant business advantage.

Beating the churn

In 2015, MOZ revealed their deep learning model for customer churn prediction. The approach was based on the recurrent neural networks, a powerful model to work with sequential data. As customer behaviour is sequential in nature, this approach fits in perfectly.

The actions a customer is about to perform are caused by a vast variety of factors from the past. In relation to the customer, these factors could be external ( changing economic circumstances, rules and regulations, market demand), internal ( change in income, urgent needs, changes in tastes) as well as product related (previous experience with the product, the functionality required, the quality of the support). In combination, all this information provides much more insight compared to any single source.

The MOZ model uses an event aggregation approach to represent the customer lifecycle for a particular user along with the demographic and other factors in a single vector. This vector represents the user’s past behavior. Using this data, the recurrent neural network predicts the future behavior of this customer at every stage of the buyer’s journey, based on the person’s activity in the past. The information that MOZ was interested in was associated with the possibility for the customer to shift from the free trial mode towards the purchase of the product or its withdrawal.

Deep machine learning Figure-7
Fig.7. MOZ deep learning model for churn prediction
Source: https://moz.com/

The model was tested on two types of churn: voluntary and involuntary. And in both cases, there was an obvious improvement in the prediction accuracy compared to conventional approaches.

Making better recommendations

Another approach was suggested by Microsoft Research in their paper A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems. The aim of the approach was to provide better recommendations to customers looking for Windows Apps, taking information from the search queries and browsing history as a base. A wide variety of factors was taken into account, including the news the person was searching for or the movies and TV shows that he or she was interested in.

The new, deep learning architecture that Microsoft has proposed was called “multi-view deep neural network”. This model analyzes user behavior in different domains (namely search queries, news read and movies/TV shows liked) and transforms this information into a single vision. This vision can be used later for making personalized suggestions about news, movies – literally anything.

Deep machine learning Figure-8
Fig.8. Microsoft Multi-View DNN model
Source: http://research.microsoft.com/

The approach has outperformed the conventional recommendation techniques on Microsoft’s internal dataset as well as on several public benchmarks. The results are quite impressive from the technical standpoint. The system was able to link automatically the behavior of a user in one type of environment (visiting a particular website) with the actions performed in an entirely different environment (searching for news).

For example, the fact that the user has visited some websites for young parents triggers the recommendation on baby clothes. While the subject seems quite straightforward, this example actually shows how learning jumps domains – an inference which is apparently clear to a human is not so obvious to a machine.

Even though deep learning still has a long way to go, the potential opportunities and benefits it can bring look quite promising. For now, no one can predict for sure how this technology will evolve, but it is very likely to quickly spread among industries, shaping business opportunities through the upcoming decades.

tags

Comments

  • Very encouraging views !!

    • Sergey Shelpuk

      Thank you :)

  • Robert Cass

    Great stuff! Would love to talk to you more about this for it’s use in the medical field here in the US. Thanks!