Jovian
⭐️
Sign In
NotebookFilesCollaborators
Version 13

INTRODUCTION:

The objective of this project is to deliver insights to understand customer demands better and thus help developers to popularize the product. The dataset is chosen from Kaggle. It is of 10k Play Store apps for analyzing the Android market. It consists of in total of 10841 rows and 13 columns.

In [1]:
!pip install numpy pandas seaborn matplotlib -q
In [2]:
import numpy as np
import pandas as pd
import seaborn as sns
import matplotlib.pyplot as plt

%matplotlib inline
In [3]:
!pip install jovian opendatasets --upgrade --quiet
In [4]:
dataset_url = 'https://www.kaggle.com/lava18/google-play-store-apps'
In [7]:
import opendatasets as od
od.download(dataset_url)
Please provide your Kaggle credentials to download this dataset. Learn more: http://bit.ly/kaggle-creds Your Kaggle username: ritikars Your Kaggle Key: ········
0%| | 0.00/1.94M [00:00<?, ?B/s]
Downloading google-play-store-apps.zip to .\google-play-store-apps
100%|██████████████████████████████████████████████████████████████████████████████| 1.94M/1.94M [00:05<00:00, 384kB/s]
In [8]:
google_playstore_df = pd.read_csv('google-play-store-apps/googleplaystore.csv')
Checking what columns are there in the dataset
In [9]:
google_playstore_df.columns
Out[9]:
Index(['App', 'Category', 'Rating', 'Reviews', 'Size', 'Installs', 'Type',
       'Price', 'Content Rating', 'Genres', 'Last Updated', 'Current Ver',
       'Android Ver'],
      dtype='object')
Checking Number of columns and rows
In [10]:
google_playstore_df.shape
Out[10]:
(10841, 13)
In [11]:
google_playstore_df.info()
<class 'pandas.core.frame.DataFrame'> RangeIndex: 10841 entries, 0 to 10840 Data columns (total 13 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 App 10841 non-null object 1 Category 10841 non-null object 2 Rating 9367 non-null float64 3 Reviews 10841 non-null object 4 Size 10841 non-null object 5 Installs 10841 non-null object 6 Type 10840 non-null object 7 Price 10841 non-null object 8 Content Rating 10840 non-null object 9 Genres 10841 non-null object 10 Last Updated 10841 non-null object 11 Current Ver 10833 non-null object 12 Android Ver 10838 non-null object dtypes: float64(1), object(12) memory usage: 1.1+ MB
Descriptive statistics
In [12]:
google_playstore_df.describe()
Out[12]:
In [ ]:
import jovian
In [ ]:
jovian.commit()
In [ ]:
google_playstore_df.loc[10472]
Removing 10472 due to data mismatch in the column
In [13]:
# Row 10472 removed due to missing value of Category
google_playstore_df.drop(google_playstore_df.index[10472], inplace=True)
Removing '+' from the values of number of installs and converting it to numeric
In [14]:
google_playstore_df['Installs'] = google_playstore_df['Installs'].map(lambda x: x.rstrip('+'))
In [15]:
google_playstore_df['Installs'] = pd.to_numeric(google_playstore_df['Installs'].str.replace(',',''))
Removing '$' from the values of Price and converting it to numeric
In [16]:
google_playstore_df['Price'] = pd.to_numeric(google_playstore_df['Price'].str.replace('$',''))
In [17]:
google_playstore_df.info()
<class 'pandas.core.frame.DataFrame'> Int64Index: 10840 entries, 0 to 10840 Data columns (total 13 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 App 10840 non-null object 1 Category 10840 non-null object 2 Rating 9366 non-null float64 3 Reviews 10840 non-null object 4 Size 10840 non-null object 5 Installs 10840 non-null int64 6 Type 10839 non-null object 7 Price 10840 non-null float64 8 Content Rating 10840 non-null object 9 Genres 10840 non-null object 10 Last Updated 10840 non-null object 11 Current Ver 10832 non-null object 12 Android Ver 10838 non-null object dtypes: float64(2), int64(1), object(10) memory usage: 1.2+ MB
In [18]:
google_playstore_df['Installs'].min(),google_playstore_df['Installs'].max()
Out[18]:
(0, 1000000000)
As we can notice,there is a high variance in the number of installs. To remove this we are adding a new column to dataframe, which is the log of number of installs
In [19]:
google_playstore_df['log_installs'] = np.log2(google_playstore_df['Installs'])
C:\Users\SinghRit\Anaconda3\lib\site-packages\pandas\core\series.py:679: RuntimeWarning: divide by zero encountered in log2 result = getattr(ufunc, method)(*inputs, **kwargs)
Checking, if the dataframe contains any duplicate values for the same App name
In [20]:
boolean = google_playstore_df['App'].duplicated().any()
boolean
Out[20]:
True
In [21]:
google_playstore_df['App'].value_counts()
Out[21]:
ROBLOX                                                9
CBS Sports App - Scores, News, Stats & Watch Live     8
ESPN                                                  7
8 Ball Pool                                           7
Duolingo: Learn Languages Free                        7
                                                     ..
CHRONO TRIGGER (Upgrade Ver.)                         1
No Pimple - Fun games                                 1
Modern Counter 3: FPS Multiplayers battlegro 3        1
BigOven Recipes, Meal Planner, Grocery List & More    1
Acorn TV: World-class TV from Britain and Beyond      1
Name: App, Length: 9659, dtype: int64
As we can see from the above mentioned data, some of the apps are having multiple rows. Let's check out if there data is identical or not
In [22]:
google_playstore_df[google_playstore_df['App']=='ROBLOX']
Out[22]:
As we can see from the above dataframe, ROBLOX app is having identical rows with difference in number of reviews. It may have happened that for the same app, the data has been scraped in different points of time. So we have kept row of an app with maximum number of reviews, assuming it to be the latest one.
In [23]:
google_playstore_df.drop_duplicates(inplace=True)
Convertingtype of Reviews column to number
In [24]:
google_playstore_df['Reviews'] = pd.to_numeric(google_playstore_df['Reviews'].str.replace('$',''))
In [25]:
google_playstore_df = google_playstore_df.loc[google_playstore_df.groupby(['App'])['Reviews'].idxmax()]
Setting up the parameters for the plots
In [26]:
sns.set_style('darkgrid')
plt.rcParams['font.size'] = 14
plt.rcParams['figure.figsize'] = (9, 5)
plt.rcParams['figure.facecolor'] = '#00000000'

What are the top 20 apps present in the google play store as per their Genres?

In [27]:
top_genres = google_playstore_df.Genres.value_counts().reset_index().rename(columns={'Genres':'Count','index':'Genres'})
In [28]:
genres_installs = google_playstore_df.groupby(['Genres'])[['Installs']].sum()
In [29]:
top_genres_installs = pd.merge(top_genres, genres_installs, on='Genres')
top_20_genres_installs = top_genres_installs.head(20)
In [30]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Number of application")
plt.title("Top 20 Genres")
sns.barplot(top_20_genres_installs.Genres, top_20_genres_installs.Count)
plt.show()
Which are the Genres that are getting installed the most in top 20 Genres?
In [45]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Installs")
plt.title("Installs according to Genres")
sns.barplot(top_20_genres_installs.Genres, top_20_genres_installs.Installs)
plt.show()
As we can see from the above two plots: Maxinum number of apps present in google play store comes under Tools, Entertainment and Education Genres but as per the installation and requirement in the market plot, scenario is not the same. Maximum installed apps comes under Communication, Tools and Productivity Genres.
In [31]:
top_category = google_playstore_df.Category.value_counts().reset_index().rename(columns={'Category':'Count','index':'Category'})
In [32]:
category_installs = google_playstore_df.groupby(['Category'])[['Installs']].sum()
In [33]:
top_category_installs = pd.merge(top_category, category_installs, on='Category')
top_20_category_installs = top_category_installs
In [40]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=90)
plt.xlabel("Category")
plt.ylabel("Number of application")
plt.title("Count of applications for each Category")
sns.barplot(top_20_category_installs.Category, top_20_category_installs.Count)
plt.show()
In [42]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=90)
plt.xlabel("Category")
plt.ylabel("Installs")
plt.title("Number of installed applications for each Category")
sns.barplot(top_20_category_installs.Category, top_20_category_installs.Installs)
plt.show()
As we can see from the above two plots: Maxinum number of apps present in google play store comes under Family, Games and Tools Category but as per the installation and requirement in the market plot, scenario is not the same. Maximum installed apps comes under Games, Communication and Tools.
In [43]:
!pip install jovian --upgrade -q
In [44]:
import jovian
In [46]:
jovian.commit(project_name = 'course-project-google-play-store-dataset')
[jovian] Attempting to save notebook.. [jovian] Updating notebook "ritz1602-rs/course-project-google-play-store-dataset" on https://jovian.ml/ [jovian] Uploading notebook.. [jovian] Capturing environment.. [jovian] Committed successfully! https://jovian.ml/ritz1602-rs/course-project-google-play-store-dataset
Out[46]:
'https://jovian.ml/ritz1602-rs/course-project-google-play-store-dataset'

Average rating

In [47]:
genres_ratings_df = google_playstore_df.groupby(['Genres'])[['Rating']].mean()
In [48]:
genres_installs_ratings = pd.merge(top_genres_installs, genres_ratings_df, on='Genres')
In [49]:
genres_installs_ratings['Rating'].describe()
Out[49]:
count    114.000000
mean       4.248546
std        0.182448
min        3.800000
25%        4.127083
50%        4.246502
75%        4.344442
max        4.800000
Name: Rating, dtype: float64
In [51]:
plt.figure(figsize=(14,7))
g = sns.kdeplot(genres_installs_ratings.Rating, color="Red", shade = True)
g.set_xlabel("Rating")
g.set_ylabel("Frequency")
plt.title('Distribution of Rating',size = 20)
plt.show()
In [52]:
jovian.commit(project_name = 'course-project-google-play-store-dataset')
[jovian] Attempting to save notebook.. [jovian] Updating notebook "ritz1602-rs/course-project-google-play-store-dataset" on https://jovian.ml/ [jovian] Uploading notebook.. [jovian] Capturing environment.. [jovian] Committed successfully! https://jovian.ml/ritz1602-rs/course-project-google-play-store-dataset
Out[52]:
'https://jovian.ml/ritz1602-rs/course-project-google-play-store-dataset'

Highest and lowest rated Genres

In [53]:
genres_installs_ratings.sort_values('Rating', ascending =False, inplace=True)
In [54]:
highest_rated_genres = genres_installs_ratings.iloc[0:20]
lowest_rated_genres = genres_installs_ratings.iloc[-20:]
lowest_rated_genres = lowest_rated_genres[lowest_rated_genres['Rating'].notnull()]
In [55]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Rating")
plt.title("Ratings according to Genres")
sns.barplot(highest_rated_genres.Genres, highest_rated_genres.Rating)
plt.show()
In [57]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Rating")
plt.title("Ratings according to Genres")
sns.barplot(lowest_rated_genres.Genres, lowest_rated_genres.Rating)
plt.show()

What are the count of applications in each category differentiated by their type?

In [58]:
app_count = google_playstore_df.groupby(['Category','Type'])[['App']].count().reset_index().rename(columns={'App':'Count','index':'App'})
In [59]:
df_app_count = app_count.pivot('Category', 'Type', 'Count').fillna(0).reset_index()
In [60]:
df_app_count.set_index('Category').plot(kind='bar', stacked=True, figsize=(18,9))
plt.xlabel("Category", fontsize=15)
plt.ylabel("Count", fontsize=15)
plt.title("Count of applications in each category differentiated by their type")
plt.show()
It looks like certain app categories have more free apps available for download than others. In our dataset, the majority of apps in Family, Food & Drink and Tools, as well as Social categories were free to install. At the same time Family, Sports, Tools and Medical categories had the biggest number of paid apps available for download.

How many apps were installed according to its type?

In [61]:
google_playstore_df['Gaming Category App'] = google_playstore_df['Category']=='GAME'
In [62]:
categoty_type_installs = google_playstore_df.groupby(['Category','Type'])[['Installs']].sum().reset_index()
In [63]:
categoty_type_installs['log_Installs'] = np.log2(categoty_type_installs['Installs'])
In [64]:
plt.figure(figsize=(18,9))
plt.xticks(rotation=65,fontsize=9)
plt.xlabel("Category")
plt.ylabel("Installs")
plt.title("Number of installs type wise according to Category")
sns.barplot('Category', 'log_Installs', hue='Type', data=categoty_type_installs);
plt.show()
It can be concludd that the number of free applications installed by the user are high when compared with the paid ones.

Size of the applications present in the datset are in MB and KB. Therefore for ease in data processing, converting entire size column to MB.

In [65]:
# Converting KB to MB 
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: str(x).replace('Varies with device', 'NaN') if 'Varies with device' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: str(x).replace('M', '') if 'M' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: str(x).replace(',', '') if 'M' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: float(str(x).replace('k', '')) / 1000 if 'k' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: float(x))

How does size impact on the number of installs of any application?

In [66]:
plt.figure(figsize=(14,7))
sns.scatterplot(google_playstore_df['Size'], google_playstore_df['log_installs'], hue=google_playstore_df['Type'])
plt.show()
It is clear from the above mentioned plot that size may impact the number of installations. Bulky applications are less installed by the user.

Histogram of log installs

In [67]:
google_playstore_df.loc[google_playstore_df['log_installs']==google_playstore_df['log_installs'].min(),'log_installs']=0
In [68]:
plt.xlabel("Log of Installs")
plt.title("Distribution of Logrithm of Installs")
plt.hist(google_playstore_df['log_installs']);