Jovian
⭐️
Sign In
NotebookFilesCollaborators
Version 5

INTRODUCTION:

The objective of this project is to deliver insights to understand customer demands better and thus help developers to popularize the product. The dataset is chosen from Kaggle. It is of 10k Play Store apps for analyzing the Android market. It consists of in total of 10841 rows and 13 columns.

In [1]:
!pip install numpy pandas seaborn matplotlib -q
In [2]:
import numpy as np
import pandas as pd
import seaborn as sns
import matplotlib.pyplot as plt

%matplotlib inline
In [3]:
!pip install jovian opendatasets --upgrade --quiet
In [4]:
dataset_url = 'https://www.kaggle.com/lava18/google-play-store-apps'
In [5]:
import opendatasets as od
od.download(dataset_url)
Please provide your Kaggle credentials to download this dataset. Learn more: http://bit.ly/kaggle-creds Your Kaggle username: ritikars Your Kaggle Key: ········
0%| | 0.00/1.94M [00:00<?, ?B/s]
Downloading google-play-store-apps.zip to .\google-play-store-apps
100%|█████████████████████████████████████████████████████████████████████████████| 1.94M/1.94M [00:00<00:00, 2.88MB/s]
In [20]:
google_playstore_df = pd.read_csv('google-play-store-apps/googleplaystore.csv')
Checking what columns are there in the dataset
In [21]:
google_playstore_df.columns
Out[21]:
Index(['App', 'Category', 'Rating', 'Reviews', 'Size', 'Installs', 'Type',
       'Price', 'Content Rating', 'Genres', 'Last Updated', 'Current Ver',
       'Android Ver'],
      dtype='object')
Checking Number of columns and rows
In [22]:
google_playstore_df.shape
Out[22]:
(10841, 13)
In [23]:
google_playstore_df.info()
<class 'pandas.core.frame.DataFrame'> RangeIndex: 10841 entries, 0 to 10840 Data columns (total 13 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 App 10841 non-null object 1 Category 10841 non-null object 2 Rating 9367 non-null float64 3 Reviews 10841 non-null object 4 Size 10841 non-null object 5 Installs 10841 non-null object 6 Type 10840 non-null object 7 Price 10841 non-null object 8 Content Rating 10840 non-null object 9 Genres 10841 non-null object 10 Last Updated 10841 non-null object 11 Current Ver 10833 non-null object 12 Android Ver 10838 non-null object dtypes: float64(1), object(12) memory usage: 1.1+ MB
Descriptive statistics
In [24]:
google_playstore_df.describe()
Out[24]:
In [32]:
import jovian
In [ ]:
jovian.commit()
[jovian] Attempting to save notebook..
In [31]:
google_playstore_df.loc[10472]
Out[31]:
App               Life Made WI-Fi Touchscreen Photo Frame
Category                                              1.9
Rating                                                 19
Reviews                                              3.0M
Size                                               1,000+
Installs                                             Free
Type                                                    0
Price                                            Everyone
Content Rating                                        NaN
Genres                                  February 11, 2018
Last Updated                                       1.0.19
Current Ver                                    4.0 and up
Android Ver                                           NaN
Name: 10472, dtype: object
Removing 10472 due to data mismatch in the column
In [19]:
# Row 10472 removed due to missing value of Category
google_playstore_df.drop(google_playstore_df.index[10472], inplace=True)
Removing '+' from the values of number of installs and converting it to numeric
In [16]:
google_playstore_df['Installs'] = google_playstore_df['Installs'].map(lambda x: x.rstrip('+'))
In [17]:
google_playstore_df['Installs'] = pd.to_numeric(google_playstore_df['Installs'].str.replace(',',''))
--------------------------------------------------------------------------- ValueError Traceback (most recent call last) pandas\_libs\lib.pyx in pandas._libs.lib.maybe_convert_numeric() ValueError: Unable to parse string "Free" During handling of the above exception, another exception occurred: ValueError Traceback (most recent call last) <ipython-input-17-26e58613fa20> in <module> ----> 1 google_playstore_df['Installs'] = pd.to_numeric(google_playstore_df['Installs'].str.replace(',','')) ~\Anaconda3\lib\site-packages\pandas\core\tools\numeric.py in to_numeric(arg, errors, downcast) 148 try: 149 values = lib.maybe_convert_numeric( --> 150 values, set(), coerce_numeric=coerce_numeric 151 ) 152 except (ValueError, TypeError): pandas\_libs\lib.pyx in pandas._libs.lib.maybe_convert_numeric() ValueError: Unable to parse string "Free" at position 10472
Removing '$' from the values of number of installs and converting it to numeric
In [ ]:
google_playstore_df['Price'] = pd.to_numeric(google_playstore_df['Price'].str.replace('$',''))
In [ ]:
google_playstore_df['Category'] = google_playstore_df['Category'].str.replace(' ','')
In [ ]:
google_playstore_df.info()
In [ ]:
google_playstore_df['log_installs'] = np.log2(google_playstore_df['Installs'])
In [ ]:
boolean = google_playstore_df['App'].duplicated().any()
boolean
In [ ]:
google_playstore_df['App'].value_counts()
As we can see from the above mentioned data, some of the apps are having multiple rows. Let's check out if there data is identical or not
In [ ]:
google_playstore_df[google_playstore_df['App']=='ROBLOX']

Dropping duplicate rows

In [ ]:
google_playstore_df.drop_duplicates(inplace=True)

A single app is having multiple rows with difference in number of reviews. So, taking the row with highest number of reviews.

In [ ]:
google_playstore_df = google_playstore_df.loc[google_playstore_df.groupby(['App'])['Reviews'].idxmax()]
In [ ]:
sns.set_style('darkgrid')
plt.rcParams['font.size'] = 14
plt.rcParams['figure.figsize'] = (9, 5)
plt.rcParams['figure.facecolor'] = '#00000000'

Creating dataframe for top 20 Genres of applications

In [ ]:
top_genres = google_playstore_df.Genres.value_counts().reset_index().rename(columns={'Genres':'Count','index':'Genres'})
In [ ]:
top_genres
In [ ]:
genres_installs = google_playstore_df.groupby(['Genres'])[['Installs']].sum()
genres_installs
In [ ]:
top_genres_installs = pd.merge(top_genres, genres_installs, on='Genres')
top_20_genres_installs = top_genres_installs.head(20)
top_genres_installs
In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Number of application")
plt.title("Top 20 Genres")
sns.barplot(top_20_genres_installs.Genres, top_20_genres_installs.Count)

Dataframe from total installs in each Genres

In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Installs")
plt.title("Installs according to Genres")
sns.barplot(top_20_genres_installs.Genres, top_20_genres_installs.Installs)
In [ ]:
google_playstore_df

Average rating

In [ ]:
genres_ratings_df = google_playstore_df.groupby(['Genres'])[['Rating']].mean()
In [ ]:
genres_ratings_df
In [ ]:
genres_installs_ratings = pd.merge(top_genres_installs, genres_ratings_df, on='Genres')
In [ ]:
genres_installs_ratings.head()

Best rated Genres

In [ ]:
genres_installs_ratings.sort_values('Rating', ascending =False, inplace=True)
In [ ]:
highest_rated_genres = genres_installs_ratings.iloc[0:20]
lowest_rated_genres = genres_installs_ratings.iloc[-20:]
lowest_rated_genres = lowest_rated_genres[lowest_rated_genres['Rating'].notnull()]
In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Rating")
plt.title("Ratings according to Genres")
sns.barplot(highest_rated_genres.Genres, highest_rated_genres.Rating)
In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65)
plt.xlabel("Genres")
plt.ylabel("Rating")
plt.title("Ratings according to Genres")
sns.barplot(lowest_rated_genres.Genres, lowest_rated_genres.Rating)

Number of installs type wise according to Genres

In [ ]:
google_playstore_df['Gaming Category App'] = google_playstore_df['Category']=='GAME'
google_playstore_df
In [ ]:
categoty_type_installs = google_playstore_df.groupby(['Category','Type'])[['Installs']].sum().reset_index()
categoty_type_installs
In [ ]:
categoty_type_installs['log_Installs'] = np.log2(categoty_type_installs['Installs'])
categoty_type_installs
In [ ]:
# categoty_type_installs = categoty_type_installs[
#     categoty_type_installs['Genres'].isin(highest_rated_genres['Genres'].unique())
# ]
# categoty_type_installs
In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65,fontsize=9)
plt.xlabel("Category")
plt.ylabel("Installs")
plt.title("Number of installs type wise according to Category")
sns.barplot('Category', 'log_Installs', hue='Type', data=categoty_type_installs);
In [ ]:
# Converting KB to MB 
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: str(x).replace('Varies with device', 'NaN') if 'Varies with device' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: str(x).replace('M', '') if 'M' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: str(x).replace(',', '') if 'M' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: float(str(x).replace('k', '')) / 1000 if 'k' in str(x) else x)
google_playstore_df['Size'] = google_playstore_df['Size'].apply(lambda x: float(x))

Installs v/s Size

In [ ]:
plt.figure(figsize=(14,7))
sns.scatterplot(google_playstore_df['Size'], google_playstore_df['log_installs'], hue=google_playstore_df['Type'])

Histogram of log installs

In [ ]:
google_playstore_df.loc[google_playstore_df['log_installs']==google_playstore_df['log_installs'].min(),'log_installs']=0
In [ ]:
plt.title("Distribution of Logrithm of Installs")
plt.hist(google_playstore_df['log_installs']);

Histogram of size

In [ ]:
# to remove null values from size column
google_playstore_df.loc[google_playstore_df['Size'].isnull(),'Size']=0
In [ ]:
plt.title("Distribution of Size")
plt.hist(google_playstore_df['Size']);
In [ ]:
In [ ]:
user_reviews_df = pd.read_csv('googleplaystore_user_reviews.csv')
In [ ]:
user_reviews_df

Merging dataframes on apps

In [ ]:
merged_df = google_playstore_df.merge(user_reviews_df, on="App")
In [ ]:
merged_df

Category wise no.of positive and negetive reviews

In [ ]:
category_sentiment = merged_df.groupby(['Category','Sentiment']).size().reset_index(name='Sentiment Count')
category_sentiment
In [ ]:
category_sentiment['log_sentiment_count'] = np.log2(aa['Sentiment Count'])
In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65,fontsize=9)
plt.xlabel("Category")
plt.ylabel("Installs")
plt.title("Number of installs type wise according to Genres")
sns.barplot('Category', 'log_sentiment_count', hue='Sentiment', data=category_sentiment);

Histogram of subjectivity

In [ ]:
# bb = merged_df[merged_df['Sentiment_Subjectivity']>0.5]
# bb
In [ ]:
# cc = bb.groupby(['Category'])['Sentiment_Subjectivity'].mean().reset_index(name='Subjectivity Aggregate')
In [ ]:
plt.title("Distribution of Size")
plt.hist(merged_df[merged_df['Sentiment_Subjectivity'].notnull()]['Sentiment_Subjectivity'])
plt.show()

Does sentiment_subjectivity proportional to sentiment_polarity

In [ ]:
sentimet_subjectivity_polarity = merged_df.groupby(['Category'])['Sentiment_Polarity','Sentiment_Subjectivity'].mean().reset_index().rename(columns={'Sentiment_Polarity':'Sentiment_polarity_avg','Sentiment_Subjectivity':'sentiment_subjectivity_avg'})
In [ ]:
plt.figure(figsize=(14,7))
plt.xticks(rotation=65,fontsize=9)
plt.plot(sentimet_subjectivity_polarity['Category'], sentimet_subjectivity_polarity['Sentiment_polarity_avg'], 's-b')
plt.plot(sentimet_subjectivity_polarity['Category'], sentimet_subjectivity_polarity['sentiment_subjectivity_avg'], 'o--r')

# plt.xlabel('Year')
# plt.ylabel('Yield (tons per hectare)')

plt.title("Does sentiment_subjectivity proportional to sentiment_polarity")
plt.legend(['Sentiment_polarity_avg','sentiment_subjectivity_avg']);
In [ ]:
plt.figure(figsize=(14,7))
sns.scatterplot(merged_df['Sentiment_Subjectivity'], merged_df['Sentiment_Polarity'])

# plt.xlabel('Year')
# plt.ylabel('Yield (tons per hectare)')

plt.title("Does sentiment_subjectivity proportional to sentiment_polarity")
In [ ]:
plt.figure(figsize=(14,7))
sns.scatterplot(sentimet_subjectivity_polarity['sentiment_subjectivity_avg'], sentimet_subjectivity_polarity['Sentiment_polarity_avg'])

# plt.xlabel('Year')
# plt.ylabel('Yield (tons per hectare)')

plt.title("Does sentiment_subjectivity proportional to sentiment_polarity")
In [ ]:
!pip install wordcloud -q
In [ ]:
review_notnull = merged_df[merged_df['Translated_Review'].notnull()]
In [ ]:
from wordcloud import WordCloud, STOPWORDS
import matplotlib.pyplot as plt
text = review_notnull.Translated_Review.values
wordcloud = WordCloud(
    width = 3000,
    height = 2000,
    background_color = 'black',
    stopwords = STOPWORDS).generate(str(text).lower())
fig = plt.figure(
    figsize = (40, 30),
    facecolor = 'k',
    edgecolor = 'k')
plt.imshow(wordcloud, interpolation = 'bilinear')
plt.axis('off')
plt.tight_layout(pad=0)
plt.show()

Percentage of Review Sentimets

In [ ]:
my_labels = merged_df['Sentiment'].unique()
plt.pie(merged_df['Sentiment'],labels=my_labels,autopct='%1.1f%%')
plt.title('Review Sentiments')
plt.axis('equal')
plt.show()
In [ ]:
!pip install jovian --upgrade -q
In [ ]:
import jovian
In [ ]:
jovian.commit()
In [ ]:
google_playstore_df['Reviews'].min()
In [ ]:
google_playstore_df['Category'].unique()
In [ ]: