Jovian
Sign In
Learn practical skills, build real-world projects, and advance your career
4 years ago
!pip install jovian --upgrade --quiet
!pip install scipy
!pip install pandas
!pip install numpy
!pip install matplotlib
!pip install pingouin
Requirement already satisfied: scipy in /srv/conda/envs/notebook/lib/python3.7/site-packages (1.5.2) Requirement already satisfied: numpy>=1.14.5 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from scipy) (1.19.2) Requirement already satisfied: pandas in /srv/conda/envs/notebook/lib/python3.7/site-packages (1.1.3) Requirement already satisfied: numpy>=1.15.4 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pandas) (1.19.2) Requirement already satisfied: python-dateutil>=2.7.3 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pandas) (2.8.0) Requirement already satisfied: pytz>=2017.2 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pandas) (2020.1) Requirement already satisfied: six>=1.5 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from python-dateutil>=2.7.3->pandas) (1.12.0) Requirement already satisfied: numpy in /srv/conda/envs/notebook/lib/python3.7/site-packages (1.19.2) Requirement already satisfied: matplotlib in /srv/conda/envs/notebook/lib/python3.7/site-packages (3.3.2) Requirement already satisfied: python-dateutil>=2.1 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (2.8.0) Requirement already satisfied: numpy>=1.15 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (1.19.2) Requirement already satisfied: pillow>=6.2.0 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (7.2.0) Requirement already satisfied: certifi>=2020.06.20 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (2020.6.20) Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.3 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (2.4.7) Requirement already satisfied: cycler>=0.10 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (0.10.0) Requirement already satisfied: kiwisolver>=1.0.1 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib) (1.2.0) Requirement already satisfied: six>=1.5 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from python-dateutil>=2.1->matplotlib) (1.12.0) Collecting pingouin Downloading https://files.pythonhosted.org/packages/e6/5f/4618f878765a8b7037b8831f19105c5c2764b26e5e9afa4a29c58fc11d26/pingouin-0.3.8.tar.gz (223kB) |████████████████████████████████| 225kB 3.3MB/s eta 0:00:01 Requirement already satisfied: numpy>=1.15 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pingouin) (1.19.2) Requirement already satisfied: scipy>=1.3 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pingouin) (1.5.2) Requirement already satisfied: pandas>=0.24 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pingouin) (1.1.3) Requirement already satisfied: matplotlib>=3.0.2 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pingouin) (3.3.2) Collecting seaborn>=0.9.0 (from pingouin) Downloading https://files.pythonhosted.org/packages/bc/45/5118a05b0d61173e6eb12bc5804f0fbb6f196adb0a20e0b16efc2b8e98be/seaborn-0.11.0-py3-none-any.whl (283kB) |████████████████████████████████| 286kB 10.1MB/s eta 0:00:01 Collecting statsmodels>=0.10.0 (from pingouin) Downloading https://files.pythonhosted.org/packages/ff/68/ca52fc6a114141f13dfaee340fc355e2825753f1cbe3702a13a5046e16de/statsmodels-0.12.0-cp37-cp37m-manylinux1_x86_64.whl (9.5MB) |████████████████████████████████| 9.5MB 16.3MB/s eta 0:00:01 Collecting scikit-learn (from pingouin) Downloading https://files.pythonhosted.org/packages/f4/cb/64623369f348e9bfb29ff898a57ac7c91ed4921f228e9726546614d63ccb/scikit_learn-0.23.2-cp37-cp37m-manylinux1_x86_64.whl (6.8MB) |████████████████████████████████| 6.8MB 36.2MB/s eta 0:00:01 Collecting pandas_flavor>=0.1.2 (from pingouin) Downloading https://files.pythonhosted.org/packages/9a/57/7fbcff4c0961ed190ac5fcb0bd8194152ee1ee6487edf64fdbae16e2bc4b/pandas_flavor-0.2.0-py2.py3-none-any.whl Collecting outdated (from pingouin) Downloading https://files.pythonhosted.org/packages/86/70/2f166266438a30e94140f00c99c0eac1c45807981052a1d4c123660e1323/outdated-0.2.0.tar.gz Collecting tabulate (from pingouin) Downloading https://files.pythonhosted.org/packages/c4/f4/770ae9385990f5a19a91431163d262182d3203662ea2b5739d0fcfc080f1/tabulate-0.8.7-py3-none-any.whl Requirement already satisfied: python-dateutil>=2.7.3 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pandas>=0.24->pingouin) (2.8.0) Requirement already satisfied: pytz>=2017.2 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from pandas>=0.24->pingouin) (2020.1) Requirement already satisfied: kiwisolver>=1.0.1 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib>=3.0.2->pingouin) (1.2.0) Requirement already satisfied: pillow>=6.2.0 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib>=3.0.2->pingouin) (7.2.0) Requirement already satisfied: cycler>=0.10 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib>=3.0.2->pingouin) (0.10.0) Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.3 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib>=3.0.2->pingouin) (2.4.7) Requirement already satisfied: certifi>=2020.06.20 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from matplotlib>=3.0.2->pingouin) (2020.6.20) Collecting patsy>=0.5 (from statsmodels>=0.10.0->pingouin) Downloading https://files.pythonhosted.org/packages/ea/0c/5f61f1a3d4385d6bf83b83ea495068857ff8dfb89e74824c6e9eb63286d8/patsy-0.5.1-py2.py3-none-any.whl (231kB) |████████████████████████████████| 235kB 23.9MB/s eta 0:00:01 Collecting joblib>=0.11 (from scikit-learn->pingouin) Downloading https://files.pythonhosted.org/packages/fc/c9/f58220ac44a1592f79a343caba12f6837f9e0c04c196176a3d66338e1ea8/joblib-0.17.0-py3-none-any.whl (301kB) |████████████████████████████████| 307kB 34.7MB/s eta 0:00:01 Collecting threadpoolctl>=2.0.0 (from scikit-learn->pingouin) Downloading https://files.pythonhosted.org/packages/f7/12/ec3f2e203afa394a149911729357aa48affc59c20e2c1c8297a60f33f133/threadpoolctl-2.1.0-py3-none-any.whl Collecting xarray (from pandas_flavor>=0.1.2->pingouin) Downloading https://files.pythonhosted.org/packages/7a/cc/62ca520e349e63b05ce43c781757cbd3bea71d83ece96f2176763b57e8c2/xarray-0.16.1-py3-none-any.whl (720kB) |████████████████████████████████| 727kB 31.8MB/s eta 0:00:01 Collecting littleutils (from outdated->pingouin) Downloading https://files.pythonhosted.org/packages/4e/b1/bb4e06f010947d67349f863b6a2ad71577f85590180a935f60543f622652/littleutils-0.2.2.tar.gz Requirement already satisfied: requests in /srv/conda/envs/notebook/lib/python3.7/site-packages (from outdated->pingouin) (2.22.0) Requirement already satisfied: six>=1.5 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from python-dateutil>=2.7.3->pandas>=0.24->pingouin) (1.12.0) Requirement already satisfied: setuptools>=38.4 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from xarray->pandas_flavor>=0.1.2->pingouin) (41.0.1) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from requests->outdated->pingouin) (1.25.3) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from requests->outdated->pingouin) (3.0.4) Requirement already satisfied: idna<2.9,>=2.5 in /srv/conda/envs/notebook/lib/python3.7/site-packages (from requests->outdated->pingouin) (2.8) Building wheels for collected packages: pingouin, outdated, littleutils Building wheel for pingouin (setup.py) ... done Created wheel for pingouin: filename=pingouin-0.3.8-cp37-none-any.whl size=221687 sha256=6e476f2b3a82b94019dda7b57b8d176b856ce455b2c01d7ca856e879726e299e Stored in directory: /home/jovyan/.cache/pip/wheels/d6/9e/53/f885f73f29cf7c8cac3d8f4b1532bbfef2f5eb543946ac9055 Building wheel for outdated (setup.py) ... done Created wheel for outdated: filename=outdated-0.2.0-cp37-none-any.whl size=4962 sha256=56f48d35b52df4d2d3623e91cd796bee52a5accc8c0215b3a2f2217bdbd317a0 Stored in directory: /home/jovyan/.cache/pip/wheels/fd/7c/ef/814f514d31197310872b5abf353feb8fef9d67ee658e1e7e39
Building wheel for littleutils (setup.py) ... done Created wheel for littleutils: filename=littleutils-0.2.2-cp37-none-any.whl size=7050 sha256=ec4177b99ec51261244d19a865e644ac1007c6be9c18c6d44b0afb45767cf688 Stored in directory: /home/jovyan/.cache/pip/wheels/53/16/9f/ac67d15c40243754fd73f620e1b9b6dedc20492ecc19a2bae1 Successfully built pingouin outdated littleutils Installing collected packages: seaborn, patsy, statsmodels, joblib, threadpoolctl, scikit-learn, xarray, pandas-flavor, littleutils, outdated, tabulate, pingouin Successfully installed joblib-0.17.0 littleutils-0.2.2 outdated-0.2.0 pandas-flavor-0.2.0 patsy-0.5.1 pingouin-0.3.8 scikit-learn-0.23.2 seaborn-0.11.0 statsmodels-0.12.0 tabulate-0.8.7 threadpoolctl-2.1.0 xarray-0.16.1

Importing the required packages

import jovian
import scipy
import numpy as np
import pandas as pd
from random import seed
from random import randint
from random import random
from scipy import stats
import numpy as np
import pingouin as pg
import matplotlib.pyplot as plt

Creating the fake dataset

Though you can use the original dataset by seperating the Independent Variable as well as the dependent variable

X=[]
Y=[]
Xcatt=[]
for i in range(0,21):
    X.append(randint(0,20000))
    X.append(random())
    
print(len(X)) 
for i in range(0,42):
    Y.append(randint(0,3000))

for i in range(0,42):
    
    Xcatt.append(randint(0,2))
    

print(len(Y))
42 42