Python For Data Science Cheat Sheet Lists Also see NumPy ...

Python For Data Science Cheat Sheet

Python Basics

Learn More Python for Data Science Interactively at

Lists

>>>

>>>

>>>

>>>

Also see NumPy Arrays

a = 'is'

b = 'nice'

my_list = ['my', 'list', a, b]

my_list2 = [[4,5,6,7], [3,4,5,6]]

Selecting List Elements

Variables and Data Types

Subset

Variable Assignment

>>> x=5

>>> x

5

>>> my_list[1]

>>> my_list[-3]

Select item at index 1

Select 3rd last item

>>>

>>>

>>>

>>>

Select items at index 1 and 2

Select items a!er index 0

Select items before index 3

Copy my_list

Slice

Calculations With Variables

Sum of two variables

>>> x+2

7

Subtraction of two variables

>>> x-2

3

Multiplication of two variables

>>> x*2

10

Exponentiation of a variable

>>> x**2

25

>>> x%2

my_list[1:3]

my_list[1:]

my_list[:3]

my_list[:]

Subset Lists of Lists

>>> my_list2[1][0]

>>> my_list2[1][:2]

my_list[list][itemOfList]

>>> my_list + my_list

['my', 'list', 'is', 'nice', 'my', 'list', 'is', 'nice']

Division of a variable

['my', 'list', 'is', 'nice', 'my', 'list', 'is', 'nice']

2.5

>>> my_list * 2

str()

'5', '3.45', 'True'

Variables to strings

int()

5, 3, 1

Variables to integers

float()

5.0, 1.0

Variables to floats

bool()

True, True, True

Variables to booleans

Asking For Help

>>> help(str)

my_list.index(a)

my_list.count(a)

my_list.append('!')

my_list.remove('!')

del(my_list[0:1])

my_list.reverse()

my_list.extend('!')

my_list.pop(-1)

my_list.insert(0,'!')

my_list.sort()

'thisStringIsAwesome'

String Operations

>>> my_string * 2

'thisStringIsAwesomethisStringIsAwesome'

>>> my_string + 'Innit'

'thisStringIsAwesomeInnit'

>>> 'm' in my_string

True

Scientific computing

2D plo"ing

Free IDE that is included

with Anaconda

Leading open data science platform

powered by Python

Create and share

documents with live code,

visualizations, text, ...

Numpy Arrays

Also see Lists

Selecting Numpy Array Elements

Subset

Index starts at 0

Select item at index 1

Slice

>>> my_array[0:2]

Get the index of an item

Count an item

Append an item at a time

Remove an item

Remove an item

Reverse the list

Append an item

Remove an item

Insert an item

Sort the list

Select items at index 0 and 1

array([1, 2])

Subset 2D Numpy arrays

my_2darray[rows, columns]

>>> my_2darray[:,0]

array([1, 4])

Numpy Array Operations

>>> my_array > 3

array([False, False, False,

True], dtype=bool)

>>> my_array * 2

array([2, 4, 6, 8])

>>> my_array + np.array([5, 6, 7, 8])

array([6, 8, 10, 12])

Strings

>>> my_string = 'thisStringIsAwesome'

>>> my_string

Machine learning

2

List Methods

>>>

>>>

>>>

>>>

>>>

>>>

>>>

>>>

>>>

>>>

Data analysis

Install Python

>>> my_array[1]

>>> my_list2 > 4

True

Types and Type Conversion

Import libraries

>>> import numpy

>>> import numpy as np

Selective import

>>> from math import pi

>>> my_list = [1, 2, 3, 4]

>>> my_array = np.array(my_list)

>>> my_2darray = np.array([[1,2,3],[4,5,6]])

List Operations

Remainder of a variable

1

>>> x/float(2)

Index starts at 0

Libraries

String Operations

Index starts at 0

>>> my_string[3]

>>> my_string[4:9]

String Methods

>>>

>>>

>>>

>>>

>>>

String to uppercase

my_string.upper()

String to lowercase

my_string.lower()

Count String elements

my_string.count('w')

my_string.replace('e', 'i') Replace String elements

my_string.strip()

Strip whitespaces

Numpy Array Functions

>>>

>>>

>>>

>>>

>>>

>>>

>>>

>>>

my_array.shape

np.append(other_array)

np.insert(my_array, 1, 5)

np.delete(my_array,[1])

np.mean(my_array)

np.median(my_array)

my_array.corrcoef()

np.std(my_array)

DataCamp

Get the dimensions of the array

Append items to an array

Insert items in an array

Delete items in an array

Mean of the array

Median of the array

Correlation coe?cient

Standard deviation

Learn Python for Data Science Interactively

Python For Data Science Cheat Sheet

Jupyter Notebook

Working with Different Programming Languages

Widgets

Kernels provide computation and communication with front-end interfaces

like the notebooks. There are three main kernels:

Notebook widgets provide the ability to visualize and control changes

in your data, often as a control like a slider, textbox, etc.

Learn More Python for Data Science Interactively at

IRkernel

IJulia

Installing Jupyter Notebook will automatically install the IPython kernel.

Saving/Loading Notebooks

Make a copy of the

current notebook

Save current notebook

and record checkpoint

Preview of the printed

notebook

Close notebook & stop

running any scripts

Interrupt kernel

Restart kernel

Create new notebook

Open an existing

notebook

Rename notebook

Revert notebook to a

previous checkpoint

You can use them to build interactive GUIs for your notebooks or to

synchronize stateful and stateless information between Python and

JavaScript.

Interrupt kernel &

clear all output

Restart kernel & run

all cells

Connect back to a

remote notebook

Restart kernel & run

all cells

Download serialized

state of all widget

models in use

Save notebook

with interactive

widgets

Embed current

widgets

Run other installed

kernels

Command Mode:

Download notebook as

- IPython notebook

- Python

- HTML

- Markdown

- reST

- LaTeX

- PDF

15

13

1

2

3

4

5

6

7

8

9

10

11

14

12

Writing Code And Text

Code and text are encapsulated by 3 basic cell types: markdown cells, code

cells, and raw NBConvert cells.

Edit Mode:

Edit Cells

Cut currently selected cells

to clipboard

Paste cells from

clipboard above

current cell

Paste cells from

clipboard on top

of current cel

Revert ¡°Delete Cells¡±

invocation

Copy cells from

clipboard to current

cursor position

Paste cells from

clipboard below

current cell

Delete current cells

Split up a cell from

current cursor

position

Merge current cell

with the one above

Merge current cell

with the one below

Move current cell up

Move current cell

down

Adjust metadata

underlying the

current notebook

Remove cell

attachments

Paste attachments of

current cell

Find and replace

in selected cells

Copy attachments of

current cell

Insert image in

selected cells

Executing Cells

Run selected cell(s)

Run current cells down

and create a new one

above

Add new cell below the

current one

Run all cells

Run all cells above the

current cell

Run all cells below

the current cell

Change the cell type of

current cell

toggle, toggle

scrolling and clear

current outputs

toggle, toggle

scrolling and clear

all output

Toggle display of Jupyter

logo and filename

Toggle display of cell

action icons:

Toggle line numbers

in cells

Walk through a UI tour

List of built-in keyboard

shortcuts

Edit the built-in

keyboard shortcuts

Notebook help topics

Description of

markdown available

in notebook

Information on

unofficial Jupyter

Notebook extensions

IPython help topics

NumPy help topics

Toggle display of toolbar

- None

- Edit metadata

- Raw cell format

- Slideshow

- Attachments

- Tags

9. Interrupt kernel

10. Restart kernel

11. Display characteristics

12. Open command palette

13. Current kernel

14. Kernel status

15. Log out from notebook server

Asking For Help

Python help topics

View Cells

Insert Cells

Add new cell above the

current one

Run current cells down

and create a new one

below

1. Save and checkpoint

2. Insert cell below

3. Cut cell

4. Copy cell(s)

5. Paste cell(s) below

6. Move cell up

7. Move cell down

8. Run current cell

SciPy help topics

Matplotlib help topics

SymPy help topics

Pandas help topics

About Jupyter Notebook

DataCamp

Learn Python for Data Science Interactively

Python For Data Science Cheat Sheet

NumPy Basics

Learn Python for Data Science Interactively at

NumPy

2

The NumPy library is the core library for scientific computing in

Python. It provides a high-performance multidimensional array

object, and tools for working with these arrays.

>>> import numpy as np

2D array

3D array

axis 1

axis 0

1.5

2

3

4

5

6

axis 2

axis 1

axis 0

>>> a = np.array([1,2,3])

>>> b = np.array([(1.5,2,3), (4,5,6)], dtype = float)

>>> c = np.array([[(1.5,2,3), (4,5,6)], [(3,2,1), (4,5,6)]],

dtype = float)

Initial Placeholders

>>> np.zeros((3,4))

Create an array of zeros

>>> np.ones((2,3,4),dtype=np.int16) Create an array of ones

>>> d = np.arange(10,25,5)

Create an array of evenly

spaced values (step value)

>>> np.linspace(0,2,9)

Create an array of evenly

spaced values (number of samples)

>>> e = np.full((2,2),7)

Create a constant array

>>> f = np.eye(2)

Create a 2X2 identity matrix

>>> np.random.random((2,2))

Create an array with random values

>>> np.empty((3,2))

Create an empty array

I/O

Saving & Loading On Disk

>>> np.save('my_array', a)

>>> np.savez('array.npz', a, b)

>>> np.load('my_array.npy')

Saving & Loading Text Files

>>> np.loadtxt("myfile.txt")

>>> np.genfromtxt("my_file.csv", delimiter=',')

>>> np.savetxt("myarray.txt", a, delimiter=" ")

Data Types

np.int64

np.float32

plex

np.bool

np.object

np.string_

np.unicode_

Subtraction

4. ,

7. ,

6. ],

9. ]])

array([[ 0.66666667, 1.

[ 0.25

, 0.4

Signed 64-bit integer types

Standard double-precision floating point

Complex numbers represented by 128 floats

Boolean type storing TRUE and FALSE values

Python object type

Fixed-length string type

Fixed-length unicode type

4. ,

10. ,

, 1.

, 0.5

],

]])

Division

Multiplication

9. ],

18. ]])

Multiplication

Exponentiation

Square root

Print sines of an array

Element-wise cosine

Element-wise natural logarithm

Dot product

np.multiply(a,b)

np.exp(b)

np.sqrt(b)

np.sin(a)

np.cos(b)

np.log(a)

e.dot(f)

7.],

7.]])

>>> a == b

Element-wise comparison

>>> a < 2

Element-wise comparison

>>> np.array_equal(a, b)

Array-wise comparison

array([[False, True, True],

[False, False, False]], dtype=bool)

array([True, False, False], dtype=bool)

Aggregate Functions

a.sum()

a.min()

b.max(axis=0)

b.cumsum(axis=1)

a.mean()

b.median()

a.corrcoef()

np.std(b)

Array-wise sum

Array-wise minimum value

Maximum value of an array row

Cumulative sum of the elements

Mean

Median

Correlation coe?cient

Standard deviation

3

5

6

Select the element at row 1 column 2

(equivalent to b[1][2])

1

2

3

Select items at index 0 and 1

1.5

2

3

Select items at rows 0 and 1 in column 1

4

5

6

1.5

2

3

4

5

6

Slicing

>>> a[0:2]

5.])

>>> c[1,...]

Select all items at row 0

(equivalent to b[0:1, :])

Same as [1,:,:]

>>> a[ : :-1]

Reversed array a

array([[[ 3., 2., 1.],

[ 4., 5., 6.]]])

Boolean Indexing

>>> a[a first')

Date

Type

Query DataFrame

a

11.432

Type

1 2016-03-02

b

13.031

Date

a

c

b

2 2016-03-01

c

20.784

2016-03-01

11.432

NaN

20.784

3 2016-03-03

a

99.906

2016-03-02

1.303

13.031

NaN

4 2016-03-02

a

1.303

2016-03-03

c

99.906

NaN

20.784

5 2016-03-03

20.784

>>> df4 = pd.pivot_table(df2,

Spread rows into columns

values='Value',

index='Date',

columns='Type'])

Stack / Unstack

Pivot a level of column labels

Pivot a level of index labels

>>> stacked = df5.stack()

>>> stacked.unstack()

1 5 0 0.233482

1

0

1 5 0.233482 0.390959

1 0.390959

2 4 0.184713 0.237102

2 4 0 0.184713

Unstacked

3 3 0 0.433522

Stacked

Melt

>>> pd.melt(df2,

Gather columns into rows

id_vars=["Date"],

value_vars=["Type", "Value"],

value_name="Observations")

0 2016-03-01

a

11.432

1 2016-03-02

b

13.031

2 2016-03-01

c

20.784

3 2016-03-03

a

99.906

4 2016-03-02

a

1.303

5 2016-03-03

c

20.784

"Capital":"cptl",

"Population":"ppltn"})

X3

a

11.432

a

20.784

b

1.303

b

NaN

c

99.906

d

20.784

X1

>>> pd.merge(data1,

data2,

how='left',

on='X1')

Date

0

1

2

3

4

5

6

7

8

9

10

11

2016-03-01

2016-03-02

2016-03-01

2016-03-03

2016-03-02

2016-03-03

2016-03-01

2016-03-02

2016-03-01

2016-03-03

2016-03-02

2016-03-03

Variable Observations

Type

Type

Type

Type

Type

Type

Value

Value

Value

Value

Value

Value

Backward Filling

>>> df.reindex(range(4),

method='ffill')

0

1

2

3

Country

Belgium

India

Brazil

Brazil

Capital

Brussels

New Delhi

Bras¨ªlia

Bras¨ªlia

Population

11190846

1303171035

207847528

207847528

>>> s3 = s.reindex(range(5),

method='bfill')

0

1

2

3

4

3

3

3

3

3

a

b

c

a

a

c

11.432

13.031

20.784

99.906

1.303

20.784

1.303

NaN

c

99.906

NaN

X2

X3

a

11.432 20.784

b

1.303

NaN

d

NaN

20.784

X2

X3

a

11.432 20.784

b

1.303

NaN

X2

X3

X1

a

11.432 20.784

b

1.303

c

99.906

NaN

d

NaN

20.784

>>> data1.join(data2, how='right')

Concatenate

s3.unique()

df2.duplicated('Type')

df2.drop_duplicates('Type', keep='last')

df.index.duplicated()

Return unique values

Check duplicates

Drop duplicates

Check index duplicates

Grouping Data

Vertical

>>> s.append(s2)

Horizontal/Vertical

>>> pd.concat([s,s2],axis=1, keys=['One','Two'])

>>> pd.concat([data1, data2], axis=1, join='inner')

Dates

>>> df2['Date']= pd.to_datetime(df2['Date'])

>>> df2['Date']= pd.date_range('2000-1-1',

periods=6,

freq='M')

>>> dates = [datetime(2012,5,1), datetime(2012,5,2)]

>>> index = pd.DatetimeIndex(dates)

>>> index = pd.date_range(datetime(2012,2,1), end, freq='BM')

Visualization

Aggregation

>>> df2.groupby(by=['Date','Type']).mean()

>>> df4.groupby(level=0).sum()

>>> df4.groupby(level=0).agg({'a':lambda x:sum(x)/len(x),

'b': np.sum})

Also see Matplotlib

>>> import matplotlib.pyplot as plt

>>> s.plot()

>>> plt.show()

>>> df2.plot()

>>> plt.show()

Transformation

>>> customSum = lambda x: (x+x%2)

>>> df4.groupby(level=0).transform(customSum)

Missing Data

Iteration

(Column-index, Series) pairs

(Row-index, Series) pairs

>>> df.dropna()

>>> df3.fillna(df3.mean())

>>> df2.replace("a", "f")

NaN

Join

Duplicate Data

>>>

>>>

>>>

>>>

b

X1

>>> pd.merge(data1,

data2,

how='outer',

on='X1')

X3

11.432 20.784

X1

>>> pd.merge(data1,

data2,

how='right',

on='X1')

>>> s2 = s.reindex(['a','c','d','e','b'])

Forward Filling

X2

a

>>> pd.merge(data1,

data2,

how='inner',

on='X1')

>>> arrays = [np.array([1,2,3]),

np.array([5,4,3])]

>>> df5 = pd.DataFrame(np.random.rand(3, 2), index=arrays)

>>> tuples = list(zip(*arrays))

>>> index = pd.MultiIndex.from_tuples(tuples,

names=['first', 'second'])

>>> df6 = pd.DataFrame(np.random.rand(3, 2), index=index)

>>> df2.set_index(["Date", "Type"])

1 0.429401

Value

Set the index

Reset the index

Rename DataFrame

MultiIndexing

1 0.237102

3 3 0.433522 0.429401

Type

Se!ing/Rese!ing Index

>>> df.set_index('Country')

>>> df4 = df.reset_index()

>>> df = df.rename(index=str,

columns={"Country":"cntry",

Reindexing

Pivot Table

>>> df.iteritems()

>>> df.iterrows()

X1

Value

0 2016-03-01

Date

Query

X2

Merge

Where

>>> df3= df2.pivot(index='Date',

columns='Type',

values='Value')

data2

X1

Drop NaN values

Fill NaN values with a predetermined value

Replace values with others

DataCamp

Learn Python for Data Science Interactively

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download