Python en:Data Structures

Introduction
Data structures are basically just that - they are structures which can hold some data together. In other words, they are used to store a collection of related data.

There are four built-in data structures in Python - list, tuple, dictionary and set. We will see how to use each of them and how they make life easier for us.

List
A list is a data structure that holds an ordered collection of items i.e. you can store a sequence of items in a list. This is easy to imagine if you can think of a shopping list where you have a list of items to buy, except that you probably have each item on a separate line in your shopping list whereas in Python you put commas in between them.

The list of items should be enclosed in square brackets so that Python understands that you are specifying a list. Once you have created a list, you can add, remove or search for items in the list. Since we can add and remove items, we say that a list is a mutable data type i.e. this type can be altered.

Quick Introduction To Objects And Classes
Although I've been generally delaying the discussion of objects and classes till now, a little explanation is needed right now so that you can understand lists better. We will explore this topic in detail later in its own chapter.

A list is an example of usage of objects and classes. When we use a variable i and assign a value to it, say integer 5 to it, you can think of it as creating an object (i.e. instance) i of class (i.e. type) int. In fact, you can read help(int) to understand this better.

A class can also have methods i.e. functions defined for use with respect to that class only. You can use these pieces of functionality only when you have an object of that class. For example, Python provides an append method for the list class which allows you to add an item to the end of the list. For example, mylist.append('an item')</tt> will add that string to the list mylist</tt>. Note the use of dotted notation for accessing methods of the objects.

A class can also have fields which are nothing but variables defined for use with respect to that class only. You can use these variables/names only when you have an object of that class. Fields are also accessed by the dotted notation, for example, mylist.field</tt>.

Example:

Output:

$ python using_list.py   I have 4 items to purchase. These items are: apple mango carrot banana I also have to buy rice. My shopping list is now ['apple', 'mango', 'carrot', 'banana', 'rice'] I will sort my list now Sorted shopping list is ['apple', 'banana', 'carrot', 'mango', 'rice'] The first item I will buy is apple I bought the apple My shopping list is now ['banana', 'carrot', 'mango', 'rice']

How It Works:

The variable shoplist</tt> is a shopping list for someone who is going to the market. In shoplist</tt>, we only store strings of the names of the items to buy but you can add any kind of object to a list including numbers and even other lists.

We have also used the for..in</tt> loop to iterate through the items of the list. By now, you must have realised that a list is also a sequence. The speciality of sequences will be discussed in a later section.

Notice the use of the end</tt> keyword argument to the print</tt> function to indicate that we want to end the output with a space instead of the usual line break.

Next, we add an item to the list using the append</tt> method of the list object, as already discussed before. Then, we check that the item has been indeed added to the list by printing the contents of the list by simply passing the list to the print</tt> statement which prints it neatly.

Then, we sort the list by using the sort</tt> method of the list. It is important to understand that this method affects the list itself and does not return a modified list - this is different from the way strings work. This is what we mean by saying that lists are mutable and that strings are immutable.

Next, when we finish buying an item in the market, we want to remove it from the list. We achieve this by using the del</tt> statement. Here, we mention which item of the list we want to remove and the del</tt> statement removes it from the list for us. We specify that we want to remove the first item from the list and hence we use del shoplist[0]</tt> (remember that Python starts counting from 0).

If you want to know all the methods defined by the list object, see help(list)</tt> for details.

Tuple
Tuples are used to hold together multiple objects. Think of them as similar to lists, but without the extensive functionality that the list class gives you. One major feature of tuples is that they are immutable like strings i.e. you cannot modify tuples.

Tuples are defined by specifying items separated by commas within an optional pair of parentheses.

Tuples are usually used in cases where a statement or a user-defined function can safely assume that the collection of values i.e. the tuple of values used will not change.

Example:

Output:

$ python using_tuple.py   Number of animals in the zoo is 3 Number of cages in the new zoo is 3 All animals in new zoo are ('monkey', 'camel', ('python', 'elephant', 'penguin')) Animals brought from old zoo are ('python', 'elephant', 'penguin') Last animal brought from old zoo is penguin Number of animals in the new zoo is 5

How It Works:

The variable zoo</tt> refers to a tuple of items. We see that the <tt>len</tt> function can be used to get the length of the tuple. This also indicates that a tuple is a sequence as well.

We are now shifting these animals to a new zoo since the old zoo is being closed. Therefore, the <tt>new_zoo</tt> tuple contains some animals which are already there along with the animals brought over from the old zoo. Back to reality, note that a tuple within a tuple does not lose its identity.

We can access the items in the tuple by specifying the item's position within a pair of square brackets just like we did for lists. This is called the indexing operator. We access the third item in <tt>new_zoo</tt> by specifying <tt>new_zoo[2]</tt> and we access the third item within the third item in the <tt>new_zoo</tt> tuple by specifying <tt>new_zoo[2][2]</tt>. This is pretty simple once you've understood the idiom.


 * Parentheses
 * Although the parentheses is optional, I prefer always having them to make it obvious that it is a tuple, especially because it avoids ambiguity. For example, <tt>print(1,2,3)</tt> and <tt>print( (1,2,3) )</tt> mean two different things - the former prints three numbers whereas the latter prints a tuple (which contains three numbers).


 * Tuple with 0 or 1 items
 * An empty tuple is constructed by an empty pair of parentheses such as <tt>myempty = </tt>. However, a tuple with a single item is not so simple. You have to specify it using a comma following the first (and only) item so that Python can differentiate between a tuple and a pair of parentheses surrounding the object in an expression i.e. you have to specify <tt>singleton = (2, )</tt> if you mean you want a tuple containing the item <tt>2</tt>.


 * Note for Perl programmers
 * A list within a list does not lose its identity i.e. lists are not flattened as in Perl. The same applies to a tuple within a tuple, or a tuple within a list, or a list within a tuple, etc. As far as Python is concerned, they are just objects stored using another object, that's all.

Dictionary
A dictionary is like an address-book where you can find the address or contact details of a person by knowing only his/her name i.e. we associate keys (name) with values (details). Note that the key must be unique just like you cannot find out the correct information if you have two persons with the exact same name.

Note that you can use only immutable objects (like strings) for the keys of a dictionary but you can use either immutable or mutable objects for the values of the dictionary. This basically translates to say that you should use only simple objects for keys.

Pairs of keys and values are specified in a dictionary by using the notation <tt>d = {key1 : value1, key2 : value2 }</tt>. Notice that the key-value pairs are separated by a colon and the pairs are separated themselves by commas and all this is enclosed in a pair of curly braces.

Remember that key-value pairs in a dictionary are not ordered in any manner. If you want a particular order, then you will have to sort them yourself before using it.

The dictionaries that you will be using are instances/objects of the <tt>dict</tt> class.

Example:

Output:

$ python using_dict.py   Swaroop's address is swaroop@swaroopch.com There are 3 contacts in the address-book Contact Swaroop at swaroop@swaroopch.com Contact Matsumoto at matz@ruby-lang.org Contact Larry at larry@wall.org Guido's address is guido@python.org

How It Works:

We create the dictionary <tt>ab</tt> using the notation already discussed. We then access key-value pairs by specifying the key using the indexing operator as discussed in the context of lists and tuples. Observe the simple syntax.

We can delete key-value pairs using our old friend - the <tt>del</tt> statement. We simply specify the dictionary and the indexing operator for the key to be removed and pass it to the <tt>del</tt> statement. There is no need to know the value corresponding to the key for this operation.

Next, we access each key-value pair of the dictionary using the <tt>items</tt> method of the dictionary which returns a list of tuples where each tuple contains a pair of items - the key followed by the value. We retrieve this pair and assign it to the variables <tt>name</tt> and <tt>address</tt> correspondingly for each pair using the <tt>for..in</tt> loop and then print these values in the for-block.

We can add new key-value pairs by simply using the indexing operator to access a key and assign that value, as we have done for Guido in the above case.

We can check if a key-value pair exists using the <tt>in</tt> operator or even the <tt>has_key</tt> method of the <tt>dict</tt> class. You can see the documentation for the complete list of methods of the <tt>dict</tt> class using <tt>help(dict)</tt>.


 * Keyword Arguments and Dictionaries
 * On a different note, if you have used keyword arguments in your functions, you have already used dictionaries! Just think about it - the key-value pair is specified by you in the parameter list of the function definition and when you access variables within your function, it is just a key access of a dictionary (which is called the symbol table in compiler design terminology).

Sequences
Lists, tuples and strings are examples of sequences, but what are sequences and what is so special about them?

The major features is that they have membership tests (i.e. the <tt>in</tt> and <tt>not in</tt> expressions) and indexing operations. The indexing operation which allows us to fetch a particular item in the sequence directly.

The three types of sequences mentioned above - lists, tuples and strings, also have a slicing operation which allows us to retrieve a slice of the sequence i.e. a part of the sequence.

Example:

Output:

$ python seq.py   Item 0 is apple Item 1 is mango Item 2 is carrot Item 3 is banana Item -1 is banana Item -2 is carrot Character 0 is s   Item 1 to 3 is ['mango', 'carrot'] Item 2 to end is ['carrot', 'banana'] Item 1 to -1 is ['mango', 'carrot'] Item start to end is ['apple', 'mango', 'carrot', 'banana'] characters 1 to 3 is wa   characters 2 to end is aroop characters 1 to -1 is waroo characters start to end is swaroop

How It Works:

First, we see how to use indexes to get individual items of a sequence. This is also referred to as the subscription operation. Whenever you specify a number to a sequence within square brackets as shown above, Python will fetch you the item corresponding to that position in the sequence. Remember that Python starts counting numbers from 0. Hence, <tt>shoplist[0]</tt> fetches the first item and <tt>shoplist[3]</tt> fetches the fourth item in the <tt>shoplist</tt> sequence.

The index can also be a negative number, in which case, the position is calculated from the end of the sequence. Therefore, <tt>shoplist[-1]</tt> refers to the last item in the sequence and <tt>shoplist[-2]</tt> fetches the second last item in the sequence.

The slicing operation is used by specifying the name of the sequence followed by an optional pair of numbers separated by a colon within square brackets. Note that this is very similar to the indexing operation you have been using till now. Remember the numbers are optional but the colon isn't.

The first number (before the colon) in the slicing operation refers to the position from where the slice starts and the second number (after the colon) indicates where the slice will stop at. If the first number is not specified, Python will start at the beginning of the sequence. If the second number is left out, Python will stop at the end of the sequence. Note that the slice returned starts at the start position and will end just before the end position i.e. the start position is included but the end position is excluded from the sequence slice.

Thus, <tt>shoplist[1:3]</tt> returns a slice of the sequence starting at position 1, includes position 2 but stops at position 3 and therefore a slice of two items is returned. Similarly, <tt>shoplist[:]</tt> returns a copy of the whole sequence.

You can also do slicing with negative positions. Negative numbers are used for positions from the end of the sequence. For example, <tt>shoplist[:-1]</tt> will return a slice of the sequence which excludes the last item of the sequence but contains everything else.

You can also provide a third argument for the slice, which is the step for the slicing (by default, the step size is 1):

Notice that when the step is 2, we get the items with position 0, 2, ... When the step size is 3, we get the items with position 0, 3, etc.

Try various combinations of such slice specifications using the Python interpreter interactively i.e. the prompt so that you can see the results immediately. The great thing about sequences is that you can access tuples, lists and strings all in the same way!

Set
Sets are unordered collections of simple objects. These are used when the existence of an object in a collection is more important than the order or how many times it occurs.

Using sets, you can test for membership, whether it is a subset of another set, find the intersection between two sets, and so on.

How It Works:

The example is pretty much self-explanatory because it involves basic set theory mathematics taught in school.

More About Strings
We have already discussed strings in detail earlier. What more can there be to know? Well, did you know that strings are also objects and have methods which do everything from checking part of a string to stripping spaces!

The strings that you use in program are all objects of the class <tt>str</tt>. Some useful methods of this class are demonstrated in the next example. For a complete list of such methods, see <tt>help(str)</tt>.

Example:

Output:

$ python str_methods.py   Yes, the string starts with "Swa" Yes, it contains the string "a" Yes, it contains the string "war" Brazil_*_Russia_*_India_*_China

How It Works:

Here, we see a lot of the string methods in action. The <tt>startswith</tt> method is used to find out whether the string starts with the given string. The <tt>in</tt> operator is used to check if a given string is a part of the string.

The <tt>find</tt> method is used to do find the position of the given string in the string or returns -1 if it is not successful to find the substring. The <tt>str</tt> class also has a neat method to <tt>join</tt> the items of a sequence with the string acting as a delimiter between each item of the sequence and returns a bigger string generated from this.

Summary
We have explored the various built-in data structures of Python in detail. These data structures will be essential for writing programs of reasonable size.

Now that we have a lot of the basics of Python in place, we will next see how to design and write a real-world Python program.

Previous Next