5 Best Ways to Get Data from a Specific Cell in a Table with Selenium and Python

by

💡 Problem Formulation: In web automation with Selenium, you may often need to extract data from a specific cell in an HTML table. For instance, locating a cell value at the second row and second column. This article demonstrates different methods for achieving this in Selenium using Python. The aim is to retrieve the text ‘Alice’ from the given cell in the following sample table:

<table>
    <tr><th>Name</th><th>Age</th></tr>
    <tr><td>John</td><td>30</td></tr>
    <tr><td>Alice</td><td>25</td></tr>
</table>
You want your output to be ‘Alice’.

Method 1: Using XPath to Locate the Cell

XPath allows you to navigate through elements and attributes in an XML document, which is also applicable for HTML documents used for web pages. Using XPath to locate a table cell, a specific cell can be targeted by its position in the table.

♥️ Info: Are you AI curious but you still have to create real impactful projects? Join our official AI builder club on Skool (only $5): SHIP! - One Project Per Month

Here’s an example:

from selenium import webdriver

browser = webdriver.Chrome()
browser.get('http://example.com/table')
cell_value = browser.find_element_by_xpath('//table/tr[3]/td[2]').text
print(cell_value)

Output:

Alice

The example uses Selenium to open the webpage that contains the table. By using the xpath method along with the correct XPath query, it locates the second cell in the second row and prints its text content.

Method 2: Using CSS Selector to Locate the Cell

CSS Selectors are patterns that select elements based on their id, classes, types, attributes, values of attributes, etc. They’re often used for styling but can also be used to select elements for manipulation via JavaScript or Selenium.

Here’s an example:

from selenium import webdriver

browser = webdriver.Chrome()
browser.get('http://example.com/table')
cell_value = browser.find_element_by_css_selector('table tr:nth-child(3) td:nth-child(2)').text
print(cell_value)

Output:

Alice

This snippet utilizes a CSS selector to find the second cell in the third row (which includes table headers as the first row in most cases). After retrieving the WebElement, the text property gives us the cell content.

Method 3: Using Row and Cell Indices with Selenium WebElements

Another approach involves first locating the entire table, then iterating to the desired row and cell based on their indices. This method is more adaptable to changes in table size or structure.

Here’s an example:

from selenium import webdriver

browser = webdriver.Chrome()
browser.get('http://example.com/table')
rows = browser.find_elements_by_xpath('//table/tr')
cell_value = rows[2].find_elements_by_tag_name('td')[1].text
print(cell_value)

Output:

Alice

Here, we fetch all row elements first and then locate the required cell within the specified row. Indices are zero-based, so the second index corresponds to the third row/column in this context.

Method 4: Using Selenium’s TableRow and TableCell

Selenium’s support package includes classes TableRow and TableCell that act as abstractions for table rows and cells. You can leverage these to make table handling more intuitive.

(Note: Method 4 utilizes components that may not be natively supported in primary Selenium packages and might require additional custom implementation.)

Here’s an example:

from selenium import webdriver
from selenium.webdriver.support.ui import TableRow, TableCell

browser = webdriver.Chrome()
browser.get('http://example.com/table')
row = TableRow(browser, row_index=2)
cell = TableCell(row, cell_index=1)
cell_value = cell.element.text
print(cell_value)

Output:

Alice

(For this specific code to work, TableRow and TableCell classes need to be created or brought in from a third-party library that extends Selenium’s functionality.)

Bonus One-Liner Method 5: Using Chained Locator Strategy

Combining locators enables you to write concise code by chaining method calls to move down the DOM hierarchy. This is a compact and readable way to get the cell data.

Here’s an example:

from selenium import webdriver

browser = webdriver.Chrome()
browser.get('http://example.com/table')
cell_value = browser.find_element_by_xpath('//table').find_element_by_xpath('.//tr[3]/td[2]').text
print(cell_value)

Output:

Alice

The first find_element_by_xpath call locates the table, then the chained find_element_by_xpath with a dot at the beginning of the XPath expression searches only within the previously found table element.

Summary/Discussion

  • Method 1: Using XPath. Strengths: Direct and precise. Weaknesses: Brittle if the structure changes.
  • Method 2: Using CSS Selector. Strengths: Clean and stylistically familiar to front-end developers. Weaknesses: Similarly brittle as XPath.
  • Method 3: Using Indices with WebElements. Strengths: More adaptable to structural changes. Weaknesses: Requires more code and can be slower with large tables.
  • Method 4: Using Selenium’s TableRow and TableCell. Strengths: Abstract and intuitive. Weaknesses: May require additional utilities not found in the primary Selenium package.
  • Bonus Method 5: Chained Locator Strategy. Strengths: Concise. Weaknesses: Clarity can suffer in complex DOM structures.