BeautifulSoup.BeautifulSoup Class Reference

Inheritance diagram for BeautifulSoup.BeautifulSoup:

Public Member Functions
def	__init__
def	__init__
def	extractCharsetFromMeta
def	extractCharsetFromMeta
Public Member Functions inherited from BeautifulSoup.BeautifulStoneSoup
def	__init__
def	__init__
def	endData
def	endData
def	extractCharsetFromMeta
def	extractCharsetFromMeta
def	handle_data
def	handle_data
def	isSelfClosingTag
def	isSelfClosingTag
def	popTag
def	popTag
def	pushTag
def	pushTag
def	reset
def	reset
def	unknown_endtag
def	unknown_endtag
def	unknown_starttag
def	unknown_starttag
Public Member Functions inherited from BeautifulSoup.PageElement
def	append
def	append
def	extract
def	extract
def	findAllNext
def	findAllNext
def	findAllPrevious
def	findAllPrevious
def	findNext
def	findNext
def	findNextSibling
def	findNextSibling
def	findNextSiblings
def	findNextSiblings
def	findParent
def	findParent
def	findParents
def	findParents
def	findPrevious
def	findPrevious
def	findPreviousSibling
def	findPreviousSibling
def	findPreviousSiblings
def	findPreviousSiblings
def	insert
def	insert
def	nextGenerator
def	nextGenerator
def	nextSiblingGenerator
def	nextSiblingGenerator
def	parentGenerator
def	parentGenerator
def	previousGenerator
def	previousGenerator
def	previousSiblingGenerator
def	previousSiblingGenerator
def	replaceWith
def	replaceWith
def	setup
def	setup
def	substituteEncoding
def	substituteEncoding
def	toEncoding
def	toEncoding

Public Attributes
	declaredHTMLEncoding
	originalEncoding
Public Attributes inherited from BeautifulSoup.BeautifulStoneSoup
	builder
	convertEntities
	convertHTMLEntities
	convertXMLEntities
	currentData
	currentTag
	declaredHTMLEncoding
	escapeUnrecognizedEntities
	fromEncoding
	hidden
	instanceSelfClosingTags
	literal
	markup
	markupMassage
	originalEncoding
	parseOnlyThese
	previous
	quoteStack
	smartQuotesTo
	tagStack
Public Attributes inherited from BeautifulSoup.PageElement
	next
	nextSibling
	parent
	previous
	previousSibling

Static Public Attributes
tuple	CHARSET_RE = re.compile("((^|;)\s*charset=)([^;]*)", re.M)
list	NESTABLE_BLOCK_TAGS = ['blockquote', 'div', 'fieldset', 'ins', 'del']
list	NESTABLE_INLINE_TAGS
dictionary	NESTABLE_LIST_TAGS
dictionary	NESTABLE_TABLE_TAGS
tuple	NESTABLE_TAGS
list	NON_NESTABLE_BLOCK_TAGS = ['address', 'form', 'p', 'pre']
tuple	PRESERVE_WHITESPACE_TAGS = set(['pre', 'textarea'])
dictionary	QUOTE_TAGS = {'script' : None, 'textarea' : None}
tuple	RESET_NESTING_TAGS
tuple	SELF_CLOSING_TAGS
Static Public Attributes inherited from BeautifulSoup.BeautifulStoneSoup
	ALL_ENTITIES = XHTML_ENTITIES
string	HTML_ENTITIES = "html"
list	MARKUP_MASSAGE
dictionary	NESTABLE_TAGS = {}
list	PRESERVE_WHITESPACE_TAGS = []
dictionary	QUOTE_TAGS = {}
dictionary	RESET_NESTING_TAGS = {}
string	ROOT_TAG_NAME = u'[document]'
dictionary	SELF_CLOSING_TAGS = {}
dictionary	STRIP_ASCII_SPACES = { 9: None, 10: None, 12: None, 13: None, 32: None, }
string	XHTML_ENTITIES = "xhtml"
string	XML_ENTITIES = "xml"
Static Public Attributes inherited from BeautifulSoup.PageElement
	fetchNextSiblings = findNextSiblings
	fetchParents = findParents
	fetchPrevious = findAllPrevious
	fetchPreviousSiblings = findPreviousSiblings

Detailed Description

This parser knows the following facts about HTML:

* Some tags have no closing tag and should be interpreted as being
  closed as soon as they are encountered.

* The text inside some tags (ie. 'script') may contain tags which
  are not really part of the document and which should be parsed
  as text, not tags. If you want to parse the text as tags, you can
  always fetch it and parse it explicitly.

* Tag nesting rules:

  Most tags can't be nested at all. For instance, the occurance of
  a <p> tag should implicitly close the previous <p> tag.

   <p>Para1<p>Para2
    should be transformed into:
   <p>Para1</p><p>Para2

  Some tags can be nested arbitrarily. For instance, the occurance
  of a <blockquote> tag should _not_ implicitly close the previous
  <blockquote> tag.

   Alice said: <blockquote>Bob said: <blockquote>Blah
    should NOT be transformed into:
   Alice said: <blockquote>Bob said: </blockquote><blockquote>Blah

  Some tags can be nested, but the nesting is reset by the
  interposition of other tags. For instance, a <tr> tag should
  implicitly close the previous <tr> tag within the same <table>,
  but not close a <tr> tag in another table.

   <table><tr>Blah<tr>Blah
    should be transformed into:
   <table><tr>Blah</tr><tr>Blah
    but,
   <tr>Blah<table><tr>Blah
    should NOT be transformed into
   <tr>Blah<table></tr><tr>Blah

Differing assumptions about tag nesting rules are a major source
of problems with the BeautifulSoup class. If BeautifulSoup is not
treating as nestable a tag your page author treats as nestable,
try ICantBelieveItsBeautifulSoup, MinimalSoup, or
BeautifulStoneSoup before writing your own subclass.

Definition at line 1447 of file BeautifulSoup.py.

Constructor & Destructor Documentation

def BeautifulSoup.BeautifulSoup.__init__	(		self,
			args,
			kwargs
	)

Definition at line 1495 of file BeautifulSoup.py.

References BeautifulSoup.BeautifulStoneSoup.HTML_ENTITIES.

Referenced by BeautifulSoup.BeautifulSoup.__init__().

    def __init__(self, *args, **kwargs):
        if not kwargs.has_key('smartQuotesTo'):
            kwargs['smartQuotesTo'] = self.HTML_ENTITIES
        kwargs['isHTML'] = True
        BeautifulStoneSoup.__init__(self, *args, **kwargs)