Grab links for anchor and image : HTML Parser « Network « Ruby






  1. Ruby
  2. Network
  3. HTML Parser

Grab links for anchor and image


require 'rexml/document'
require 'rexml/streamlistener'
require 'set'

class LinkGrabber
  include REXML::StreamListener
  attr_reader :links

 def initialize(interesting_tags = {'a' => %w{href}, 'img' => %w{src}}.freeze)
    @tags = interesting_tags
    @links = Set.new
  end

  def tag_start(name, attrs)
    @tags[name].each do |uri_attr|
      @links << attrs[uri_attr] if attrs[uri_attr]
    end if @tags[name]
  end

  def parse(text)
    REXML::Document.parse_stream(text, self)
  end
end


text = %{"test
<a href="http://www.example.com/">http://www.example.com/</a>, http://www.example.com/blog/. Email me at <a
href="mailto:bob@example.com">b@e.com</a>.}

grabber = LinkGrabber.new
grabber.parse(text)
p grabber.links








Related examples in the same category

1.Extract URL
2.Customizing HTTP Request Headers
3.Check body size