问题描述
我正在尝试从一个带有div标签中的项目列表的网站抓取数据。然后在单个项目中，两个单独的部分也用div标签制成。一个带有图像，另一个带有文本和描述。在startElement中，我可以使用Attribute标识它们，但不能以endElement结尾。如何解析带有相同标签的项目？
我要抓取的项目示例：
<html>
<head>
<Meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>JSP Page</title>
</head>
<body>
<div class="o-ResultCard__m-MediaBlock m-MediaBlock">
<div class="m-MediaBlock__m-textwrap">
<h3 class="m-MediaBlock__a-Headline">
<a href="abc.com"><span class="m-MediaBlock__a-HeadlineText">Air Fryer Chicken Wings</span></a>
</h3>
<div class="parbase recipeInfo time">
<section class="o-RecipeInfo__o-Time">
<dl>
<dt class="o-RecipeInfo__a-Headline a-Headline">Total Time: 40 minutes</dt>
</dl>
</section>
</div>
</div>
<div class="m-MediaBlock__m-MediaWrap">
<a href="abc.com" class="" title="Air Fryer Chicken Wings">
<img src="https://dinnerthendessert.com/wp-content/uploads/2019/01/Fried-Chicken-2.jpg" class="m-MediaBlock__a-Image" alt="Air Fryer Chicken Wings">
</a>
</div>
</div>
</body>
我的处理程序：
private String currentTag;
private FoodDAO dao;
private FoodsDTO dto;
private String itemIdentify = "o-ResultCard__m-MediaBlock m-MediaBlock";
private String itemmedia = "m-MediaBlock__m-MediaWrap";
private String itemText = "m-MediaBlock__m-textwrap";
private boolean foundItem;
public FoodHandler() {
dao = new FoodDAO();
foundItem = false;
}
@Override
public void startElement(String uri,String localName,String qName,Attributes attributes) throws SAXException {
String attrVal = attributes.getValue(0);
if (qName.equals("div") && attrVal.equals(itemIdentify)) {
dto = new FoodsDTO();
foundItem = true;
}
currentTag = qName;
}
@Override
public void endElement(String uri,String qName) throws SAXException {
if (qName.endsWith("div")) {
foundItem = false;
try {
dao.manageCrawl(dto);
} catch (Exception e) {
Logger.getLogger(NewsHandler.class.getName()).log(Level.SEVERE,null,e);
}
}
currentTag = "";
}
解决方法
停止堆栈中的属性。
更具体地说，将属性的副本存储在Deque中：
private Deque<Attributes> attributesStack = new ArrayDeque<>();
@Override
public void startDocument() throws SAXException {
// Clear the stack at start of parsing,in case this handler is
// re-used for multiple parsing operations,and previous parse failed.
attributesStack.clear();
}
@Override
public void startElement(String uri,String localName,String qName,Attributes attributes) throws SAXException {
attributesStack.push(new AttributesImpl(attributes)); // Attributes must be copied
// code here
}
@Override
public void endElement(String uri,String qName) throws SAXException {
Attributes attributes = attributesStack.pop();
// code here
}