久久久久久久av_日韩在线中文_看一级毛片视频_日本精品二区_成人深夜福利视频_武道仙尊动漫在线观看

Java爬蟲實(shí)現(xiàn)Jsoup利用dom方法遍歷Document對(duì)象

本文主要介紹了Java爬蟲實(shí)現(xiàn)Jsoup利用dom方法遍歷Document對(duì)象,文中通過(guò)示例代碼介紹的非常詳細(xì),對(duì)大家的學(xué)習(xí)或者工作具有一定的參考學(xué)習(xí)價(jià)值,需要的朋友們下面隨著小編來(lái)一起學(xué)習(xí)

先給出網(wǎng)頁(yè)地址:

https://wall.alphacoders.com/featured.php?lang=Chinese

主要步驟:

利用Jsoup的connect方法獲取Document對(duì)象

String html = "https://wall.alphacoders.com/featured.php?lang=Chinese";
Document doc = Jsoup.connect(html).get();

內(nèi)容過(guò)長(zhǎng),就不再顯示。

我們以這部分為例:

<ul class="nav nav-pills"> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >About Us</a></li> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >FAQ</a></li> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >Privacy Policy</a></li> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >Terms Of Service</a></li> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >Acceptable Use</a></li> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >Etiquette</a></li> 
    <li><a  rel="external nofollow"  rel="external nofollow"  >Advertise With Us</a></li> 
    <li><a id="change_consent">Change Consent</a></li> 
</ul> 

我們先找到所有的ul:

Elements elements = doc.getElementsByTag("ul");

輸出如下:

<ul class="nav navbar-nav center"> 
 <li> <a title="Submit Wallpapers"  rel="external nofollow" ><i class="el el-circle-arrow-up"></i> 提交</a> </li> 
 <li> <a  rel="external nofollow" ><i class="el el-gift"></i> 精美獎(jiǎng)品</a> </li> 
</ul>
<ul class="nav navbar-nav navbar-right center"> 
 <li> <a href="language.php?lang=Chinese" rel="external nofollow" > <img src="https://static.alphacoders.com/wa/Chinese-flag.png" alt="Chinese-flag">   中文    </a> </li> 
 <li> <a   rel="external nofollow" ><i class="el el-user"></i> 登錄</a> </li> 
 <li> <a  rel="external nofollow" ><i class="el el-edit"></i> 注冊(cè)</a> </li> 
</ul>
<ul class="pagination"> 
 <li class="active"><a id="prev_page" href="#" rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >&lt; 上一頁(yè)</a></li> 
 <li class="active"><a>1</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >2</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >3</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >4</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >5</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >6</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >7</a></li> 
 <li><a  rel="external nofollow" >8</a></li> 
 <li><a  rel="external nofollow" >9</a></li> 
 <li><a  rel="external nofollow" >10</a></li> 
 <li><a>...</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >319</a></li> 
 <li><a id="next_page"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >下一頁(yè) &gt;</a></li> 
</ul>
<ul class="pagination"> 
 <li class="active"><a href="#" rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >&lt; 上一頁(yè)</a></li> 
 <li class="active"><a>1</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >2</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >3</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >4</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >5</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >6</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >7</a></li> 
 <li><a>...</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >319</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >下一頁(yè) &gt;</a></li> 
</ul>
<ul class="pagination"> 
 <li class="active"><a href="#" rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >&lt;&lt; </a></li> 
 <li class="active"><a href="#" rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >&lt; 上一頁(yè)</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >下一頁(yè) &gt;</a></li> 
 <li><a title="末頁(yè) (319)"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" > &gt;&gt;</a></li> 
</ul>
<ul class="pagination"> 
 <li class="active"><a href="#" rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >1</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >2</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >3</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >4</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >5</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >6</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  rel="external nofollow" >7</a></li> 
</ul>
<ul class="nav nav-pills"> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >About Us</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >FAQ</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >Privacy Policy</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >Terms Of Service</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >Acceptable Use</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >Etiquette</a></li> 
 <li><a  rel="external nofollow"  rel="external nofollow"  >Advertise With Us</a></li> 
 <li><a id="change_consent">Change Consent</a></li> 
</ul>

可以發(fā)現(xiàn)class為"nav nav-pills"的只有一個(gè),我們找到它:

Elements elements = doc.getElementsByTag("ul");
        //System.out.println(elements);
Element tempElement = null;
for(Element element : elements) {
    if (element.className().equals("nav nav-pills")) {
        tempElement = element;
        //System.out.println(element.className());
        break;
    }
}

循環(huán)遍歷這個(gè)ul,輸出其中每一個(gè)li里每一個(gè)a的href和rel屬性:

Elements li = tempElement.getElementsByTag("li");
for(Element element : li) {
    Elements element2 = element.getElementsByTag("a");
    for(Element element3 : element2) {
        String hrefString = element3.attr("href");
        String relString = element3.attr("rel");
        if(hrefString != "" && relString != "") {
            System.out.println("href=" + hrefString + " rel="external nofollow"  rel="external nofollow"  " + "rel=" + relString);
        }
    }
}

最終結(jié)果:

href=https://alphacoders.com/site/about-us rel=nofollow
href=https://alphacoders.com/site/faq rel=nofollow
href=https://alphacoders.com/site/privacy rel=nofollow
href=https://alphacoders.com/site/tos rel=nofollow
href=https://alphacoders.com/site/acceptable_use rel=nofollow
href=https://alphacoders.com/site/etiquette rel=nofollow
href=https://alphacoders.com/site/advertising rel=nofollow

完整代碼:

import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;
import java.io.IOException;
import org.jsoup.Jsoup;


/**?
?* @ClassName: Jsoup_Test
?* @description:?
?* @author: KI
?* @Date: 2020年8月17日 下午8:15:14
?*/

public class Jsoup_Test {

?? ?public static void main(String[] args) throws IOException {
?? ??? ?// TODO 自動(dòng)生成的方法存根
?? ??? ?
?? ??? ?String html = "https://wall.alphacoders.com/featured.php?lang=Chinese";
?? ??? ?Document doc = Jsoup.connect(html).get();
?? ??? ?
?? ??? ?System.out.println(doc);
?? ??? ?Elements elements = doc.getElementsByTag("ul");
?? ??? ?//System.out.println(elements);
?? ??? ?Element tempElement = null;
?? ??? ?for(Element element : elements) {
?? ??? ??? ?if (element.className().equals("nav nav-pills")) {
?? ??? ??? ??? ?tempElement = element;
?? ??? ??? ??? ?//System.out.println(element.className());
?? ??? ??? ??? ?break;
?? ??? ??? ?}
?? ??? ?}
?? ??? ?System.out.println(tempElement);
?? ??? ?Elements li = tempElement.getElementsByTag("li");
?? ??? ?for(Element element : li) {
?? ??? ??? ?Elements element2 = element.getElementsByTag("a");
?? ??? ??? ?for(Element element3 : element2) {
?? ??? ??? ??? ?String hrefString = element3.attr("href");
?? ??? ??? ??? ?String relString = element3.attr("rel");
?? ??? ??? ??? ?if(hrefString != "" && relString != "") {
?? ??? ??? ??? ??? ?System.out.println("href=" + hrefString + " rel="external nofollow"  rel="external nofollow"  " + "rel=" + relString);
?? ??? ??? ??? ?}
?? ??? ??? ?}
?? ??? ?}?? ??? ?

?? ?}

}

到此這篇關(guān)于Java爬蟲實(shí)現(xiàn)Jsoup利用dom方法遍歷Document對(duì)象的文章就介紹到這了,更多相關(guān)Java Jsoup遍歷Document對(duì)象內(nèi)容請(qǐng)搜索html5模板網(wǎng)以前的文章希望大家以后多多支持html5模板網(wǎng)!

【網(wǎng)站聲明】本站部分內(nèi)容來(lái)源于互聯(lián)網(wǎng),旨在幫助大家更快的解決問(wèn)題,如果有圖片或者內(nèi)容侵犯了您的權(quán)益,請(qǐng)聯(lián)系我們刪除處理,感謝您的支持!

相關(guān)文檔推薦

這篇文章主要介紹了Java中兩種基本的輸入方式,具有很好的參考價(jià)值,希望對(duì)大家有所幫助。如有錯(cuò)誤或未考慮完全的地方,望不吝賜教
這篇文章主要介紹了Java中Scanner使用方式:單行/多行輸入,具有很好的參考價(jià)值,希望對(duì)大家有所幫助。如有錯(cuò)誤或未考慮完全的地方,望不吝賜教
這篇文章主要為大家詳細(xì)介紹了如何利用Java語(yǔ)言實(shí)現(xiàn)PDF轉(zhuǎn)Word文件的效果,并可以無(wú)水印、無(wú)頁(yè)數(shù)限制。文中的示例代碼講解詳細(xì),需要的可以參考一下
這篇文章主要介紹了java輸入時(shí)如何通過(guò)回車(enter)來(lái)結(jié)束輸入,具有很好的參考價(jià)值,希望對(duì)大家有所幫助。如有錯(cuò)誤或未考慮完全的地方,望不吝賜教
這篇文章主要為大家詳細(xì)介紹了一下Java線程中的一些常用操作,文中的示例代碼講解詳細(xì),對(duì)我們學(xué)習(xí)或工作有一定幫助,需要的可以參考一下
這篇文章主要介紹了java輸入空行結(jié)束問(wèn)題,具有很好的參考價(jià)值,希望對(duì)大家有所幫助。如有錯(cuò)誤或未考慮完全的地方,望不吝賜教
主站蜘蛛池模板: 久久久久久久av麻豆果冻 | 一区二区三区四区av | 国内精品久久久久久久影视简单 | 91久久精品国产91久久性色tv | caoporon| 成人在线观看欧美 | 国产黄色在线 | 91精品国产一区 | 91av在线免费看 | 视频在线一区二区 | 成人在线播放网址 | 欧美一区二区三区大片 | 亚洲欧美精品 | 91精品一区二区三区久久久久 | 亚洲一区二区三区 | 99精品视频免费在线观看 | 国产精品大片在线观看 | 日韩一区精品 | 国产清纯白嫩初高生在线播放视频 | 91精品久久久久 | 国产在线激情视频 | 中文亚洲视频 | 精品久久久一区二区 | 欧美福利影院 | 在线亚洲欧美 | 手机在线观看 | 久久久久久久久精 | 一区二区三区四区不卡视频 | 狠狠爱一区二区三区 | 国产www在线 | 超碰在线国产 | 在线成人 | 免费看大片bbbb欧美 | 亚洲成人天堂 | 亚洲一区二区日韩 | 91免费福利在线 | 激情国产| 亚洲高清av在线 | 久热精品视频 | 欧美一级欧美三级在线观看 | 欧美色综合网 |