如何使用C#下载正确编码的HTML页面？

发布于 2024-10-19 03:55:10 字数 279 浏览 2 评论 0原文

我需要一个方法来获取页面的链接并返回该页面的标题。

我使用了 WebClient -

        var webClient = new WebClient();
        var htmlString = webClient.DownloadString(_link);

它运行良好，但在外语编码时失败。我收到问号和奇怪的字符，而不是我需要的文本。

是否有通用的方法来识别页面的编码并使用它？我需要它支持大多数编码（如果不是全部）。

原文

I needed a method that gets a link to a page and returns the title of this page.

I used WebClient -

        var webClient = new WebClient();
        var htmlString = webClient.DownloadString(_link);

It works well, but it fails with encoding of foreign languages. I'm getting question marks and weird characters instead of the text I need.

Is there a generic way to identify the encoding of the page and use it? I need it to support most of the encodings if not all.

分享到QQ

分享到微博

如果你对这篇内容有疑问，欢迎到本站社区发帖提问参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。

发布评论

需要登录才能够评论，你可以免费注册一个本站的账号。

九厘米的零° 2024-10-26 03:55:10

使用 HtmlAgilityPack 你可以做这样的事情

using (WebClient client = new WebClient())
using (var read = client.OpenRead("http://your.com"))
{
    HtmlDocument doc = new HtmlDocument();
    doc.Load(read, true); // true = get encoding from byte order masks
    // process doc, extract title
    var title = doc.DocumentNode.SelectSingleNode("//title").InnerText;
}

Using the HtmlAgilityPack you can do something like this

using (WebClient client = new WebClient())
using (var read = client.OpenRead("http://your.com"))
{
    HtmlDocument doc = new HtmlDocument();
    doc.Load(read, true); // true = get encoding from byte order masks
    // process doc, extract title
    var title = doc.DocumentNode.SelectSingleNode("//title").InnerText;
}

回复收藏 0 原文

风尘浪孓 2024-10-26 03:55:10

using System;
using System.IO;
using System.Net;
using System.Text;

...

    public static void GetFile
            (
            string strURL,
            string strFilePath
            )
        {

            WebRequest myWebRequest = WebRequest.Create(strURL); 

            WebResponse myWebResponse = myWebRequest.GetResponse(); 

            Stream ReceiveStream = myWebResponse.GetResponseStream();

            Encoding encode = System.Text.Encoding.GetEncoding("utf-8");

            StreamReader readStream = new StreamReader( ReceiveStream, encode );

            string strResponse=readStream.ReadToEnd();

            StreamWriter oSw=new StreamWriter(strFilePath);

            oSw.WriteLine(strResponse);

            oSw.Close();

            readStream.Close();

            myWebResponse.Close();

        }

using System;
using System.IO;
using System.Net;
using System.Text;

...

    public static void GetFile
            (
            string strURL,
            string strFilePath
            )
        {

            WebRequest myWebRequest = WebRequest.Create(strURL); 

            WebResponse myWebResponse = myWebRequest.GetResponse(); 

            Stream ReceiveStream = myWebResponse.GetResponseStream();

            Encoding encode = System.Text.Encoding.GetEncoding("utf-8");

            StreamReader readStream = new StreamReader( ReceiveStream, encode );

            string strResponse=readStream.ReadToEnd();

            StreamWriter oSw=new StreamWriter(strFilePath);

            oSw.WriteLine(strResponse);

            oSw.Close();

            readStream.Close();

            myWebResponse.Close();

        }

回复收藏 0 原文

~没有更多了~