pyppeteer安裝chromium太慢

在安裝chromium的時候,因爲是谷歌源所以我們下載不了或者下載很慢,並且網上大多數的資料都是複製別人的,並沒有給出具體的解決辦法,很坑,這裏給出我搞了一天的解決辦法,有點複雜

我們選擇系統默認的版本,這樣最保險

用清華源安裝pyppeteer

pip3 install -i https://pypi.tuna.tsinghua.edu.cn/simple pyppeteer

然後我們在新建一個py文件寫入一下代碼

from pyppeteer import chromium_downloader

print(chromium_downloader.DEFAULT_DOWNLOAD_HOST)
print(chromium_downloader.downloadURLs)
print(chromium_downloader.BASE_URL)

"""
https://storage.googleapis.com
{'linux': 'https://storage.googleapis.com/chromium-browser-snapshots/Linux_x64/575458/chrome-linux.zip', 'mac': 'https://storage.googleapis.com/chromium-browser-snapshots/Mac/575458/chrome-mac.zip', 'win32': 'https://storage.googleapis.com/chromium-browser-snapshots/Win/575458/chrome-win32.zip', 'win64': 'https://storage.googleapis.com/chromium-browser-snapshots/Win_x64/575458/chrome-win32.zip'}
https://storage.googleapis.com/chromium-browser-snapshots
"""

可以發現,這裏的chromium下載源是國外的,國外的是普遍的慢
其實chromium源也有類似於pip一樣的國內鏡像源
例如 https://npm.taobao.org/mirrors/chromium-browser-snapshots/

  1. 我們可以查看下其pyppeteer源碼,位置在$python\Lib\site-packages\pyppeteer\chromium_downloader.py
  2. 該源碼 中的DEFAULT_DOWNLOAD_HOST字段,字段的值爲https://storage.googleapis.com
  3. 我們改變它的值,設置爲 DEFAULT_DOWNLOAD_HOST = 'https://npm.taobao.org/mirrors'

這樣,我們在一次打印chromium下載器的信息就會發生改變

https://npm.taobao.org/mirrors
{'linux': 'https://npm.taobao.org/mirrors/chromium-browser-snapshots/Linux_x64/575458/chrome-linux.zip', 'mac': 'https://npm.taobao.org/mirrors/chromium-browser-snapshots/Mac/575458/chrome-mac.zip', 'win32': 'https://npm.taobao.org/mirrors/chromium-browser-snapshots/Win/575458/chrome-win32.zip', 'win64': 'https://npm.taobao.org/mirrors/chromium-browser-snapshots/Win_x64/575458/chrome-win32.zip'}
https://npm.taobao.org/mirrors/chromium-browser-snapshots

接下來通過pyppeteer安裝chromium的速度就會倍速的增大

from pyppeteer import chromium_downloader

chromium_downloader.download_chromium()
print(chromium_downloader.check_chromium())
[W:pyppeteer.chromium_downloader] start chromium download.
Download may take a few minutes.
https://npm.taobao.org/mirrors/chromium-browser-snapshots
100%|██████████| 133194757/133194757 [00:22<00:00, 6053700.03it/s]
[W:pyppeteer.chromium_downloader] 
chromium download done.
[W:pyppeteer.chromium_downloader] chromium extracted to: C:\Users\Administrator\AppData\Local\pyppeteer\pyppeteer\local-chromium\575458

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章