Site icon KerKer 的模組世界

[AI繪圖] 在Stable-diffusion-webui裡應用SDXL模型

&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">最近SDXL1&period;0發布後,剛好注意到stable-diffusion-webui(AUTOMATIC1111)已經支援使用SDXL的模型了,這篇文章會詳細記錄如何在stable-diffusion-webui上使用SDXL模型。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">如果還沒完成安裝可以參考這篇文章:<a href&equals;"https&colon;&sol;&sol;kerker&period;website&sol;ai&percnt;e7&percnt;b9&percnt;aa&percnt;e5&percnt;9c&percnt;96-win11&percnt;e5&percnt;ae&percnt;89&percnt;e8&percnt;a3&percnt;9dstable-diffusion-webuiautomatic1111&percnt;e6&percnt;b5&percnt;81&percnt;e7&percnt;a8&percnt;8b&sol;" title&equals;""><strong><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color">&lbrack;AI繪圖&rsqb; Win11安裝Stable-Diffusion-WebUI&lpar;AUTOMATIC1111&rpar;流程<&sol;mark><&sol;span><&sol;strong><&sol;a>。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<&excl;--more-->&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>更新stable-diffusion-webui<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">如果你的stable-diffusion-webui版本足夠新,可以略過這一步。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">首先,開啟安裝stable-diffusion-webui的資料夾,將滑鼠移到檔案路徑的上方並點擊左鍵。這樣檔案路徑應該會被反白,例如&&num;8221&semi;C&colon;&bsol;stable-diffusion-webui&&num;8221&semi;(或您的安裝路徑)。接下來在檔案路徑上直接輸入&&num;8221&semi;cmd&&num;8221&semi;並按下Enter。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczM2QfdG7OZVrCP3DFULSUHH9EpsSiIb2AcvI9DjoujX2gwDJ454G0K4KQWtsUcwjuLN4nLPdImPc26undaciA3ooTYtPS3Xy48EYt&lowbar;nG8eL49qvYxcpxw7mvmVFAKup2Hox3Y-Hzj9TW2GjSRql5QFc&equals;w513-h262-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczN0-DBlW2vsP1fgoKTQmRHZHomm0vacQA1W5fYTMBDqaQV0XDDkW6PDqd-07Lvgf8gaXR1Wj2tbZgOJCh5LXxL2LqMRaS-JVA&lowbar;ABLRsgxmCsUn4t93NSTByYGHloB9H&lowbar;T6ooGfaVUO8et02UiMcTP0S&equals;w950-h279-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph"><br>這會在該資料夾位置開啟一個黑色的命令提示字元視窗。在視窗中輸入指令&&num;8221&semi;git pull&&num;8221&semi;並按下Enter。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">完成更新後,執行&&num;8221&semi;webui-user&period;bat&&num;8221&semi;。這時候會自動安裝一些相依性的套件,若版本差異較大可能需要稍微等一下。<br><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>下載SDXL相關模型<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">SDXL的模型要下載三個檔案:base、refiner和vae:<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph">SDXL Base 1&period;0 :<a href&equals;"https&colon;&sol;&sol;huggingface&period;co&sol;stabilityai&sol;stable-diffusion-xl-base-1&period;0&sol;blob&sol;main&sol;sd&lowbar;xl&lowbar;base&lowbar;1&period;0&period;safetensors"><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color"><strong>https&colon;&sol;&sol;huggingface&period;co&sol;stabilityai&sol;stable-diffusion-xl-base-1&period;0&sol;blob&sol;main&sol;sd&lowbar;xl&lowbar;base&lowbar;1&period;0&period;safetensors<&sol;strong><&sol;mark><&sol;span><&sol;a><br>SDXL Refiner 1&period;0:<a href&equals;"https&colon;&sol;&sol;huggingface&period;co&sol;stabilityai&sol;stable-diffusion-xl-refiner-1&period;0&sol;blob&sol;main&sol;sd&lowbar;xl&lowbar;refiner&lowbar;1&period;0&period;safetensors"><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color"><strong>https&colon;&sol;&sol;huggingface&period;co&sol;stabilityai&sol;stable-diffusion-xl-refiner-1&period;0&sol;blob&sol;main&sol;sd&lowbar;xl&lowbar;refiner&lowbar;1&period;0&period;safetensors<&sol;strong><&sol;mark><&sol;span><&sol;a><br>SDXL VAE 1&period;0 :<a href&equals;"https&colon;&sol;&sol;huggingface&period;co&sol;stabilityai&sol;sdxl-vae&sol;blob&sol;main&sol;sdxl&lowbar;vae&period;safetensors"><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color"><strong>https&colon;&sol;&sol;huggingface&period;co&sol;stabilityai&sol;sdxl-vae&sol;blob&sol;main&sol;sdxl&lowbar;vae&period;safetensors<&sol;strong><&sol;mark><&sol;span><&sol;a><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">其中Base和Refiner要放在stable-diffusion-webui的安裝資料夾下的models&bsol;Stable-diffusion資料夾內。我的環境下使用的路徑為”C&colon;&bsol;stable-diffusion-webui&bsol;models&bsol;Stable-diffusion”。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczN6EBwOjko4ypSOzoWRGoW4Q98Vu24iX7CocXrrvAVx2zVhJNfBdSElO-QFlt&lowbar;WWdcpdcmQzWIla4fZmLebVZ26YvZT9doFz0Ex9wl5sQTuktk1bT4ikE7bL4NDLM&lowbar;Er4paNnmmj1CGFAQkRFoW92bP&equals;w394-h168-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph"><br>而VAE要放在stable-diffusion-webui的安裝資料夾下的models&bsol;VAE資料夾內。我的環境下使用的路徑為”C&colon;&bsol;stable-diffusion-webui&bsol;models&bsol;VAE”。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczMwD3YM3n8pGJ7F1xxU8k6Lvl6bqIEbX3oYGRc8lNuKveI4m7BpVb0VWzLWnD99eGvLKDkyGHLkgPioszh1ZlI2rw9KJMOVSheVXKqoLWckJsjTcN2BGEpW0cujcTTu63aRGlUHAe&lowbar;LhmdJWTcbwxWf&equals;w401-h147-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><br><strong>新增快速選擇VAE選項<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">檔案放置完成後使用瀏覽器開啟stable-diffusion-webui的介面。在第一層的頁籤中選擇&&num;8221&semi;Settings&&num;8221&semi;,然後在側邊攔位選擇&&num;8221&semi;User interface&&num;8221&semi;。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large is-resized"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczMhVRrcgbzrEhGX6NOM5LmqzPElEE1lvI8Z8zf&lowbar;OBSuit3LZrYCf4piK7sgVrf8tiO9uWVYtyKRyivNSQH8k-9Hw6NfEbN5sxLAMa0E9XiqYetQWzDlXkEmrShT7dhPEAYeD768WmP9TXUL-gYFNLJ7&equals;w1827-h848-s-no-gm&quest;authuser&equals;1" alt&equals;"" style&equals;"width&colon;840px&semi;height&colon;389px"&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph"><br>往下滾動直到找到&&num;8221&semi;Quicksettings list&&num;8221&semi;選項。在這裡,找到並新增&&num;8221&semi;sd&lowbar;vae&&num;8221&semi;選項。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczPGhELGrPsYgVbOoXmt8kkj0cIQ8zZLFGc7r1otB36&lowbar;-b2ISyXQkub0JVjBJLE-M06-zOOjoNcZ0re1QQDIW7JHdS-ukmHWNwPvVG5gW1H1u9I61VTyGZzVecyhad&lowbar;pKvklThOUZuxAPKHNbCtWvX8g&equals;w693-h412-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczP2PFUnTH29xDnsUKfnKZLWn2BizMnnmmblVF1T7LCO0cEHxDpi0uJfYASgzKFVib&lowbar;VM&lowbar;ew26ws&lowbar;6JWbHVHcT9s8b7FFSbZUpX&lowbar;l4S-T3IwZtser9NsqCFh5dx3zZFcIDi3-fN0F4mGwkhFZJvm-Gnk&equals;w681-h85-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph"><br>完成新增後回到上方依序點選&&num;8221&semi;Apply settings&&num;8221&semi;和&&num;8221&semi;Reload UI&&num;8221&semi;按鈕以套用設定並重新載入使用者介面。現在應該可以在繪圖模式中快速選擇SDXL的VAE選項了。<br><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>使用SDXL模型<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">SDXL模型中的Base可以理解為一般的文生圖(txt2img)使用,而Refiner可以理解為用來精緻化文生圖&lpar;txt2img&rpar;結果的圖生圖(img2img)模型。(我知道還是不太一樣,但是使用上可以先這麼理解)<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">在txt2img畫面的左上角有一個下拉選單,在這裡選擇我們剛剛下載的sd&lowbar;xl&lowbar;base&lowbar;1&period;0模型,並在旁邊SD VAE的下拉選單選擇sdxl&lowbar;vae。<br>然後一樣輸入Prompt、調整一些想要的參數就可以生成圖了,使用SDXL建議生成圖像不要小於1024&ast;1024效果會比較好。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczNNKXEP9oUUeGbdLJt-U2b7iPM6PDuNYEIlHVvQxyNRY5Fx74dv5DU1Ql5YSYR4CKYEPKdGNLJK6pkcQQr5JSyIFF83WCYw776OQURLLPdexPSg&lowbar;wm6spzcjHKycbdfN9h4oFje4oPY-JUU-SC44AOO&equals;w1817-h791-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph"><br>這裡是我使用的測試Prompt:<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<pre class&equals;"wp-block-preformatted">a asian high school girl with blonde ponytail studying in the classroom&comma; beautiful detailed eyes&comma; sailor collar&comma; school uniform&comma; textbook&comma; masterpiece&comma; best quality&comma; HDR&comma; 8K&comma; highres&comma; extremely detailed&comma; absurdres&comma; ultra realistic&comma; raw photo&comma; photography&comma; focus on face&comma; simple background<&sol;pre>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">SDXL的記憶體耗費會大很多,生成速度也比較慢,我用來測試的3060 12G記憶體也只是勉強夠用,如果記憶體不夠可能要試著用lowvram參數來啟動stable-diffusion-webui了。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">再來把剛剛生成的圖放到圖生圖,這時候左上角下拉選單要選擇我們剛剛下載的sd&lowbar;xl&lowbar;refiner&lowbar;1&period;0模型,下面是我把重繪權重調到0&period;3生成結果:<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczP5hg2FPXYIAv2NDI8RaT2wHyH7XZBzszYsYQGZjuq50HWi01W&lowbar;4TQnYKnUkenrmdqdzafp1xsWoKGkbL0trDX0cydGYmu5&lowbar;9zt3lwDUXFm5C4eF8mjYLL3ndyrDxxawRs74z9mBgr&lowbar;MH5z4xwo8B0o&equals;w1830-h925-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph"><br>整體來說SDXL模型還很新,還沒有ControlNet、lora等等好用的插件和模型可以使用,而且生圖效率較差,就目前個人使用體驗覺得還有一段路要走&lpar;當然也可能是我還沒有找到正確的下Prompt方式&rpar;。<&sol;p>&NewLine;

Exit mobile version