Site icon KerKer 的模組世界

[AI繪圖] 使用不同模組在stable-diffusion-webui中實現多樣化的生成

&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">在這篇文章中將詳細說明如何在stable-diffusion-webui中套用各種模型。<br>如果還沒完成安裝可以參考這篇文章:<a href&equals;"https&colon;&sol;&sol;kerker&period;website&sol;ai&percnt;e7&percnt;b9&percnt;aa&percnt;e5&percnt;9c&percnt;96-win11&percnt;e5&percnt;ae&percnt;89&percnt;e8&percnt;a3&percnt;9dstable-diffusion-webuiautomatic1111&percnt;e6&percnt;b5&percnt;81&percnt;e7&percnt;a8&percnt;8b&sol;" title&equals;""><strong><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color">&lbrack;AI繪圖&rsqb; Win11安裝Stable-Diffusion-WebUI&lpar;AUTOMATIC1111&rpar;流程<&sol;mark><&sol;span><&sol;strong><&sol;a><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">在成功安裝stable-diffusion-webui後預設安裝有一個名為v1-5-pruned-emaonly的checkpoint模型。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">另外網路上有許多高手分享了不同的訓練模型可以作使用,目前最受歡迎的模型共享網站是<strong><a href&equals;"https&colon;&sol;&sol;civitai&period;com&sol;" title&equals;""><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color">civitai&period;com<&sol;mark><&sol;span><&sol;a><&sol;strong>,每個模型在生成圖像效果和擅長領域方面都有所差異。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<&excl;--more-->&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">常見的模型類型包括checkpoint、Textual Inversion(embedding)、lora和LyCORIS &lpar;LoHa&sol;LoCon&rpar;。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">LyCORIS &lpar;LoHa&sol;LoCon&rpar;類模型在stable-diffusion-webui的預設設定中是不支援的,需要安裝額外的插件(plugin)才可以作使用,就不在這邊做進一步的說明了。<br><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>checkpoint<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">checkpoint簡單來說就是主要模型,檔案大小大約介於2到10GB之間,對於整體風格有重大影響。這裡用在civitai找到的一個名為&&num;8221&semi;<a href&equals;"https&colon;&sol;&sol;civitai&period;com&sol;models&sol;43331&sol;majicmix-realistic" title&equals;""><strong><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color">majicMIX realistic<&sol;mark><&sol;span><&sol;strong><&sol;a>&&num;8220&semi;的模型來進行實作。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large is-resized"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczNvl8OI2N-K&lowbar;4kAio6&lowbar;E4YjnetiQAsFgIZn3uPmq9euHRqvxpwz7L6AkWaKD6S-o93VONr1xB3IHZW8j5dRMeays8qPB0fx&lowbar;uzsepD8xwMB8rGbhLJjx3YpJqgYBKh10SBcFyidz56nqK1PVuHDTNmb&equals;w1765-h945-s-no-gm&quest;authuser&equals;1" alt&equals;"" style&equals;"width&colon;840px&semi;height&colon;449px"&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">首先要將下載的&&num;8221&semi;majicmixRealistic&lowbar;v6&period;safetensors&&num;8221&semi;檔案放置在stable-diffusion-webui的安裝資料夾下的models&bsol;Stable-diffusion資料夾內。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">我的環境下使用的路徑為&&num;8221&semi;C&colon;&bsol;stable-diffusion-webui&bsol;models&bsol;Stable-diffusion&&num;8221&semi;。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">這裡需要特別注意的是,如果模型的附檔名是ckpt,就可能存在隱藏惡意程式碼的風險。所以可以的話儘量使用副檔名為safetensors的模型。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczO6DWPXtQuU0jW5flKFakiY1qB4v-5VsDfYUgkcFDZx9GdNrUyAcOiuPtTvWZpZtpDQBZ3t8XuqKeyfqFT17ZWrgejriFRWSkX0gNwJ8oIEyHztUIZSSH5aYnVgpWIjoRdUza&lowbar;1Q6LhI0uS6YsSRV2N&equals;w639-h192-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">檔案放置完成後,使用瀏覽器開啟stable-diffusion-webui的介面。在畫面的左上角有一個下拉選單,在這裡選擇我們剛剛下載的majicMIX realistic模型。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">如果下拉選單中沒有看到剛剛下載的模型,可以點擊下拉選單旁邊的重新整理按鈕。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczNXWc3hZnbPu7DrJ51F8xJb&lowbar;AsEy9opT8UFPwbbBfsMMi8K4YgGZeJ2Z4CLeaBA9-fOroeWapcM&lowbar;NOmEK7AZGma2UgNbRBhu7J-6J&lowbar;YQYfayJ548yqMZClFH0hepDujBQsaBBMXkIiCnZTESLDx5-GS&equals;w1770-h945-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczNcXue0ORZ0NBSdZXldmf0xCAdBIxmM3xwDAdRk0k&lowbar;Ku15teUokNxMGlfEq6Vs&lowbar;QnEuMFFtJOzPPU-nNPPiLc7HhuEynHqGVYWuUFRXbRFU1gBLQJS7qBE1a2f1pGpU3FFs5AoCGIAa&lowbar;9lCN06Ho9P1&equals;w403-h128-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">這裡我就用&&num;8221&semi;a cute girl in school uniform&&num;8221&semi;做一個簡單的對比測試。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">左側為內建的v1-5-pruned-emaonly模型,而右側則是由majicmixRealistic&lowbar;v6生成的結果。可以明顯看出這兩者在畫風上存在巨大的差別。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczMwgbNluo8gSwsAfcCFnqKy9NNXZ6-kyFA6XPra3eST8SKuVmEV0Ioc7QwC4VFcma5KnOYDQGWsNFFIh-gtnvad0sro&lowbar;&lowbar;vsXVmG-MPszpj1msMh&lowbar;EI0xoSF&lowbar;j&lowbar;wGAqLuCwCRCLtR&lowbar;cbaKn0pLVFNsy4&equals;w1078-h536-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>Textual Inversion(embedding)<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">Textual Inversion 是一種輕量級的擴充模型,其檔案大小介於數十KB到數百KB之間。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">除了能夠影響畫面風格外,Textual Inversion 目前最常見的應用是用來修正一些常見的負面提示。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">這裡在civitai 網站上找到並下載我常使用的<a href&equals;"https&colon;&sol;&sol;civitai&period;com&sol;models&sol;16993&sol;badhandv4-animeillustdiffusion" title&equals;""><strong><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color">badhandv4<&sol;mark><&sol;span><&sol;strong><&sol;a>模型作為例子。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczONLcJ2zFwFFhvj5jzVHrvfPm&lowbar;3NUyIz06OTPV6nhEtV1p5cSdnOycGJOSFpDIJJ7ADGnikA9OuNpgyuO3eWFndM5-eEKjV&lowbar;-ghTEPbQ9k61P3HRHd9b24BRJO3SE&lowbar;tBpr47fVwpqEdLahX2qjclZQD&equals;w1836-h897-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">Textual Inversion 的存放路徑位於 stable-diffusion-webui 安裝資料夾中的embeddings資料夾。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">我的環境下使用的路徑為&&num;8221&semi;C&colon;&bsol;stable-diffusion-webui&bsol;embeddings&&num;8221&semi;。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczPlFUztZZQ2kRqSWrGb-G6bGvavRexAHnrmJK5PE&lowbar;Hdr6WizDjyOZ4FQOSP1IKG-2Q77fBNPkuwoCfNoSd4LqBLJJfGgdy9UHFAdUKiA-HhGGQCeTu2&lowbar;KILocxKC9DZKAMMlK&lowbar;9N1liwHPy9MHDqA-d&equals;w663-h150-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">在將模型放置正確位置後,使用瀏覽器開啟stable-diffusion-webui的介面。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">點擊在Generate按鈕下方的紅色按鈕,此時prompt區塊下方將出現模型選擇視窗。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">如果在Textual Inversion頁籤中未看到剛剛下載的模型,可以點擊Refresh按鈕進行更新。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">Textual Inversion 的使用方式是在模型選擇視窗中直接點擊要使用的模型,點擊模型的圖示後相應的提示詞(prompt)將出現在prompt&sol;negative prompt欄位中。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczMYDRHSyhGZSE8656YbbgZi&lowbar;&lowbar;TN0&lowbar;sNCI&lowbar;nOcL7gaTFKdg5w5W&lowbar;y2ou-yRY5ruIwKzztYoRtw8MzXFFDvyHW2eOGqw8X&lowbar;M8lDhASte8f5g82-CeBJGJlZTuaD-l8FIXGNjsbE&lowbar;FeNFhG3c7eKFeRuzB&equals;w1838-h927-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">對於像手部修復這樣的Textual Inversion,需要先點擊negative prompt欄位,再點擊模型選擇視窗中的模型,以便正確的將相應的提示詞(prompt)添加到negative prompt欄位。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>lora<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">lora是另一種輕量級的擴充模型,其檔案大小介於數十KB到數百KB之間。lora可以說是目前影響畫面風格比較主流的方式之一。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">這裡我們以一個3D風格的lora模型<a href&equals;"https&colon;&sol;&sol;civitai&period;com&sol;models&sol;73756&quest;modelVersionId&equals;107366" title&equals;""><strong><span style&equals;"text-decoration&colon; underline&semi;"><mark style&equals;"background-color&colon;rgba&lpar;0&comma; 0&comma; 0&comma; 0&rpar;" class&equals;"has-inline-color has-vivid-cyan-blue-color">3DMM<&sol;mark><&sol;span><&sol;strong><&sol;a>作為例子,同樣在civitai網站上找到該模型並下載。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">這裡需要注意的是,觸發詞(trigger words)欄位中的內容需要先複製記錄下來,稍後我們會用到(此處的例子是3DMM)。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczMkXQyBjXF19IJvx9yXyLgB69e36lFP8sT9bo5ry7s1Y2RaAOk3kIquCeLDcGrEgoNzqeOdXLPUwNKF&lowbar;-gxRrgLHfGjOlK1FDEK0agPva&lowbar;YWG9qJxq0gDJ5HqXHRaLkZ3reL-PHgJNeCXO2ycvz1FYz&equals;w1763-h945-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">lora模型放置的位置是stable-diffusion-webui安裝資料夾中的models&bsol;Lora資料夾內。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">我的環境下使用的路徑為&&num;8221&semi;C&colon;&bsol;stable-diffusion-webui&bsol;models&bsol;Lora&&num;8221&semi;。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczPTGSZjREblUC&lowbar;POjVHRHASCulQBUnm6TX-CFIwF17LhSWnPkTaXKsEdW9moDl78uwsviqG&lowbar;U5kcq724Lrg&lowbar;CDgwa7MpbsYk3A9lxp1cRMQm&lowbar;CTyGIEtVmTfIBSfyCTqeDKeOA05D7Aes&lowbar;7XZ3OxHqx&equals;w620-h148-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">放置好模型後使用瀏覽器開啟stable-diffusion-webui的介面。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">一樣點擊在Generate按鈕下方的紅色按鈕,此時prompt區塊下方將出現模型選擇視窗。如果在lora頁籤中沒有看到剛剛下載的模型,可以點擊Refresh按鈕進行更新。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">點擊模型的圖示後,lora模型將以的格式出現在prompt欄位中。其中,後面的數字1代表該模型的權重,數字越高表示對畫面的影響越大。另外lora模型還需要在prompt中填入相應的觸發詞。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">以&&num;8221&semi;a cute girl in school uniform&comma; 3DMM&comma; &&num;8220&semi;作為例子,可以看到生成的女學生呈現了3D畫風,同時保留了主模型majicMIX realistic中的精緻亞洲臉孔風格。<&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<figure class&equals;"wp-block-image size-large"><img src&equals;"https&colon;&sol;&sol;lh3&period;googleusercontent&period;com&sol;pw&sol;AP1GczMCFmRDNi5MGKucRmk09KU4r1gGeCU3T0G5LRFJdAErcu8zboMjRYcZV2vssbV&lowbar;0XRjnMZxwB34JQDN1njdnVVO4Tu3xtthq695oO44JdgHS2wxYMjY&lowbar;gK9NrrmqBhyzFQxmwFu3yQrfJzTRdEKLmlh&equals;w1817-h925-s-no-gm&quest;authuser&equals;1" alt&equals;""&sol;><&sol;figure>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"wp-block-paragraph"><&sol;p>&NewLine;&NewLine;&NewLine;&NewLine;<h2 class&equals;"wp-block-heading has-medium-font-size"><strong>總結<&sol;strong><&sol;h2>&NewLine;&NewLine;&NewLine;&NewLine;<p class&equals;"has-medium-font-size wp-block-paragraph">由於網路上有許多高手分享了各種模組,我們可以靈活地運用喜歡的主模組,結合多個Textual Inversion(embedding)、lora等模組,以達到我們所期望的畫面效果。這種彈性的選擇讓我們能夠更好地探索並發揮stable-diffusion-webui的潛力!<&sol;p>&NewLine;

Exit mobile version