‹ Reports
The Dispatch

Surge in User-Reported Performance Issues Highlights Stability Challenges for Stable Diffusion WebUI Forge

Stable Diffusion WebUI Forge, an enhancement platform for the original Stable Diffusion WebUI, aims to streamline development and optimize performance using Gradio for its interface. The project is experiencing a surge in user-reported issues related to performance degradation and increased resource usage following recent updates, particularly with Flux model integration.

Recent Activity

Recent issues and pull requests (PRs) indicate a focus on addressing performance problems and enhancing compatibility. Key themes include:

Development Team and Recent Activity

  1. lllyasviel

    • Extensive commits focused on memory management and performance optimizations.
    • Collaborated on bug fixes and enhancements.
  2. DenOfEquity

    • Worked on bug fixes related to samplers and processing modules.
  3. twarrendewit

    • Enhanced StyleAlign feature.
  4. altoiddealer

    • Updated README and contributed to bug fixes.
  5. IgorAherne

    • Minor API module updates.
  6. Panchovix

    • Added new samplers and fixed related issues.
  7. chocolateboy

    • Fixed Gradio audio notification issue.
  8. continue-revolution

    • Contributed to ongoing maintenance.
  9. davidmartinrius

    • Fixed validation errors in model generation.

Of Note

  1. High Volume of Open Issues/PRs: Over 600 open issues/PRs suggest active development but potential backlog management challenges.
  2. Compatibility Focus: Efforts to support Apple Silicon and Intel XPU highlight a commitment to broad hardware compatibility.
  3. API Versatility: New API parameters reflect a focus on enhancing programmatic access.
  4. User Frustration: Critical failures reported by users indicate urgent areas needing resolution.
  5. Collaboration Dynamics: Strong collaboration among team members, especially between lllyasviel and DenOfEquity, suggests a cohesive development effort focused on resolving current challenges.

Quantified Reports

Quantify Issues



Recent GitHub Issues Activity

Timespan Opened Closed Comments Labeled Milestones
7 Days 177 52 464 173 1
30 Days 311 109 849 307 1
90 Days 320 118 865 315 1
All Time 897 287 - - -

Like all software activity quantification, these numbers are imperfect but sometimes useful. Comments, Labels, and Milestones refer to those issues opened in the timespan in question.

Quantify commits



Quantified Commit Activity Over 30 Days

Developer Avatar Branches PRs Commits Files Changes
layerdiffusion 1 11/11/0 180 159 269953
Panchovix 1 2/2/0 2 4 412
DenOfEquity 1 7/6/0 7 7 33
twarrendewit 1 1/1/0 1 1 29
altoiddealer 1 7/3/3 2 2 16
continue revolution 1 1/2/1 1 2 16
David Martín Rius 1 2/2/0 2 2 4
Igor Aherne 1 2/1/0 1 1 2
chocolateboy 1 1/1/0 1 1 2
Robin Fernandes (rewbs) 0 0/0/1 0 0 0
Dan Weiss (Dwedit) 0 0/1/0 0 0 0
Will Cole (wcole3) 0 1/0/0 0 0 0
Bedovyy (bedovyy) 0 1/0/0 0 0 0
Jodh Singh (jetjodh) 0 0/0/1 0 0 0
Jianqi Pan (Jannchie) 0 0/0/1 0 0 0
Haoming (Haoming02) 0 1/0/0 0 0 0
Conor Nash (conornash) 0 1/0/0 0 0 0
bluelovers (bluelovers) 0 0/1/1 0 0 0
None (catboxanon) 0 0/0/2 0 0 0
crm4wav3 (realwumbl3) 0 0/0/1 0 0 0
Hina (HinaHyugaHime) 0 0/0/1 0 0 0
Andray (light-and-ray) 0 0/0/1 0 0 0
None (PegasusSpectra) 0 0/0/1 0 0 0
cocktailpeanut (cocktailpeanut) 0 1/0/1 0 0 0

PRs: created by that dev and opened/merged/closed-unmerged during the period

Detailed Reports

Report On: Fetch issues



Recent Activity Analysis

The GitHub repository for the Stable Diffusion WebUI Forge has seen a surge in activity, with 610 open issues currently reported. Many of these issues relate to recent updates, particularly concerning the integration of Flux models and their associated performance and functionality. A notable theme among the issues is the degradation of performance and increased resource usage following updates, which has led to user frustration and a series of urgent bug reports.

Several users have reported critical problems such as "CUDA out of memory" errors, unexpected behavior with LoRA models, and issues with ControlNet not functioning properly. The community appears to be actively engaged in troubleshooting these problems, with many users providing detailed logs and potential solutions.

Issue Details

Here are the most recently created and updated issues:

  1. Issue #1433: The command to clear the cache

    • Priority: Low
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  2. Issue #1432: The inference speed totally dropped after using the latest commit

    • Priority: High
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  3. Issue #1431: Support T5 gguf

    • Priority: Medium
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  4. Issue #1430: Sometimes my lora won't be patched or will be ignored

    • Priority: Medium
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  5. Issue #1429: Sometimes if I click the preview image before it's finished, the preview sticks

    • Priority: Medium
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  6. Issue #1428: What is the benefit of Lowering GPU Weights?

    • Priority: Medium
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  7. Issue #1423: Anomaly with hiresfix and gguf models

    • Priority: High
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  8. Issue #1422: Seeds not working

    • Priority: High
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  9. Issue #1421: Can't change models via API

    • Priority: Medium
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A
  10. Issue #1420: ControlNet AttributeError: 'KModel' object has no attribute 'noise_augmentor'

    • Priority: High
    • Status: Open
    • Created: 0 days ago
    • Updated: N/A

Analysis of Themes and Complications

The issues reflect several recurring themes:

  • Performance Degradation: Users have expressed significant concerns regarding slower inference speeds and increased memory usage after recent updates, particularly when using Flux models.
  • Model Compatibility: There are multiple reports about LoRA models not functioning as expected, raising questions about compatibility with different model types (e.g., FP16 vs NF4).
  • ControlNet Issues: Several users are encountering errors related to ControlNet functionality, indicating potential bugs in how these models are integrated into Forge.
  • User Frustration: The volume of urgent issues suggests that many users are experiencing critical failures that disrupt their workflows, leading to calls for immediate fixes.

Overall, the repository's current state indicates a pressing need for developers to address performance-related issues and ensure that new features do not adversely affect existing functionalities.

Report On: Fetch pull requests



Report on Pull Requests

Overview

The repository lllyasviel/stable-diffusion-webui-forge currently has 7 open pull requests (PRs) and a total of 173 closed PRs. The recent activity indicates ongoing enhancements, bug fixes, and feature additions aimed at improving the functionality and performance of the Stable Diffusion WebUI.

Summary of Pull Requests

Open Pull Requests

  • PR #1434: Reimplement Skip Early CFG and NGMS (Negative Guidance Minimum Sigma)
    Created: 0 days ago
    This PR aims to fix the functionality of s_min_uncond and skip_early_cond, which were not operational in the Forge version. It references the original implementation from Automatic1111 to enhance speed during the diffusion process.

  • PR #1427: Checkpoint Change
    Created: 0 days ago
    This PR introduces the sd_model_checkpoint parameter for API payloads, allowing users to specify model checkpoints more flexibly.

  • PR #1425: Bugfix: ControlNet Works in API - Image No Longer a Dictionary
    Created: 0 days ago
    This PR addresses an issue where generating images via API resulted in type errors due to incorrect data structures being passed.

  • PR #1386: Possible Partial Fix for Multiple Issues
    Created: 1 day ago
    This PR attempts to fix issues related to loading checkpoints during xyz grid runs, although it has some noted lockup concerns.

  • PR #1264: Get Flux Working on Apple Silicon
    Created: 5 days ago
    Aims to enable Flux support on Apple Silicon devices, addressing compatibility issues with MPS.

  • PR #1198: Add/Fix Infotext Loading for Builtin Extensions
    Created: 6 days ago
    Implements changes to ensure infotext is correctly loaded across various built-in extensions.

  • PR #1162: Add Flux Support for Intel XPU
    Created: 7 days ago
    This PR modifies the code to support Intel's XPU architecture by changing data types used in computations.

Closed Pull Requests

  • PR #1413: Add Distilled CFG to XYZ Grid
    Closed: Merged within a day. A straightforward addition that enhances functionality.

  • PR #1410 & PR #1409: Fix FieldInfo Object Attribute Error
    Both addressed a common error with different approaches; one was merged while the other was not, indicating a decision-making process on which solution was preferable.

  • PR #1403: Send Distilled CFG Scale When Generating Hires Conds
    Closed: Merged successfully, enhancing the generation process by including distilled CFG scale parameters.

  • PR #1389: Bugfix for GET /sdapi/v1/sd-models
    Closed: Merged, fixing a validation error related to missing configuration parameters in API responses.

Analysis of Pull Requests

The current state of pull requests in the stable-diffusion-webui-forge repository reflects an active development environment focused on both feature enhancement and bug fixing.

Themes and Commonalities

  1. Performance Improvements: Several recent PRs, such as #1434 and #1264, focus on optimizing performance by reimplementing existing functionalities or adding new features that allow for faster processing times. These enhancements are crucial in maintaining user satisfaction and ensuring that the tool remains competitive within the rapidly evolving AI landscape.

  2. Compatibility Enhancements: There is a notable emphasis on improving compatibility with various hardware architectures (e.g., Apple Silicon and Intel XPU). PRs like #1162 and #1264 highlight efforts to ensure that users can leverage their specific hardware capabilities without running into issues, which is vital for user retention and satisfaction.

  3. API Functionality: The introduction of new API parameters (e.g., in PR #1427) demonstrates an ongoing commitment to making the tool more versatile for developers who rely on programmatic access. This trend aligns with broader industry movements toward making software more accessible through APIs.

Anomalies

  1. High Volume of Open Issues/PRs: With over 600 open issues and pull requests, there is potential concern regarding backlog management. While this indicates active development, it also suggests that some areas may be neglected or require additional resources to address effectively.

  2. Discrepancies in Merge Decisions: The closed PRs reveal instances where multiple solutions were proposed for similar problems (e.g., PRs #1409 and #1410). The decision-making process behind which solution gets merged could benefit from clearer guidelines or community input to avoid confusion among contributors.

  3. Recent Activity Concentration: The majority of recent PR activity has occurred within a short timeframe (last few days), suggesting either a sprint-like development phase or a response to emerging needs or bugs identified by users. This concentrated activity can lead to rapid improvements but may also introduce instability if not managed properly.

Conclusion

The stable-diffusion-webui-forge repository is currently thriving with active contributions aimed at enhancing performance, compatibility, and usability through its API. However, attention should be given to managing open issues effectively and ensuring that contributors feel supported in their efforts. Overall, the project appears well-positioned for continued growth and improvement as it adapts to user needs and technological advancements.

Report On: Fetch commits



Repo Commits Analysis

Development Team and Recent Activity

Team Members and Their Recent Activities

  1. lllyasviel

    • Recent Commits: 180 commits with 269,953 changes.
    • Key Contributions:
    • Extensive work on memory management and performance optimizations, including revisions to the LoRA system and GPU weight management.
    • Added new features such as a way to empty CUDA cache on the fly and support for various model types.
    • Collaborated with multiple team members on bug fixes and enhancements.
    • Ongoing revisions to the "space" functionalities, indicating a focus on improving user experience and resource management.
  2. DenOfEquity

    • Recent Commits: 7 commits with 33 changes.
    • Key Contributions:
    • Focused on fixing bugs related to new samplers and enhancing the processing module.
    • Collaborated with lllyasviel on several features and bug fixes, indicating active participation in ongoing development.
  3. twarrendewit

    • Recent Commits: 1 commit with 29 changes.
    • Key Contributions:
    • Worked on enhancing the StyleAlign feature, collaborating with lllyasviel.
  4. altoiddealer

    • Recent Commits: 2 commits with 16 changes.
    • Key Contributions:
    • Made minor updates to the README and contributed to bug fixes, indicating engagement in documentation as well as code.
  5. IgorAherne

    • Recent Commits: 1 commit with 2 changes.
    • Key Contributions:
    • Minor updates to the API module, showing involvement in backend improvements.
  6. Panchovix

    • Recent Commits: 2 commits with 412 changes.
    • Key Contributions:
    • Significant contributions to adding new samplers and fixing issues related to sampler integration, indicating a strong focus on expanding functionality.
  7. chocolateboy

    • Recent Commits: 1 commit with 2 changes.
    • Key Contributions:
    • Fixed an audio notification issue related to Gradio, showing attention to user interface details.
  8. continue-revolution

    • Recent Commits: 1 commit with 16 changes.
    • Key Contributions:
    • Minor contributions that indicate involvement in ongoing maintenance of the project.
  9. davidmartinrius

    • Recent Commits: 2 commits with 4 changes.
    • Key Contributions:
    • Focused on fixing validation errors in the model generation process, contributing to stability.

Patterns and Themes

  • The majority of recent activity is led by lllyasviel, who is heavily involved in both feature development and bug fixing, indicating a central role in the project.
  • Collaboration is evident among team members, particularly between lllyasviel and DenOfEquity, suggesting a cohesive team dynamic focused on enhancing functionality and resolving issues.
  • A significant number of commits are dedicated to performance optimizations and memory management improvements, reflecting an ongoing effort to enhance user experience and system efficiency.
  • The presence of numerous open pull requests (616) suggests that while development is active, there may be bottlenecks in review or integration processes that need addressing.
  • The team appears responsive to community feedback, as evidenced by the frequent updates based on user input regarding functionality and performance.

Overall, the development team is actively engaged in improving the Stable Diffusion WebUI Forge project through collaborative efforts focused on performance enhancements, feature additions, and bug fixes.