‹ Reports
The Dispatch

OSS Report: Skyvern-AI/skyvern


Skyvern Project Faces Persistent Network and Database Challenges Amidst Active Development

Skyvern, a Python-based tool by Skyvern-AI, aims to automate browser workflows using LLMs and Computer Vision, offering resilience against website layout changes. The project has seen active development with significant community interest, evidenced by its 5,629 stars and 403 forks on GitHub.

Recent activities highlight ongoing challenges with network errors (#688) and database connectivity issues (#678), which indicate persistent integration and resource management hurdles. Despite these challenges, the development team remains active, focusing on frontend enhancements, bug fixes, and new feature developments. Notable contributions include Kerem Yilmaz's improvements in async execution contexts and Shuchang Zheng's logging optimizations. The team shows strong collaboration, particularly between Zheng and Yilmaz, driving forward both maintenance and new feature development.

Recent Activity

Development Team Activities

  1. Shuchang Zheng

    • Removed run_streaming.sh, deprecated Docker Compose images.
    • Fixed update_task bug, optimized logging.
    • Collaborated on screen streaming under Docker.
  2. Kerem Yilmaz

    • Added async executor context features, enhanced frontend with pagination.
    • Worked on Bitwarden CLI improvements.
  3. LawyZheng

    • Enhanced DOM utilities, optimized SVG logic.
    • Fixed file upload bugs.
  4. Salih Altun

    • Improved frontend routes, updated styling.
  5. Suchintan

    • Focused on documentation clarity.

Of Note

Quantified Reports

Quantify commits



Quantified Commit Activity Over 30 Days

Developer Avatar Branches PRs Commits Files Changes
LawyZheng 1 25/25/0 25 21 1968
Kerem Yilmaz 1 40/40/1 40 62 1864
Suchintan 1 0/0/0 4 5 339
Shuchang Zheng 3 22/21/2 23 22 215
Salih Altun 1 2/2/0 2 2 8

PRs: created by that dev and opened/merged/closed-unmerged during the period

Quantify Issues



Recent GitHub Issues Activity

Timespan Opened Closed Comments Labeled Milestones
7 Days 1 4 0 1 1
30 Days 6 6 10 6 1
90 Days 25 33 65 12 1
All Time 82 71 - - -

Like all software activity quantification, these numbers are imperfect but sometimes useful. Comments, Labels, and Milestones refer to those issues opened in the timespan in question.

Detailed Reports

Report On: Fetch issues



Recent Activity Analysis

Recent GitHub issue activity for the Skyvern project indicates a steady stream of issues being created and updated, reflecting ongoing development and user engagement. Notable anomalies include recurring issues with network errors (#688), database connectivity (#678), and API rate limits (#546). These issues suggest persistent challenges in maintaining stable integrations with external services and managing resource constraints. A theme of troubleshooting deployment and configuration problems is evident, with several users encountering difficulties in setting up the environment, particularly with Docker and PostgreSQL configurations.

Issue Details

  • #704: Skyvern doesn't load past initial page

    • Priority: High
    • Status: Open
    • Created: 4 days ago
  • #694: Webhook failed

    • Priority: Medium
    • Status: Open
    • Created: 9 days ago
  • #688: Network error

    • Priority: High
    • Status: Open
    • Created: 10 days ago
    • Updated: 1 day ago
  • #678: Issue with database

    • Priority: Medium
    • Status: Open
    • Created: 11 days ago
    • Updated: 5 days ago
  • #575: 2FA login support

    • Priority: Low
    • Status: Stale
    • Created: 38 days ago
    • Updated: 8 days ago
  • #546: RateLimitError: Exceeded OpenAI API Quota Leading to LLMProviderError Despite 0% Usage on Apple M2 Pro

    • Priority: Medium
    • Status: Stale
    • Created: 45 days ago
    • Updated: 8 days ago
  • #545: Handle parallel requests and tasks

    • Priority: High (P1)
    • Status: Open
    • Created: 45 days ago
    • Updated: 4 days ago

Report On: Fetch pull requests



Overview

The provided data consists of a list of closed pull requests (PRs) from the Skyvern-AI/skyvern repository. This repository is part of the Skyvern project, which focuses on automating browser-based workflows using Large Language Models (LLMs) and Computer Vision. The PRs cover a range of updates, including bug fixes, feature enhancements, and infrastructure improvements.

Summary of Pull Requests

  • #710: Removed run_streaming.sh script that captured root window screenshots.
  • #709: Added a Temporal task queue and worker framework for better task management.
  • #708: Introduced support for parsing table-related elements in the DOM.
  • #707: Updated DOM script to recognize Angular click bindings.
  • #706 & #705: Updated selection prompts to improve handling of required fields.
  • #703: Added timeout to Bitwarden subprocess calls to prevent indefinite waits.
  • #702: Upgraded Playwright version for improved functionality.
  • #701: Optimized SVG logic for more efficient element tree processing.
  • #700: Deprecated Streamlit UI image in Docker Compose configuration.
  • #699: Extended select2 dropdown detection for better interaction handling.
  • #698: Increased lazy loading wait time to improve dropdown menu performance.
  • #697: Fixed false negative in user goal achievement status reasoning.
  • #696: Downgraded litellm due to errors in the newer version.
  • #695: Attempted to fix a file upload bug by adjusting file setting order.
  • #693: Fixed potential bug in build_html_tree by allowing None as default for element_tree.
  • #692: Added support for managing multiple browser tabs and video artifacts.
  • #691: Removed JSON response logging in webhook failure scenarios.
  • #690: Reordered JSON structure keys for better readability.
  • #689 & #688: Updated custom selection prompts and added new features for element interaction.

Analysis of Pull Requests

The Skyvern-AI/skyvern repository shows active development with a focus on enhancing the robustness and functionality of its automation capabilities. A significant number of recent PRs address improvements in DOM interaction and task management, reflecting the project's core objective of providing stable and flexible browser automation.

Several PRs (#709, #692) introduce or enhance frameworks for task management and multi-tab handling, indicating a shift towards more scalable and efficient task execution. This aligns with the project's goal of operating across various websites without custom code.

Bug fixes and optimizations are prevalent throughout the PRs (#703, #701, #695), demonstrating a commitment to maintaining stability and performance. The downgrade of litellm (#696) highlights the team's responsiveness to external library issues that impact functionality.

The removal of deprecated components (#700) and updates to configuration files (#674) suggest ongoing efforts to streamline the project's infrastructure. These changes likely aim to reduce complexity and improve maintainability.

Overall, the PRs reflect a well-rounded approach to development, balancing new feature implementation with necessary maintenance and optimization tasks. The project's emphasis on using AI for automation is evident in updates that enhance interaction capabilities through LLMs (#675, #681). This focus on AI-driven solutions is central to Skyvern's value proposition as an innovative tool for browser-based workflow automation.

Report On: Fetch commits



Development Team and Recent Activity

Team Members and Activities

  1. Shuchang Zheng (wintonzheng)

    • Recent activities include removing scripts (run_streaming.sh), deprecating Docker Compose images, and making logging optimizations.
    • Worked on bug fixes such as the update_task bug and made improvements to logging and task management.
    • Collaborated with Kerem Yilmaz on tasks like screen streaming under a Docker environment.
  2. Kerem Yilmaz (ykeremy)

    • Added features like request context to the async executor and detailed logs for webhook failures.
    • Made several updates to the frontend, including pagination, status badge updates, and workflow table enhancements.
    • Collaborated with Shuchang Zheng on multiple tasks, including screen streaming and Bitwarden CLI improvements.
  3. LawyZheng

    • Focused on enhancing DOM utilities and prompts, optimizing SVG logic, and fixing bugs related to file uploads and multi-tab support.
    • Worked on extending select functionalities and supporting new elements like PDF printers.
    • Engaged in optimizing existing code for better performance and reliability.
  4. Salih Altun (msalihaltun)

    • Contributed to frontend improvements such as adding routes and updating task generation prompts.
    • Made minor updates to styling and component configurations.
  5. Suchintan

    • Primarily involved in documentation edits, ensuring clarity and comprehensiveness in project documentation.

Patterns, Themes, and Conclusions

  • Collaboration: There is significant collaboration among team members, particularly between Shuchang Zheng and Kerem Yilmaz, indicating a cohesive team effort towards project goals.
  • Frontend Enhancements: A considerable focus has been placed on improving the user interface and experience, with numerous updates to frontend components by Kerem Yilmaz and Salih Altun.
  • Bug Fixes and Optimizations: The team is actively addressing bugs and optimizing existing features, as seen in the work by LawyZheng and Shuchang Zheng.
  • Documentation: Suchintan's contributions highlight the importance of maintaining up-to-date documentation to support users and contributors.
  • Feature Development: New features are being added regularly, with Kerem Yilmaz leading efforts in enhancing backend capabilities like async execution contexts.

Overall, the development team is actively engaged in both maintaining existing functionalities and pushing forward with new features, ensuring the project's robustness and usability.