‹ Reports
The Dispatch

OSS Report: khoj-ai/khoj


Khoj Development Focuses on Integration and User Experience Enhancements

Khoj, an open-source personal AI application, continues to evolve with a focus on expanding integration capabilities and improving user experience across platforms.

Recent Activity

Recent issues and pull requests highlight a focus on platform integration and user experience. Issues such as #917 request new integrations (e.g., Sharedpoint), while others like #915 address user interaction bugs. Self-hosting challenges (#911, #910) indicate documentation gaps. Pull requests reflect enhancements in AI model support (#912, #902) and user interface improvements (#904).

Development Team and Recent Activity

  1. Debanjum (debanjum)

    • Implemented chat message features via URL (3 days ago).
    • Released Khoj version 1.23.2 (3 days ago).
    • Total: 51 commits.
  2. Sabaimran (sabaimran)

    • Enhanced email templates (1 day ago).
    • Fixed agent page issues (2 days ago).
    • Total: 44 commits.
  3. Brian Kanya (kanya-approve)

    • Updated email configuration (6 days ago).
    • Total: 1 commit.
  4. Alexander Matyasko (aam-at)

    • Added support for Google's Gemini models (6 days ago).
    • Total: 1 commit.
  5. Raghav Tirumale (MythicalCow)

    • Contributed vision support features (9 days ago).
    • Total: 1 commit.
  6. HusainBhattiwala (HusainBhattiwala)

    • Merged desktop improvement PRs.
    • Total: 1 commit.
  7. LV Nilesh (lvnilesh)

    • Addressed deprecation warnings.
    • Total: 1 commit.

Of Note

Quantified Reports

Quantify Issues



Recent GitHub Issues Activity

Timespan Opened Closed Comments Labeled Milestones
7 Days 6 4 3 0 1
30 Days 13 17 25 0 1
90 Days 27 24 81 1 1
1 Year 160 151 515 44 1
All Time 429 375 - - -

Like all software activity quantification, these numbers are imperfect but sometimes useful. Comments, Labels, and Milestones refer to those issues opened in the timespan in question.

Quantify commits



Quantified Commit Activity Over 30 Days

Developer Avatar Branches PRs Commits Files Changes
Debanjum 1 4/4/1 51 56 4307
sabaimran 2 4/3/0 44 62 1212
Raghav Tirumale 1 0/1/0 1 33 1159
Alexander Matyasko 1 1/1/0 1 11 454
Husain007 1 2/1/1 1 3 16
Brian Kanya 1 1/1/0 1 1 7
LV Nilesh 1 1/1/0 1 1 1

PRs: created by that dev and opened/merged/closed-unmerged during the period

Detailed Reports

Report On: Fetch issues



Recent Activity Analysis

The recent GitHub issue activity for the Khoj project indicates a vibrant and engaged community, with 54 open issues currently being discussed. Notably, there is a mix of feature requests, bug reports, and documentation updates. A significant number of issues relate to user experience improvements, particularly around the integration with various platforms like Obsidian and Emacs, suggesting a focus on enhancing usability across different environments.

Several issues exhibit recurring themes, such as problems with self-hosting configurations, API integrations, and the need for better handling of file types during indexing. There are also discussions around performance optimizations and user feedback mechanisms. The presence of multiple issues related to the chat functionality indicates that this feature may require further refinement to meet user expectations.

Issue Details

Recent Issues

  1. Issue #917: [IDEA] Support connection with Sharedpoint

    • Priority: Upgrade
    • Status: Open
    • Created: 0 days ago
    • Description: Request for a feature to connect a Sharedpoint site to sync PDF files automatically.
  2. Issue #915: [FIX] The "Create Agent" button doesn't trigger anything

    • Priority: Fix
    • Status: Open
    • Created: 2 days ago
    • Description: The button fails to trigger any action; only a GET request is sent.
  3. Issue #913: [FIX] Obsidian vault is too big with all kinds of media. Image and PDF exclude not enough

    • Priority: Fix
    • Status: Open
    • Created: 5 days ago (Edited 2 days ago)
    • Description: User cannot use Khoj due to excessive file types in their vault.
  4. Issue #911: Trying to self-host on Ubuntu using Docker - /server/admin returns bad request (400)

    • Priority: Fix
    • Status: Open
    • Created: 6 days ago
    • Description: Encountering a bad request error when accessing the admin panel.
  5. Issue #910: Trying to Self-Host on Ubuntu (using pip) - Can't Complete Install

    • Priority: Fix
    • Status: Open
    • Created: 6 days ago
    • Description: Issues during installation on a clean Ubuntu environment.
  6. Issue #906: [IDEA] Any plan add quivr brain feature to khoj

    • Priority: Upgrade
    • Status: Open
    • Created: 9 days ago (Edited 1 day ago)
    • Description: Suggestion for a feature allowing users to upload files for enhanced searching capabilities.
  7. Issue #895: [IDEA] Any plan to add i18n support?

    • Priority: Upgrade
    • Status: Open
    • Created: 25 days ago (Edited 1 day ago)
    • Description: Request for internationalization support in the project.
  8. Issue #841: [IDEA] Using function calling to integrate more tools

    • Priority: Upgrade
    • Status: Open
    • Created: 74 days ago (Edited 10 days ago)
    • Description: Proposal for adding the ability for agents to integrate with additional tools.

Analysis of Themes and Commonalities

  • There is a strong focus on improving integration capabilities with external services (e.g., Sharedpoint, quivr).
  • Many issues revolve around fixing bugs related to user interactions within the application, particularly in creating agents and managing file indexing.
  • Requests for enhancements in localization and user interface improvements are prevalent, indicating that users are looking for a more inclusive and intuitive experience.
  • The challenges faced during self-hosting setups highlight potential gaps in documentation or support for users attempting to deploy the application independently.

This analysis underscores an active development cycle where user feedback is being prioritized, and ongoing improvements are being made based on community input.

Summary of Important Issues

Issue Number Title Priority Status Created Updated
#917 Support connection with Sharedpoint Upgrade Open 0 days ago N/A
#915 The "Create Agent" button doesn't trigger anything Fix Open 2 days ago N/A
#913 Obsidian vault is too big with all kinds of media Fix Open 5 days ago 2 days ago
#911 Trying to self-host on Ubuntu using Docker returns bad request (400) Fix Open 6 days ago N/A
#910 Trying to Self-Host on Ubuntu using pip can't complete install Fix Open 6 days ago N/A
#906 Any plan add quivr brain feature to khoj? Upgrade Open 9 days ago 1 day ago
#895 Any plan to add i18n support? Upgrade Open 25 days ago 1 day ago
#841 Using function calling to integrate more tools Upgrade Open 74 days ago 10 days ago

This table summarizes key issues that reflect both user needs and ongoing development efforts within the Khoj project.

Report On: Fetch pull requests



Overview

The analysis of the pull requests (PRs) for the Khoj project reveals a dynamic and active development environment with a focus on enhancing functionality, improving user experience, and integrating new technologies. The PRs range from significant feature additions to crucial bug fixes and performance improvements.

Summary of Pull Requests

Open Pull Requests

  • PR #916: Weave agent personality through subtasks
    • Significance: Introduces agent personality into subtasks, enhancing the overall interaction quality.
    • Notable: Sets the stage for future agent creation features.

Closed Pull Requests

  • PR #914: Add a unique_id field for identifying conversations

    • Significance: Adds a unique identifier for conversations, improving tracking and management.
    • Notable: Includes migration scripts to handle existing data.
  • PR #912: Support OpenAI's new O1 Model Series

    • Significance: Updates the system to support new AI models from OpenAI, ensuring the platform remains cutting-edge.
    • Notable: Addresses specific limitations of the new models.
  • PR #909: Support using image generation models like Flux via Replicate

    • Significance: Expands image generation capabilities by integrating with new models.
    • Notable: Includes significant changes to image processing logic.
  • PR #907: Use environment variable to set sender email of auth link emails

    • Significance: Enhances configurability by allowing dynamic setting of sender email for authentication links.
    • Notable: Resolves issues with hard-coded values that limited deployment flexibility.
  • PR #904: Set File Types to Sync from Obsidian via Khoj Plugin Settings Page

    • Significance: Improves integration with Obsidian by allowing users to specify file types for syncing.
    • Notable: Helps manage data limits and improves response context quality.
  • PR #903: Fix URL to web, desktop settings pages on Desktop application

    • Significance: Fixes navigation issues within the desktop application.
    • Notable: Ensures consistency in user experience across platforms.
  • PR #902: Support Google's Gemini model series

    • Significance: Integrates support for new AI models from Google, expanding the platform's capabilities.
    • Notable: Involves extensive changes to conversation processing logic.
  • PR #889: New Feature: Vision Support for Khoj

    • Significance: Introduces vision capabilities, allowing users to interact with images within conversations.
    • Notable: Represents a significant expansion of Khoj's functionality.

Analysis of Pull Requests

The PRs reflect a strong focus on expanding Khoj's capabilities through integration with new AI models and technologies. The introduction of features like agent personality in subtasks (#916) and support for vision (#889) indicates an effort to enhance user interaction and engagement.

There's also a clear emphasis on improving existing functionalities and fixing issues, as seen in PRs like adding unique identifiers for conversations (#914) and fixing navigation issues in the desktop application (#903). These efforts are crucial for maintaining a smooth user experience as the platform evolves.

The integration of environment variables for configuration (#907) and the ability to sync specific file types from Obsidian (#904) demonstrate a commitment to flexibility and user control over their setups. This is particularly important for self-hosted instances where customization can significantly impact usability.

The support for new AI models from OpenAI (#912) and Google (#902) ensures that Khoj remains competitive and leverages the latest advancements in AI technology. This is vital for attracting and retaining users who seek cutting-edge tools for personal productivity enhancement.

Overall, the PRs indicate a healthy development pace with a balanced approach towards feature expansion, user experience improvement, and technological integration. The active management of pull requests also suggests a well-organized project structure that can efficiently handle contributions from both core developers and the community.

Report On: Fetch commits



Repo Commits Analysis

Development Team and Recent Activity

Team Members and Recent Contributions

  1. Debanjum (debanjum)

    • Recent Activity:
    • Implemented a feature to send chat messages via URL query parameters for quick access (3 days ago).
    • Simplified code to remove JSON code blocks from AI response strings (3 days ago).
    • Released Khoj version 1.23.2 (3 days ago).
    • Improved handling of harmful categorized responses to provide clearer error messaging (3 days ago).
    • Made various enhancements and bug fixes across multiple files, including significant changes to image generation support and modularization of related code.
    • Total Commits in 30 Days: 51 commits with 4307 changes.
  2. Sabaimran (sabaimran)

    • Recent Activity:
    • Enhanced email templates to align with new branding (1 day ago).
    • Fixed handling for new conversations on the agents page (2 days ago).
    • Released Khoj version 1.23.2 (3 days ago).
    • Collaborated on adding unique identifiers for conversations and improved email link handling.
    • Total Commits in 30 Days: 44 commits with 1212 changes.
  3. Brian Kanya (kanya-approve)

    • Recent Activity:
    • Updated sender email configuration for authentication links to be environment variable driven (6 days ago).
    • Total Commits in 30 Days: 1 commit with 7 changes.
  4. Alexander Matyasko (aam-at)

    • Recent Activity:
    • Contributed to adding support for Google's Gemini model series, including various enhancements and fixes (6 days ago).
    • Total Commits in 30 Days: 1 commit with 454 changes.
  5. Raghav Tirumale (MythicalCow)

    • Recent Activity:
    • Major contributions towards adding vision support, including UI updates and backend adjustments (9 days ago).
    • Total Commits in 30 Days: 1 commit with 1159 changes.
  6. HusainBhattiwala (HusainBhattiwala)

    • Recent Activity:
    • Merged several pull requests related to desktop application improvements and fixed bugs in automation settings.
    • Total Commits in 30 Days: 1 commit with 16 changes.
  7. LV Nilesh (lvnilesh)

    • Recent Activity:
    • Merged a pull request addressing deprecation warnings in the project dependencies.
    • Total Commits in 30 Days: 1 commit with 1 change.

Patterns and Themes

  • The team is actively working on enhancing user experience through UI improvements, especially around chat functionalities and email communications.
  • Significant focus on modularizing features such as image generation and improving the handling of various AI models, indicating a shift towards more robust architecture.
  • Collaboration is evident, particularly between Debanjum and Sabaimran, who frequently co-author commits related to major features.
  • The release cycle is consistent, with multiple versions being pushed out within short timeframes, reflecting an agile development approach.
  • There is a strong emphasis on addressing user feedback through bug fixes and enhancements, particularly around the chat interface and error handling.

Conclusions

The recent activities of the Khoj development team demonstrate a commitment to continuous improvement and responsiveness to user needs. The collaborative efforts among team members have led to significant advancements in functionality and user experience, positioning Khoj as a robust tool for personal AI integration. The active release cycle suggests a healthy development pace aimed at maintaining user engagement and satisfaction.