‹ Reports
The Dispatch

OSS Report: elastic/kibana


Kibana Project Faces Stability Challenges Amidst Active Development

Kibana, a key component of the Elastic Stack, continues to see active development with a focus on user experience enhancements and security features. However, a surge in failing tests and recurring issues raises concerns about software stability.

Recent Activity

Recent issues and pull requests (PRs) highlight a concerted effort to improve user experience and address bugs, particularly in observability and security domains. Issues like #191833 and #191832 focus on user interface improvements, while PRs such as #191838 aim to enhance code organization. The presence of numerous failing tests, such as those in issues #191820 and #191810, suggests potential instability in recent releases.

Development Team and Recent Activities

  1. Alejandro Fernández Haro (afharo)

    • Added @kbn/ebt-tools to shared dependencies.
    • Refactored @kbn/config-schema for server-side use.
    • Worked on security solution features.
  2. Elena Shostak (elena-shostak)

    • Added bootstrap step for CodeQL scans.
    • Co-authored security solution updates.
  3. Stratoula Kalafateli (stratoula)

    • Added ESQL utilities helper.
    • Fixed APM breadcrumbs on Serverless.
  4. Ievgen Sorokopud (e40pud)

    • Edited rules in security solutions.
    • Improved UI for rule management.
  5. Nicolas Chaulet (nchaulet)

    • Stopped fetching all agent policies in Fleet.
    • Migrated enterprise search plugin dependencies.
  6. Carlos Crespo (crespocarlos)

    • Fixed APM breadcrumbs.
    • Made UI adjustments across observability solutions.
  7. Dima Arnautov (darnautov)

    • Fixed schema definitions for ML module endpoints.
    • Engaged in bug fixes within the ML area.
  8. Dominique Clarke (dominiqueclarke)

    • Improved accessibility features in Synthetics management actions.
  9. Candace Park (parkiino)

    • Addressed bugs related to event filters in Security Solution.
  10. Others: Various contributions across plugins, documentation, and testing improvements.

Of Note

Quantified Reports

Quantify Issues



Recent GitHub Issues Activity

Timespan Opened Closed Comments Labeled Milestones
7 Days 181 60 388 0 1
14 Days 281 128 545 0 1
30 Days 397 195 889 0 1
All Time 66905 57158 - - -

Like all software activity quantification, these numbers are imperfect but sometimes useful. Comments, Labels, and Milestones refer to those issues opened in the timespan in question.

Quantify commits



Quantified Commit Activity Over 30 Days

Developer Avatar Branches PRs Commits Files Changes
Steph Milovic 3 1/1/0 4 106 155570
Maxim Palenov (maximpn) 2 2/0/0 4 121 83169
Kibana Machine 24 45/40/0 77 501 37199
Karen Grigoryan 2 0/0/0 5 455 27239
Lisa Cawley 7 9/4/0 15 215 22514
Jean-Louis Leysens 3 0/0/0 3 16 9606
Walter Rafelsberger 1 1/1/0 3 260 6135
Ersin Erdal 2 0/0/0 2 118 6091
Achyut Jhunjhunwala 1 1/0/0 1 83 5467
Nicolas Chaulet 4 1/1/0 7 151 5407
elena-shostak 6 2/1/0 13 9 4890
Colleen McGinnis 1 0/0/0 1 129 4516
Pierre Gayvallet 2 0/0/0 4 57 3830
Kevin Delemme 3 2/1/0 4 118 3699
Carlos Crespo 5 0/0/0 6 116 3320
Davis McPhee (davismcphee) 3 1/0/0 3 88 3263
Anton Dosov 3 3/1/0 4 116 3248
Nick Partridge 2 0/0/0 3 105 3047
Garrett Spong 1 0/0/0 1 35 2948
Ignacio Rivas 3 0/0/0 5 54 2938
Elena Stoeva (ElenaStoeva) 3 2/1/0 6 91 2853
Dzmitry Lemechko 4 0/0/0 4 320 2594
Kevin Lacabane 3 2/1/0 4 68 2387
James Gowdy 2 3/0/0 4 80 2369
Jen Huang 4 3/3/0 9 86 2311
Sébastien Loix 3 3/1/0 4 71 2294
Larry Gregory 5 0/0/0 6 251 2203
Patryk Kopyciński 2 0/0/0 2 302 2129
Jill Guyonnet 2 2/1/0 3 36 2028
Nathan Reese 4 0/0/0 5 48 2017
Philippe Oberti 2 0/0/0 2 76 1920
Eyo O. Eyo 4 3/0/0 6 176 1911
Marius Iversen 2 4/2/0 6 69 1742
Maryam Saeidi 3 0/0/0 3 334 1697
Jiawei Wu 2 0/0/0 2 35 1523
Rickyanto Ang 2 1/0/0 3 169 1501
Andrew Macri 2 1/1/0 2 74 1483
Ievgen Sorokopud 2 0/0/0 2 21 1418
Alexi Doak 2 0/0/0 3 21 1417
renovate[bot] 2 0/0/0 3 12 1405
Jatin Kathuria 1 0/0/0 1 160 1283
Julia 2 0/0/0 5 19 1274
Mark J. Hoy 2 0/0/0 2 28 1181
Dominique Clarke 4 1/1/0 9 65 1155
Yngrid Coello 2 0/0/0 3 45 1137
Tiago Costa 6 1/0/0 14 68 1134
Alejandro Fernández Haro 4 19/16/0 29 350 1111
Patrick Mueller 3 0/0/0 3 20 1086
Tim Sullivan 5 4/1/0 11 80 1051
Rodney Norris 2 1/1/0 3 31 1043
Paul Tavares 1 0/0/0 2 38 977
Drew Tate 3 1/0/0 4 18 911
Jon 9 4/4/0 33 107 893
Julia Bardi 2 2/1/0 3 20 877
Mark Hopkin 2 0/0/0 2 35 862
Jamie Tanna 2 0/0/0 2 1 845
Catherine Liu 1 0/0/0 1 46 806
Mykola Harmash 4 0/0/0 5 10 747
Bharat Pasupula 1 1/0/0 1 33 719
elastic-renovate-prod[bot] 9 6/2/0 13 28 700
Paulo Henrique 3 0/0/0 4 10 689
jennypavlova 3 2/2/0 5 55 602
Ying Mao 2 3/0/0 3 26 600
Dario Gieselaar 1 2/1/0 2 25 600
Kurt 3 0/0/0 3 32 529
Georgii Gorbachev 2 0/0/0 2 2 520
Alex Szabo 3 2/1/0 9 22 506
Søren Louv-Jansen 1 1/0/1 2 31 496
Lola (Omolola-Akinleye) 4 1/0/0 4 12 492
Devon Thomson 1 0/0/0 1 11 490
Dmitrii Shevchenko 1 0/0/0 1 14 481
Marco Liberati 1 0/0/0 1 16 476
Cristina Amico 2 0/0/0 2 3 456
Efe Gürkan YALAMAN 1 0/0/0 1 19 452
Tre' 1 4/1/0 2 77 413
Bryce Buchanan (bryce-b) 1 1/0/0 2 8 403
Sander Philipse 4 0/0/0 5 30 397
Vadim Kibana 2 2/1/0 2 6 394
Angela Chuang 1 0/0/0 1 11 388
Ilya Nikokoshev (ilyannn) 1 1/0/0 1 19 384
mohamedhamed-ahmed 3 0/0/0 3 18 375
Katerina 2 1/1/0 3 8 367
seanrathier 1 0/0/0 1 8 342
Ash 2 0/0/0 3 19 315
Saarika Bhasi 1 0/0/0 1 22 308
Irene Blanco 2 2/1/0 3 5 282
Chris Cowan 3 0/0/0 3 15 280
Brad White 3 1/0/1 3 12 248
Aleh Zasypkin 2 0/0/0 2 5 241
Shaunak Kashyap 1 0/0/0 1 8 239
Stratoula Kalafateli 3 1/1/0 4 18 213
Shahzad 3 4/2/0 5 16 210
Melissa Alvarez (alvarezmelissa87) 1 1/0/0 1 22 207
Joe McElroy 3 2/1/0 3 8 198
Vitalii Dmyterko 1 0/0/0 1 1 194
Lukas Olson 1 0/0/0 3 12 177
natasha-moore-elastic 1 2/2/0 2 8 174
Alexey Antonov 4 0/0/0 6 14 172
Dan Panzarella 1 0/0/0 1 4 152
Maxim Kholod 2 0/0/0 4 10 147
Saikat Sarkar 2 0/0/0 2 27 145
Joe Reuter 1 0/0/0 2 8 134
Christiane (Tina) Heiligers 1 1/1/0 1 15 133
Gergő Ábrahám 1 1/0/0 1 3 126
Julia Rechkunova 1 0/0/0 1 2 125
florent-leborgne 1 0/0/0 1 1 121
Mike Côté (mikecote) 1 2/0/0 1 4 119
Sergi Massaneda 1 1/0/0 2 6 118
Christos Nasikas 1 0/0/0 1 3 111
Jordan 1 0/0/0 1 14 110
Hannah Mudge 2 0/0/0 2 8 110
Miriam 1 1/0/0 1 4 106
Yara Tercero 2 0/0/0 4 10 74
Marta Bondyra 1 1/0/1 2 8 70
Milton Hultgren 1 1/1/0 1 5 70
Kyle Pollich 1 0/0/0 2 4 61
Gergely Kalapos 1 0/0/0 1 8 61
Candace Park 1 0/0/0 2 4 58
Quynh Nguyen (Quinn) 1 0/0/0 1 8 54
Ahmad Bamieh 2 0/0/0 2 4 51
Yan Savitski 1 0/0/0 1 6 51
Antonio 1 0/0/0 2 3 47
Pablo Machado 1 0/0/0 1 1 46
Khristinin Nikita (nkhristinin) 1 1/0/0 1 6 46
Sid 1 0/0/0 1 5 45
Sandra G 1 0/0/0 1 1 35
Charis Kalpakis 1 0/0/0 1 3 32
Konrad Szwarc 1 0/0/0 2 3 31
Robert Oskamp (pheyos) 2 1/0/0 2 6 29
Ryan Keairns 2 0/0/0 2 7 26
Elastic Machine (elasticmachine) 3 1/1/0 5 2 26
Jorge Sanz 1 1/1/0 2 4 24
Julian Gernun 1 0/0/0 1 2 16
Marius Dragomir 3 0/0/0 3 1 14
Gloria Hornero 1 0/0/0 1 1 14
Liam Thompson 1 0/0/0 1 1 13
Amir Ben Nun 1 2/1/0 2 1 10
Dima Arnautov 1 1/1/0 2 2 10
Navarone Feekery 1 0/0/0 1 1 7
Cauê Marcondes 2 0/0/0 2 3 6
Clint Andrew Hall (clintandrewhall) 1 1/0/0 1 1 6
Pius 1 0/0/0 1 1 4
Julien Lind 1 0/0/0 1 2 4
Gerard Soldevila 1 0/0/0 1 1 4
Lucas Bremgartner 1 0/0/0 1 1 2
Jedr Blaszyk 1 0/0/0 1 1 2
Tomasz Ciecierski 1 1/0/0 1 1 2
Yulia Čech (yuliacech) 1 1/1/0 1 1 2
Alison Goryachev 1 0/0/0 1 1 1
Victor Martinez (v1v) 0 1/0/0 0 0 0
Robert Jaszczurek (rbrtj) 0 1/0/0 0 0 0
Xavier Mouligneau (XavierM) 0 1/0/0 0 0 0
Juan Pablo Djeredjian (jpdjere) 0 1/0/0 0 0 0
Ido Cohen (CohenIdo) 0 1/0/0 0 0 0
Davis Plumlee (dplumlee) 0 1/0/0 0 0 0
Jaime Soriano Pastor (jsoriano) 0 1/0/0 0 0 0
David Kilfoyle (kilfoyle) 0 1/0/0 0 0 0
Matthew Kime (mattkime) 0 1/0/0 0 0 0
Lene Gadewoll (mgadewoll) 0 1/0/0 0 0 0
Gonçalo Rica Pais da Silva (Bluefinger) 0 1/0/0 0 0 0
Marco Antonio Ghiani (tonyghiani) 0 1/0/0 0 0 0
Jeramy Soucy (jeramysoucy) 0 2/0/0 0 0 0
Andrea Del Rio (andreadelrio) 0 1/0/0 0 0 0
Justin Kambic (justinkambic) 0 1/0/0 0 0 0
None (christineweng) 0 1/0/0 0 0 0

PRs: created by that dev and opened/merged/closed-unmerged during the period

Detailed Reports

Report On: Fetch issues



Recent Activity Analysis

The Kibana project has seen significant recent activity with a total of 9,747 open issues. Notably, there is a surge in newly created issues, particularly concerning user experience enhancements and bug fixes related to the observability and security features. This uptick suggests an ongoing commitment to improving the platform, but it also raises concerns about the management of these issues, especially given the number of failing tests and bugs reported.

Several issues exhibit patterns of recurring problems, such as failures in automated tests across various functionalities, indicating potential instability in recent releases. The presence of multiple "failing test" issues highlights a critical area that may require immediate attention to ensure the reliability of the software.

Issue Details

Most Recently Created Issues

  1. Issue #191833: [Observability Onboarding] Whole category card should be clickable

    • Priority: Normal
    • Status: Open
    • Created: 0 days ago
  2. Issue #191832: [Security Solution] Add validation error description on prebuilt rule editing

    • Priority: Normal
    • Status: Open
    • Created: 0 days ago
  3. Issue #191826: Improve serverless logout when session expires or unexpected session error

    • Priority: Enhancement
    • Status: Open
    • Created: 0 days ago
  4. Issue #191822: Sustainable Kibana Architecture

    • Priority: Normal
    • Status: Open
    • Created: 0 days ago
  5. Issue #191821: [Dataset quality] Empty prompt

    • Priority: Normal
    • Status: Open
    • Created: 0 days ago

Most Recently Updated Issues

  1. Issue #191820: Failing test: X-Pack Endpoint Functional Tests on ESS...

    • Priority: Failed Test
    • Status: Open
    • Last Updated: 0 days ago
  2. Issue #191819: Failing test: Security Solution Cypress...

    • Priority: Failed Test
    • Status: Open
    • Last Updated: 0 days ago
  3. Issue #191812: [ES|QL] High-level AST mutation API

    • Priority: Enhancement
    • Status: Open
    • Last Updated: 0 days ago
  4. Issue #191810: Failing serverless feature flag test...

    • Priority: Failed Test
    • Status: Open
    • Last Updated: 0 days ago
  5. Issue #191809: Failing serverless feature flag test suites...

    • Priority: Failed Test
    • Status: Open
    • Last Updated: 0 days ago

Notable Anomalies and Themes

  • A significant number of recently created issues are related to user experience improvements and bug fixes, particularly in the observability and security domains.
  • There is a concerning trend of failing tests across various functionalities, which could indicate underlying stability issues within the codebase.
  • The recurring nature of certain bugs suggests that some areas may require deeper investigation or refactoring to prevent future occurrences.
  • The high volume of open issues juxtaposed with the number of failing tests indicates potential resource allocation challenges within the development team.

Overall, while there is active engagement in enhancing Kibana's features, addressing the stability and reliability concerns highlighted by the numerous failing tests should be prioritized to maintain user trust and satisfaction.

Report On: Fetch pull requests



Overview

The dataset consists of a comprehensive list of pull requests (PRs) from the Kibana repository, with a total of 1009 open PRs. The PRs cover various enhancements, bug fixes, and refactoring efforts aimed at improving functionality, performance, and maintainability within the Kibana project.

Summary of Pull Requests

Recent Open Pull Requests

  • PR #191838: Moves @kbn/config-schema to server in @kbn/search-connectors to prevent browser leakage. This change is part of a larger effort to enhance code organization and security.

  • PR #191837: Adds publicBaseUrl to Elasticsearch config, allowing users to set a publicly accessible URL for Elasticsearch, enhancing configurability.

  • PR #191836: A manual backport of improvements made in empty object creation for ML jobs, addressing potential issues with object handling.

  • PR #191834: A chore to uncomment the moduleDetection option in TypeScript configuration, which was previously marked as TODO.

  • PR #191830: Introduces a temporary solution for TypeScript inference limits related to rule schemas in security workflows.

  • PR #191829: Adds documentation on entity definition internals for observability solutions, aiming to clarify internal workings.

  • PR #191828: Implements logic to infer group sort order from the DOM for dashboard panels, improving user experience.

  • PR #191825: Introduces new empty states in APM for logs-only services to encourage APM usage.

  • PR #191824: Adds retry logic for Docker operations in CI pipelines to improve reliability during builds.

  • PR #191823: Fixes serverless security platform authorization feature flag test by updating applicable snapshots.

Notable Closed Pull Requests

  • PR #191831: Fixed an issue with viewing watcher execution history. This PR addresses a critical bug that caused errors when accessing execution details.

  • PR #191736: Fixes a flaky Jest test related to attack discovery in the Security Solution, ensuring stability in testing.

  • PR #191675: A significant refactor that improves the organization of common services within the functional test framework, enhancing maintainability.

Analysis of Pull Requests

Themes and Commonalities

The recent pull requests reflect several key themes: 1. Refactoring and Code Organization: Many PRs focus on moving components and configurations from client-side code to server-side implementations (e.g., PRs related to moving @kbn/config-schema). This indicates an ongoing effort to improve code structure and prevent unnecessary exposure of backend logic to the client side.

  1. Enhancements for User Experience: Several PRs aim to improve user interactions and experiences within Kibana's UI. For instance, adding new features like the public base URL for Elasticsearch and enhancing APM's UI demonstrate a commitment to user-centric design.

  2. Performance Improvements: There are multiple instances where performance is being addressed, such as optimizing API calls (e.g., using resolve/cluster instead of resolve/index) and reducing bundle sizes significantly (e.g., reducing APM's initial load size).

  3. Documentation and Testing Enhancements: The addition of documentation for new features and improvements in testing practices (like addressing flaky tests) highlight an emphasis on maintaining high-quality standards as the project evolves.

Anomalies and Issues

  1. Flaky Tests: There are recurring mentions of flaky tests across several PRs. For example, PR #191736 addresses flakiness in Jest tests related to attack discovery. This points towards a need for more robust testing strategies or infrastructure improvements.

  2. CI Build Failures: Several PRs have reported flaky CI builds or failures during testing phases. This could indicate underlying issues with the CI/CD pipeline or dependencies that need attention.

  3. Draft Status of Many PRs: A significant number of open PRs are still in draft status, suggesting that while there is active development, many features are not yet ready for production or require further refinement before merging.

  4. Dependency Management Challenges: Some PRs indicate challenges with dependency management (e.g., updates related to chromedriver), which can affect testing environments and overall project stability if not handled properly.

Lack of Recent Merge Activity

While there is a high volume of open pull requests, there appears to be a lack of recent merge activity on some older PRs. This could be due to several factors:

  • Resource allocation may be focused on urgent bug fixes or high-priority features.
  • Potential bottlenecks in the review process may delay merges.
  • Some PRs may require additional work or discussion before they can be merged effectively.

In conclusion, while there is significant ongoing work within the Kibana project reflected through these pull requests, attention should be given to addressing flaky tests, improving CI reliability, and ensuring timely reviews and merges to maintain momentum in development efforts.

Report On: Fetch commits



Repo Commits Analysis

Development Team and Recent Activity

Team Members and Recent Activities

  1. Alejandro Fernández Haro (afharo)

    • Recent Commits:
    • Added @kbn/ebt-tools to shared dependencies.
    • Moved @kbn/config-schema to the server for multiple plugins including home, visualization, and unified search.
    • Worked on security solution features allowing editing rules independently of source data.
    • Involved in various refactoring tasks across multiple plugins.
    • Collaboration: Frequently collaborates with other team members like Ievgen Sorokopud and Carlos Crespo.
  2. Elena Shostak (elena-shostak)

    • Recent Commits:
    • Added a bootstrap step before CodeQL scans.
    • Co-authored several commits related to security solution features and documentation updates.
    • Collaboration: Co-authored with various team members including kibanamachine and Vitalii Dmyterko.
  3. Stratoula Kalafateli (stratoula)

    • Recent Commits:
    • Added a helper for retrieving metadata columns in ESQL utilities.
    • Fixed APM breadcrumbs on Serverless.
    • Collaboration: Engaged in collaborative efforts with other developers on related tasks.
  4. Ievgen Sorokopud (e40pud)

    • Recent Commits:
    • Implemented changes for editing rules in the security solution, addressing specific issues.
    • Worked on user interface improvements for rule management workflows.
    • Collaboration: Co-authored with several team members.
  5. Nicolas Chaulet (nchaulet)

    • Recent Commits:
    • Stopped fetching all agent policies in Fleet.
    • Contributed to the migration of enterprise search plugin authc dependencies from the security plugin to core security service.
    • Collaboration: Collaborated with the team on various Fleet-related tasks.
  6. Carlos Crespo (crespocarlos)

    • Recent Commits:
    • Fixed APM breadcrumbs on serverless.
    • Made various UI adjustments across observability solutions.
    • Collaboration: Works closely with other developers on UI/UX improvements.
  7. Dima Arnautov (darnautov)

    • Recent Commits:
    • Fixed schema definitions for ML module endpoints.
    • Engaged in various bug fixes and enhancements within the ML area.
    • Collaboration: Collaborates with other team members on ML-related tasks.
  8. Dominique Clarke (dominiqueclarke)

    • Recent Commits:
    • Improved accessibility features in Synthetics management actions.
    • Enhanced user experience by adjusting headings and adding aria-live regions in components.
    • Collaboration: Works on accessibility improvements alongside other developers.
  9. Candace Park (parkiino)

    • Recent Commits:
    • Addressed bugs related to event filters and improved user interaction elements in the Security Solution.
    • Collaboration: Collaborates with multiple team members for enhancements in the Security Solution.
  10. Others (e.g., Tre', Kevin Lacabane, etc.)

    • Various contributions ranging from fixing bugs, enhancing documentation, improving tests, and implementing new features across different plugins.

Patterns and Themes

  • The recent activities show a strong focus on refactoring existing code, improving accessibility, and enhancing user experience across various components of Kibana.
  • There is significant collaboration among team members, particularly in co-authoring commits, indicating a cohesive development environment where knowledge sharing is prevalent.
  • The development team is actively addressing bugs and implementing features that enhance functionality, particularly within the Security Solution and Observability areas.
  • The movement of configurations such as @kbn/config-schema to server-side implementations suggests ongoing efforts to streamline code structure and improve performance.

Conclusions

The Kibana development team is highly active, demonstrating a commitment to continuous improvement through refactoring, bug fixes, and feature enhancements. The collaborative nature of their work fosters an environment conducive to innovation and responsiveness to user needs.