175 Commits

Author	SHA1	Message	Date
Eric Hare	e555e470d9	fix: Cherry-pick nightly SDK build fixes to main (#12491) ... * fix: Build and install the langflow-sdk for lfx (fixes nightly) (#12481) * fix: Build and install the langflow-sdk for lfx * Publish sdk as a nightly * Update ci.yml * Update python_test.yml * Update ci.yml * fix: Properly grep for the langflow version (#12486) * fix: Properly grep for the langflow version * Mount the sdk where needed * Skip the sdk * [autofix.ci] apply automated fixes * Update setup.py * fix(docker): Remove broken npm self-upgrade from Docker images (#12309) * fix: replace grep -oP with sed for Node.js version extraction in Docker builds (#12331) The grep -oP (PCRE regex) command fails in the python:3.12.12-slim-trixie Docker base image because PCRE support is not available in the slim variant. This replaces grep -oP with portable sed -nE in all 5 Dockerfiles and adds an empty version guard to fail fast with a clear error message instead of producing a broken download URL. --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Cristhian Zanforlin Lousa <cristhian.lousa@gmail.com> Co-authored-by: vjgit96 <vijay.katuri@ibm.com>	2026-04-03 14:25:33 -04:00
Jordan Frazier	67d56947e8	chore: remove hash history (#12183) ... * Remove hash history Custom component checks will be done directly through the component index. Removing hash history as it no longer fits into any planned functionality. * [autofix.ci] apply automated fixes * baseline format fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2026-03-16 10:42:08 +00:00
Mendon Kissling	d048a1d029	docs: use npm in makefile and cursor rules (#11784) ... * update-makefile-to-use-npm * update-cursor-rules-file-to-use-npm	2026-02-19 18:43:41 +00:00
Adam-Aghili	0c8c834df3	feat: update pre-release flow to be useable for qa (#11322) ... * feat: create prerelease dedicated to qa allow prerelease versions dedicated to qa * chore: revert lfx dep to 0.2.1 * chore: lfx pyproject version 0.2.1 for testing * feat: use pythin script to determine rc version use a python script to auto incremenet rc version so we do not have to manually maintain what rc version we are on. add it to both release.yml and docker-build-v2.yml for pypi, docker and ghrc. * [autofix.ci] apply automated fixes * chore: change script vars to more meaningful ones * chore: add meaningful echos * chore: add quotes to pass empty str if no version * test: REVERT always pass ci REVERT * chore: add normalization to built ver tests * chore: remove unused uv environment set up * chore: add back in checkout code * chore: disable caching for ensure-lfx-published * chore: revert changes added after merge * fix: allow prerelase python install flag * chore: test base and main install as 1 * chore: seperate base and main * chore: install main using local base first * chore: try using reinstall * chore: create locl directory and use it first * chore: try --no-deps * chore: langflow-*.whl * [autofix.ci] apply automated fixes * fix: try using unsafe-best-match use ./local-packages --index-strategy unsafe-best-match * fix: add a dynamic constriant for langflow base add a dynamic constriant for langflow base during build-main. if this works I will need to go back and remove any unneeded cross-platform test changes * chore: revert to normal install * fix: add pre-main option to make build * chore: remove hyphen in make var * chore: keep propigation wait for pre-release * chore: revert cross-platform-test.yml changes * chore: use else ifdef and add test echos * chore: remove --no-soruces * chore: use ifeq * chore: revert lfx 0.2.1 * chore: downgrade to python 3.12 ragstack-ai-knowledge-store does not support pythong 3.13 * chore: add else to Makefile * chore: back to ifdef * chore: reset to Makefile to main and add pre again * chore: revert to python 3.13 * chore: set compatability check to 3.12 hopeffuly fixes Found 1 incompatibility The package `ragstack-ai-knowledge-store` requires Python >=3.9, <3.13, but `3.13.11` is installed * [autofix.ci] apply automated fixes * fix: new flow reset. * chore: update LFX Determine version * fix: remove buil-lfx dep on lfx release * chore: remove more inputs.release_lfx if statments * fix: uv pip install --find-links * chore: create uv venv before uv pip install * chire: attempt for reinatll of local whls * fix: add OBJC_DISABLE_INITIALIZE_FORK_SAFETY: YES add OBJC_DISABLE_INITIALIZE_FORK_SAFETY: YES to macos cross-platform test builds * [autofix.ci] apply automated fixes * chore: add back in ci step * fix(ci): correctly generate pre-release rc tags * [autofix.ci] apply automated fixes * feat: update pre-release flow to be useable for qa * Revert "feat: update pre-release flow to be useable for qa" This reverts commit 22737729a2d0ed64ea774a30af070f0010cba9e1. * feat: update pre-release flow to be useable for qa * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * feat: update pre-release flow to be useable for qa * feat: update pre-release flow to be useable for qa * feat: update pre-release flow to be useable for qa * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: vijay kumar katuri <vijaykaturi@vijays-MacBook-Air.local> Co-authored-by: vijay kumar katuri <vijay.katuri@ibm.com>	2026-02-06 15:10:32 +00:00
Jordan Frazier	50bab0a4e7	feat: introduce component hash history (#11311) ... * Remove hash history from index * first draft of adding component id and stable hash history * Simplify - use version -> hash mapping * Add unit tests and simple safeguards for stable vs nightly * Add uniqueness check for comp id in comp index build * Remove component id - use name as unique id * Use component name as unique identifier - fix tests * regenerate hash history; add script to makefile * Remove component id * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes (attempt 3/3) * ruff * comp index * ruff * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * update index * ruff * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2026-01-20 14:00:54 +00:00
Cristhian Zanforlin Lousa	1769b0f2fa	feat: Add asymmetric JWT authentication with RS256/RS512 support (#10755) ... * add possibility to change jwt algorithm * add docs related to jwt auth * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes (attempt 3/3) * ruff check fixes * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes (attempt 3/3) * convert to enum auth types * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes (attempt 3/3) * copilot gh suggestions * ruff check * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * add validation to images read file compnent * [autofix.ci] apply automated fixes * ruff fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes (attempt 3/3) * [autofix.ci] apply automated fixes * revert: remove starter project changes * revert: yarn lock * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * remove-docs-for-1.8-release * remove starter projects * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes (attempt 2/3) * [autofix.ci] apply automated fixes (attempt 3/3) * [autofix.ci] apply automated fixes * improve logs message * add missing dep in lfx * [autofix.ci] apply automated fixes * fix typo test error * create helper functions * [autofix.ci] apply automated fixes * ruff checker * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Mendon Kissling <59585235+mendonk@users.noreply.github.com>	2026-01-06 12:37:52 +00:00
olayinkaadelakun	46539f5ca8	Fix: component_index autofix (#11093) ... * fix: strip runtime variable * [autofix.ci] apply automated fixes * fix: install BE dependecies befor generating the component_index * fix: testcase added * [autofix.ci] apply automated fixes --------- Co-authored-by: Olayinka Adelakun <olayinkaadelakun@mac.war.can.ibm.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Olayinka Adelakun <olayinkaadelakun@Olayinkas-MacBook-Pro.local>	2025-12-19 16:30:19 +00:00
Gabriel Luiz Freitas Almeida	2a6461560d	ci(lfx): add coverage generation and Codecov reporting (#10266) ... * chore: update dependency markers and add pytest-cov for coverage reporting - Refined dependency markers for several packages to improve compatibility with Python 3.12 and specific platforms. - Added pytest-cov to development dependencies for enhanced test coverage reporting. - Updated dependencies for pyobjc frameworks to include platform-specific markers for better compatibility. * chore: enhance lfx_tests command with coverage reporting - Updated the lfx_tests target in the Makefile to include coverage reporting options for pytest. - Added coverage metrics output in XML, HTML, and terminal formats to improve test visibility and analysis. * chore: update codecov configuration for LFX coverage tracking - Added LFX coverage target and threshold to the codecov.yml file. - Defined separate coverage flags for frontend, backend, and LFX components. - Updated ignore patterns to exclude LFX test and component directories from coverage reports. * chore: add coverage upload steps to Python CI workflow - Implemented steps to upload coverage reports to Codecov for Python 3.10. - Added artifact upload for coverage reports, retaining them for 30 days. * chore: update LFX coverage target in codecov configuration - Increased the LFX coverage target from 40% to 60% to encourage aspirational improvement. - Clarified the allowable drop in coverage threshold from 44% to 39% without failing the status check. * chore: update coverage configuration in pyproject.toml - Enabled branch coverage in the coverage run configuration. - Fixed a typo in the main module check to ensure proper execution.	2025-10-14 21:55:36 +00:00
Gabriel Luiz Freitas Almeida	fd74f194dd	feat: add static components index to avoid rebuild on startup (#10181) ... * feat: add script to build static component index for fast startup This script generates a prebuilt index of all built-in components in the lfx.components package, saving it as a JSON file for quick loading at runtime. It includes versioning and integrity verification through SHA256 hashing. * chore: update package dependencies and versioning - Bump revision to 3 in uv.lock. - Update dependency markers for several packages to improve compatibility with Python versions and platforms. - Increment versions for langflow (1.6.4) and langflow-base (0.6.4). - Adjust dependency markers for packages related to darwin platform to enhance specificity. * chore: update .gitignore to include component index cache - Added entry for user-specific component index cache directory to .gitignore. - Included member_servers.json in the ignore list for better file management. * feat: enhance component loading with custom index support - Introduced functions to detect development mode and read a custom component index from a specified path or URL. - Added caching mechanism for dynamically generated component indices to improve performance. - Updated `import_langflow_components` to utilize the new index reading and caching logic, allowing for faster startup in production mode. - Added `components_index_path` to settings for user-defined index configuration. * feat: add GitHub Actions workflow to automatically update component index - Introduced a new workflow that triggers on pull requests and manual dispatch to update the component index. - The workflow checks for changes in the component index and commits updates if necessary. - Added a comment feature to notify users when the component index is updated. * [autofix.ci] apply automated fixes * fix: enhance development mode detection logic - Updated the `_dev_mode` function to improve clarity and functionality in detecting development mode. - Refined environment variable checks to explicitly handle "1"/"true"/"yes" for development and "0"/"false"/"no" for production. - Maintained the editable install heuristic as a fallback for determining the mode when the environment variable is not set. * refactor: simplify development mode detection logic - Revised the `_dev_mode` function to clarify the detection of development mode. - Removed the editable install heuristic, making the environment variable `LFX_DEV` the sole determinant for development mode. - Updated documentation to reflect the new behavior and ensure accurate understanding of the mode switching. * docs: update DEVELOPMENT.md to clarify component development mode - Added tips for enabling dynamic component loading with `LFX_DEV=1` for faster development. - Emphasized the importance of using `LFX_DEV=1` for live reloading of components during development. - Included instructions for manually rebuilding the component index for testing purposes. * add component index * test: add unit tests for component index functionality - Introduced comprehensive unit tests for the component index system, covering functions such as _dev_mode, _read_component_index, _save_generated_index, and import_langflow_components. - Tests include various scenarios for development mode detection, reading and saving component indices, and handling custom paths and URLs. - Enhanced test coverage to ensure robustness and reliability of the component index features. * chore: update GitHub Actions workflow for component index updates - Modified the workflow to include separate checkout steps for pull requests and manual dispatch events. - Added an environment variable `LFX_DEV` to the build step for enhanced development mode support. - Improved clarity in the workflow structure to accommodate different triggering events. * chore: update component index with new timezones and remove deprecated entries - Added new timezone options including America/Boise, Australia/North, and Etc/GMT-2. - Removed outdated timezone entries to streamline the selection process. - Updated the component index structure to enhance clarity and maintainability. * docs: clarify output path determination in build_component_index.py - Updated comment to specify that the output path is relative to the script location and intended for development/CI use, not from the installed package. - Enhanced clarity for future developers regarding the script's execution context. * refactor: update component import logic and structure - Changed the comment to reflect the correct module path for extracting subpackage names. - Flattened the custom components dictionary if it has a "components" wrapper for consistency. - Merged built-in and custom components into a single structure, ensuring the output maintains a "components" wrapper. - Updated the component count calculation to reflect the new merged structure. * refactor: streamline component merging logic - Simplified the merging of built-in and custom components by removing the "components" wrapper at the cache level. - Updated the component count calculation to directly reflect the new structure of the merged components. - Enhanced code clarity by refining comments related to the merging process. * chore: enhance GitHub Actions workflow for component index updates - Updated the workflow to conditionally comment on pull requests from community forks, instructing users to manually update the component index. - Refined the commit and push logic to ensure it only executes for changes made within the same repository. * chore: update component index [skip ci] * chore: refine GitHub Actions workflow for component index checks - Enhanced the logic to check for changes in the component index file, ensuring it only triggers actions for changes made within the same repository. - Updated the PR comment step to clarify that it applies only to pull requests from the same repository, improving workflow accuracy. * chore: update component index [skip ci] * chore: update component index [skip ci] * refactor: rename version retrieval function for clarity - Changed the function name from _get_lfx_version to _get_langflow_version to accurately reflect the version being retrieved. - Updated the version retrieval logic in the build_component_index function to use the new function name. * fix: update version check to reflect langflow instead of lfx - Changed the version check logic in the _read_component_index and _save_generated_index functions to use "langflow" instead of "lfx". - Ensured that the component index version matches the installed langflow version for better accuracy. * fix: sort timezone options in CurrentDateComponent - Updated the timezone options in the CurrentDateComponent to be sorted for better user experience. - Ensured that the dropdown displays timezones in a consistent and organized manner. * chore: update component index with new timezone options and MistralAI model configurations - Replaced outdated timezone options with a more relevant and diverse set for improved user experience. - Added new configurations for the MistralAI model component, including input fields for API key, model selection, and request parameters. - Updated version number to reflect recent changes. * chore: update component index [skip ci] * chore: update component index [skip ci] * chore: update component index [skip ci] * chore: update component index [skip ci] * chore: minify component index output to reduce file size * test: Add unit tests for build_component_index script functionality * chore: enhance push logic in update-component-index workflow to handle concurrent updates with retries * chore: update component index [skip ci] * fix: standardize logging messages for MCP server initialization * chore: update component index [skip ci] * test: Add unit tests for build_component_index script functionality * chore: update component index [skip ci] * fix: improve error handling for missing LangChain dependencies in run.py * feat: add deterministic normalization for component index serialization * chore: update component index [skip ci] * chore: update component index * chore: update component index * chore: update component index * chore: enhance component index update workflow with detailed diff statistics and SHA256 comparison * chore: update component index * chore: update component loading message to reflect total components discovered * chore: sort model options for improved readability in NVIDIA component * chore: filter out 'localtime' from timezone options for improved user experience * chore: update component index with sorted lists * chore: update component index with mistral * chore: update component index * fix: improve error message for langflow tests to include detailed instructions for environment setup * refactor: rename and enhance _dev_mode function to _parse_dev_mode for improved clarity and functionality; support boolean and list modes for module loading * docs: enhance DEVELOPMENT.md with updated instructions for Component Development Mode, including dynamic loading options for specific components * fix: enhance error handling in _read_component_index to log specific issues with fetching and parsing component indices, including corrupted JSON and missing SHA256 hash * chore: update component index * feat: add metadata to component index including number of modules and components for improved indexing information * feat: integrate telemetry for component index loading, capturing metrics on modules and components, and enhancing performance tracking * feat: add build command for dynamic component index generation * fix: add missing import for json in CustomComponent definition in LoopTest.json * fix: improve handling of dotted imports in prepare_global_scope function * chore: update component index * fix: refine import handling in prepare_global_scope to correctly manage aliased and dotted imports * chore: update component index * feat: enhance component index update workflow with detailed change analysis and summary --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>	2025-10-13 18:54:17 +00:00
Edwin Jose	f24a064baa	chore: Improve and expand Makefile help commands (#10184) ... * Improve and expand Makefile help commands Enhanced the help output in Makefile and Makefile.frontend with clearer formatting, color, and categorized command lists. Added specialized help targets for backend, frontend, testing, Docker, and advanced commands to improve developer onboarding and usability. * Update Makefile	2025-10-10 19:29:04 +00:00
Gabriel Luiz Freitas Almeida	583db4101a	feat: add new Locust load testing with user behavior simulations and error handling improvements (#9848) ... * feat: add enhanced Langflow Locust load testing file with user behavior simulations * fix: resolve ruff linting errors in Locust test files - Remove shebang lines from locust files to fix EXE001 errors - Fix docstring formatting (D205) by adding blank lines after summary - Remove unused function arguments (ARG001) by prefixing with underscore - Add noqa comments for acceptable use of random module (S311) - Move imports to top of file to fix E402 * feat: add enhanced load testing targets with improved error handling and reporting options * fix: update locustfile references to use the correct filename for load testing * fix: add error handling for 404 responses in BaseLangflowUser requests * fix: add missing color definition for yellow in Makefile * fix: improve request handling in locustfile for better error reporting - Refactor on_request function parameters for clarity. - Implement strict checking for success in response payload. - Enhance failure messages to include success status for better debugging. * fix: enhance request tracking and error reporting in locustfile - Refactor on_request function to improve environment handling. - Implement strict checks for success in response payloads. - Update failure messages to include success status for better clarity. * fix: remove unnecessary shape parameter from ramp load test command in Makefile - Simplified the command for generating HTML reports and running headless tests by removing the shape parameter, ensuring cleaner execution. * refactor: Clean up import statements across various test files - Removed unnecessary blank lines and organized import statements for consistency. - Ensured that all imports are correctly formatted and follow the project's style guidelines. - Improved readability and maintainability of the test files by standardizing import practices. * chore: Update Ruff configuration for locust tests - Added specific linting rules to the Ruff configuration for locust test files to accommodate common CLI practices. - Included exceptions for missing docstrings, print statements, subprocess calls, and other relevant patterns to enhance code quality while maintaining usability in CLI contexts. - Improved overall maintainability and clarity of the testing codebase by aligning linting rules with project requirements. * refactor: Clean up and organize import statements in test files - Removed unnecessary blank lines and organized imports for consistency across various test files. - Improved readability and maintainability by standardizing import practices. - Ensured that all imports are correctly formatted and follow the project's style guidelines. * feat: Implement comprehensive load testing for Langflow API - Added a detailed locustfile for Langflow API load testing, including multiple user behaviors and performance analysis. - Introduced realistic message distributions and enhanced error logging mechanisms. - Implemented various load test shapes (RampToHundred, StepRamp) to simulate different user loads. - Improved error handling and logging for better diagnostics during tests. - Captured Langflow server logs and provided a summary of errors encountered during testing. - Ensured environment variable configurations for flexibility in testing scenarios. * refactor: rename lfx locust files * feat: Introduce a new Langflow API load testing framework - Added a comprehensive locustfile for Langflow API load testing, replacing the previous locustfile. - Implemented multiple user behaviors and performance analysis with realistic message distributions. - Enhanced error logging and metrics tracking for improved diagnostics during tests. - Introduced various load test shapes (RampToHundred, StepRamp) to simulate different user loads. - Captured Langflow server logs and provided detailed error summaries for better analysis. - Configured environment variables for flexible testing scenarios. * feat: Add Langflow load test setup and runner scripts - Introduced `langflow_run_load_test.py` for executing load tests with customizable parameters and automatic Langflow server management. - Added `langflow_setup_test.py` to facilitate the setup of a Langflow test environment, including user account creation and API key generation. - Implemented interactive flow selection and error handling for a smoother user experience. - Enhanced documentation with usage examples and detailed descriptions for both scripts. * feat: Add example Langflow load testing workflow script - Introduced `langflow_example_workflow.py` to demonstrate a complete workflow for setting up and executing Langflow load tests. - Implemented dependency checks, user prompts, and environment variable management for a seamless testing experience. - Enhanced documentation within the script to guide users through the load testing process and available options. * feat: Add comprehensive README for Langflow load testing - Introduced a detailed README.md for the Langflow load testing framework using Locust. - Documented setup processes, user types, load test shapes, and performance grading. - Included quick start instructions, advanced usage scenarios, and troubleshooting tips. - Enhanced clarity and usability for users looking to implement load testing for Langflow and LFX APIs. * feat: Enhance load testing capabilities in Makefile - Added new load testing commands for enhanced functionality, including setup, execution, and cleanup for Langflow load tests. - Introduced commands for quick and stress testing, as well as listing available flows and running complete workflows. - Updated existing commands to use new locust files for improved performance and reporting. - Enhanced documentation within the Makefile to guide users through the new load testing features and options. * feat: Enhance Langflow load test scripts with improved host handling - Updated argument parsing to clarify the use of the `--host` option, including guidance for remote instances. - Added checks for remote host detection and provided user feedback on starting Langflow. - Enhanced health check messages to specify accessibility of the Langflow instance. - Improved documentation within the scripts to assist users in configuring and running load tests effectively. * docs: Expand README for remote instance load testing - Added a new section detailing the setup and execution of load tests against remote Langflow instances. - Included important notes on best practices for remote testing, such as using HTTPS and monitoring resources. - Updated examples to reflect remote instance configurations, enhancing clarity for users conducting load tests in varied environments. * feat: Improve API project fetching with enhanced error handling and response validation - Updated the `get_starter_projects_from_api` function to ensure proper URL formatting and added detailed logging for request status. - Implemented fallback logic to attempt fetching projects without authentication if the initial request fails. - Added checks for empty responses and improved error reporting to include status codes and response texts for better diagnostics. - Enhanced overall robustness of the API interaction, providing clearer feedback during the fetching process. * feat: Add remote load testing capabilities to Makefile - Introduced new commands for setting up and running load tests against remote Langflow instances. - Added checks for the required LANGFLOW_HOST environment variable and provided user feedback for setup and execution. - Updated load test help documentation to include instructions for remote testing, enhancing usability for users. - Improved overall structure and clarity of load testing commands in the Makefile. * feat: Add single request test for Langflow load testing - Introduced a new function `test_single_request` to validate the setup by testing a single flow request before executing load tests. - Implemented connectivity checks and response validation to ensure the Langflow instance is operational. - Updated the load test script to abort if the single request test fails, enhancing robustness and user feedback. - Adjusted default user count in load test options from 10 to 50 for improved testing scenarios. * feat: Update load test scripts to use credentials from JSON files and adjust user counts * docs: Update README with additional notes for remote testing best practices * feat: Enhance error logging in load testing scripts - Updated the `log_detailed_error` function to accept an additional `traceback` parameter for improved error reporting. - Enhanced exception handling in the `BaseLangflowUser` class to capture detailed error information, including connection issues and timeouts. - Improved logging of connection errors by providing structured error details in the response text, aiding in diagnostics during load tests. * docs: Update README to enhance load testing instructions and features - Added sections for pre-flight testing and enhanced error logging to improve user experience. - Introduced Makefile commands for easier setup and execution of load tests. - Updated remote testing instructions and clarified the use of default credentials. - Improved troubleshooting tips and added a diagnostic tool for remote instances. * feat: Add diagnostic tool for remote Langflow instances - Introduced a new script `diagnose_remote.py` to assist in debugging connection issues and performance problems with remote Langflow instances. - Implemented functions for testing connectivity, flow execution, and running load simulations, providing detailed feedback on each step. - Added command-line arguments for user flexibility, including options for saving results to a JSON file. - Enhanced user experience with clear output messages and recommendations based on diagnostic results. * feat: Enhance load test commands in Makefile for automatic setup and flow selection - Updated `load_test_run`, `load_test_langflow_quick`, and `load_test_stress` commands to automatically set up credentials if not found. - Added support for specifying flow names via the `FLOW_NAME` environment variable, improving user experience and flexibility. - Enhanced error messages to guide users in selecting available flows, ensuring smoother execution of load tests. * feat: Update flow descriptions and enhance endpoint name sanitization in load testing setup - Improved descriptions of known starter projects to include load testing suitability and requirements. - Enhanced the uniqueness and validity of the `endpoint_name` by sanitizing it to allow only letters, numbers, hyphens, and underscores, ensuring better compliance with API standards. * [autofix.ci] apply automated fixes * revert: remove unintended formatting changes * feat: update locust dependency to version 2.40.5 in pyproject.toml and uv.lock * Update uv.lock * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Edwin Jose <edwin.jose@datastax.com>	2025-10-08 20:57:34 +00:00
Gabriel Luiz Freitas Almeida	8e18fd973f	ci: Update Docker commands to use Podman and add missing bindings for LFX (#9838)	2025-09-12 11:44:41 -03:00
Cristhian Zanforlin Lousa	bd20f24078	feat: Add frontend build cleaning and CLI run options (#9706) ... * 🔧 (Makefile): add clean_frontend_build target to clean frontend build artifacts for a fresh build 🔧 (Makefile): modify run_cli target to include cleaning frontend build artifacts before running the CLI with a fresh build 🔧 (Makefile): add run_cli_cached target to run the CLI quickly without cleaning the build cache * 🔧 (Makefile): fix typo in the 'run_clic' target name to 'run_cli' for consistency 🔧 (Makefile): update 'run_cli_cached' target name to 'run_cli' to match the intended functionality and improve clarity * 📝 (DEVELOPMENT.md): Update links and formatting in the development documentation 🔧 (DEVELOPMENT.md): Add troubleshooting steps for frontend build issues in the development setup guide * move-section * move-section --------- Co-authored-by: Mendon Kissling <59585235+mendonk@users.noreply.github.com>	2025-09-04 17:20:22 +00:00
Gabriel Luiz Freitas Almeida	aaaaed1e59	feat: introduce lfx package (#9133) ... * docs: add README for lfx CLI tool - Created a comprehensive README for the lfx command-line tool, detailing installation instructions, command usage, and examples for both `serve` and `execute` commands. - Included sections on input sources and development setup to enhance user understanding and facilitate contributions. * fix: update import paths and test assertions in queryInputComponent.spec.ts - Modified import statements to reflect the new module structure, changing `langflow` to `lfx` for consistency. - Adjusted test assertions to ensure proper syntax and functionality, enhancing the reliability of the test suite. * fix: streamline test assertions and update import paths in tabComponent.spec.ts - Refactored test assertions for tab visibility to improve readability and maintainability. - Updated import paths from `langflow` to `lfx` for consistency with the new module structure. - Ensured proper syntax in test cases to enhance the reliability of the test suite. * fix: skip table input component test due to UI event conflicts - Marked the test for user interaction with the table input component as skipped due to conflicts between double-click and single-click events. - Added a comment to indicate the need for further investigation into event handling issues affecting this branch. * fix: update CLI test cases to include 'serve' command - Modified test cases in `test_serve_simple.py` to include the 'serve' command in the CLI invocation, ensuring accurate testing of command behavior. - Adjusted assertions to maintain consistency and reliability in test outcomes when handling various scenarios, such as missing API keys and invalid JSON inputs. * feat: implement LFX nightly release workflow in GitHub Actions - Added a new job for releasing LFX nightly builds, including steps for checking out code, setting up the environment, installing dependencies, verifying versioning, building the package, testing the CLI, publishing to PyPI, and uploading artifacts. - Introduced a wait step for PyPI propagation to ensure successful package availability post-release. - Refactored existing release job structure to accommodate the new LFX workflow while maintaining the Langflow nightly base release process. * refactor: Simplify flow execution validation by removing unnecessary asyncio.wait_for calls Updated the validate_flow_execution function to directly use the client.post and client.get methods with a timeout parameter, improving code readability and maintainability. This change eliminates redundant timeout handling while ensuring consistent timeout values across API calls. * refactor: Enhance template tests for improved structure and validation Refactored the template tests in `test_starter_projects.py` to utilize parameterization for better readability and maintainability. Introduced helper functions to retrieve template files and disabled tracing for all tests. Updated individual test methods to validate JSON structure, flow execution, and endpoint validation, ensuring comprehensive coverage of template functionality. This change streamlines the testing process and enhances the robustness of the test suite. * refactor: Update project metadata and import paths in starter project JSON files Modified the metadata section in multiple starter project JSON files to reflect updated code hashes and module paths, transitioning from 'lfx' to 'langflow' components. This change enhances consistency across the codebase and ensures that the correct modules are referenced for improved maintainability and clarity. * chore: Update template test commands to utilize parallel execution Modified the commands in the Makefile and CI workflows to include the `-n auto` option for pytest, enabling parallel test execution for the starter project template tests. This change enhances test performance and efficiency across the codebase. * chore: Remove news-aggregated.json file Deleted the news-aggregated.json file * chore: Update .gitignore to include new files Added entries for *.mcp.json, news-aggregated.json, and CLAUDE.md to the .gitignore file to prevent these files from being tracked in the repository. * refactor: Update module paths and code hashes in starter project JSON files Modified the metadata section in multiple starter project JSON files to transition module paths from 'langflow' to 'lfx' components and updated code hashes accordingly. This change enhances consistency and maintainability across the codebase, ensuring that the correct modules are referenced. * refactor: Remove debug logging from module processing function Eliminated the debug log statement in the _process_single_module function to streamline logging output. This change enhances code clarity and reduces unnecessary log clutter during module processing. * refactor: Update import paths and clean up component exports Modified import statements to transition from 'langflow' to 'lfx' in the field_typing module and adjusted component exports in various modules by removing unused components. This change enhances code organization and maintainability across the codebase. * fix: Add timeout header to flow execution validation test Updated the headers in the flow execution validation test to include a timeout value. This change ensures that the test accurately reflects the expected behavior of the validate_flow_execution function when handling timeouts, enhancing the robustness of the test suite. * fix: Add timeout to mock client delete assertion in flow execution validation test Updated the mock client delete assertion in the flow execution validation test to include a timeout value. This change ensures that the test accurately reflects the expected behavior when handling timeouts, contributing to the robustness of the test suite. * refactor: Update Dockerfile to use Alpine-based Python image and install build dependencies Changed the base image in the Dockerfile to an Alpine-based Python image for a smaller footprint. Added installation of necessary build dependencies for Python packages on Alpine. Updated user creation to follow best practices for non-root users. This change enhances the efficiency and security of the Docker build process. * refactor: move development mode toggle functions in settings to lfx Introduced `_set_dev` and `set_dev` functions in `settings.py` to manage the development mode flag. Updated import path in `base.py` to reflect the new function location. This change enhances the configurability of the development environment. * feat: Register SettingsServiceFactory in service manager Added registration of the SettingsServiceFactory in the service manager if it is not already present. This change ensures that the settings service is available for retrieval, enhancing the functionality of the service management system. * feat: Add global variable validation option to serve and execute commands Introduced a new option to the serve and execute commands to check global variables for environment compatibility. This enhancement allows users to validate their configurations before execution, improving robustness and error handling in the application. Validation errors are reported clearly, and users can choose to skip this check if desired. * refactor: Remove unused development mode functions from settings Eliminated the `_set_dev` and `set_dev` functions from `settings.py` and their associated validator in `base.py`. This change simplifies the code by removing unnecessary functions, enhancing maintainability and clarity in the settings management. * fix: Update load_graph_from_path to include verbose parameter in JSON handling Modified the `load_graph_from_path` function to accept the file suffix as an argument when loading JSON graphs. Updated related tests to ensure correct behavior with the new parameter, including assertions for verbose logging. This change enhances error handling and logging clarity during graph loading operations. * [autofix.ci] apply automated fixes * refactor: Update import paths for version utilities in settings Changed the import statements in `base.py` to source version utility functions from `lfx.utils.version` instead of `langflow.utils.version`. Additionally, added the `is_pre_release` function to `version.py` to check for pre-release indicators in version strings. This refactor improves code organization and aligns with the updated module structure. * feat: Add BuildStatus schema for API compatibility Introduced a new BuildStatus class in the schema module to define the structure for build status responses. This addition enhances API compatibility by providing a standardized way to convey build status, including optional message and progress fields. Updated import paths in the cache utility to reflect the new schema location. * refactor: Update import path for EventManager in component_tool.py Changed the import statement for EventManager to reflect its new location in the lfx.events module. This update improves code organization and maintains consistency with the updated module structure. * refactor: Improve file upload handling in SaveToFileComponent Updated the _upload_file method to dynamically import necessary functions for file upload, enhancing error handling for missing Langflow functionality. Refactored session management to use async context with session_scope, improving code clarity and maintainability. * refactor: Enhance import handling in MCPToolsComponent for Langflow dependencies Updated the MCPToolsComponent to dynamically import Langflow-related functions within a try-except block, improving error handling for missing functionality. This change ensures that users receive a clear message when the Langflow MCP server features are unavailable, enhancing robustness and maintainability of the code. * refactor: Update JSON handling in JSONDocumentBuilder to use orjson directly Replaced the use of orjson_dumps with orjson.dumps for serializing documents in the JSONDocumentBuilder class. This change improves performance and simplifies the code by directly utilizing orjson for JSON serialization, enhancing overall code clarity and maintainability. * refactor: Improve error handling for Langflow Flow model import in get_flow_snake_case Updated the get_flow_snake_case function to dynamically import the Flow model within a try-except block. This change enhances error handling by providing a clear message when the Langflow installation is missing, improving the robustness and maintainability of the code. * chore: Add orjson as a dependency in project configuration Included orjson in both the uv.lock and pyproject.toml files to ensure proper JSON handling and serialization capabilities. This addition enhances the project's performance and maintains consistency in dependency management. * [autofix.ci] apply automated fixes * refactor: Convert execute function to async and update JSON flow loading Refactored the execute function to be asynchronous using syncify, allowing for non-blocking execution. Updated the JSON flow loading to utilize aload_flow_from_json for improved performance. Adjusted the results handling to support asynchronous graph execution, enhancing overall code efficiency and maintainability. * refactor: Enhance import handling for Langchain dependencies in validate.py and constants.py Updated the validate.py file to suppress LangChainDeprecationWarning during dynamic imports. In constants.py, renamed DEFAULT_IMPORT_STRING for clarity and added a conditional import string based on the presence of the Langchain module. These changes improve error handling and maintainability of the code. * refactor: Improve error handling and output formatting in execute function Enhanced the execute function by introducing a dedicated output_error function for consistent error messaging in both JSON and verbose formats. Updated error handling throughout the function to utilize this new method, improving clarity and maintainability. Adjusted the handling of input sources and validation errors to provide more informative feedback to users. * feat: Add simple chat flow example with JSON and Python integration Introduced a new simple chat flow example demonstrating the use of ChatInput and ChatOutput components. This includes a JSON configuration file and a Python script that sets up a basic conversational flow, enhancing the documentation and usability of Langflow for users. Additionally, integration tests have been added to validate the execution of the flow, ensuring robust functionality. * refactor: Update message extraction to use json.dumps for improved serialization Modified the extract_message_from_result function to utilize json.dumps with ensure_ascii=False for better JSON serialization of message content. This change enhances the output formatting and maintains consistency in handling message data. * feat: Add initial graph module with core components Introduced a new graph module in Langflow, including essential classes such as Edge, Graph, Vertex, and specific vertex types (CustomComponentVertex, InterfaceVertex, StateVertex). This addition enhances the modularity and functionality of the codebase, laying the groundwork for future graph-related features. * feat: Add pytest collection modification for automatic test markers Implemented a new function to automatically add markers to test items based on their file location. This enhancement categorizes tests into unit, integration, and slow tests, improving test organization and clarity in both the backend and lfx test suites. * chore: Update test configuration for improved organization and clarity Modified the test paths and markers in both the main and lfx pyproject.toml files. Added new markers for unit, integration, and slow tests, enhancing test categorization. Removed the redundant pytest.ini file to streamline configuration management. * chore: Update project description in pyproject.toml Revised the project description to provide a clearer overview of LFX (Langflow Executor) as a lightweight CLI tool for executing and serving Langflow AI flows. This change enhances the documentation and helps users better understand the project's purpose. * [autofix.ci] apply automated fixes * chore: Remove redundant per-file ignores from pyproject.toml Eliminated unnecessary linting ignores for scripts and backend tests in the pyproject.toml file. This streamlines the configuration and improves clarity in the project's linting setup. * chore: Update Dockerfile project description for clarity Revised the project description in the Dockerfile to reflect the correct name of the CLI tool as "LFX - Langflow Executor CLI Tool." This change improves clarity and aligns with the project's branding. * feat: Introduce 'run' command for executing Langflow workflows Renamed the 'execute' command to 'run' in the lfx CLI for consistency and clarity. Updated the README documentation to reflect this change, including command usage examples. Added a new run.py module that implements the run command functionality, allowing users to execute Langflow workflows from Python scripts or JSON files. Comprehensive unit and integration tests have been added to ensure robust functionality and error handling for the new command. * fix: Update test command in Makefile to include all tests Modified the test command in the Makefile to run all tests located in the 'tests' directory instead of just the 'unit' tests. This change ensures comprehensive test coverage during the testing process. * chore: Clean up pyproject.toml formatting and linting ignores Adjusted the formatting of the members list in the [tool.uv.workspace] section for improved readability. Removed a redundant linting ignore from the ignore list, streamlining the configuration and enhancing clarity in the project's linting setup. * docs: Update README.md with environment variable requirement and command examples Added a note about the necessity of setting the `LANGFLOW_API_KEY` environment variable before running the server. Updated command examples to reflect the correct flow ID display and included additional options for the `uv run lfx` commands, enhancing clarity and usability for users. * feat: Add LFX release workflow and release script Introduced a comprehensive GitHub Actions workflow for managing LFX releases, including version validation, testing across multiple Python versions, building and publishing to PyPI, and creating Docker images. Additionally, added a Bash script for local release preparation, which updates versioning in relevant files, runs tests, and facilitates the release process with dry-run capabilities. This enhancement streamlines the release workflow and ensures robust version management. * feat: Add hypothesis to development dependencies Included the 'hypothesis' library in both the uv.lock and pyproject.toml files to enhance testing capabilities with property-based testing. This addition supports more robust test coverage and improves the overall quality of the codebase. * feat: Enhance Makefile with release operations and version bumping Added new targets to the Makefile for checking the current version, preparing for releases, and bumping the version. The `prepare_release` target outlines next steps for the release process, while `bump_version` allows for version updates directly from the Makefile, improving the release workflow and version management. * Temporarily modify nightly build to publish release lfx * fix version * fix versions * skip tests * Revert changes to run release lfx * refactor: Change logger warning to trace for environment variable loading Updated the logging level from warning to trace in the `update_params_with_load_from_db_fields` function to provide more granular logging when loading variables from environment variables due to the unavailability of the database. This change enhances the debugging capabilities without altering the functionality. * chore: Update project description in pyproject.toml Modified the project description in the pyproject.toml file for clarity, removing the acronym "LFX" to enhance understanding of the Langflow Executor's purpose as a CLI tool for executing and serving Langflow AI flows. * docs: Update README for inline JSON format clarification Revised the README to reflect changes in the inline JSON format for commands, ensuring consistency in the structure by including "data" as a key for nodes and edges. This update enhances clarity for users on how to properly format their JSON input when using the CLI. * fix: Update message extraction logic in script_loader.py Refactored the `extract_message_from_result` and `extract_text_from_result` functions to improve message handling. The changes include parsing JSON directly from the message's model dump and adding type checks to handle both dictionary and Message object types. This enhances robustness and ensures proper extraction of text content. * feat: Add complex chat flow example and enhance test coverage Introduced a new script `complex_chat_flow.py` demonstrating a multi-component chat flow, showcasing the integration of `ChatInput`, `TextInput`, `TextOutput`, and `ChatOutput`. Enhanced unit tests in `test_script_loader.py` to validate loading and execution of real scripts, ensuring proper graph structure and result extraction. This improves the robustness of the testing framework and provides a practical example for users. * refactor: Enhance unit tests for FastAPI serve app with real graph data Updated unit tests in `test_serve_app.py` to utilize real graph data from JSON files, improving test accuracy and coverage. Replaced mock graph instances with real graphs created from payloads, ensuring better alignment with actual application behavior. This change enhances the robustness of the testing framework and prepares for future feature expansions. * refactor: Update unit tests to utilize real graph data and improve structure Refactored unit tests in `test_serve_components.py` to replace mock graph instances with real graphs created from JSON data. This change enhances the accuracy and robustness of the tests, ensuring better alignment with actual application behavior. Additionally, removed the `create_mock_graph` function in favor of a new `create_real_graph` function, streamlining the test setup process. * test: Increase timeout for selector in Prompt Chaining tests Updated the timeout for the selector waiting for "built successfully" in the Prompt Chaining integration tests from 30 seconds to 60 seconds. This change aims to enhance test reliability by allowing more time for the expected output to appear, particularly in environments with variable performance. * feat: Add nightly build and publish workflow for LFX Implemented a new GitHub Actions workflow for building and publishing the LFX package nightly. This includes steps for checking out the code, setting up the environment, installing dependencies, verifying the package name and version, building the distribution, testing the CLI, and publishing to PyPI. The workflow is designed to run conditionally based on input parameters, enhancing the CI/CD process for LFX. * refactor: Remove redundant re-export comments across multiple modules * fix: Update __all__ to include Component in custom_component module * Move all of message_original to lfx * refactor: Update component module to improve imports and maintain backward compatibility * refactor: Clean up imports and remove unnecessary TYPE_CHECKING block * refactor: Remove enhanced Data class and update imports for backward compatibility * refactor: Enhance pytest configuration to check for langflow installation and update error handling * Refactor import statements in component modules to use new import structure - Updated import paths in various component files to reflect the new structure under . - Ensured all components are correctly importing their respective modules. - Added unit tests for dynamic imports and import utilities to validate the new import system. * [autofix.ci] apply automated fixes * fix: update import paths to use the new lfx structure across multiple components * style: run pre-commit on all files * fix: move dotdict import inside TYPE_CHECKING block for better performance * feat: add MCP session management settings and update knowledge bases directory * fix: update module paths and code hashes in Knowledge Ingestion and Retrieval JSON files * fix: reorder imports for better organization and readability * fix: update KBRetrievalComponent module path and code hash - Changed module path from `langflow.components.data.kb_retrieval.KBRetrievalComponent` to `lfx.components.data.kb_retrieval.KBRetrievalComponent`. - Updated code hash to reflect recent changes in the KBRetrievalComponent implementation. - Refactored import statements and adjusted the logic for handling knowledge bases and embeddings. * fix: move parse_api_endpoint import inside try block for better error handling * refactor: clean up base.py by removing unused imports and code * fix: update version and revision in pyproject.toml and uv.lock files * refactor: remove unused validation functions and imports from validate.py * fix: handle langflow import conditionally and adjust code references * fix: update version to 0.1.3 in pyproject.toml and uv.lock files * refactor: update code handling in utils.py for custom components - Refactored the _generate_code_hash function to remove the class_name parameter, simplifying its signature and improving clarity. - Introduced a new function, get_module_name_from_display_name, to convert display names into valid module names. - Updated references to custom_component.code to custom_component._code for consistency across the codebase. - Enhanced error handling during code hash generation to log exceptions, improving debugging capabilities. - Adjusted metadata handling in build_custom_component_template functions to derive module names when not provided, ensuring accurate metadata generation. * [autofix.ci] apply automated fixes * refactor: update type hinting for Graph in load.py * refactor: implement lazy initialization for storage service in ParameterHandler * feat: add timing option to run function for performance measurement * refactor: implement lazy initialization for tracing service in Graph class * feat: add lazy initialization for tracing service in CustomComponent * refactor: implement lazy initialization for storage service in Vertex and loading functions * bump: update version to 0.1.4 in pyproject.toml and uv.lock * feat: add UUID generation for session_id in LCAgentComponent * fix: import sqlmodel conditionally in get_flow_snake_case to avoid ImportError * feat: conditionally import model components to enhance modularity and avoid ImportError * feat: implement lazy loading for agent and data components to enhance modularity * fix: conditionally filter OpenAI inputs and handle empty case in AgentComponent * refactor: enhance verbose logging and error handling in run function * fix: update USER_AGENT assignment to use importlib for better compatibility * fix: change async methods to synchronous in Component class for toolkit conversion * feat: add complete agent example with setup instructions and dependencies in README * [autofix.ci] apply automated fixes * fix: update import paths from langflow to lfx for consistency across test files * fix: bump version to 0.1.5 in pyproject.toml and uv.lock * fix: enhance _get_tools method to handle both sync and async calls * fix: bump version to 0.1.6 in pyproject.toml and uv.lock * fix: streamline _get_tools method to handle sync and async calls more efficiently * feat: implement lazy loading for searchapi components * feat: add dynamic imports and lazy loading for component modules * feat: implement lazy loading for NotDiamondComponent * fix: add type check for source_code in _generate_code_hash function * test: add error handling for missing langchain-openai dependency in class import * fix: update error handling for None source in _generate_code_hash function and correct import paths * fix: improve error handling for dynamic imports and update import paths in tests * fix: enhance error handling for dynamic imports and ensure proper caching behavior * fix: improve error handling for missing modules in import_mod function * fix: enhance dynamic imports with on-demand discovery and improved error handling * fix: update error handling in tests to raise ModuleNotFoundError for missing dependencies * fix: update version to 0.1.7 in pyproject.toml and uv.lock * fix: update version to 0.1.8 in pyproject.toml and uv.lock; enhance README with flattened component access examples * [autofix.ci] apply automated fixes * fix: update import path for Graph in composio_base.py * merge the createl-lfx changes into the Component * update code in templates * feat: Add simple agent flow example in test data * feat: Add LFX commands as a sub-application in the main app * feat: Add tests for simple agent workflow execution via lfx run * fix: update import for KeyedMemoryLockManager to maintain consistency * refactor: remove unused imports from various modules for cleaner code * refactor: remove unused import of aget_messages for cleaner code * update manager in lfx * update logger to use lfx * rename lfx_logging to logs * refactor: remove loguru dependency and add structlog * chore: update starter project files for consistency * refactor: update logger calls to use exc_info for better error reporting * refactor: update import paths to use lfx module instead of langflow * move vector store components for various databases - Implement PGVector store component for PostgreSQL with search capabilities. - Implement Pinecone store component with support for various distance strategies. - Implement Qdrant store component with customizable server settings. - Implement Supabase store component for vector storage and retrieval. - Implement Upstash store component with metadata filtering options. - Implement Vectara store component with RAG capabilities and document management. - Implement Weaviate store component with support for API key authentication and capitalized index names. - Add dynamic imports for all new components to facilitate lazy loading. * refactor: reorder import statements for better organization * refactor: improve dynamic import handling for Chroma components * refactor: update test for ChromaVectorStoreComponent to check for import errors * refactor: update __init__.py to import all components from lfx and improve attribute forwarding * refactor: add forwarding for langflow components to lfx counterparts * refactor: simplify mock setup in component_setup method * refactor: update module references from langflow.logging to lfx.logs in test_logger.py * refactor: enhance test structure for simple agent workflow in lfx run * Refactor logging imports and update code snippets in JSON configuration files - Changed logger import from `lfx.lfx_logging.logger` to `lfx.logs.logger` in multiple components. - Updated code snippets in Travel Planning Agents, ChatInputTest, LoopTest, and TwoOutputsTest JSON files to reflect the new logger import. - Ensured consistency in code formatting and structure across the affected files. * docs: update README to clarify installation and usage instructions * refactor: update import paths from langflow to lfx in multiple component __init__.py files * refactor: improve test structure and organization in test_run_command.py * refactor: clean up unused imports and improve code organization in kb_ingest.py * refactor: update test data structure in ChatInputTest.json, LoopTest.json, and TwoOutputsTest.json * refactor: update dynamic imports and __all__ exports in vectorstores __init__.py * refactor: clean up and organize test files for MCP and KB components * refactor: update import paths in test_kb_ingest.py and test_kb_retrieval.py to use lfx namespace * refactor: update structure and organization of Knowledge Ingestion JSON file * [autofix.ci] apply automated fixes * rename lfx.logs to lfx.log to avoid gitignore * refactor: alias run command in LFX app to lfx_run for clarity * refactor: update import path for validate_code to improve clarity * [autofix.ci] apply automated fixes * revert docs changes for now * [autofix.ci] apply automated fixes * fix: mark DataFrame as unhashable due to mutability * refactor: update function signatures to use keyword-only arguments for clarity * fix: update import paths from langflow to lfx for consistency * refactor: reorganize imports and ensure create_input_schema_from_json_schema is consistently defined * fix: update import statement for Action to use the correct path * refactor: remove TYPE_CHECKING import for DataFrame to streamline code * refactor: clean up import statements for improved readability * refactor: remove unused imports and enhance code clarity * refactor: improve test structure and organization in test_import_utils.py * fix: update logger configuration to use environment variable for log level * fix: remove default log level configuration and set logger initialization * fix: enhance logger configuration to prevent redundant setup and improve cache handling * fix: improve cache handling in logger configuration to prevent unintended defaults * fix: enhance logger configuration to prevent redundant setup and improve early-exit logic * fix: remove defensive comment in logger configuration for clarity * fix: update project templates for consistency and clarity * fix: refactor field handling in set_multiple_field_advanced and set_current_fields for improved clarity and consistency * fix: update error message in import_mod test for clarity and specificity * fix: change _get_tools method from async to synchronous for consistency * fix: update error handling in test_module_not_found_error_handling for clarity * fix: update import statements in test_custom_component for consistency * fix: update import statements in test_custom_component_endpoint for consistency * fix: remove SupabaseComposioComponent from dynamic imports and __all__ for consistency * fix: mock log method in component_setup to avoid tracing service context issues * fix: adjust uniqueness threshold for code hashes to account for legitimate sharing * fix: update test for structured output to support NVIDIA models and handle errors appropriately * fix: update logger patches and modify pandas inclusion test in validate.py * fix: update import path for langflow module in get_default_imports function * fix: replace hard assertions with informative prints in performance tests to avoid CI failures * fix: ensure all component modules are importable after dynamic import refactor * fix: enhance composio compatibility checks and improve import handling for Action enum * fix: remove compatibility check for composio components and always expose all components * fix: update Slack component documentation link to ensure accuracy * fix: remove 'Agent' from skipped components list in constants * fix: remove await from CurrentDateComponent instantiation in AgentComponent * fix: Filter out None values from headers in URLComponent * update starter projects hat use url compoennt * feat: add processing components and converter utilities * fix: add OpenAI constants forward import * chore: update Knowledge Ingestion starter project structure * fix: correct parameter usage in set_multiple_field_display function * fix: update set_field_display function signature to remove unnecessary keyword argument * feat: implement backwards compatibility layer and add OpenAI response schemas * fix: update version to 0.1.9 in pyproject.toml and uv.lock * feat: add compatibility for langflow.components and related helper modules * fix: update version to 0.1.10 in pyproject.toml and uv.lock * fix: remove unnecessary import and update message type check in convert_message_to_data method * fix: enhance attribute access in LangflowCompatibilityModule with caching * fix: update import paths in Data class to use lfx module * fix: add comment to clarify import and re-export purpose in message.py * fix: remove unused code and improve flow data checks in openai_responses.py * fix: update LoopTest.json structure for improved data representation * fix: update test_api_schemas.py for improved hypothesis testing configurations * fix: update hypothesis strategies for improved test coverage in test_api_schemas.py * fix: remove unused code and improve structure in __init__.py * refactor: add knowledge base components for ingestion and retrieval in lfx - Implemented KnowledgeIngestionComponent for creating and updating knowledge bases from DataFrames. - Added KnowledgeRetrievalComponent for searching and retrieving data from knowledge bases. - Introduced dynamic imports for knowledge base components in the main module. - Created utility functions for managing knowledge base metadata and embeddings. - Enhanced error handling and logging for better debugging and user feedback. * fix: enhance convert_to_dataframe function to handle pandas DataFrame and improve type conversion * refactor: remove knowledge base components and related imports for cleanup * fix: update TypeConverterComponent to include pandas as a dependency and enhance convert_to_dataframe function for better DataFrame handling * fix: update imports for knowledge_bases module and enhance compatibility in langflow.base * refactor: remove unused imports and simplify backwards compatibility module in langflow.base.data * refactor: streamline inputs module by removing unused code and maintaining compatibility layer * refactor: remove unused classes and streamline input handling in inputs.py * Update language model components across multiple starter projects to include new dependencies and model options - Standardized description format for language model components. - Added metadata for dependencies including langchain packages and lfx. - Updated model options to include new versions such as gpt-5 and its variants. - Ensured consistency in the structure of JSON files for various starter projects including Market Research, Meeting Summary, Memory Chatbot, Portfolio Website Code Generator, Research Agent, and others. * fix: update import path for custom component - Changed the import path for the `Component` class from `lfx.custom.custom_component.component` to `langflow.custom.custom_component.component` in the `Youtube Analysis.json` file. * refactor: update component IDs and streamline connections in Custom Component Generator * refactor: standardize formatting of source and target handles in Custom Component Generator * refactor: update component IDs and streamline connections in Custom Component Generator * [autofix.ci] apply automated fixes * fix: revert name change in Custom Component Generator --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Jordan Frazier <jordan.frazier@datastax.com>	2025-09-02 17:45:53 +00:00
Ítalo Johnny	067c1d7fc2	fix: remove duplicated Makefile target format_frontend (#9191) ... fix: remove duplicated format_frontend target to silence warnings Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>	2025-07-30 12:01:28 +00:00
Gabriel Luiz Freitas Almeida	cd4464d6b1	refactor(tests): parameterize template tests and update timeout use (#9224) ... * refactor: Simplify flow execution validation by removing unnecessary asyncio.wait_for calls Updated the validate_flow_execution function to directly use the client.post and client.get methods with a timeout parameter, improving code readability and maintainability. This change eliminates redundant timeout handling while ensuring consistent timeout values across API calls. * refactor: Enhance template tests for improved structure and validation Refactored the template tests in `test_starter_projects.py` to utilize parameterization for better readability and maintainability. Introduced helper functions to retrieve template files and disabled tracing for all tests. Updated individual test methods to validate JSON structure, flow execution, and endpoint validation, ensuring comprehensive coverage of template functionality. This change streamlines the testing process and enhances the robustness of the test suite. * refactor: Update project metadata and import paths in starter project JSON files Modified the metadata section in multiple starter project JSON files to reflect updated code hashes and module paths, transitioning from 'lfx' to 'langflow' components. This change enhances consistency across the codebase and ensures that the correct modules are referenced for improved maintainability and clarity. * chore: Update template test commands to utilize parallel execution Modified the commands in the Makefile and CI workflows to include the `-n auto` option for pytest, enabling parallel test execution for the starter project template tests. This change enhances test performance and efficiency across the codebase. * chore: Remove news-aggregated.json file Deleted the news-aggregated.json file * Update test_template_validation.py * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2025-07-29 22:32:48 +00:00
Yuqi Tang	d0e4e7d1cc	feat: Add template tests (#9083) ... * add template tests * remove files * adding validate flow build * add validate endpoint and flow execution * Update .github/workflows/template-tests.yml Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * Update src/backend/base/langflow/utils/template_validation.py Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * [autofix.ci] apply automated fixes * change workflow running * add ci * fix test * fix test * delete when push * fix: Exclude template tests from unit test bundle Template tests are already run separately in CI via the test-templates job. This change prevents duplicate execution and eliminates timeout failures in the unit test suite by excluding slow template execution tests. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: Exclude template tests from unit test bundle Template tests are already run separately in CI via the test-templates job. This change prevents duplicate execution and eliminates timeout failures in the unit test suite by excluding slow template execution tests. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: Exclude template tests from unit test bundle Template tests are already run separately in CI via the test-templates job. This change prevents duplicate execution and eliminates timeout failures in the unit test suite by excluding slow template execution tests. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: Remove remaining merge conflict markers 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: Improve validate.py unit tests to eliminate CI failures Fixed 4 failing tests in test_validate.py: - test_code_with_syntax_error: Better error message handling for syntax errors - test_raises_error_for_missing_function: Handle StopIteration along with ValueError - test_creates_simple_class: Use optional constructor parameter to avoid TypeError - test_handles_validation_error: Use proper ValidationError constructor from pydantic_core - test_creates_context_with_langflow_imports: Remove invalid module patching - test_creates_mock_classes_on_import_failure: Use proper import mocking All 50 validate tests now pass consistently, improving CI stability. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * enhance: Add comprehensive edge case tests for template_validation.py Added 6 additional test cases to improve coverage of template_validation.py: - test_validate_stream_exception: Tests Graph.validate_stream() exception handling - test_code_validation_other_exceptions: Tests TypeError/KeyError/AttributeError handling - test_vertices_sorted_without_end_vertex_events: Tests variable usage tracking - test_vertex_count_tracking: Tests vertex_count increment paths - test_empty_lines_in_stream: Tests empty line handling in event streams - test_event_stream_validation_exception: Tests exception handling in _validate_event_stream These tests target the remaining 7 uncovered lines to maximize coverage percentage. Total tests: 40 (all passing) 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> --------- Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Claude <noreply@anthropic.com>	2025-07-28 18:32:24 +00:00
Mike Fortman	0f89e39da1	feat: Move to Biome for linting and formatting (#8997) ... * init biome * lint * format * unused vars * more unused vars * error fixes * import ordering * test precommit hook * add precommit hook * [autofix.ci] apply automated fixes * remove prettier and eslint and update gh actions * pre-commit update * ✨ (Makefile): add new targets 'biome' and 'biome_check' to run biome check and format on frontend code. * 🔧 (Makefile): rename 'biome' target to 'format_frontend' for clarity and consistency 🔧 (Makefile): rename 'biome_check' target to 'format_frontend_check' for clarity and consistency * 📝 (biome.json): Update a11y rule in biome.json to turn off 'noStaticElementInteractions' warning 🔧 (apiModal/code-tabs.tsx): Remove unused 'autologin' variable in APITabsComponent ♻️ (global-variable-modal.tsx): Simplify GeneralGlobalVariableModal component by removing unused props definition * 📝 (biome.json): Remove 'debug' from allowed console methods to improve code quality 🔧 (index.tsx): Replace console.debug with console.log for better logging consistency ♻️ (index.tsx): Refactor UpdateAllComponents function signature to remove unnecessary empty object parameter * fix console rules * 📝 (biome.json): update a11y rule to warn for noStaticElementInteractions to improve accessibility compliance. --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: cristhianzl <cristhian.lousa@gmail.com>	2025-07-15 18:46:51 +00:00
Deon Sanchez	ff00eb582f	fix: improves table formatting in the playground and adds Jest tests (#8743) ... * feat(tests): add Jest configuration and setup for testing environment - Introduced Jest configuration file to set up testing environment with TypeScript support and JSDOM. - Added setupTests.ts for global test configurations, including mocks for ResizeObserver and IntersectionObserver. - Updated package.json and package-lock.json to include Jest and related dependencies. - Implemented utility functions for processing markdown content, including handling tables and <think> tags. - Added comprehensive tests for markdown utility functions to ensure proper functionality. * refactor(makefile): separate frontend commands into a dedicated Makefile - Removed frontend-related targets from the main Makefile and created a new Makefile.frontend to manage frontend-specific commands. - Updated the main Makefile to include a reference to the new frontend Makefile and added a help message for frontend commands. - This restructuring improves organization and clarity for managing backend and frontend build processes.	2025-06-30 21:13:04 +00:00
Gabriel Luiz Freitas Almeida	8ae85abb9f	feat(makefile): add patch target for automated version management (#8719) ... * feat: Add version management to Makefile for streamlined updates * Introduced a new `patch` target in the Makefile to update version numbers across all projects. * The target updates `pyproject.toml` and `package.json` files, syncing backend and frontend dependencies. * Includes error handling for missing version argument and cleanup of backup files after updates. * refactor: Replace sed commands with Python scripts for version updates in Makefile * Updated the `patch` target in the Makefile to use Python for modifying version numbers in `pyproject.toml` and `package.json`, enhancing readability and maintainability. * Removed cleanup of backup files as they are no longer created with the new approach. * chore: Update Makefile to remove frozen flag from uv sync command * Modified the `patch` target in the Makefile to remove the `--frozen` flag from the `uv sync` command, allowing for more flexible dependency synchronization. * This change enhances the update process for backend dependencies. * chore: Enhance Makefile patch target with validation and parallel dependency syncing * Updated the `patch` target in the Makefile to include validation checks for version changes in `pyproject.toml` and `package.json`. * Implemented parallel execution for syncing backend and frontend dependencies to improve efficiency. * Added final state validation to ensure expected files are modified after the update process. * Improved user feedback during the version update process with clear success and error messages.	2025-06-24 23:11:18 +00:00
Gabriel Luiz Freitas Almeida	dbaa8a1c6f	refactor: simplify init target by removing cache cleanup and adding pre-commit hook (#8590) ... * build: add pyyaml dependency * refactor: simplify init command by removing cache cleaning and langflow run call * refactor: simplify init target by removing cache cleanup and adding pre-commit hook * refactor: update langchain_core.prompts import paths to use specific modules --------- Co-authored-by: Edwin Jose <edwin.jose@datastax.com>	2025-06-23 13:46:55 +00:00
Deon Sanchez	f091d6373c	fix: add selected_output field to components & templates to prevent disconnected edges (#8444) ... * feat: add selected_output property to Component and update validation logic * feat: add selected_output property to various components and update related logic * fix: improve error handling in JSON processing and update type hints * refactor: clean up Makefile and reorder JSON properties in Vector Store RAG.json * Removed the update_selected_outputs target from the Makefile to streamline the build process. * Reordered properties in Vector Store RAG.json for consistency, ensuring "selected_output" appears before "type" in multiple entries. * chore: remove add_selected_outputs.py script * Deleted the add_selected_outputs.py script, which was responsible for adding selected_output fields to Langflow JSON template files. This script is no longer needed as part of the project. * chore: clean up Makefile by removing unnecessary blank line * Removed an extra blank line in the Makefile to improve readability and maintain consistency. * chore: tidy up Makefile by adding a blank line for better readability * Added a blank line before the help target in the Makefile to enhance readability and maintain consistency in formatting. * chore: remove unnecessary blank line in Makefile * Eliminated an extra blank line before the help target in the Makefile to enhance readability and maintain consistency in formatting. * [autofix.ci] apply automated fixes * fix(GenericNode): update output selection logic to use selected_output name * Modified the logic for selecting the initial output in GenericNode to match the selected_output name from the data object. * Adjusted the return logic in NodeOutputs to ensure it correctly handles the selected output state. * fix(GenericNode): refine output selection logic to prioritize selected outputs * Updated the output selection logic in the cleanEdges function to filter for selected outputs before finding the matching output by name. This change enhances the accuracy of output handling for generic nodes. * updated blog writer * fix: update Memory Chatbot configuration for improved message handling - Adjusted JSON structure for Memory Chatbot to ensure correct output types and display names. - Added new input fields for sender type and refined existing fields for clarity. - Enhanced message retrieval methods to support dynamic output based on selected modes. - Improved overall structure for better integration with Langflow components. * Update src/backend/base/langflow/custom/custom_component/component.py Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org> * [autofix.ci] apply automated fixes * Ruff linting error fix * [autofix.ci] apply automated fixes * fix: Update test to reflect change in heading from "OpenAi" to "Language Model" --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Lucas Oliveira <lucas.edu.oli@hotmail.com> Co-authored-by: Cristhian Zanforlin Lousa <cristhian.lousa@gmail.com> Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org> Co-authored-by: Eric Hare <ericrhare@gmail.com>	2025-06-13 15:51:37 +00:00
yihong	61e345a029	fix: wrong command in Makefile since drop poetry (#6745) ... * fix: wrong command in Makefile since drop poetry Signed-off-by: yihong0618 <zouzou0208@gmail.com> * fix: address comments Signed-off-by: yihong0618 <zouzou0208@gmail.com> * fix: update Makefile to use uvx for codespell commands --------- Signed-off-by: yihong0618 <zouzou0208@gmail.com> Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>	2025-06-03 11:33:31 +00:00
Gabriel Luiz Freitas Almeida	4953227391	chore: Update Makefile to include PostgreSQL in backend installation (#7561) ... fix: update Makefile to include 'postgresql' in backend installation command	2025-04-10 17:23:24 +00:00
Christophe Bornet	d9b8211a18	build: Bump ruff version to 0.9.7 (#6614) ... * Bump ruff version to 0.9.7 * [autofix.ci] apply automated fixes * refactor: Update Gmail Agent starter project to Langflow 1.2.0 This commit updates the Gmail Agent starter project with new node IDs and configuration reflecting Langflow version 1.2.0. Changes include: - Updated node identifiers for Agent, ChatInput, ChatOutput, and ComposioAPI - Refreshed project metadata and version information - Minor adjustments to node configurations and viewport settings * [autofix.ci] apply automated fixes * fix: Revert Gmail Agent name to original * fix: Remove trailing comma in Gmail Agent JSON * feat: Add tags to Gmail Agent starter project --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>	2025-02-26 20:36:36 +00:00
Jordan Frazier	400572342f	feat: add nvidia ingest component (#6333) ... * initial * cleanup * [autofix.ci] apply automated fixes * ruff * add else * update deps * uv lock * Make nv-ingest an optional dep * revert change to validate * rebase fixes * [autofix.ci] apply automated fixes * Update language * add extra args to make target * [autofix.ci] apply automated fixes * update error language * lockfile update * rebase lockfile: * [autofix.ci] apply automated fixes * Adds nv-ingest by default to -ep docker image * caps fixes * update uv lock * revert ruff upgrade * ruff * Fix lint * [autofix.ci] apply automated fixes * No code changes made. * fix: update ruff configuration to ignore additional linting rule and allow built-in modules * fix: update ruff command to ignore linting rule A005 during autofix * fix: update Ruff check command to ignore linting rule A005 --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>	2025-02-20 19:26:03 +00:00
Christophe Bornet	41edba73c9	feat: Add support for Python 3.13 (#6685)	2025-02-20 18:13:21 +00:00
Gabriel Luiz Freitas Almeida	e1fb90074c	chore: Enhance Locust load testing and optimize database settings (#6265) ... * feat: Enhance Locust load testing for Langflow run endpoint Refactor locustfile to provide more robust and configurable load testing: - Add dynamic configuration via environment variables - Improve error handling and logging - Implement realistic flow run simulation - Add connection and timeout handling - Support API key authentication - Enhance stats tracking and error reporting * fix: Improve transaction logging error handling and performance - Add `no_autoflush` context to prevent unnecessary database operations - Change transaction logging error from exception to error level logging - Simplify error handling in log_transaction function * chore: Add Locust to development dependencies Update project dependencies by adding Locust (version 2.32.9) to the development requirements, supporting load testing capabilities * feat: Optimize database connection settings for improved performance and scalability - Increase default pool_size from 10 to 20 for better connection handling - Adjust max_overflow to 40 to support higher concurrent connections - Extend db_connect_timeout from 20 to 30 seconds - Add pool_recycle and echo settings to db_connection_settings - Enhance documentation for database connection settings, highlighting SQLite limitations * feat: Add Locust load testing configuration to Makefile - Introduce comprehensive Locust load testing target with configurable parameters - Support flexible testing scenarios with customizable users, spawn rate, and host - Enable headless and interactive testing modes - Add environment variable support for API key, flow ID, and other testing parameters - Provide sensible default values for load testing configuration * refactor: Remove unused retry configuration in Locust load testing - Remove RETRY_DELAY and MAX_RETRIES environment variables - Simplify FlowRunUser configuration by eliminating unused retry settings - Maintain existing wait time configuration for load testing * feat: Enforce FLOW_ID requirement for Locust load testing - Add mandatory validation for FLOW_ID environment variable - Raise a clear ValueError if FLOW_ID is not provided - Remove default flow ID to ensure explicit configuration - Improve load testing configuration robustness * feat: Add configurable request timeout for Locust load testing - Introduce `locust_request_timeout` parameter in Makefile - Update locustfile to use configurable request timeout from environment variable - Set dynamic connection and network timeout based on REQUEST_TIMEOUT - Improve request handling with flexible timeout configuration * revert change to database connection retry	2025-02-17 14:26:36 +00:00
Ítalo Johnny	93d5a22c56	fix: adjust path to run only unit tests (#5184) ... * fix: adjust path to run only unit tests * style: split unit test command for readability	2025-01-08 13:40:08 +00:00
Gabriel Luiz Freitas Almeida	039f80cb50	refactor: Enhance frontend build process with detailed logging and error handling (#5473)	2024-12-27 12:23:54 -08:00
Gabriel Luiz Freitas Almeida	37126991f4	ci: Update Makefile to show output during frontend build (#5472)	2024-12-27 11:09:47 -08:00
Gabriel Luiz Freitas Almeida	50b6a0b5a5	fix: Remove unnecessary directory clearing in build_langflow_base target (#5356) ... fix: remove unnecessary directory clearing in build_langflow_base target	2024-12-19 04:12:06 -08:00
Phil Miesle	d1821cb466	ref: improving development environment and instructions (#5180) ... * improving development environment and instructions * minor edits as requested * fix typo in DEVELOPMENT.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2024-12-12 04:01:05 -08:00
Gabriel Luiz Freitas Almeida	fb83af224a	chore: Add pyproject.toml configuration to ruff format command in Makefile (#4714) ... * Add pyproject.toml config flag to ruff commands in Makefile * Update ruff exclude path in pyproject.toml * Remove unused TYPE_CHECKING import from api_key.py * Remove redundant config flag from 'ruff check' command in Makefile	2024-11-19 19:06:01 +00:00
Ítalo Johnny	d65274da78	chore: remove unnecessary target from makefile (#4702)	2024-11-19 06:20:27 -08:00
Gabriel Luiz Freitas Almeida	467e546e8e	docs: Update local run instructions in CONTRIBUTING.md (#4615) ... * docs: Update local run instructions in CONTRIBUTING.md * chore: Remove pipx check and environment compatibility check from Makefile	2024-11-14 18:24:07 +00:00
Gabriel Luiz Freitas Almeida	6b3bf7b523	chore: Add 'lf' and 'ff' options to Makefile for pytest configuration (#4494) ... Add 'lf' and 'ff' options to Makefile for pytest configuration	2024-11-11 18:59:56 +00:00
Ítalo Johnny	7dd85ac0fe	fix: update regex to get supported python versions (#4175) ... * fix: update regex to get supported python versions * chore: move version check to bash script	2024-10-19 13:08:50 +00:00
Edwin Jose	6aa34dac65	chore:Add Alembic Commands to Makefile (#4083) ... Update Makefile added make commands related to alembic	2024-10-10 11:35:17 -04:00
Gabriel Luiz Freitas Almeida	8d88fc3059	chore: Add 'unsafe_fix' target to Makefile (#4081) ... Add 'unsafe_fix' target to Makefile for applying unsafe fixes with ruff	2024-10-09 14:37:26 +00:00
Gabriel Luiz Freitas Almeida	54dd81a681	chore: removes Poetry references from pyproject.toml and updates the project metadata (#4019) ... * Remove Poetry references from pyproject.toml and update project metadata * Remove '--no-update' flag from 'uv lock' commands in Makefile * Add script metadata with Python version and dependencies * Remove Poetry references and integrate UV setup in CI workflow * Remove Poetry setup and installation from integration tests workflow * Remove Poetry references and update workflow to use custom setup action * Remove references to Poetry from configuration files	2024-10-04 17:24:55 +00:00
Ítalo Johnny	ed7ec6a332	feat: improve CLI parameter handling and cleanup unused code (#4002) ... * chore: remove envvar parameter from CLI option * chore: add show_default=False flag to CLI option * chore: update argument type to accept None * feat: add missing Settings to CLI options * feat: add default path value for components * chore: rename CLI parameters to match Settings * feat: update function to enforce parameter hierarchy CLI > specific env_file > default env_file * fix: adjust CLI parameter code to pass unit tests * fix: mypy error arg-type * fix: little ajustments	2024-10-03 16:10:04 +00:00
Jordan Frazier	e19d90bd6c	ci: fix releases with uv (#3971) ... * Update scripts * update the base dep in uv deps * update nightly scripts * Add uv creds for publish * skip tests for now * fix version * only build the wheel * try again * add uv to python run * [autofix.ci] apply automated fixes * use uv cache * more version fixe * fixing versions * fix base version * Try no frozen? * skip everything to try docker build * tag * frozen * separate script for updating uv dep * [autofix.ci] apply automated fixes * hardcoded versions * hardcoded versions * add version to editable package * build project before docker file runs * try again * fix uv patht o build * don't know why this would mkae a difference * debug statements * debug statements * debug statements * change path to whl 🤷 * manually move the wheel... * make dir * try no sources * add back tests * refactor uv to action * add uv action * Update nightly build workflow to include uv lock files in version update commit * Update lint-py workflow to use specific ref for setup-uv action * Add checkout step to style-check-py GitHub Actions workflow * Remove redundant GitHub ref syntax in lint-py.yml workflow * Update lint-py.yml to use specific ref for setup-uv action * Update action.yml: standardize quotes and remove redundant checkout step * Add checkout step to GitHub Actions workflows for specific ref handling - Introduced `actions/checkout@v4` step to multiple workflows to ensure code is checked out at a specific ref. - Updated `.github/workflows/docker-build.yml`, `.github/workflows/release_nightly.yml`, `.github/workflows/lint-py.yml`, and `.github/workflows/style-check-py.yml` to include the new checkout step. - Ensured credentials are persisted during the checkout process. * Add checkout step to Python test workflow with specific ref --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>	2024-10-02 05:37:04 -07:00
Gabriel Luiz Freitas Almeida	43ad226ddb	chore: update docker images to use uv (#3916) ... * fix dev dependencies * fix dev dependencies * update lock * Add langchain-unstructured dependency to pyproject.toml * Switch to uv-based Docker image and streamline build process - Use `ghcr.io/astral-sh/uv:python3.12-bookworm-slim` as the base image - Simplify environment variable setup and remove unnecessary ones - Install project dependencies using `uv sync` with cache mounts - Add and copy necessary files for the build process - Update npm installation and frontend build steps - Adjust entrypoint and runtime configurations - Remove redundant user setup and streamline CMD execution * Refactor Dockerfile to use multi-stage builds for optimized image size - Introduce a builder stage to install dependencies and build the frontend. - Use npm ci instead of npm install for more reliable builds. - Copy built frontend assets to the final image. - Transition to a runtime stage with a slimmer Python base image. - Ensure the final image only contains necessary runtime dependencies. * Switch base image to `ghcr.io/astral-sh/uv:python3.12-bookworm-slim` and update Dockerfile - Replace `python:3.12.3-slim` with `ghcr.io/astral-sh/uv:python3.12-bookworm-slim` as the base image. - Enable bytecode compilation and set link mode to copy. - Update dependency installation process using `uv sync`. - Simplify frontend build and copy process. - Add OCI labels for image metadata. - Update CMD to use `langflow-base` for running the application. * Update Dockerfile to use uv base image and optimize dependency installation - Switch base image to `ghcr.io/astral-sh/uv:python3.12-bookworm-slim` - Combine apt-get commands and clean up to reduce image size - Replace Poetry with uv for dependency management and caching * Refactor Dockerfile to use multi-stage build for optimized image size - Introduce a builder stage using `ghcr.io/astral-sh/uv:python3.12-bookworm-slim` - Add a runtime stage using `python:3.12.3-slim` - Copy the virtual environment from the builder stage to the runtime stage - Remove the `uv` entrypoint to avoid invoking it by default * Update Dockerfile: Fix indentation and remove redundant ENTRYPOINT reset * ci: update release workflows to use uv (#3919) * Update nightly build workflow to use 'uv' for dependency management and caching - Replace Poetry with 'uv' for dependency installation and project setup - Add steps to install 'uv' and set up caching for 'uv.lock' - Modify Python setup to use version specified in 'pyproject.toml' - Remove Node.js setup steps * Update release workflow to use uv for dependency management - Replace Poetry with uv for dependency installation and caching - Update Python setup to use version specified in pyproject.toml - Add steps to restore uv cache and install project dependencies using uv - Adjust publish steps to maintain functionality with new setup * Replace 'poetry publish' with 'uv publish' in Makefile for consistency * Update nightly build workflow to use 'uv' for dependency management and caching * Set up Node.js 20 in release_nightly workflow and update version verification logic * Update Makefile to use `uv sync --frozen` for backend dependencies installation * Update Makefile to pass arguments to 'uv build' and remove '--skip-existing' from publish commands - Modified 'build_langflow' target to accept arguments. - Removed '--skip-existing' from 'publish_base' and 'publish_base_testpypi' commands. - Added TODO comments for updating test-pypi repository usage. * Remove --skip-existing flag from uv publish commands and add TODO comments for test-pypi updates * new lock * Update CI workflow to remove version prefix and add build args - Removed 'v' prefix from version extraction in nightly release workflow. - Added '--no-sources' argument to the build command in the distribution step. * Update CI workflow to use 'uv' for versioning and publishing - Replace 'poetry' with 'uv' for version extraction in release checks * Update CI workflow to use UV_PUBLISH_TOKEN for PyPI publishing * Add verification step for 'langflow-nightly' name and version in CI workflow - Corrected awk commands for extracting 'langflow-base' name and version. - Added a new step to verify 'langflow-nightly' name and version against expected values. * feat: Update dev.Dockerfile to use 'uv' for dependency management and caching * update dockerfiles with --no-editable --------- Co-authored-by: phact <estevezsebastian@gmail.com> Co-authored-by: Jordan Frazier <jordan.frazier@datastax.com>	2024-09-30 22:49:25 +00:00
Gabriel Luiz Freitas Almeida	bbeaf68a26	docs: Update CONTRIBUTING.md to mention uv (#3965) ... * Remove Poetry check, update uv command, and remove dev target from Makefile * Update CONTRIBUTING.md to reflect new development setup and remove docker-compose instructions	2024-09-30 12:23:35 -07:00
Gabriel Luiz Freitas Almeida	bf2aadf6a4	refactor: update dependency versions and streamline backend installation commands (#3939) ... * Update Makefile to streamline backend dependency installation commands * Update dependency versions in pyproject.toml for weaviate-client, httpx, and others * Update dependency versions in pyproject.toml for better compatibility and stability * new lock * refactor: streamline backend dependency installation commands * update examples formatting	2024-09-26 12:23:26 -07:00
Sebastián Estévez	fbb097dc4c	chore: uv to replace poetry (#3900) ... * uv sync works * fist stab at Makefile * uv treatment for langflow-base * sqlmodel to 0.0.18 * add reinstall_backend to Makefile * makefile - reinstall_backend fix and unit_test dependency * fix dev dependencies * fix dev dependencies * fix dev dependencies * lock * Makefile * [autofix.ci] apply automated fixes * Update Makefile Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org> * delete update_dependencies * fix lint * Remove Poetry lock check from GitHub Actions workflow * Switch to 'uv' for dependency management and caching in style-check workflow * Update style-check workflow to use '--only-dev' flag for Ruff check * Integrate 'uv' package setup and caching in GitHub Actions workflows * Update version check in GitHub Actions to use 'uv tree' for langflow-base * Remove redundant poetry environment setup in GitHub Actions workflow * Add step to minimize uv cache in GitHub Actions workflow * Update GitHub Actions workflow to use 'uv' for dependency management and caching * Remove redundant script execution from build_langflow target in Makefile * [autofix.ci] apply automated fixes * Switch build system from Poetry to Hatchling and update dependencies - Replace `poetry-core` with `hatchling` in build-system requirements - Update `langflow-base` dependency to version `0.0.96` - Add `tool.hatch.build.targets.wheel` configuration - Adjust `tool.uv.sources` paths for `langflow-frontend` and `langflow-base` * update lock * Switch build system from Poetry to Hatchling in pyproject.toml * Add langchain-unstructured dependency to pyproject.toml --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>	2024-09-25 13:40:30 -07:00
Gabriel Luiz Freitas Almeida	fcf780bf42	tests: optimize test durations and refactor test fixtures (#3713) ... * Refactor test fixtures and imports for optimization - Reordered and optimized imports in `conftest.py`. - Changed return statements to yield in `basic_graph` and `create_webhook` fixtures for better resource management. - Added cleanup step to `create_webhook` fixture to delete created webhook after test completion. * Refactor imports and add placeholder client fixture in test_ChatOllama_component.py * Add pytest fixture 'client' to test_graph.py * Add pytest fixture 'client' to test_callback_graph.py for test optimization * Add 'unit_tests_looponfail' target to Makefile for running unit tests with loop-on-fail option * Optimize test durations and update test cases in various modules	2024-09-06 14:03:27 -07:00
Jordan Frazier	7b3e51f769	ci: create a nightly build workflow (#3553) ... * test poetry install * Add nightly builds workflow * remove old comments and fix poetry * remove old debug statement * [autofix.ci] apply automated fixes --------- Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>	2024-09-05 19:13:04 +00:00
Gabriel Luiz Freitas Almeida	6388883f1b	fix: update Makefile to conditionally enable --reload based on worker count (#3675) ... * Update Makefile to handle backend port kill errors * Update Makefile to conditionally enable --reload based on worker count	2024-09-03 17:58:35 -03:00