Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / postgrespro / testgres

Testing framework for PostgreSQL and its extensions

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/postgrespro%2Ftestgres
PURL: pkg:github/postgrespro/testgres

Stars: 150
Forks: 37
Open issues: 11

License: other
Language: Python
Size: 1.08 MB
Dependencies parsed at: Pending

Created at: about 9 years ago
Updated at: 5 days ago
Pushed at: 5 days ago
Last synced at: 5 days ago

Commit Stats

Commits: 503
Authors: 36
Mean commits per author: 13.97
Development Distribution Score: 0.557
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/postgrespro/testgres

Topics: pathman, postgres, postgresql, replication, testgres, testing

Releases
Date Semver
1.11.1

1.11.1

What’s Changed

Full Changelog: https://github.com/postgrespro/testgres/compare/1.11.0...1.11.1

Changes in testgres code

  • [#240] Using of node.psql with other host and port in #242
  • [#249] Fix of port number leak in NodeBackup::spawn_replica in #250
  • [Refactoring] Default port manager functions now use PortManager__Generic and LocalOperations in #251
  • [#244] PostgresNode now uses os_ops only in #245
  • LocalOperations::get_single_instance is added in #252
  • New OsOperations methods: makedir, rmdir in #253
  • OsOperations::get_tempdir() is added in #254
  • [#256] Port number 65535 is valid for using in #268
  • [#264] New property PostgresNode::port_manager in #269
  • PortManager__Generic sends debug messages “port is reserved/released” in #270
  • [#266] OsOperations::build_path is added in #273
  • A support of cwd parameter is added to OsOperations::exec_command in #272
  • [#274] Unused should_rm_dirs is deleted (cleanup) in #275
  • [python v3.13] TestTestgresCommon::test_logging uses logging._lock in #276
  • NodeApp is refactored in #278
  • Testgres is tested on python 3.7 now, too in #280
  • Remove usage of not standard function nc in remote_ops.py is_port_free in #284

Changes in testgres tests

  • [FIX] Tests include testgres by right way through import in #241
  • Testgres tests create log dir in exact place in #243
  • [test] TestTestgresLocal.test_upgrade_node is corrected in #246
  • Releasing of reserved port in tests in #248
  • [#235] test_pg_ctl_wait_option detects a port conflict in #257
  • Incomplete asserts in are fixed (conftest) in #261
  • [tests] Creation of “dummy/empty” log file for xdist controller is fixed in #282
  • conftest is updated - ExitStatusNames in #283

Our plans

Split testgres’ code

We will move the content of testgres/operations folder into the separated package - testgres.os_ops.

Some exceptions will be moved in separated packages testgres.common, too.

It allows to use these things separately.

This change requires to the internal reorganization of testgres source code - ‘testgres’ folder will be renamed with ‘src’.

Remove testgres.plugins

We will remove testgres.plugins folder with all its content (plugin for pg_probackup2).

Plugin for pg_probackup2 was already moved to the separated package - https://github.com/postgrespro/testgres-pg_probackup2

If you download testgres-pg-probackup2 from github directly, please update your code to avoid any problem in the near future.

Contributors

  • @demonolock
  • @dmitry-lipetsk
2 months ago
Download
1.11.0

1.11.0

Testgres 1.11.0 Release Notes

1. Important Changes

1.1. Removal of testgres.OsOperations::db_connect method (#237)

The db_connect method has been removed from the OsOperations interface as it was not fitting with the OS-specific functionality it was intended for.

1.2. Replacement of testgres.helpers.port_manager.PortManager (#234)

The old PortManager class has been replaced by the new testgres.port_manager.PortManager interface. The functionalities of the old PortManager are now in the testgres.utils.internal__reserve_port function.

1.3. PostgresNode property changes (#234)

  • PostgresNode::name, PostgresNode::host, PostgresNode::port, PostgresNode::ssh_key, and PostgresNode::os_ops are now read-only properties. These properties cannot be modified after the creation of a PostgresNode object.
  • Modifying a node’s port now requires recreating the PostgresNode object due to potential complexities in synchronizing configurations across PostgreSQL instances.

1.4. New PostgresNode parameters (#234, ac0a2bbd373b5d5852bfb3b3ff0ff6caec2c6633)

  • port_manager and os_ops parameters have been added to the PostgresNode constructor. These parameters allow explicit control over the port reservation and the OS operations used by the node.

2. New Features

2.1. New testgres.port_manager.PortManager Interface (#234)

A new interface for reserving and releasing ports, used by PostgresNode to manage port assignments correctly on both local and remote systems. Two implementations are available:

  • PortManager__ThisHost (for local systems)
  • PortManager__Generic (for both local and remote systems)

2.2. PostgresNode::clone_with_new_name_and_base_dir Method (ac0a2bbd373b5d5852bfb3b3ff0ff6caec2c6633)

New method to clone a PostgresNode with a new name and base directory. This method is now used in NodeBackup::spawn_primary for better node cloning.

2.3. OsOperations::is_free_port Method (#234)

A new method added to OsOperations to check if a port is free. This method is used in the new PortManager__Generic class.

2.4. Support for Environment Variables in OsOperations::execute_command (#239)

You can now pass environment variables through the new exec_env parameter when using the execute_command method of OsOperations. This feature has been added to PostgresNode::start and PostgresNode::slow_start.

3. Updates and Changes

3.1. PostgresNode::start Does Not Call logging.error Anymore (b91714142fb77d1af7450bfa58abf2cecf529c4d)

The PostgresNode::start method no longer logs errors before raising exceptions. This change improves the handling of errors and avoids misclassification of errors as they are now left for the client to handle.

3.2. RemoteOperations::exec_command Updates (#185, #187)

  • Explicit enumeration of supported cmd parameter types.
  • Explicitly transfers language environment variables (LANG, LC_*, etc.) during SSH command execution.

3.3. PostgresNode::pid Improved (#199)

Now uses pg_ctl to handle pid property more reliably.

3.4. Refactoring of OsOperations::execute_command (#203)

Improved error handling and the way results are processed. The function now only checks the exit code for errors and allows the caller to manage expected errors.

4. Bug Fixes

4.1. OsOperations::cwd Bug Fix (#182)

The implementation of cwd now works correctly with local systems.

4.2. Fixes in OsOperations::write Method (#183)

Bug fixes and data preparation improvements for both local and remote operations.

4.3. Fixes in PostgresNode::start Method (50fc4c5fecc9aa722dbc660762a9d120f12e92fa)

Corrected an issue in the warning message generation when starting a node.

4.4. RemoteOperations::mktemp Fix (#202)

The call to mktemp now correctly uses the -t option to return the full path instead of just a name.

4.5. Fix for RemoteOperations::listdir (#217)

Improved handling of directory listings, especially for paths with spaces.

5. Other Changes

5.1. New CI Verifications

  • Support for multiple Python versions (3.8 - 3.12).
  • Tests on multiple Linux distributions (Ubuntu 2024.04, AltLinux 10/11).

5.2. Migration to pytest

Tests have been migrated from unittest to pytest for better flexibility and efficiency.

5.3. Global Test Refactoring

New unified tests for LocalOperations and RemoteOperations.

5.4. Experimental Logging Feature

A new conftest.py allows logging test results for further processing of errors and warnings within a single test.

Full Changelog: 1.10.5 → 1.11.0

Contributors

  • @dmitry-lipetsk
7 months ago
Download
1.10.5

1.10.5

What’s Changed

Full Changelog: https://github.com/postgrespro/testgres/compare/1.10.4...1.10.5

9 months ago
Download
1.10.4

1.10.4

Testgres 1.10.4 Release Notes

🚀 Key Improvements

  • Better Port Management: Improved handling of port numbers to reduce conflicts and errors. #165 @dmitry-lipetsk
  • More Reliable Error Handling:

🔧 Bug Fixes & Enhancements

  • Database Connection Fix: PSQL now explicitly passes the database name using -d <dbname>. #168 @dmitry-lipetsk
  • SSH Command Fix: Corrected SSH command execution in RemoteOperations::execute. #169 @dmitry-lipetsk
  • Remote Operations Updates:
    • Added new methods: read_binary, get_file_size. #170 @dmitry-lipetsk
  • File Operations Enhancements:
    • OsOps::read methods now correctly handle text mode. #171
    • OsOps::read_binary now supports offsets. #173 @dmitry-lipetsk
  • Backup Testing Support: Added check backup-source to help test pg_probackup3. #176 @egarbuz

🛠 Refactoring & Code Cleanup

  • Refactored Node Management:
    • PostgresNode::start refactored for better reliability. #174 @dmitry-lipetsk
    • Node.start improved. #167 @dmitry-lipetsk
    • PortManager::find_free_port updated for efficiency. #178 @dmitry-lipetsk
  • Command Execution Improvements:
    • LocalOperations::_run_command refactored. #158 @dmitry-lipetsk
    • NodeApp::make_simple now uses tempfile.gettempdir. #157 @dmitry-lipetsk

🎉 New Contributors

  • @dmitry-lipetsk made their first contribution! 🎉 #157

📌 Full Changelog: 1.10.3 → 1.10.4

9 months ago
Download
1.10.3

1.10.3

What’s Changed

New Contributors

Full Changelog: https://github.com/postgrespro/testgres/compare/1.10.2...1.10.3

11 months ago
Download
1.10.2

1.10.2

What’s Changed

New Contributors

Full Changelog: https://github.com/postgrespro/testgres/compare/1.10.1...1.10.2

about 1 year ago
Download
1.10.1

1.10.1

What’s Changed

New Contributors

Full Changelog: https://github.com/postgrespro/testgres/compare/1.10.0...1.10.1

over 1 year ago
Download
1.10.0

1.10.0

What’s Changed

  • Add pg_upgrade option by @demonolock (#97)
    This function allows upgrade PostgreSQL versions.
  • Remove unnecessary output by @homper (#88)
  • Fix get_pg_version for Linux Mint by @demonolock (#101)
  • Set default test locale to en by @Ogurezzz (#107)
    This change aims to standardize test outputs.
  • Fix Error during executing query by @z-kasymalieva (#110)
    Resolved an issue related to executing queries within the framework, particularly when executing commands that do not produce row output, which previously resulted in errors.
  • Run the archive command through exec by @asavchkov (#113)
    If the PostgreSQL archive command is run through the dash shell the shell produces a core dump upon receiving a SIGQUIT during the PostgreSQL server shutdown. This change replaces the dash process with pg_probackup to avoid the production of a core dump.

New Contributors

Full Changelog: https://github.com/postgrespro/testgres/compare/1.9.3...1.10.0

over 1 year ago
Download
1.9.3

1.9.3

  • Fixed a problem on MacOS with command –version
  • Fixed problems on Windows
almost 2 years ago
Download
1.9.2

1.9.2

  • Removed sshtunnel and fabric libraries usage
about 2 years ago
Download