CERN Accelerating science

All releases

FTS 3.6.7

Bug

  • [FTS-906] - Change int user_filesize to long long

FTS 3.6.4

Improvement

  • [FTS-901] - Provide error reason in FAILED file state messages.
  • [FTS-904] - Provide user_filesize for raw_rate out of file_metadata.

FTS-Rest 3.6.3

Bug

  • [FTS-888] - Not allow automatic session reuse for unknown userfilesize
  • [FTS-893] - Create Auto session reuse configuration parameter (disable by default)

FTS 3.6.2

Bug

  • [FTS-879] - revertToSubmitted considered harmful
  • [FTS-883] - Wrong condition on reapStalledTransfers
  • [FTS-884] - --global-timeout was dropped from fts_url_copy
  • [FTS-885] - Staging start and finished timestamps are not sent in the messages
  • [FTS-887] - Session reuse + staging do not work well together
  • [FTS-889] - READY are not accounted for when checking if the transfer is allowed
  • [FTS-892] - When stream optimization is enabled, even if they are few transfers the number keeps growing

FTS 3.6.0

FTS

Sub-task

  • [FTS-830] - Publish error reason with FAILED state transitions
  • [FTS-831] - Prepend STAGING to the error message when caused on a staging operation
  • [FTS-832] - Publish start and end timestamps to state transitions as well

Epic

  • [FTS-828] - Provide extra information for staging performance analysis

Bug

  • [FTS-629] - Improve staging query
  • [FTS-718] - CLI should interpret nulls as nulls
  • [FTS-738] - fts-transfer-submit man page needs a refresh
  • [FTS-741] - Remove workaround for FTS-740
  • [FTS-773] - Consolidate default handling
  • [FTS-783] - Race condition with Producer inside MySqlAPI
  • [FTS-786] - If a transfer is to be marked as stalled, it better be killed
  • [FTS-791] - Tight loops when DB connection is lost
  • [FTS-797] - Cloud storage wildcard should be explicit (i.e '*')
  • [FTS-806] - Issue an SRM abort even if the bring online get status fails
  • [FTS-811] - Public share with 0 is automatically created if there is a link configuration
  • [FTS-816] - MySQL 5.7: ORDER BY clause is not in SELECT list
  • [FTS-835] - src_hostname and dst_hostname should not send the url schema
  • [FTS-840] - Deadlock between updateProtocol and updateFileTransferStatus
  • [FTS-841] - Incorrect timestamp for SUBMITTED state
  • [FTS-845] - Need a 404.html template
  • [FTS-849] - updateBringOnlineToken generates a bad query, and some files are left with an empty token
  • [FTS-853] - Draining ineffective

New Feature

  • [FTS-858] - Allow to disable cert verification

Task

  • [FTS-597] - Drop unused tables
  • [FTS-603] - Provide FTS via containers
  • [FTS-605] - Drop client side SOAP configuration
  • [FTS-780] - Provide backup duration in the logs
  • [FTS-792] - Drop snapshot API
  • [FTS-821] - Poll VOs to see which apparently unused functionalities are being used or will be
  • [FTS-824] - Drop t_server_sanity (unused)
  • [FTS-864] - Drop myosg-update
  • [FTS-865] - Reduce overview overhead

Improvement

  • [FTS-598] - Drop unused columns
  • [FTS-599] - Optimize database schema
  • [FTS-600] - Drop server side SOAP code
  • [FTS-617] - Redundant indexes
  • [FTS-621] - Use archive engine for t_*_backup tables
  • [FTS-671] - Restricted view for server logs in web monitoring
  • [FTS-727] - Remove workarounds for compatibility with schema 1.*
  • [FTS-770] - t_server_config values should be all picked per vo
  • [FTS-771] - Producer should connect using TLS
  • [FTS-772] - Remove dn from webmon
  • [FTS-779] - Do not print the user-dn on the url-copy logs
  • [FTS-782] - Heuristics for timeout is too short for small files
  • [FTS-807] - Make stalled timeout configurable, and set to 360 seconds
  • [FTS-808] - Log timeout events on Bring Online
  • [FTS-817] - Adapt to new database schema
  • [FTS-818] - 'credential' parameter removed from REST
  • [FTS-822] - Use ENUM for the states
  • [FTS-823] - Review queries
  • [FTS-827] - Replace EOT with a space on the messages
  • [FTS-847] - CLI should log warnings from CURL too
  • [FTS-859] - Remove wait timeout from storage blacklisting

Configuration Change

  • [FTS-843] - Change staging defaults to bulk of 500 and 400 requests

REST API

Bug

  • [FTS-546] - Cancel jobs when job_finished = NULL
  • [FTS-568] - FTS REST and VOMS RFC proxies
  • [FTS-734] - Fix schema reporting in REST API
  • [FTS-744] - Packaging: /var/log/fts3rest must be owned by fts3.fts3
  • [FTS-784] - Use always UTC for timestamp comparison in http
  • [FTS-798] - Client implementation of the delegation broken due to m2crypto API changes
  • [FTS-836] - fts-rest-http-authz-signed-cert error when comparing datetimes

New Feature

  • [FTS-705] - FTS can decide to enable or not session reuse depending on the size of the files contained on a job

Task

  • [FTS-408] - Consult roles for job listing
  • [FTS-603] - Provide FTS via containers
  • [FTS-792] - Drop snapshot API

Improvement

  • [FTS-727] - Remove workarounds for compatibility with schema 1.*
  • [FTS-781] - All server config now can be done per VO
  • [FTS-850] - Allow staging jobs for all protocols
  • [FTS-859] - Remove wait timeout from storage blacklisting

FTS 3.5.8

Bug

FTS-REST 3.5.4

Bug

  • [FTS-752] - Rest sends the SUBMITTED/STAGING with the hostname rather than the alias
  • [FTS-719] - useexisting is deprecated, switch to extend_existing
  • [FTS-722] - Requires python-requests

Improvement

  • [FTS-749] - 40x statuses are not service errors, so they should be logged as info

FTS 3.5.7

Bug

  • [FTS-748] - When setting READY, start_time should be set too
  • [FTS-754] - Reduce verbosity of SOAP errors
  • [FTS-755] - Reduce verbosity of set-priority errors on terminal transfers
  • [FTS-757] - Retries should not be accounted for when they are old
  • [FTS-753] - Put user_dn back into url_copy messages

FTS-REST 3.5.2

Sub-task

  • [FTS-533] - "Fixed" configuration must be adapted to range settings

Bug

  • [FTS-526] - Fix serialization of data to JSON in the configuration GUI
  • [FTS-535] - Remove and update fix values from the Configuration GUI
  • [FTS-548] - Failure to submit when a job combines banned and non banned storages
  • [FTS-650] - VO shares must be configurable with JSON
  • [FTS-658] - Most of the tabs on the config UI are not working on C7
  • [FTS-663] - Debug view is broken
  • [FTS-665] - Review fix values view
  • [FTS-687] - Remove max limitation on config UI
  • [FTS-693] - Propagate the verify flag down to requests
  • [FTS-694] - Request class must return the body as a string, not as unicode
  • [FTS-697] - When getting a transfer, check for user if the vo does not match
  • [FTS-714] - Call m2crypto thread initialization methods

New Feature

  • [FTS-417] - Add vo group/role support to cloud credentials

Task

  • [FTS-492] - Add +LegacyDNStringFormat for the fts3rest.config
  • [FTS-406] - fts rest: cancelAll result is "null"
  • [FTS-654] - Change default SSL cipher-suite
  • [FTS-666] - Log message that indicates the authorized VO when a job is submitted
  • [FTS-667] - Disable GridSite session files
  • [FTS-673] - Show user-dn and vo in REST logs for each submission.

Improvement

  • [FTS-468] - Allow the use of suffixes for 'max_time_in_queue'
  • [FTS-497] - Factor out the configuration parser from fts-rest so it can be reused outside
  • [FTS-630] - 3.5 should be able to run with the old database schema
  • [FTS-636] - Add connection timeout and request timeout options to client context
  • [FTS-610] - Static configuration stored on the DB should be read when creating the user context
  • [FTS-660] - Allow users to select alternative S3 syntax
  • [FTS-664] - Pass HTML validator to config views
  • [FTS-690] - Client should delegate before the proxy has less than one hour.
  • [FTS-713] - Use %{GLOBAL} WSGIApplicationGroup
  • [FTS-715] - Use Python sha1 instead of M2crypto's

FTS 3.5.5

Important: Please, read the Upgrade Guide before upgrading

Sub-task

  • [FTS-534] - "Fixed" view must be adapted to range settings

Epic

Bug

  • [FTS-354] - Do not change state from terminal to terminal
  • [FTS-384] - Remove CMP0053 warning in cmake
  • [FTS-407] - Typo: quite instead of quiet as a CLI flag
  • [FTS-413] - REST response parser fails when frequent_error is null
  • [FTS-437] - fts-transfer-status detailed listing fails with deletion jobs
  • [FTS-440] - CLI does not list deletion when using REST backend
  • [FTS-461] - Fix the warning message when using the command fts-config-set with gSOAP
  • [FTS-463] - SSL_SERVER_S_DN and Credentials.user_dn provide different formats in Centos7
  • [FTS-483] - FTS DB schema script fails on Mysql 5.7
  • [FTS-509] - fts-transfer-submit should accept 0 number of streams
  • [FTS-525] - Accumulation of <defunct> fts_url_copy
  • [FTS-529] - set_metadata segfaults when the metadata is the empty string
  • [FTS-536] - Optimizer view misses a filter for fixed pairs
  • [FTS-549] - Canceled transfers are updated to failed
  • [FTS-551] - Race condition when transferring to S3
  • [FTS-554] - Checksum enabled when verify_checksum=False
  • [FTS-557] - Remove double check when forking
  • [FTS-564] - Failed to create pipe between parent/child processes
  • [FTS-577] - Make fts_url_copy capable of running without a proxy
  • [FTS-579] - Multiple reuse with retries is not setting properly the value of "retry" on the end message
  • [FTS-608] - "Current job throughput" in the job view should show aggregated throughput
  • [FTS-635] - Cancel NOT_USED replicas when a job timeout expires
  • [FTS-469] - SUBMITTED state should be sent on submission, not later
  • [FTS-518] - Double check known PIDS (from the DB) when FTS3 starts up
  • [FTS-651] - Remove schema parsing from REST reference cli
  • [FTS-652] - CLI: Default to hostcert and hostkey (useful for config)
  • [FTS-656] - Statistics overview links point to host=undefined
  • [FTS-657] - Plots are drawn twice on the same canvas
  • [FTS-676] - Set X509 env variables in url copy
  • [FTS-681] - Drop static library fts_common_min
  • [FTS-684] - Do not run sanity checks on startup
  • [FTS-685] - Race condition on the logger

New Feature

  • [FTS-308] - Allow for range settings for the number of actives (Schema change!)
  • [FTS-403] - Allow to configure logging level
  • [FTS-417] - Add vo group/role support to cloud credentials
  • [FTS-418] - Allow to run FTS3 disabling SOAP
  • [FTS-422] - Allow to configure staging parameters (bulk size, waiting time, concurrent requests)
  • [FTS-428] - Add support for short-term S3 credentials
  • [FTS-496] - Rotate f_*_backup
  • [FTS-500] - SIGKILL rather than SIGUSR1 stalled url copies
  • [FTS-530] - Database upgrade tool
  • [FTS-648] - Support "Params" on the CLI
  • [FTS-703] - Publish FTS core version via REST

Task

  • [FTS-330] - New optimizer algorithm: 'Prefer-active' (suggested by Saul)
  • [FTS-346] - Required 646 permissions for /var/lib/fts3 directories
  • [FTS-411] - Reuse logger between server, monitoring and url-copy
  • [FTS-419] - Extract coverage information also from functional tests
  • [FTS-444] - Use dirq instead of custom code to store/retrieve messages on disk
  • [FTS-501] - Remove buffersize and nostreams heuristics from url-copy
  • [FTS-502] - Refactor fts_url_copy
  • [FTS-537] - Remove Oracle backend
  • [FTS-545] - Show link to logs only if service is running
  • [FTS-593] - Merge 3.4.7 fixes into develop
  • [FTS-604] - Drop client side SOAP code except configuration
  • [FTS-627] - Remove profiler
  • [FTS-628] - Remove t_turl
  • [FTS-632] - Remove SOAP Python Bindings
  • [FTS-634] - Bring nagios probles back to live
  • [FTS-406] - fts rest: cancelAll result is "null"
  • [FTS-654] - Change default SSL cipher-suite
  • [FTS-667] - Disable GridSite session files
  • [FTS-668] - Split MySqlAPI.cpp into different files
  • [FTS-669] - Write logging messages without overlaps
  • [FTS-670] - Log inconsistencies found
  • [FTS-672] - Show user-dn and vo in SOAP logs for each submission.

Improvement

  • [FTS-357] - If the proxy is expired, log a more readable error message
  • [FTS-385] - Remove dependency on is-interface
  • [FTS-395] - Consolidate log levels
  • [FTS-397] - Improve unit tests
  • [FTS-399] - Fix warnings given by Coverity, compiler, SonarQube
  • [FTS-400] - Allow to configure running user and group
  • [FTS-416] - Increase size of cloudStorage_name
  • [FTS-420] - Allow to configure messaging spool directory
  • [FTS-421] - Allow to configure the location of the configuration file for the messaging
  • [FTS-425] - Use exit to finish, ordered destruction of resources
  • [FTS-434] - Add to SLS the DB situation
  • [FTS-464] - Use boost 1.48 available in EPEL
  • [FTS-504] - Logger should not redirect stdout
  • [FTS-506] - Register on the optimizer actual number of actives (Schema change!)
  • [FTS-523] - Optimizer->Stream: Show message if stream optimizing is disabled
  • [FTS-531] - Improve calculation of throughput in the overview
  • [FTS-532] - Mark activities that will fallback to default
  • [FTS-580] - Increase number of actives when good efficiency and throughput not changes during 5 min.
  • [FTS-581] - Indicate a meaningful throughput for the optimizer in the monitoring.
  • [FTS-606] - In the optimizer view, change 'throughput' column for something more descriptive
  • [FTS-611] - Optimizer: Remove redundant limit check
  • [FTS-613] - Change optimizer calculation of throughput
  • [FTS-614] - Improve visualization of throughput and ema
  • [FTS-622] - Publish if IPv6 was used or not
  • [FTS-630] - 3.5 should be able to run with the old database schema
  • [FTS-653] - CLI: Default to REST when running on fts3 host
  • [FTS-660] - Allow users to select alternative S3 syntax
  • [FTS-686] - Default log level should be INFO
  • [FTS-689] - On the optimizer, log when we hit the lower range limit
  • [FTS-691] - Reduce min validity time for a proxy to 1 minute
  • [FTS-704] - Shuffle queues to avoid starving links
  • [FTS-710] - Show time in the X axis
  • [FTS-711] - Take into account the avg. file size for the optimizer decision

Pages