CERN Accelerating science

All releases

FTS 3.7.0

Release Notes - FTS - Version fts 3.7.0

Note: See the upgrade to 3.7 documentation

Sub-task

  • [FTS-979] - Generalise Checksum in Server
  • [FTS-984] - Create corresponding tests

Bug

  • [FTS-890] - getReadySessionReuseTransfers picks reuse transfers one by one
  • [FTS-891] - Should not account for READY transfers that belong to session reuse jobs
  • [FTS-975] - Fix error grouping view
  • [FTS-990] - Transfers stuck in READY
  • [FTS-991] - fts-transfer-cancel needs a proxy to run
  • [FTS-995] - Timeout is ignored in CLI

Epic

  • [FTS-894] - Reevaluate and refactor configuration, optimizer and scheduler

New Feature

  • [FTS-723] - Publish messages with Optimizer decision
  • [FTS-750] - Generalize checksum methods
  • [FTS-922] - Allow to set minimum number of transfers globally
  • [FTS-983] - Use the transfer type event to populate a new field for the monitoring

Task

  • [FTS-1002] - Change CheckStalledTimeout default value to 900
  • [FTS-1003] - Update FTS documentation for REST Config

Improvement

  • [FTS-940] - Optimize query in getActivePairs
  • [FTS-953] - Optimizer should get throughput over more than 1 minute
  • [FTS-960] - Make sleep intervals configurable
  • [FTS-992] - Optimizer should be more aggressive
  • [FTS-994] - Introduce zeromq for ping messages from url-copy
  • [FTS-996] - Improve optimizer for small files
  • [FTS-997] - Optimizer success values should be configurable

Release Notes - FTS - Version fts-rest 3.7.0

Sub-task

  • [FTS-795] - Generalize Checksums in REST
  • [FTS-796] - Generalize Checksums in Client
  • [FTS-984] - Create corresponding tests

Bug

  • [FTS-882] - Some data management methods can leave a proxy behind
  • [FTS-886] - Web UI is not adapted to the fact that t_server_config now supports config per vo
  • [FTS-910] - When configuring changes, make sure data hasn't been truncated
  • [FTS-964] - If max_active == min_active, setup the fix value
  • [FTS-967] - Make sure setting the range always return the new configuration
  • [FTS-982] - Config interface problem with firefox
  • [FTS-1004] - Remove se from javascript

Epic

  • [FTS-793] - Provide an Optimizer API

New Feature

  • [FTS-977] - Update fts-rest to the new config schema

Task

  • [FTS-987] - Update FTS documentation for FTS Rest CLI

Improvement

  • [FTS-661] - Add FTS-REST instance monitoring
  • [FTS-857] - REST on pilot gives json or html randomly
  • [FTS-965] - When setting the working range, bump the number of actives to min_active if lower
  • [FTS-1007] - Provide reason for the optimizer API

WebFTS 2.2.12

Bug

  • [FTS-902] - WebFTS news feed stopped working
  • [FTS-981] - WebFTS fails to delegate when the user certificate misses the X509v3 SKID

Task

  • [FTS-971] - Report error signing the CSR to the user

FTS 3.6.8

Bug

  • [FTS-919] - Permissions on Proxy file are too permissive for the LFC plugin to work
  • [FTS-920] - fts-client help misbehavior
  • [FTS-933] - fts-delegation-init --proxy does not work with just the file name
  • [FTS-935] - Improve some queries in the web monitoring
  • [FTS-945] - 3.6 breaks Dropbox integration

New Feature

  • [FTS-926] - Publish error codes
  • [FTS-929] - DB Clean binary should log progress
  • [FTS-930] - Upgrade script should double check t_hosts before running .sql diff

Task

  • [FTS-937] - improve performance of fts3.6.0 schema diff and provide partial upgrade script

Improvement

  • [FTS-932] - Drop "database statistics" view
  • [FTS-936] - Reorder group by in getQueuesWithPending to benefit from group by with index
  • [FTS-939] - Log when a message is sent

FTS 3.6.7

Bug

  • [FTS-906] - Change int user_filesize to long long

FTS 3.6.4

Improvement

  • [FTS-901] - Provide error reason in FAILED file state messages.
  • [FTS-904] - Provide user_filesize for raw_rate out of file_metadata.

FTS-Rest 3.6.3

Bug

  • [FTS-888] - Not allow automatic session reuse for unknown userfilesize
  • [FTS-893] - Create Auto session reuse configuration parameter (disable by default)

FTS 3.6.2

Bug

  • [FTS-879] - revertToSubmitted considered harmful
  • [FTS-883] - Wrong condition on reapStalledTransfers
  • [FTS-884] - --global-timeout was dropped from fts_url_copy
  • [FTS-885] - Staging start and finished timestamps are not sent in the messages
  • [FTS-887] - Session reuse + staging do not work well together
  • [FTS-889] - READY are not accounted for when checking if the transfer is allowed
  • [FTS-892] - When stream optimization is enabled, even if they are few transfers the number keeps growing

FTS 3.6.0

FTS

Sub-task

  • [FTS-830] - Publish error reason with FAILED state transitions
  • [FTS-831] - Prepend STAGING to the error message when caused on a staging operation
  • [FTS-832] - Publish start and end timestamps to state transitions as well

Epic

  • [FTS-828] - Provide extra information for staging performance analysis

Bug

  • [FTS-629] - Improve staging query
  • [FTS-718] - CLI should interpret nulls as nulls
  • [FTS-738] - fts-transfer-submit man page needs a refresh
  • [FTS-741] - Remove workaround for FTS-740
  • [FTS-773] - Consolidate default handling
  • [FTS-783] - Race condition with Producer inside MySqlAPI
  • [FTS-786] - If a transfer is to be marked as stalled, it better be killed
  • [FTS-791] - Tight loops when DB connection is lost
  • [FTS-797] - Cloud storage wildcard should be explicit (i.e '*')
  • [FTS-806] - Issue an SRM abort even if the bring online get status fails
  • [FTS-811] - Public share with 0 is automatically created if there is a link configuration
  • [FTS-816] - MySQL 5.7: ORDER BY clause is not in SELECT list
  • [FTS-835] - src_hostname and dst_hostname should not send the url schema
  • [FTS-840] - Deadlock between updateProtocol and updateFileTransferStatus
  • [FTS-841] - Incorrect timestamp for SUBMITTED state
  • [FTS-845] - Need a 404.html template
  • [FTS-849] - updateBringOnlineToken generates a bad query, and some files are left with an empty token
  • [FTS-853] - Draining ineffective

New Feature

  • [FTS-858] - Allow to disable cert verification

Task

  • [FTS-597] - Drop unused tables
  • [FTS-603] - Provide FTS via containers
  • [FTS-605] - Drop client side SOAP configuration
  • [FTS-780] - Provide backup duration in the logs
  • [FTS-792] - Drop snapshot API
  • [FTS-821] - Poll VOs to see which apparently unused functionalities are being used or will be
  • [FTS-824] - Drop t_server_sanity (unused)
  • [FTS-864] - Drop myosg-update
  • [FTS-865] - Reduce overview overhead

Improvement

  • [FTS-598] - Drop unused columns
  • [FTS-599] - Optimize database schema
  • [FTS-600] - Drop server side SOAP code
  • [FTS-617] - Redundant indexes
  • [FTS-621] - Use archive engine for t_*_backup tables
  • [FTS-671] - Restricted view for server logs in web monitoring
  • [FTS-727] - Remove workarounds for compatibility with schema 1.*
  • [FTS-770] - t_server_config values should be all picked per vo
  • [FTS-771] - Producer should connect using TLS
  • [FTS-772] - Remove dn from webmon
  • [FTS-779] - Do not print the user-dn on the url-copy logs
  • [FTS-782] - Heuristics for timeout is too short for small files
  • [FTS-807] - Make stalled timeout configurable, and set to 360 seconds
  • [FTS-808] - Log timeout events on Bring Online
  • [FTS-817] - Adapt to new database schema
  • [FTS-818] - 'credential' parameter removed from REST
  • [FTS-822] - Use ENUM for the states
  • [FTS-823] - Review queries
  • [FTS-827] - Replace EOT with a space on the messages
  • [FTS-847] - CLI should log warnings from CURL too
  • [FTS-859] - Remove wait timeout from storage blacklisting

Configuration Change

  • [FTS-843] - Change staging defaults to bulk of 500 and 400 requests

REST API

Bug

  • [FTS-546] - Cancel jobs when job_finished = NULL
  • [FTS-568] - FTS REST and VOMS RFC proxies
  • [FTS-734] - Fix schema reporting in REST API
  • [FTS-744] - Packaging: /var/log/fts3rest must be owned by fts3.fts3
  • [FTS-784] - Use always UTC for timestamp comparison in http
  • [FTS-798] - Client implementation of the delegation broken due to m2crypto API changes
  • [FTS-836] - fts-rest-http-authz-signed-cert error when comparing datetimes

New Feature

  • [FTS-705] - FTS can decide to enable or not session reuse depending on the size of the files contained on a job

Task

  • [FTS-408] - Consult roles for job listing
  • [FTS-603] - Provide FTS via containers
  • [FTS-792] - Drop snapshot API

Improvement

  • [FTS-727] - Remove workarounds for compatibility with schema 1.*
  • [FTS-781] - All server config now can be done per VO
  • [FTS-850] - Allow staging jobs for all protocols
  • [FTS-859] - Remove wait timeout from storage blacklisting

FTS 3.5.8

Bug

FTS-REST 3.5.4

Bug

  • [FTS-752] - Rest sends the SUBMITTED/STAGING with the hostname rather than the alias
  • [FTS-719] - useexisting is deprecated, switch to extend_existing
  • [FTS-722] - Requires python-requests

Improvement

  • [FTS-749] - 40x statuses are not service errors, so they should be logged as info

Pages