Revisions of python-fsspec
Ana Guerrero (anag+factory)
accepted
request 1165946
from
Dirk Mueller (dirkmueller)
(revision 33)
- update to 2024.3.1: * allow override of expand in open() * root handling in local file paths, fix for windows * coroutines throttle to stream pool rather than batches * write transactions in simplecache * allow deep nested refs in referenceFS/parquet * Fixes bug (#1476) that made open_files ignore expand=False * remove extra calling mapper contains * connection retry for SMB * zip64 should be on is allowZip64 is
Ana Guerrero (anag+factory)
accepted
request 1157039
from
Matej Cepl (mcepl)
(revision 32)
Forwarded request #1156422 from bnavigator - Update to 2024.2.0 ## Enhancements * add 9P known implementation (#1513) * allow TqdmCallback subclassing (#1497, 1480) * callbacks/branching kwargs handling and scopes (#1496, 1495, 1460) * add aluuxioFS to known implementations (#1469) * implement pipe_file for dirFS (#1465) ## Fixes * infer compression for .lzma files (#1514) * fix append to categorical/parquet references (#1510) * allow for FTP servers that list with leading "total" line (#1503) * convert FTP failure to FileNotFound (#1494) * out of order reference fix (#1492) * retry "backoff" response for DBFS (#1491) * referenceFS case for scalar arrays (#1487) * fix create_parents for SFTP (#1484) * fix local .ls() on files (#1479) * allow Path and similar in _expand_path (#1475) * make lazy references editable (#1468) * fix eq for abstract buffered files (#1466) * fit tqdm cleanup (#1463) * fix passing kwargs from cached file to underlying FS (#1462) ## Other * fix tests for supports_empty_directories=False (#1512) * don't read references in init for referenceFS (#1521) * code cleaning (#1518, 1502, 1499, 1493, 1481) * pass through "replication" for HDFS (#1486) * record more info for HTTP info() (#1483)
Ana Guerrero (anag+factory)
accepted
request 1138849
from
Markéta Machová (mcalabkova)
(revision 31)
Ana Guerrero (anag+factory)
accepted
request 1133605
from
Dirk Mueller (dirkmueller)
(revision 30)
- update to 2023.12.2: * top-level glob in ZIP (#1454) * append mode on local ZIP files/truncate (#1449) * restrict ":" as protocol marker to data: (#1452) * sftp relative paths (#1451) * http encoding in HTTP FS put_file (#1450) - update to 2023.12.1: * Remove trailing "/" from directory names in zipFS (#1445) * allow HTTP size guess in more circumstances (#1440) * allow kwargs passed to GUI to be dict (#1437) * transaction support for writing via a cache FS (#1434) * make cached FSs work better with async backends (#1429) * allow FSs to set their transaction implementation (#1424) * add dataFS (#1421, 1415) * allow basic auth in webHDFS (#1409) * in referenceFS, maintain order when some keys are omitted in cat (#1436) * nested subdirectory listing in referenceFS (#1433) * allow "=" in webHDF paths (#1428) * fix file mode to consistent "r+b" format (#1426) * pass on kwargs in HTTP glob (#1422) * allow Path in can_be_local and open_local (#1419, #1418) * fix parent for cachedFS (#1413) * "ends" list in _cat_ranges was incorrect (#1402)
Ana Guerrero (anag+factory)
accepted
request 1115766
from
Dirk Mueller (dirkmueller)
(revision 28)
- update to 2023.9.2: * revert #1358: auto_mkdir in open() (#1365) * code style updates (#1373, 1372, 1371, 1370, 1369, 1364) * update CI setup (#1386) - 2023.9.1 * #1353, save file cache metadata in JSON * #1352, remove some unnecessary list iterations * #1361, re-allow None for default port for SMB * #1360, initialising GUI widget FS with kwargs * #1358, pass auto_mkdir vi url_to_fs again * #1354, auto delete temp cache directory - 2023.9.0 * #1346, add ocilake protocol * #1345, implement async-sync and async-async generic cp and rsync * #1344, add lakefs protocol * #1337 add goatcounter to docs * #1323, 1328, add xethub protocol * #1320, in HTTP, check content-encoding when getting length * #1303, add on_error in walk * #1302, add dirfs attribute to mappers * #1293, configure port for smb * #1349, don't reorder paths in bulk ops if source and dest are both lists * #1333, allow mode="x" in get_fs_token_paths * #1324, allow generic to work with complex URLs * #1316, exclude bytes-cache kwargs in url_to_fs * #1314, remote utcnow/utcfromtimestamp * #1311, dirFS's protocol * #1305, use get_file rather than get in file caching
Fabian Vogt (favogt_factory)
accepted
request 1097061
from
Daniel Garcia (dgarcia)
(revision 27)
- Update to 2023.6.0 # Enhancements * #1259, add maxdepth fo cp/get/put * #1263, allow dir modification during walk() * #1264, add boxfs to registry * #1266, optimise referenceFS lazy lookups, especially for writing parquet * #1287, 1288 "encoding" for FTP # Fixes * #1273, (re)allow reading .zstd reference sets * #1275, resource.error for win32 * #1278, range reads in dbfs * #1282, create parent directories in get_file * #1283, off-by-one in reference block writing * #1286, strip protocol in local rm_file # Other * #1267, async bulk tests * #1268, types and mypy * #1277, 1279, drop outdated forms io.open, IOError
Dominique Leuenberger (dimstar_suse)
accepted
request 1089793
from
Dirk Mueller (dirkmueller)
(revision 26)
- update to 2023.5.0: * #1236, allow writing ReferenceFS references directly to parquet * #1255, copy of glob to single output directory * #1254, non-recursive copy of directory (no-op) * #1253, cleanup fix on close of ZIP FS * #1250, ignore dirs when copying list of files * #1249, don't error on register without clobber is registering same thing again * #1245, special case for other_files and relative path * Other * #1248, add test harness into released wheel package * #1247, docs and tests around common bulk file operations * 2023.4.0 * #1225, comprehensive docs of expected behaviour of cp/get/put and tests * #1216, test harness for any backend * #1224, small fixes in reference and dask FSs * #1218, mv is no-op when origin and destination are the same * #1217, await in AbstractStreamedFile * #1215, docbuild fixes * #1214, unneeded maxdepth manipulation in expand_path * #1213, pyarros and posixpath related test fixes * #1211, BackgroundBlockCache: keep a block longer if not yet used * #1210, webHDFS: location parameter * Other * #1241, add HfFileSystem to registry * #1237, register_implementation clobber default changes to False
Dominique Leuenberger (dimstar_suse)
accepted
request 1076836
from
Dirk Mueller (dirkmueller)
(revision 25)
Dominique Leuenberger (dimstar_suse)
accepted
request 1074477
from
Dirk Mueller (dirkmueller)
(revision 24)
Dominique Leuenberger (dimstar_suse)
accepted
request 1036969
from
Dirk Mueller (dirkmueller)
(revision 23)
Dominique Leuenberger (dimstar_suse)
accepted
request 1032652
from
Matej Cepl (mcepl)
(revision 22)
- Update to 2022.10.0 Enhancements * referenceFS consolidates reads in the same remote file (#1063) * localfs: add link/symlink/islink (#1059) * asyncfs: make mirroring methods optional (#1054) * local: info: provide st_ino and st_nlink from stat (#1053) * arrow_hdfs replaces hdfs (#1051) * Add read/write_text (#1047) * Add pipe/cat to genericFS (#1038) Fixes * SSH write doesn’t return number of bytes (#1072) * wrap flush method for LocalFileOpened (#1070) * localfs: fix support for pathlib/os.PathLike objects in rm (#1058) * don’t get_file remote FTP directory (#1056) * fix zip write to remote (#1046) * fix zip del following failed init (#1040) Other * add asynclocalfs to the registry (#1060) * add DVCFileSystem to the registry (#1049) * add downstream tests (#1037) * Don’t auto-close OpenFiles (#1035)
Dominique Leuenberger (dimstar_suse)
accepted
request 1010953
from
Markéta Machová (mcalabkova)
(revision 21)
Dominique Leuenberger (dimstar_suse)
accepted
request 973298
from
Markéta Machová (mcalabkova)
(revision 19)
Dominique Leuenberger (dimstar_suse)
accepted
request 949718
from
Benjamin Greiner (bnavigator)
(revision 17)
- Update to 2022.1.0 * Fix blocks cache metadata (#746) * Fix default SMB port (#853) * Fix caching fixes (#856, 855) * Fix explicit close for http files (#866) * Fix put_file to continue when no bytes (#869, 870) * temporary files location (#851, 871) * async abstract methods (#858, 859, 860) * md5 for FIPS (#872) * remove deprecated pyarrow/distutils (#880, 881) - Update flavored requirements: python36 no longer exists, python-distributed does not support python310 yet.
Dominique Leuenberger (dimstar_suse)
accepted
request 942710
from
Dirk Mueller (dirkmueller)
(revision 16)
Displaying revisions 1 - 20 of 33