Reading Directory . Input/output Error S3fs
Contents |
Sign in Pricing Blog Support Search GitHub This repository Watch 107 Star 1,461 Fork 231 s3fs-fuse/s3fs-fuse Code s3fs logs Issues 87 Pull requests 1 Projects 0 Wiki Pulse Graphs
S3fs Latest Version
New issue ls: reading directory .: Input/output error on top level directory #197 Open kabads opened
S3fs Permission Denied
this Issue Jun 19, 2015 · 6 comments Labels None yet Milestone No milestone Assignees No one assigned 5 participants kabads commented Jun 19,
S3fs Mount Permissions
2015 root@myserver:/srv/s3# ls ls: reading directory .: Input/output error This is only for the first top-level directory. I can cd in to the next directory down and start to ls there. I have seen other bugs that are similar to this - but not exactly the same issue as mine. This is a s3fs unmount stock ubuntu 14.04 machine with s3fs version 1.78 with openssl. Any ideas what can be wrong with this top level dir? andrewgaul commented Jun 19, 2015 @kabads Can you run s3fs with the -d -d -f -o f2 -o curldbg flags and report any errors? kabads commented Jun 20, 2015 I have redacted my bucket name: Connection #0 to host mybucket.s3-eu-west-1.amazonaws.com left intact MultiRead(3481): failed a request(403: http://mybucket.s3-eu-west-1.amazonaws.com/%7EVersionArchive/) multi_head_retry_callback(2170): Over retry count(3) limit(/~VersionArchive/). readdir_multi_head(2246): error occuered in multi request(errno=-5). s3fs_readdir(2301): readdir_multi_head returns error(-5). unique: 24, error: -5 (Input/output error), outsize: 16 unique: 25, opcode: RELEASEDIR (29), nodeid: 1, insize: 64, pid: 0 unique: 25, success, outsize: 16 enmatt commented Jun 25, 2015 I've noticed that when there are merely folders in the directory, ls works fine. If there are standard files inside the directory I too am getting the error. I can touch a file, and receive the error, but see that file was uploaded to th
here for a quick overview of the site Help Center Detailed answers to any questions you might have Meta Discuss the workings and policies of this site About Us Learn more about Stack Overflow the company Business Learn more about hiring ls: reading directory .: input/output error developers or posting ads with us Stack Overflow Questions Jobs Documentation Tags Users Badges Ask Question input output error linux x Dismiss Join the Stack Overflow Community Stack Overflow is a community of 6.2 million programmers, just like you, helping each other. Join them; it only takes a minute: Sign up ls: reading directory ./: Input/output error via S3FS up vote 2 down vote favorite I have a bucket with more than ten thousand files. I am getting the following error while doing https://github.com/s3fs-fuse/s3fs-fuse/issues/197 'ls -l' folder but working fine for less than 1000 files in the folder. Any suggestions? ls: reading directory ./: Input/output error I notice that each listing of a file in folder makes an http call to S3, any chance this # can be increased? Thanks! amazon-web-services amazon-s3 amazon-ec2 s3fs share|improve this question asked May 30 '13 at 2:50 Ma Diga 10618 I'd recommend to avoid such abusive situations and use sub-directories in S3 –yegor256 Jun 3 http://stackoverflow.com/questions/16827192/ls-reading-directory-input-output-error-via-s3fs '13 at 18:32 add a comment| 1 Answer 1 active oldest votes up vote 0 down vote I would like to recommend to take a look at the new project RioFS (Userspace S3 filesystem): https://github.com/skoobe/riofs. This project is “s3fs” alternative, the main advantages comparing to “s3fs” are: simplicity, the speed of operations and bugs-free code. Currently the project is in the “testing” state, but it's been running on several high-loaded fileservers for quite some time. We are seeking for more people to join our project and help with the testing. From our side we offer quick bugs fix and will listen to your requests to add new features. RioFS should work fine with such great number of files per directory, but please try to increase the directory caching timeout in the configuration file (see dir_cache_max_time description in riofs.conf.xml) Hope it helps you and we are looking forward to seeing you joined our community ! share|improve this answer answered Jul 16 '13 at 16:39 Wizzard 903514 add a comment| Your Answer draft saved draft discarded Sign up or log in Sign up using Google Sign up using Facebook Sign up using Email and Password Post as a guest Name Email Post as a guest Name Email discard By posting your answer, you agree to the privacy policy and terms of service. Not the answer you're looking for? Browse other questions tagged amazon-web-services amazon-s3 amazon-ec2 s3fs
GoogleВойтиСкрытые поляПоиск групп или сообщений