Description

When using Zend_Translate inside a SVN repository, depending how big it is, you may fall into a situation where the amount of opened files is bigger than environment is allowed, even though you may only have 2 translation files.

UnexpectedValueException: RecursiveDirectoryIterator::__construct(/path/to/my_project/application/languages/en/.svn/tmp/prop-base): failed to open dir: Too many open files

To fix this, it is required to strip the .svn files before RecursiveIteratorIterator, because internally it uses a FilterIterator which holds the file pointers until the end of scope.

@thomas
In which cases does it break? I think it's possible to fix it.
Problem is that E_FATAL happens during RecursiveIteratorIterator, so it's not possible to simply add it to ignore.

@ramon
No way. The E_FATAL does not happen during RecursiveDirectoryIterator, but inside RecursiveIteratorIterator. The problem blows up internally, because it uses the FilterIterator, which is where it explodes.

@guilherme
See a example of bc break http://pastebin.com/VzpkZXk0.
The problem is with the option scan = directory, because after r24215 was deleted the second argument(the mode) of RecursiveIteratorIterator::__construct() that was the following RecursiveIteratorIterator::SELF_FIRST.
Is need return the parents too(dir) to that meets the condition (Zend_Translate_Adapter in line 276).

Greetings,
Ramon

Posted by Thomas Weidner (thomas) on 2011-07-24T19:44:12.000+0000

As said directory scanning does not work anymore within the latest released version.
The language is not set which is caused by the BC you integrated within my component.

See the two linked issues for details on reproduction.
See pull request 259 for the fix within ZF2.

Please backport this fix within ZF1 to make this component work properly again.

@Thomas Your patch only fixes a small part of the problem.
There're some specific folders (like .cvs, .svn) that are not related to user customized ignore list. Your patch sounds valid to fix user issues, but not this one. We'd have to always include the ignore for these folders, that's why your PR is not useless. It can be used, for sure.

I'm fixing the issue myself by applying the proposed patch of @Christoph.

@Thomas your proposal is still valid here, but since it does not refer to actual issue, but rather an enhancement to "ignore" support, I'm marking this ticket as resolved by now.

Posted by Thomas Weidner (thomas) on 2011-07-25T18:38:29.000+0000

@Guilherme:
You seem not to understand what my change does and how it works nor how the component itself works in detail.

The ignore option has been added in past to prevent all "." directories from being scanned.
This includes per default also all other "." directories like ".hudson" or the hidden "." directories from windows.
On the other hand a user can change the ignore option in a way that it still scans a ".svn" or any other wished directory.
The "ignore" option prevents scanning for all directories BEGINNING with the given string. This includes ".svn" and ".cvs".

Your change makes it impossible for a user to scan the directories he whishes to use. This is a potentional BC as it erases existing functionallities.

Only because I work on ZF2 and try to add additional benefits as component author does not mean that I don't know what I do.

@Thomas
It was never my intention on my words to sound like you don't know what you do. Quite the opposite.

The point I referred previously is that "ignore" option never worked well, mostly because the possible script break have already happened.
To be useful, the "ignore" option must be added between the RecursiveDirectoryIterator and RecursiveIteratorIterator, because it's in the latter that script breaks.

I already saw your patch, and I agree with your proposal. The option to be part of RegExIterator is extremely valid, simplifying the operation of FilterIterator used internally by RecursiveIteratorIterator. Then again, that's why I mentioned to your your patch is still valid, because it fixes the "ignore" problem. But then again, "ignore" must still have default values and not only user values.

But getting stick to the bug, the reported issue is the missing flag on RecursiveIteratorIterator. For a simple solution, adding it is enough to have my issue fixed and recently opened ones fixed too. The enhancements related to "ignore" can be surely merged, but that is a bigger patch, which may take more time to me merged/fixed.

Sorry, but it was never my intention to make you angry. I just want to have a patch that fixes my problem and also do not break existent functionality. I just don't wanted to have my issue reverted because it would solve some reported issues, but would make mine active again.

Cheers,

Posted by Thomas Weidner (thomas) on 2011-07-25T19:45:18.000+0000

I'm not angry.

The point is that the default value for the ignore option is "." since this feature has been added. This includes ".svn" and ".cvs" directories as those begin with ".".

But default values must be overwriteable. This functionallity has been deleted by your change. That's what I wrote you about and what I was aware of for ZF2.

Additionally I would ask you not to take over issues which have been marked as in progress as this means that someone is already working on them.