From last few days I was wondering why this internal variable (Internal.Job.Filename.Dire... is always empty in my development environment. The documentation at http://wiki.pentaho.com/dis... says these variable will be always defined. But it was not in my case. After lot of time spent debugging and breaking my head I found that these variables are set only if you do not use the repository. In my case I was using a file based repository which was causing this issue. By disconnecting ......
Many articles on implementing a loop in PDI suggest to put a ‘Wait For’ step and join the output hop back to a previous step. Something as suggested by below screen shot: But I would like to warn about this implementation of looping that this causes recursive stack allocation by JVM during job execution and the system may run out of memory after a high number of iterations (depending the system available available memory). In a test run on my laptop in which I continuously ran the above job with ......
Context: Recently I got a chance to get introduced to Kettle, due to a new project which requires ingesting huge and dynamic data files using PDI in a data warehouse. I have a good experience working with Microsoft technology stack - .NET Framework, C#, SQL Server, SSIS. The idea of open source has always been fascinating to me but I have not worked much with open source tools. So, working with PDI is quite a different experience for me. I liked the continuous evolution of PDI and the capabilities ......