We may have answered our own question having gained familiarity with the Lagotto system.
After we logged in with admin priviledge we found that all our articles for 2016 were being rejected as invalid by ActiveRecord which alerted with a year range of 1650-2015. That was for rake db:articles:load < doi_export.csv file. Articles entered manually using the admin pages passed validation and entered the database and are now acquiring metrics.
We have found the source of the validation (app/models/article.rb) which uses Time.zone.now.year. This function looks to be sometimes returning the value '2015' even though it is now 2016 - for reason unknown. We suspect we should update from 3.9 to the latest version.
(original question for reference)
*Sorry to address this to you directly - I think our problem is probably something very simple but I am getting stuck finding detailed help and the solution.
Our organisation has been using Lagotto for some time but we have no expertise in it. I think we are still running v 3.9.1 and it is too risky and time-consuming to upgrade.
Our last few attempts to load details of our recent articles using the rake db:articles:load command have been failing i.e. the alm_production/articles database does not show any articles from 2016 and lagotto status page shows same number of articles as before. I did not find any useful log messages which might have told me why.
I suspect a character encoding issue. Our input file of doi/date/title lines comes either from ctrl-A of a webpage or from file created using wget. Looking into the code it appears Lagotto does very little format checking but does transcode from windows_1252 to UTF-8. Could this be the problem?
I am not finding details of this particular issue on the forum so I am drilling down into the code which is difficult as I am not a ruby coder. It would be very helpful if there were detailed guidance somewhere or a way to get a debug/log message as to why the lagotto system rejects an input line.
any help very much appreciated,
PS: I have found http://www.lagotto.io/docs/setup/ and will also try to queue of a single doi when I have access to our system.*