macressler / alfresco-bulk-filesystem-import Goto Github PK

Ideally the BasicMetadataLoader would read the creation and modification 
timestamps of the files and folders as they are on disk, and default the 
equivalent properties in the repository to those same values (for which there 
are separate challenges described in issue #4).

Currently this is not easily achieved in Java, although JSR 203 [1], slated for 
JDK 1.7 is supposed to address this.

For now I'll park this issue here, and revisit when/if JSR 203 sees the light 
of day.

[1] http://jcp.org/en/jsr/detail?id=203

What steps will reproduce the problem?
1. Select a local folder to import
2. Use "/Company Home" as destination

What is the expected output? What do you see instead?
You should be able to import files to the company home root, but this 
results in a server error. Choosing to go to "/Company Home/foldername" 
works as expected.

What version of the product are you using? On what operating system?
0.6, Windows Server 2008 r2

Examples might include:
* bytes read
* bytes written
* elapsed time
* succeeded / failed indicator (see issue #5)

Currently if the cm:created or cm:modified properties are set, the
repository ignores them.

While this is standard Alfresco behaviour, there are some tools (notably
the ACP file import tool) that appear to be able to get around this issue.

Further investigation is needed to determine how they accomplish this, and
use the same technique in the bulk filesystem metadata loader.

Currently the bulk filesystem importer halts ingestion if any I/O errors
occur.  It may be worth considering a more lenient policy, whereby the
process simply skips the problematic file and continues.

This may well be important in the case where Java is unable to determine
whether a file is readable or not (java.io.File.canRead() - used by the
code already) and instead throws SecurityExceptions when the file is opened.

What steps will reproduce the problem?
1. Do an import
2. click "initiate another import" and do another import 
3. Status page shows earlier time, source, and target (see attached)

What is the expected output? What do you see instead?

Both imports succeed, but
I expect the status page to reflect the current import

Not sure if this is a cached page or if only some fields show earlier values

What version of the product are you using? On what operating system?
Importer v10
Browser on PC Firefox/IE and Ubuntu Firefox
Alfresco runs on Red Hat Enterprise 5.5

Please provide any additional information below.

The target/source for the first import are as shown in the attached status page.
The source for the second import is 
/var/lib/alfresco/staff/bulk_import_tests/metadata_only/52 and the target is as 
above

Note also that the status page says "(metadata)" after "Last folder or file 
processed" though there is no metadata in the stated folder from the previous 
import (but the current, successful import is metadata only)

It would be useful to be able to provide metadata for a set of content files 
being imported as a single spreadsheet (tab-delimited text file). File name and 
path in metadata record would link metadata with content file.

Test various dimensions to see how they affect performance, both of the
ingestion process and concurrent repository activity:
* Multi-threaded vs single-threaded (hypothesis: multi-threaded is faster,
but creates more contention)
* Different batch sizes (hypothesis: larger batches are faster, but create
more contention)

What steps will reproduce the problem?
1. Intall Alfresco 3.3
2. Apply the ampy
3. Start Alfresco

What is the expected output? What do you see instead?
Alfresco starts as normal. Instead, I get: 

4:12:56,750 ERROR [org.springframework.web.context.ContextLoader] Context
initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating
bean with name 'LuceneFullTextSearchIndexer' defined in class path resource
[alfresco/core-services-context.xml]: Cannot resolve reference to bean
'luceneFullTextSearchIndexer' while setting bean property 'target'; nested
exception is org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'luceneFullTextSearchIndexer' defined in class path
resource [alfresco/core-services-context.xml]: Initialization of bean
failed; nested exception is
org.springframework.beans.factory.CannotLoadBeanClassException: Error
loading class
[org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebS
cript]
for bean with name
'webscript.org.alfresco.extension.bulkfilesystemimport.initiate.get'
defined in URL
[jar:file:/var/lib/tomcat6/webapps/alfresco/WEB-INF/lib/alfresco-bulk-filesystem
-import-0.7.jar!/alfresco/extension/bulk-filesystem-import-web-scripts-context.x
ml]:
problem with class file or dependent class; nested exception is
java.lang.NoClassDefFoundError: org/alfresco/web/scripts/AbstractWebScript
        at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveRef
erence(BeanDefinitionValueResolver.java:328)
        at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveVal
ueIfNecessary(BeanDefinitionValueResolver.java:106)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.app
lyPropertyValues(AbstractAutowireCapableBeanFactory.java:1305)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.pop
ulateBean(AbstractAutowireCapableBeanFactory.java:1067)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doC
reateBean(AbstractAutowireCapableBeanFactory.java:511)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.cre
ateBean(AbstractAutowireCapableBeanFactory.java:450)
        at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(Abstra
ctBeanFactory.java:290)
        at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingle
ton(DefaultSingletonBeanRegistry.java:222)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Abstract
BeanFactory.java:287)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBe
anFactory.java:189)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstanti
ateSingletons(DefaultListableBeanFactory.java:540)
        at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactory
Initialization(AbstractApplicationContext.java:842)
        at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractA
pplicationContext.java:416)
        at
org.springframework.web.context.ContextLoader.createWebApplicationContext(Contex
tLoader.java:261)
        at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextL
oader.java:192)
        at
org.springframework.web.context.ContextLoaderListener.contextInitialized(Context
LoaderListener.java:47)
        at
org.alfresco.web.app.ContextLoaderListener.contextInitialized(ContextLoaderListe
ner.java:63)
        at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3934
)
        at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4429)
        at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
        at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
        at
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526)
        at
org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:630)
        at
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:556)
        at
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:491)
        at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1206)
        at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:314)
        at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.ja
va:119)
        at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
        at org.apache.catalina.core.StandardHost.start(StandardHost.java:722)
        at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
        at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
        at
org.apache.catalina.core.StandardService.start(StandardService.java:516)
        at
org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:583)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:177)
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'luceneFullTextSearchIndexer' defined in class path
resource [alfresco/core-services-context.xml]: Initialization of bean
failed; nested exception is
org.springframework.beans.factory.CannotLoadBeanClassException: Error
loading class
[org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebS
cript]
for bean with name
'webscript.org.alfresco.extension.bulkfilesystemimport.initiate.get'
defined in URL
[jar:file:/var/lib/tomcat6/webapps/alfresco/WEB-INF/lib/alfresco-bulk-filesystem
-import-0.7.jar!/alfresco/extension/bulk-filesystem-import-web-scripts-context.x
ml]:
problem with class file or dependent class; nested exception is
java.lang.NoClassDefFoundError: org/alfresco/web/scripts/AbstractWebScript
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doC
reateBean(AbstractAutowireCapableBeanFactory.java:519)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.cre
ateBean(AbstractAutowireCapableBeanFactory.java:450)
        at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(Abstra
ctBeanFactory.java:290)
        at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingle
ton(DefaultSingletonBeanRegistry.java:222)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Abstract
BeanFactory.java:287)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBe
anFactory.java:189)
        at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveRef
erence(BeanDefinitionValueResolver.java:322)
        ... 44 more
Caused by: org.springframework.beans.factory.CannotLoadBeanClassException:
Error loading class
[org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebS
cript]
for bean with name
'webscript.org.alfresco.extension.bulkfilesystemimport.initiate.get'
defined in URL
[jar:file:/var/lib/tomcat6/webapps/alfresco/WEB-INF/lib/alfresco-bulk-filesystem
-import-0.7.jar!/alfresco/extension/bulk-filesystem-import-web-scripts-context.x
ml]:
problem with class file or dependent class; nested exception is
java.lang.NoClassDefFoundError: org/alfresco/web/scripts/AbstractWebScript
        at
org.springframework.beans.factory.support.AbstractBeanFactory.resolveBeanClass(A
bstractBeanFactory.java:1211)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.pre
dictBeanType(AbstractAutowireCapableBeanFactory.java:568)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.isFactoryBean(Abst
ractBeanFactory.java:1277)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanName
sForType(DefaultListableBeanFactory.java:302)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeansOfT
ype(DefaultListableBeanFactory.java:381)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeansOfT
ype(DefaultListableBeanFactory.java:375)
        at
org.alfresco.repo.search.impl.lucene.fts.FullTextSearchIndexerImpl.setBeanFactor
y(FullTextSearchIndexerImpl.java:247)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.inv
okeAwareMethods(AbstractAutowireCapableBeanFactory.java:1422)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.ini
tializeBean(AbstractAutowireCapableBeanFactory.java:1389)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doC
reateBean(AbstractAutowireCapableBeanFactory.java:512)
        ... 50 more
Caused by: java.lang.NoClassDefFoundError:
org/alfresco/web/scripts/AbstractWebScript
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
        at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
        at
org.apache.catalina.loader.WebappClassLoader.findClassInternal(WebappClassLoader
.java:1850)
        at
org.apache.catalina.loader.WebappClassLoader.findClass(WebappClassLoader.java:89
0)
        at
org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:13
54)
        at
org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:12
33)
        at org.springframework.util.ClassUtils.forName(ClassUtils.java:258)
        at
org.springframework.beans.factory.support.AbstractBeanDefinition.resolveBeanClas
s(AbstractBeanDefinition.java:408)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.doResolveBeanClass
(AbstractBeanFactory.java:1229)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.resolveBeanClass(A
bstractBeanFactory.java:1200)
        ... 59 more
Caused by: java.lang.ClassNotFoundException:
org.alfresco.web.scripts.AbstractWebScript
        at
org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:13
87)
        at
org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:12
33)
        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
        ... 70 more



What version of the product are you using? On what operating system?
CentOS5, Alfresco Community Edition 3.3

Please provide any additional information below.

Alfresco starts as normal after install 3.3. I add the amp using: 
java -jar alfresco-mmt-3.3.jar install
alfresco-bulk-filesystem-import-0.7.amp 
/usr/share/tomcat6/webapps/alfresco.war

I clear out /var/lib/tomcat/webapps/alfresco

restart tomcat, and the error above is generated. If I then clear out
/alfresco, delete alfresco.war and use the backup (generated from the mmt)
alfresco starts as usual again.

Was working fine under 3.2r.

Thanks,

Tom.

Add support to the loader so that "naked" metadata files (ie. metadata files 
that don't have a matching content file) that have an associated file already 
in the repository (eg. which had been previously loaded) get processed.

What steps will reproduce the problem?
1. Not sure 
2.
3.

What is the expected output? What do you see instead?

I was trying to import a directory into a Share site using the importer's form

What version of the product are you using? On what operating system?

0.9 
Firefox on Ubuntu
Please provide any additional information below.

Might be connected with caching problem

Implement a metadata loader that reads from a "shadow" metadata file in
YAML format.

Examples:
* number of metadata files read
* number of metadata files loaded
* number of metadata files skipped
* size in bytes of metadata files read

Import tool does not work.  It will say it is ingesting files in the log, 
but does not actually do it. No errors are thrown, and the status page 
shows the number of files handled.  All I end up with is a file structure 
with the proper folders but all the files are 0KB.  Click on a file in 
Alfresco Explorer, and you'll get a message akin to:

The node's content is missing: 
   node: workspace://SpacesStore/fe937bdc-86fe-45c3-9d3a-b61d9603cdaa 
   reader: null  
Please contact your system administrator.

If you load the same files through the Alfresco Explorer Web Client, it 
will work perfectly.

Software Versions
=================

OS
--
Ubuntu 9.10 x86_64 Intel


Alfresco
--------
Fresh install of Alfresco Community 3.2r2 on Alfresco 9.10 x86_64
0.5 version of the bulk file import plugin

OpenOffice
----------
OpenOffice.Org 3.1 as installed by default on Ubuntu 9.10

Java 
----
Java(TM) SE Runtime Environment (build 1.6.0_15-b03)
Java HotSpot(TM) 64-Bit Server VM (build 14.1-b02, mixed mode)

MySQL
-----
Stock server 5.1 loaded with Ubuntu 9.10, no changes made to default 
config.

Need to implement a metadata loader that can read from XML files.

Currently when a file or folder already exists in the repository, it's type
is not modified (even if a Metadata Loader reports that it has a different
type).

Requires further thought on how to handle the case where the new type is
not a subclass of the existing type (in which case type specialisation is
not applicable).

Hi,

i see at startup failures while loading the module (see attachment).

It is a fresh Install 
(http://www.howtoforge.com/how-to-install-alfresco-community-3.3-on-ubuntu-serve
r-10.04-lucid-lynx).

Con

Environment:
* Mac OSX 10.6
* MySQL 5.1.44
* Alfresco Enterprise 3.2r

What steps will reproduce the problem?
1. create a folder with punctuation characters in the name (specifically, the 
parenthesis (,) characters)
2. instruct the bulk importer to load content from that folder

What is the expected output?
* Content is loaded normally

What do you see instead?
* 500 error:

The Web Script /alfresco/service/bulk/import/filesystem/initiate  has responded 
with a status of 500 - Internal Error.

500 Description:    An error inside the HTTP server which prevented it from 
fulfilling the request.

Message:    03260001 Time of failure: Mon Apr 26 15:36:47 PDT 2010 Host where 
failure occurred: zigzag.local (192.168.1.196) Root exception: 
org.alfresco.service.cmr.model.FileNotFoundException: File not found: at 
org.alfresco.repo.model.filefolder.FileFolderServiceImpl.resolveNamePath(FileFol
derServiceImpl.java:913) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25) at java.lang.reflect.Method.invoke(Method.java:597) at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils
.java:304) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(Ref
lectiveMethodInvocation.java:182) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:149) at 
org.alfresco.repo.model.filefolder.TempFileMarkerInterceptor.invoke(TempFileMark
erInterceptor.java:83) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.model.ml.MLContentInterceptor.invoke(MLContentInterceptor.java
:131) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.model.filefolder.MLTranslationInterceptor.invoke(MLTranslation
Interceptor.java:211) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
net.sf.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invo
ke(MethodSecurityInterceptor.java:80) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor
.invoke(ExceptionTranslatorMethodInterceptor.java:49) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.jav
a:148) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(Transa
ctionInterceptor.java:106) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.j
ava:204) at $Proxy65.resolveNamePath(Unknown Source) at 
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebSc
ript.convertPathToNodeRef(BulkFilesystemImportWebScript.java:203) at 
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebSc
ript.execute(BulkFilesystemImportWebScript.java:135) at 
org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(Repositor
yContainer.java:335) at 
org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(Reposit
oryContainer.java:439) at 
org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContai
ner.java:303) at 
org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:306)

at 
org.alfresco.web.scripts.servlet.WebScriptServletRuntime.executeScript(WebScript
ServletRuntime.java:178) at 
org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:183)
 at 
org.alfresco.web.scripts.servlet.WebScriptServlet.service(WebScriptServlet.java:
122) at 
javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt
erChain.java:290) at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.
java:206) at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2
33) 
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1
91) at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) 
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) 
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109
) at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr
otocol.java:583) at 
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) 
at java.lang.Thread.run(Thread.java:637)

Exception:  org.alfresco.service.cmr.model.FileNotFoundException - File not 
found:

    org.alfresco.repo.model.filefolder.FileFolderServiceImpl.resolveNamePath(FileFolderServiceImpl.java:913)
    sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
    org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
    org.alfresco.repo.model.filefolder.TempFileMarkerInterceptor.invoke(TempFileMarkerInterceptor.java:83)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.alfresco.repo.model.ml.MLContentInterceptor.invoke(MLContentInterceptor.java:131)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.alfresco.repo.model.filefolder.MLTranslationInterceptor.invoke(MLTranslationInterceptor.java:211)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    net.sf.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:80)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor.invoke(ExceptionTranslatorMethodInterceptor.java:49)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.java:148)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
    org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
    org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    $Proxy65.resolveNamePath(Unknown Source)
    org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebScript.convertPathToNodeRef(BulkFilesystemImportWebScript.java:203)
    org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebScript.execute(BulkFilesystemImportWebScript.java:135)
    org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(RepositoryContainer.java:335)
    org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(RepositoryContainer.java:439)
    org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContainer.java:303)
    org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:306)
    org.alfresco.web.scripts.servlet.WebScriptServletRuntime.executeScript(WebScriptServletRuntime.java:178)
    org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:183)
    org.alfresco.web.scripts.servlet.WebScriptServlet.service(WebScriptServlet.java:122)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
    org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
    org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
    org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
    org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
    org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845)
    org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
    org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
    java.lang.Thread.run(Thread.java:637)

Exception:  org.alfresco.web.scripts.WebScriptException - 03260001 Time of 
failure: Mon Apr 26 15:36:47 PDT 2010 Host where failure occurred: zigzag.local 
(192.168.1.196) 
Root exception: org.alfresco.service.cmr.model.FileNotFoundException: File not 
found: at 
org.alfresco.repo.model.filefolder.FileFolderServiceImpl.resolveNamePath(FileFol
derServiceImpl.java:913) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method) at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25) at 
java.lang.reflect.Method.invoke(Method.java:597) at 
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils
.java:304) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(Ref
lectiveMethodInvocation.java:182) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:149) at 
org.alfresco.repo.model.filefolder.TempFileMarkerInterceptor.invoke(TempFileMark
erInterceptor.java:83) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.model.ml.MLContentInterceptor.invoke(MLContentInterceptor.java
:131) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.model.filefolder.MLTranslationInterceptor.invoke(MLTranslation
Interceptor.java:211) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
net.sf.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invo
ke(MethodSecurityInterceptor.java:80) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor
.invoke(ExceptionTranslatorMethodInterceptor.java:49) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.jav
a:148) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(Transa
ctionInterceptor.java:106) at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171) at 
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.j
ava:204) at $Proxy65.resolveNamePath(Unknown Source) at 
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebSc
ript.convertPathToNodeRef(BulkFilesystemImportWebScript.java:203) at 
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebSc
ript.execute(BulkFilesystemImportWebScript.java:135) at 
org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecute(Repositor
yContainer.java:335) at 
org.alfresco.repo.web.scripts.RepositoryContainer.transactionedExecuteAs(Reposit
oryContainer.java:439) at 
org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContai
ner.java:303) at 
org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:306)

at 
org.alfresco.web.scripts.servlet.WebScriptServletRuntime.executeScript(WebScript
ServletRuntime.java:178) at 
org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:183)
 at 
org.alfresco.web.scripts.servlet.WebScriptServlet.service(WebScriptServlet.java:
122) at 
javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt
erChain.java:290) at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.
java:206) at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2
33) 
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1
91) at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) 
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) 
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109
) at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Pr
otocol.java:583) at 
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) 
at java.lang.Thread.run(Thread.java:637)

    org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFilesystemImportWebScript.execute(BulkFilesystemImportWebScript.java:166)

Server: Alfresco Enterprise v3.2.0 (r 416) schema 3,400
Time:   Apr 26, 2010 3:36:47 PM

Add support for loading multiple versions of a single asset (useful in
cases where an existing version history needs to be migrated into Alfresco
intact).

Great suggestion from Steve Reiner:

Integrate this into the Share UI's pluggable administration console.

Currently the properties file metadata loader doesn't support multi-valued
properties.  Need to decide how to represent them in the properties file
(comma separated?) and then update the code to ensure they get set correctly.

While an import is in progress the bulk status bean seems to capture reads
and writes out of order.  For example sometimes the number of writes is
higher than the number of reads (which makes no sense).

I think the issue is due to where in the code reads and writes are counted
(ie. reads are only counted *after* a write succeeds), but this needs a bit
more investigation.

Currently errors aren't reported via the status bean (or the status Web
Script that renders it as HTML).

What steps will reproduce the problem?
1. do multiple imports using the "initiate new import" link
2.
3.

What is the expected output? What do you see instead?

Sometimes an older status page is returned and import does not occur
Not prompted for login when session may have expired

What version of the product are you using? On what operating system?

0.9 Firefox browser on Ubuntu

Please provide any additional information below.
Browser will accept no cache directive in html pages. Can this be added to 
status page and form?

Add support for associations in metadata loaders.  Will require a two-pass
process (first pass loads all the content, second pass wires up the
associations between those content items).

Using the provided pom.xml file leads to download errors. The plugin should use 
the official 
Alfresco maven repository http://maven.alfresco.com/

Adding an XML template to the status Web Script will make it easier to query 
the status of the bulk filesystem import tool from external tools.

This is an enhancement request.

Is it possible to add an option to change ownership of imported files to 
another user, for example, if an admin is loading files for another user into a 
site in Share? (In our case, we may need the files to be charged against the 
quota of a certain user.)

It would be useful to be able to submit metadata in spreadsheet format: as tab 
(or comma) delimited text files. (I guess headers would need to be used as 
labels.) Prefer default character encoding UTF-8.

While monitoring via the status Web Script is reasonably functional, it
would be ideal if the backing bean (the Bulk Import Status bean) was itself
JMX enabled, allowing monitoring not only via HTTP calls, but also via JMX.

What steps will reproduce the problem?
1. import a directory with a single file, and a shadow metadata properties file
2. make sure the metadata properties file is invalid.  For example:

cm\:categories=this is invalid

What is the expected output?
The import fails.
The filename of the problematic metadata file is displayed in the error message.

What do you see instead?
The import fails (correct behaviour).
The filename of the parent directory is displayed in the error message 
(incorrect behaviour).

What version of the product are you using?
v0.8

On what operating system?
n/a - reproducible on any OS

What steps will reproduce the problem?
1. Download source 0.4 version
2. mvn compile

What is the expected output? What do you see instead?
It is expected a Build Success
Instead we see:

[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Compilation failure

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[31,34]
 package org.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[32,34]
 package org.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[37,25]
 cannot find symbol
symbol  : class Pair
location: package org.alfresco.util

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[36,34]
package or
g.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[37,34]
package or
g.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[49,25]
cannot fin
d symbol
symbol  : class Pair
location: package org.alfresco.util

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[50,25]
 cannot find symbol
symbol  : class Log
location: class
org.alfresco.extension.bulkfilesystemimport.impl.SingleThreadedB
ulkFilesystemImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[65,25]
cannot fin
d symbol
symbol  : class Log
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\MetadataLoader.java:[34,25] cannot find symbol
symbol  : class Pair
location: package org.alfresco.util

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[147,25]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[189,23]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[248,18]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\MetadataLoader.java:[70,26] cannot find symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.MetadataLoader.Metad
ata

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\MetadataLoader.java:[74,35] cannot find symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.MetadataLoader.Metad
ata

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportStatusWebScript.java:[3
1,34] package org.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportStatusWebScript.java:[3
2,34] package org.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportStatusWebScript.java:[5
1,25] cannot find symbol
symbol  : class Log
location: class
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFiles
ystemImportStatusWebScript

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportWebScript.java:[36,34]
package org.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportWebScript.java:[62,25]
cannot find symbol
symbol  : class Log
location: class
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFiles
ystemImportWebScript

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\AsynchronousSingleThreadedBulkFilesystemImporter.
java:[31,34] package org.apache.commons.logging does not exist

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\AsynchronousSingleThreadedBulkFilesystemImporter.
java:[50,25] cannot find symbol
symbol  : class Log
location: class
org.alfresco.extension.bulkfilesystemimport.impl.AsynchronousSin
gleThreadedBulkFilesystemImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[65,35]
cannot fin
d symbol
symbol  : variable LogFactory
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[149,13]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[149,74]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[168,47]
cannot fi
nd symbol
symbol  : method copyOfRange(java.lang.String[],int,int)
location: class java.util.Arrays

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[174,89]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[176,32]
cannot fi
nd symbol
symbol: class Pair
                    public List<Pair<NodeRef, File>> execute()

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[191,13]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[191,57]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[250,8]
cannot fin
d symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[254,25]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[325,21]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\AbstractBulkFilesystemImporter.java:[384,17]
cannot fi
nd symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesyst
emImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[50,35]
 cannot find symbol
symbol  : variable LogFactory
location: class
org.alfresco.extension.bulkfilesystemimport.impl.SingleThreadedB
ulkFilesystemImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[65,13]
 cannot find symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.impl.SingleThreadedB
ulkFilesystemImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\impl\SingleThreadedBulkFilesystemImporter.java:[68,13]
 cannot find symbol
symbol  : class Pair
location: class
org.alfresco.extension.bulkfilesystemimport.impl.SingleThreadedB
ulkFilesystemImporter

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportStatusWebScript.java:[5
1,35] cannot find symbol
symbol  : variable LogFactory
location: class
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFiles
ystemImportStatusWebScript

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportWebScript.java:[62,35]
cannot find symbol
symbol  : variable LogFactory
location: class
org.alfresco.extension.bulkfilesystemimport.webscripts.BulkFiles
ystemImportWebScript

D:\Fran\00_Desarrollos\00_workspace\bulk
import\src\main\java\org\alfresco\exten
sion\bulkfilesystemimport\webscripts\BulkFilesystemImportWebScript.java:[111,8]
cannot access org.alfresco.error.AlfrescoRuntimeException
file org\alfresco\error\AlfrescoRuntimeException.class not found
        try


[INFO] ------------------------------------------------------------------------
[INFO] For more information, run Maven with the -e switch
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6 seconds
[INFO] Finished at: Fri Nov 06 15:39:33 CET 2009
[INFO] Final Memory: 8M/17M
[INFO] ------------------------------------------------------------------------
D:\Fran\00_Desarrollos\00_workspace\bulk import>


What version of the product are you using? On what operating system?
Product version is 0.4
Operating System is Windows xp sp2


Please provide any additional information below.

There is no additional info

Currently a metadata loader can signal that certain files should be ignored
(ie. because they contain metadata and shouldn't be loaded as content into
the repository).

There are cases where it would be handy to be able to configure filename
filters independent of metadata loading behaviour (eg. to filter out the
.DS_Store droppings that Macs seem to leave everywhere they go).

This is not natively possible in JDK <= 1.6, but will become available in
JDK 1.7's enhanced file metadata libraries.

In the meantime, it may be worth investigating whether anyone has
implemented this via JNI.

Implement a BulkFilesystemImporter implementation that internally uses a
thread pool to further improve ingestion throughput.

The approach here would be to process each directory in a separate thread
from the pool, while ensuring that each directory is processed serially (to
avoid concurrency within a single Space in Alfresco).

Hi,
I am trying to create the .amp file using the source downloaded from this trunk:
# Non-members may check out a read-only working copy anonymously over HTTP.
svn checkout http://alfresco-bulk-filesystem-import.googlecode.com/svn/trunk/ 
alfresco-bulk-filesystem-import-read-only

My configuration is:
Maven version: 2.0.9
Java version: 1.6.0_20
OS name: "linux" version: "2.6.28-15-generic" arch: "i386" Family: "unix"

The complete error is reported in the attached file, these are just few 
sketches of the log:

[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Failed to resolve artifact.

I hope that you can help me,
Thanks and Kind Regards,
SM

Implement a metadata loader that reads from a "shadow" metadata file in
JSON format.

A <a 
href="http://blogs.alfresco.com/wp/pmonks/2009/10/22/bulk-import-from-a-filesyst
em/#comment-580">comment</a> on the blog post indicates that spurious 
whitespace is being appended to folder names during ingestion.

Task is to investigate (for both files & folders) and fix as needed.

Need to test multi-byte (UTF-8 etc.) characters in metadata files.

What steps will reproduce the problem?
1. Go to alfresco/service/bulk/import/filesystem/ (including the trailing slash
2. Fill out fields
3. Submit

What is the expected output? What do you see instead?
I expect the import to begin and be shown the status webscript. Instead I
get a 404:

"The Web Script /alfresco/service/bulk/import/filesystem//initiate has
responded with a status of 404 - Not Found."

What version of the product are you using? On what operating system?
Exported from SVN on 17 November 2009.
Ubuntu 9.10
Java 1.6.0_15

Please provide any additional information below.
The issue appears to be line 58 in ui.get.html.ftl. It sets the action for
the form to ${url.service}/initiate. If you loaded
/alfresco/service/bulk/import/filesystem/ in the browser you get an
incorrect URL: /alfresco/service/bulk/import/filesystem//initiate. If, on
the other hand, you load /alfresco/service/bulk/import/filesystem in the
browser, it works just fine.

Need to test metadata loading of non-string data types (datetimes in
particular).

Hi,
just tried to build the v0.10 release from scratch (using the JARs from the 
Alfresco 3.4a release ) but failed to do so since 
the source for 
org.alfresco.extension.bulkfilesystemimport.impl.AbstractMetadataLoader is 
missing.
I also checked the v0.9 branch and its the same situation there.

What steps will reproduce the problem?
1. replace a file or metadata file with new version in a folder to be imported
2. check Update Existing Files checkbox
3.

What is the expected output? What do you see instead?
I expect the new file to show up or the metadata to be updated. Instead the
number of files skipped seems to increase.

What version of the product are you using? On what operating system?
Alfresco Community 3.2r on Windows XP
alfresco-bulk-filesystem-import-0.6.amp

Please provide any additional information below.

What steps will reproduce the problem?
1. What is the expected output? What do you see instead?

I would love to use your tool as I need to load thousands of PDFs nightly
and Alfresco share hangs on both CIFS and FTP copies after about 600-1000
documents. I used MMT to include the supplied AMP file into Alfresco.war.
I’m not sure if I have not turned something on or if it is a security
error. Any help would be appreciated.



I get the following error in alfresco.log:
14:32:53,670 ERROR [org.alfresco.web.scripts.AbstractRuntime] Exception
from executeScript - redirecting to status template error: 02030011 Not
implemented
org.alfresco.error.AlfrescoRuntimeException: 02030011 Not implemented
at
org.alfresco.repo.security.authentication.DefaultMutableAuthenticationDao.loadUs
erByUsername(DefaultMutableAuthenticationDao.java:410)

If I go through the webscripts, I get the following error.

Web Script Status 500 - Internal Error

The Web Script /alfresco/service/bulk/import/filesystem/initiate has
responded with a status of 500 - Internal Error.

500 Description: An error inside the HTTP server which prevented it from
fulfilling the request.

Message: 02030011 Not implemented

Exception: org.alfresco.error.AlfrescoRuntimeException - 02030011 Not
implemented

org.alfresco.repo.security.authentication.DefaultMutableAuthenticationDao.loadUs
erByUsername(DefaultMutableAuthenticationDao.java:410)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
java.lang.reflect.Method.invoke(Method.java:597)
org.alfresco.repo.management.subsystems.ChainingSubsystemProxyFactory$1.invoke(C
hainingSubsystemProxyFactory.java:95)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171)
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.j
ava:204)
$Proxy22.loadUserByUsername(Unknown Source)
net.sf.acegisecurity.providers.dao.DaoAuthenticationProvider.getUserFromBackend(
DaoAuthenticationProvider.java:390)
net.sf.acegisecurity.providers.dao.DaoAuthenticationProvider.authenticate(DaoAut
henticationProvider.java:225)
net.sf.acegisecurity.providers.ProviderManager.doAuthentication(ProviderManager.
java:159)
net.sf.acegisecurity.AbstractAuthenticationManager.authenticate(AbstractAuthenti
cationManager.java:49)
org.alfresco.repo.security.authentication.AuthenticationComponentImpl.authentica
teImpl(AuthenticationComponentImpl.java:81)
org.alfresco.repo.security.authentication.AbstractAuthenticationComponent.authen
ticate(AbstractAuthenticationComponent.java:144)
org.alfresco.repo.security.authentication.AuthenticationServiceImpl.authenticate
(AuthenticationServiceImpl.java:129)
org.alfresco.repo.security.authentication.AbstractChainingAuthenticationService.
authenticate(AbstractChainingAuthenticationService.java:166)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
java.lang.reflect.Method.invoke(Method.java:597)
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils
.java:304)
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(Ref
lectiveMethodInvocation.java:182)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:149)
net.sf.acegisecurity.intercept.method.aopalliance.MethodSecurityInterceptor.invo
ke(MethodSecurityInterceptor.java:80)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171)
org.alfresco.repo.security.permissions.impl.ExceptionTranslatorMethodInterceptor
.invoke(ExceptionTranslatorMethodInterceptor.java:49)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171)
org.alfresco.repo.audit.AuditComponentImpl.audit(AuditComponentImpl.java:275)
org.alfresco.repo.audit.AuditMethodInterceptor.invoke(AuditMethodInterceptor.jav
a:69)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171)
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(Transa
ctionInterceptor.java:106)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveM
ethodInvocation.java:171)
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.j
ava:204)
$Proxy26.authenticate(Unknown Source)
org.alfresco.repo.web.scripts.servlet.BasicHttpAuthenticatorFactory$BasicHttpAut
henticator.authenticate(BasicHttpAuthenticatorFactory.java:187)
org.alfresco.repo.web.scripts.RepositoryContainer.executeScript(RepositoryContai
ner.java:280)
org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:262)
org.alfresco.web.scripts.AbstractRuntime.executeScript(AbstractRuntime.java:139)
org.alfresco.web.scripts.servlet.WebScriptServlet.service(WebScriptServlet.java:
122)
javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilt
erChain.java:290)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.
java:206)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:2
33)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:1
91)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109
)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:857)
org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http1
1AprProtocol.java:565)
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1509)
java.lang.Thread.run(Thread.java:619)



What version of the product are you using? On what operating system?
Alfresco 3.2r2 community edition on Ubuntu 9.04.

Please provide any additional information below.

Currently the filesystem text entry field in the UI Web Script doesn't provide 
a google-suggest-like 
autocomplete field.  This should be added.

Would be good to test this code against an AVM NodeRef and see what happens.

What steps will reproduce the problem?
1. import file with metadata including custom title
2. reimport file without metadata (choose update option in migration tool)
3. original title is replaced by filename but other metadata remains

What is the expected output? What do you see instead?
original title metadata should be left intact (description and DC metadata 
fields are left intact)

What version of the product are you using? On what operating system?
.10 on RedHat Linux

Please provide any additional information below.

What steps will reproduce the problem?
1. Install amp file from website
2. Go to the service for bulk/import/filesystem (login as admin)
3. type in parameters and execute

What is the expected output? What do you see instead?
Expected import to occur.  The status screen comes up but the job is 
completed in .03 sec.
Reviewing the console shows an error.
13:02:30,015  ERROR 
[bulkfilesystemimport.impl.AsynchronousSingleThreadedBulkFilesystemImporter
] Background Bulk Filesystem Import Failed
java.lang.RuntimeException: Error during run as.
        at 
org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(Authenti
cationUtil.java:509)
        at 
org.alfresco.extension.bulkfilesystemimport.impl.AsynchronousSingleThreaded
BulkFilesystemImporter$1.run(AsynchronousSingleThreadedBulk
FilesystemImporter.java:83)
        at java.lang.Thread.run(Thread.java:595)
Caused by: java.lang.NoSuchMethodError: 
java.util.Arrays.copyOfRange([Ljava/lang/Object;II)[Ljava/lang/Object;
        at 
org.alfresco.extension.bulkfilesystemimport.AbstractBulkFilesystemImporter.
importDirectory(AbstractBulkFilesystemImporter.java:168)
        at 
org.alfresco.extension.bulkfilesystemimport.impl.SingleThreadedBulkFilesyst
emImporter.bulkImportImpl(SingleThreadedBulkFilesystemImpor
ter.java:65)
        at 
org.alfresco.extension.bulkfilesystemimport.impl.AsynchronousSingleThreaded
BulkFilesystemImporter$1$1.doWork(AsynchronousSingleThreade
dBulkFilesystemImporter.java:88)
        at 
org.alfresco.repo.security.authentication.AuthenticationUtil.runAs(Authenti
cationUtil.java:497)
        ... 2 more

What version of the product are you using? On what operating system?
.04

Please provide any additional information below.

It would be useful to have more detailed logging of current status during an 
import (e.g., which directory/file is currently being read) and what has been 
successfully loaded when a failure occurs.

After installing the AMP on Alfresco 3.0 running on RHEL 4 and restarting, i 
receive this error.

15:26:42,997  ERROR [web.context.ContextLoader] Context initialization failed
org.springframework.beans.factory.CannotLoadBeanClassException: Error loading 
class 
[org.alfresco.extension.bulkfilesystemimport.impl.AsynchronousSingleThreadedBulk
FilesystemImporter] for bean with name 'imp
orter-implementation' defined in URL 
[jar:file:/opt/alfresco3.0/tomcat/webapps/alfresco/WEB-INF/lib/alfresco-bulk-fil
esystem-import-0.7.jar!/alfresco/extension/bulk-filesystem-import-web-scripts-co
ntext.xml]
: problem with class file or dependent class; nested exception is 
java.lang.UnsupportedClassVersionError: Bad version number in .class file 
(unable to load class org.alfresco.extension.bulkfilesystemimport.i
mpl.AsynchronousSingleThreadedBulkFilesystemImporter)
Caused by: java.lang.UnsupportedClassVersionError: Bad version number in .class 
file (unable to load class 
org.alfresco.extension.bulkfilesystemimport.impl.AsynchronousSingleThreadedBulkF
ilesystemImporter)
        at org.apache.catalina.loader.WebappClassLoader.findClassInternal(WebappClassLoader.java:1851)
        at org.apache.catalina.loader.WebappClassLoader.findClass(WebappClassLoader.java:890)
        at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1354)
        at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1233)
        at org.springframework.util.ClassUtils.forName(ClassUtils.java:201)
        at org.springframework.beans.factory.support.AbstractBeanDefinition.resolveBeanClass(AbstractBeanDefinition.java:327)
        at org.springframework.beans.factory.support.AbstractBeanFactory.resolveBeanClass(AbstractBeanFactory.java:1075)
        at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:282)
        at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:352)
        at org.springframework.web.context.ContextLoader.createWebApplicationContext(ContextLoader.java:244)
        at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:187)
        at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:49)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3843)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4342)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:525)
        at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:830)
        at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:719)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:490)
        at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1149)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:311)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:117)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
        at org.apache.catalina.core.StandardHost.start(StandardHost.java:719)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
        at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
        at org.apache.catalina.core.StandardService.start(StandardService.java:516)
        at org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:578)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)