Error Executing Mouse Click

Hi all,

I have been trying to get RPA express running for automating a task which involves an internal Java based desktop application. The application contains a form and I am trying to automate the task of filling of that form. But whenever I try to click on any of the field of the form I get an error Error Executing Mouse Click.

I have tried implementing the click manually from action library and by recording as well but unfortunately neither of it is working. When I try to use window component under Application from the Actions Library, and click on it to select the window from the dropdown the I cannot see the dropdown because it keeps on loading forever as shown in the screenshot below (But the options show up when the Java application is closed)

This is the detailed log of the error when I try to record the click manually.

Error executing MouseClickAction
      com.workfusion.studio.rpa.recorder.playback.PlaybackException: Error executing TemplateAction[templateName=MouseClickAction.ftl,id=2,name=Optional[MouseClickAction],parent=1,arguments=ActionArguments[clickCount=[1],exactMatch=[true],imageName=[C:\\Users\\DEV-BANORES\\workfusion-workspace\\rpae_project\\Untitled-11\\1553506711268-anchor.apng],fullImageName=[1553506711268.png],xsi:type=[recorder:MouseClickAction, recorder:MouseClickAction],controlName=[Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)],pollingInterval=[300],active=[true],controlText=[Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)],searchInFrames=[false],modifiers=[256],type=[CONTROL],when=[1553506711340],button=[1],offsetX=[-3539],paramString=[NativeMouseEvent{type=RELEASE, button=1, position=(-1752, 304), clickCount=1} NativeInputEvent{window=WindowDTO{hWnd='67542', pid='4556', className='SunAwtFrame', title='Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)', location=(-1928, 105), size=(1936х1056)}, component=ComponentDTO{name='Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)', className='SunAwtFrame', metaId='{"hControl":"0x00000000000107D6"}', text='Oracle Applica...APRD 01-02-19)', instance=null, location=(0, 0), size=(1936х1056), enabled=true, visible=true, selected=false}, modifiers=256, when=1553506711340}],delay=[0],controlClassName=[SunAwtFrame],webElementLocatorType=[XPATH],x=[-1752],y=[304],selector=[[CLASS:SunAwtFrame; NAME:Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19); TEXT:Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)]],actionDetails=[(click left button)],awaitTimeout=[5000]]]
          at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:54)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:28)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:15)
          at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:64)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.playNextAction(PlaybackLogic.java:152)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.run(PlaybackLogic.java:112)
          at java.lang.Thread.run(Thread.java:745)
      Caused by: org.openqa.selenium.WebDriverException: Unable to find JDK path for target architecture: null
    Command duration or timeout: 0 milliseconds
    Driver info: com.freedomoss.crowdcontrol.webharvest.selenium.wrapper.RemoteDriverWrapper
    Capabilities [{imageSimilarityThreshold=0.8, extra.executor.id={Name=RPA Recorder}, CLOSE_ALL_WINDOWS=false, browserName=universal, javascriptEnabled=true, extra.capabilities.context={"browserType":"universal","startInPrivate":false,"blockImages":false,"maximizeOnStartup":false,"customCapabilities":{"platform":"WINDOWS","javascriptEnabled":true,"SEARCH_ALL_WINDOWS":true,"CLOSE_ALL_WINDOWS":false,"imageSimilarityThreshold":"0.8"},"executorId":{"Name":"RPA Recorder"}}, platformName=WINDOWS, SEARCH_ALL_WINDOWS=true, platform=WINDOWS}]
    Session ID: d421a3c8-957b-48d9-86cf-e35c82f90774
    *** Element info: {Using=css selector, value=[CLASS:SunAwtFrame; NAME:Oracle Applications - IUAT Instance (Clone of PRD 01-02-19); TEXT:Oracle Applications - UAT Instance (Clone of PRD 01-02-19)]}
          at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
          at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
          at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
          at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
          at org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:216)
          at org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:168)
          at org.openqa.selenium.remote.http.JsonHttpResponseCodec.reconstructValue(JsonHttpResponseCodec.java:41)
          at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:82)
          at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:45)
          at org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:164)
          at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:741)
          at org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:446)
          at org.openqa.selenium.remote.RemoteWebDriver.findElementByCssSelector(RemoteWebDriver.java:540)
          at org.openqa.selenium.By$ByCssSelector.findElement(By.java:430)
          at org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:438)
          at com.workfusion.rpa.helpers.RPA.getElement(RPA.java:944)
          at com.workfusion.rpa.helpers.RPA.$(RPA.java:864)
          at com.workfusion.rpa.helpers.RPA.$(RPA.java:852)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:104)
          at org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite$StaticMetaMethodSiteNoUnwrapNoCoerce.invoke(StaticMetaMethodSite.java:151)
          at org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite.callStatic(StaticMetaMethodSite.java:102)
          at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:197)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:209)
          at Script3$_run_closure1.doCall(Script3.groovy:9)
          at Script3$_run_closure1.doCall(Script3.groovy)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:104)
          at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:326)
          at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:264)
          at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)
          at groovy.lang.Closure.call(Closure.java:421)
          at groovy.lang.Closure.call(Closure.java:415)
          at com.workfusion.rpa.helpers.RPA.inDesktop(RPA.java:670)
          at com.workfusion.rpa.helpers.RPA$inDesktop$0.callStatic(Unknown Source)
          at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:197)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:209)
          at Script3.run(Script3.groovy:8)
          at com.workfusion.studio.rpa.recorder.playback.shell.GroovyShellWrapper.executeScript(GroovyShellWrapper.java:48)
          at com.workfusion.studio.rpa.recorder.playback.player.PlaybackContext.executeScript(PlaybackContext.java:65)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.executeBehavior(TemplateAction.java:33)
          at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:46)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:28)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:15)
          at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:64)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.playNextAction(PlaybackLogic.java:152)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.run(PlaybackLogic.java:112)
          at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IllegalArgumentException: Unable to find JDK path for target architecture: null
          at com.workfusion.mfw.manupulators.jvm.connection.PathResolver.unknownArchitecture(PathResolver.java:49)
          at com.workfusion.mfw.manupulators.jvm.connection.PathResolver.getJdkExePath(PathResolver.java:43)
          at com.workfusion.mfw.manupulators.jvm.connection.AttacherDispatcher.dispatch(AttacherDispatcher.java:39)
          at com.workfusion.mfw.manupulators.jvm.connection.VMConnectionBuilder.attachToJvm(VMConnectionBuilder.java:51)
          at com.workfusion.mfw.manupulators.jvm.connection.VMConnectionBuilder.newConnection(VMConnectionBuilder.java:28)
          at com.workfusion.mfw.manupulators.jvm.connection.VirtualMachineConnector$1.load(VirtualMachineConnector.java:52)
          at com.workfusion.mfw.manupulators.jvm.connection.VirtualMachineConnector$1.load(VirtualMachineConnector.java:49)
          at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522)
          at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315)
          at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278)
          at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193)
          at com.google.common.cache.LocalCache.get(LocalCache.java:3932)
          at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3936)
          at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4806)
          at com.workfusion.mfw.manupulators.jvm.connection.VirtualMachineConnector.getJvmUiAgentService(VirtualMachineConnector.java:59)
          at com.workfusion.mfw.manupulators.jvm.connection.JvmUiAgentProxy.getRemoteService(JvmUiAgentProxy.java:30)
          at com.workfusion.mfw.manupulators.jvm.connection.JvmUiAgentProxy.getWindow(JvmUiAgentProxy.java:110)
          at com.workfusion.mfw.manupulators.jvm.JvmWindowManipulator.get(JvmWindowManipulator.java:124)
          at com.workfusion.mfw.manupulators.api.base.BaseWindowManipulator.get(BaseWindowManipulator.java:68)
          at com.workfusion.mfw.manupulators.search.ComponentSearchEngine.getXmlContent(ComponentSearchEngine.java:61)
          at com.workfusion.mfw.manupulators.search.ComponentSearchEngine.getSearchEngine(ComponentSearchEngine.java:48)
          at com.workfusion.mfw.manupulators.search.ComponentSearchEngine.findFirst(ComponentSearchEngine.java:39)
          at com.workfusion.mfw.manupulators.jvm.JvmWindowManipulator.findComponent(JvmWindowManipulator.java:146)
          at com.workfusion.autoit.driver.DesktopWindow.findElement(DesktopWindow.java:122)
          at com.workfusion.autoit.driver.DesktopWindow.lambda$findElement$2(DesktopWindow.java:110)
          at com.workfusion.common.utils.SynchUtils.retry(SynchUtils.java:70)
          at com.workfusion.autoit.driver.DesktopWindow.findElement(DesktopWindow.java:109)
          at com.workfusion.autoit.driver.AutoItDriver.findElement(AutoItDriver.java:139)
          at com.workfusion.universal.driver.UniversalDriver.findElement(UniversalDriver.java:80)
          at org.openqa.selenium.remote.server.handler.FindElement.call(FindElement.java:48)
          at org.openqa.selenium.remote.server.handler.FindElement.call(FindElement.java:33)
          at org.openqa.selenium.remote.server.handler.WebDriverHandler.handle(WebDriverHandler.java:41)
          at org.openqa.selenium.remote.server.rest.ResultConfig.handle(ResultConfig.java:133)
          at org.openqa.selenium.remote.server.JsonHttpCommandHandler.handleRequest(JsonHttpCommandHandler.java:205)
          at org.openqa.selenium.remote.server.InMemorySession.execute(InMemorySession.java:98)
          at org.openqa.selenium.remote.server.WebDriverServlet.lambda$handle$0(WebDriverServlet.java:231)
          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
          at java.lang.Thread.run(Thread.java:745)

It would be great if anyone could help me with this.

Thank you !

Hello @banoresaurabh.
I suppose that application that you tried to automate is using 32-bit Java version. Please correct if I’m wrong.

Dear @banoresaurabh,
Is this still actual?

Hi @Lera, It runs on an 64-bit Java version. Now I am using keyboard shortcuts instead of clicks to make things work.

2 Likes

Thanks, so does it work now?

1 Like

@Lera Thank you for following up ! Yes it works but only because I am not using any clicks (I am using keyboard shortcuts of the application instead of clicks). It still fails if I try to use clicks.

hi, I have the same issue, how can I get the elements on native java applications. I cannot use keyboard shortcuts…
it is a 32bit java application

Hi @gerhardus_meyer when you try to inspect the application, the Inspector doesn’t see the elements?
Have you tried starting RPA Express as administrator?