Error Executing Mouse Click

Automation Cloud Community
, , ,
#1

Hi all,

I have been trying to get RPA express running for automating a task which involves an internal Java based desktop application. The application contains a form and I am trying to automate the task of filling of that form. But whenever I try to click on any of the field of the form I get an error Error Executing Mouse Click.

I have tried implementing the click manually from action library and by recording as well but unfortunately neither of it is working. When I try to use window component under Application from the Actions Library, and click on it to select the window from the dropdown the I cannot see the dropdown because it keeps on loading forever as shown in the screenshot below (But the options show up when the Java application is closed)

rpa_error1
rpa_error11649Ă—960 15 KB

This is the detailed log of the error when I try to record the click manually.

Error executing MouseClickAction
      com.workfusion.studio.rpa.recorder.playback.PlaybackException: Error executing TemplateAction[templateName=MouseClickAction.ftl,id=2,name=Optional[MouseClickAction],parent=1,arguments=ActionArguments[clickCount=[1],exactMatch=[true],imageName=[C:\\Users\\DEV-BANORES\\workfusion-workspace\\rpae_project\\Untitled-11\\1553506711268-anchor.apng],fullImageName=[1553506711268.png],xsi:type=[recorder:MouseClickAction, recorder:MouseClickAction],controlName=[Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)],pollingInterval=[300],active=[true],controlText=[Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)],searchInFrames=[false],modifiers=[256],type=[CONTROL],when=[1553506711340],button=[1],offsetX=[-3539],paramString=[NativeMouseEvent{type=RELEASE, button=1, position=(-1752, 304), clickCount=1} NativeInputEvent{window=WindowDTO{hWnd='67542', pid='4556', className='SunAwtFrame', title='Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)', location=(-1928, 105), size=(1936Ń…1056)}, component=ComponentDTO{name='Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)', className='SunAwtFrame', metaId='{"hControl":"0x00000000000107D6"}', text='Oracle Applica...APRD 01-02-19)', instance=null, location=(0, 0), size=(1936Ń…1056), enabled=true, visible=true, selected=false}, modifiers=256, when=1553506711340}],delay=[0],controlClassName=[SunAwtFrame],webElementLocatorType=[XPATH],x=[-1752],y=[304],selector=[[CLASS:SunAwtFrame; NAME:Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19); TEXT:Oracle Applications - IAEBSUAT Instance (Clone of IAEAPRD 01-02-19)]],actionDetails=[(click left button)],awaitTimeout=[5000]]]
          at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:54)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:28)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:15)
          at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:64)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.playNextAction(PlaybackLogic.java:152)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.run(PlaybackLogic.java:112)
          at java.lang.Thread.run(Thread.java:745)
      Caused by: org.openqa.selenium.WebDriverException: Unable to find JDK path for target architecture: null
    Command duration or timeout: 0 milliseconds
    Driver info: com.freedomoss.crowdcontrol.webharvest.selenium.wrapper.RemoteDriverWrapper
    Capabilities [{imageSimilarityThreshold=0.8, extra.executor.id={Name=RPA Recorder}, CLOSE_ALL_WINDOWS=false, browserName=universal, javascriptEnabled=true, extra.capabilities.context={"browserType":"universal","startInPrivate":false,"blockImages":false,"maximizeOnStartup":false,"customCapabilities":{"platform":"WINDOWS","javascriptEnabled":true,"SEARCH_ALL_WINDOWS":true,"CLOSE_ALL_WINDOWS":false,"imageSimilarityThreshold":"0.8"},"executorId":{"Name":"RPA Recorder"}}, platformName=WINDOWS, SEARCH_ALL_WINDOWS=true, platform=WINDOWS}]
    Session ID: d421a3c8-957b-48d9-86cf-e35c82f90774
    *** Element info: {Using=css selector, value=[CLASS:SunAwtFrame; NAME:Oracle Applications - IUAT Instance (Clone of PRD 01-02-19); TEXT:Oracle Applications - UAT Instance (Clone of PRD 01-02-19)]}
          at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
          at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
          at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
          at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
          at org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:216)
          at org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:168)
          at org.openqa.selenium.remote.http.JsonHttpResponseCodec.reconstructValue(JsonHttpResponseCodec.java:41)
          at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:82)
          at org.openqa.selenium.remote.http.AbstractHttpResponseCodec.decode(AbstractHttpResponseCodec.java:45)
          at org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:164)
          at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:741)
          at org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:446)
          at org.openqa.selenium.remote.RemoteWebDriver.findElementByCssSelector(RemoteWebDriver.java:540)
          at org.openqa.selenium.By$ByCssSelector.findElement(By.java:430)
          at org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:438)
          at com.workfusion.rpa.helpers.RPA.getElement(RPA.java:944)
          at com.workfusion.rpa.helpers.RPA.$(RPA.java:864)
          at com.workfusion.rpa.helpers.RPA.$(RPA.java:852)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:104)
          at org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite$StaticMetaMethodSiteNoUnwrapNoCoerce.invoke(StaticMetaMethodSite.java:151)
          at org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite.callStatic(StaticMetaMethodSite.java:102)
          at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:197)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:209)
          at Script3$_run_closure1.doCall(Script3.groovy:9)
          at Script3$_run_closure1.doCall(Script3.groovy)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:104)
          at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:326)
          at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:264)
          at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)
          at groovy.lang.Closure.call(Closure.java:421)
          at groovy.lang.Closure.call(Closure.java:415)
          at com.workfusion.rpa.helpers.RPA.inDesktop(RPA.java:670)
          at com.workfusion.rpa.helpers.RPA$inDesktop$0.callStatic(Unknown Source)
          at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:197)
          at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:209)
          at Script3.run(Script3.groovy:8)
          at com.workfusion.studio.rpa.recorder.playback.shell.GroovyShellWrapper.executeScript(GroovyShellWrapper.java:48)
          at com.workfusion.studio.rpa.recorder.playback.player.PlaybackContext.executeScript(PlaybackContext.java:65)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.executeBehavior(TemplateAction.java:33)
          at com.workfusion.studio.rpa.recorder.playback.flow.StandardControlFlow.execute(StandardControlFlow.java:46)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:28)
          at com.workfusion.studio.rpa.recorder.playback.action.template.TemplateAction.execute(TemplateAction.java:15)
          at com.workfusion.studio.rpa.recorder.playback.player.ActionPlayer.next(ActionPlayer.java:64)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.playNextAction(PlaybackLogic.java:152)
          at com.workfusion.studio.rpa.recorder.player.PlaybackLogic.run(PlaybackLogic.java:112)
          at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IllegalArgumentException: Unable to find JDK path for target architecture: null
          at com.workfusion.mfw.manupulators.jvm.connection.PathResolver.unknownArchitecture(PathResolver.java:49)
          at com.workfusion.mfw.manupulators.jvm.connection.PathResolver.getJdkExePath(PathResolver.java:43)
          at com.workfusion.mfw.manupulators.jvm.connection.AttacherDispatcher.dispatch(AttacherDispatcher.java:39)
          at com.workfusion.mfw.manupulators.jvm.connection.VMConnectionBuilder.attachToJvm(VMConnectionBuilder.java:51)
          at com.workfusion.mfw.manupulators.jvm.connection.VMConnectionBuilder.newConnection(VMConnectionBuilder.java:28)
          at com.workfusion.mfw.manupulators.jvm.connection.VirtualMachineConnector$1.load(VirtualMachineConnector.java:52)
          at com.workfusion.mfw.manupulators.jvm.connection.VirtualMachineConnector$1.load(VirtualMachineConnector.java:49)
          at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522)
          at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315)
          at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278)
          at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193)
          at com.google.common.cache.LocalCache.get(LocalCache.java:3932)
          at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3936)
          at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4806)
          at com.workfusion.mfw.manupulators.jvm.connection.VirtualMachineConnector.getJvmUiAgentService(VirtualMachineConnector.java:59)
          at com.workfusion.mfw.manupulators.jvm.connection.JvmUiAgentProxy.getRemoteService(JvmUiAgentProxy.java:30)
          at com.workfusion.mfw.manupulators.jvm.connection.JvmUiAgentProxy.getWindow(JvmUiAgentProxy.java:110)
          at com.workfusion.mfw.manupulators.jvm.JvmWindowManipulator.get(JvmWindowManipulator.java:124)
          at com.workfusion.mfw.manupulators.api.base.BaseWindowManipulator.get(BaseWindowManipulator.java:68)
          at com.workfusion.mfw.manupulators.search.ComponentSearchEngine.getXmlContent(ComponentSearchEngine.java:61)
          at com.workfusion.mfw.manupulators.search.ComponentSearchEngine.getSearchEngine(ComponentSearchEngine.java:48)
          at com.workfusion.mfw.manupulators.search.ComponentSearchEngine.findFirst(ComponentSearchEngine.java:39)
          at com.workfusion.mfw.manupulators.jvm.JvmWindowManipulator.findComponent(JvmWindowManipulator.java:146)
          at com.workfusion.autoit.driver.DesktopWindow.findElement(DesktopWindow.java:122)
          at com.workfusion.autoit.driver.DesktopWindow.lambda$findElement$2(DesktopWindow.java:110)
          at com.workfusion.common.utils.SynchUtils.retry(SynchUtils.java:70)
          at com.workfusion.autoit.driver.DesktopWindow.findElement(DesktopWindow.java:109)
          at com.workfusion.autoit.driver.AutoItDriver.findElement(AutoItDriver.java:139)
          at com.workfusion.universal.driver.UniversalDriver.findElement(UniversalDriver.java:80)
          at org.openqa.selenium.remote.server.handler.FindElement.call(FindElement.java:48)
          at org.openqa.selenium.remote.server.handler.FindElement.call(FindElement.java:33)
          at org.openqa.selenium.remote.server.handler.WebDriverHandler.handle(WebDriverHandler.java:41)
          at org.openqa.selenium.remote.server.rest.ResultConfig.handle(ResultConfig.java:133)
          at org.openqa.selenium.remote.server.JsonHttpCommandHandler.handleRequest(JsonHttpCommandHandler.java:205)
          at org.openqa.selenium.remote.server.InMemorySession.execute(InMemorySession.java:98)
          at org.openqa.selenium.remote.server.WebDriverServlet.lambda$handle$0(WebDriverServlet.java:231)
          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
          at java.lang.Thread.run(Thread.java:745)

It would be great if anyone could help me with this.

Thank you !

#2

Hello @banoresaurabh.
I suppose that application that you tried to automate is using 32-bit Java version. Please correct if I’m wrong.

#3

Dear @banoresaurabh,
Is this still actual?

#4

Hi @Lera, It runs on an 64-bit Java version. Now I am using keyboard shortcuts instead of clicks to make things work.

2 Likes
#5

Thanks, so does it work now?

1 Like
#6

@Lera Thank you for following up ! Yes it works but only because I am not using any clicks (I am using keyboard shortcuts of the application instead of clicks). It still fails if I try to use clicks.

#7

hi, I have the same issue, how can I get the elements on native java applications. I cannot use keyboard shortcuts…
it is a 32bit java application

#8

Hi @gerhardus_meyer when you try to inspect the application, the Inspector doesn’t see the elements?
Have you tried starting RPA Express as administrator?

#9

will test with admin rights, let me check

1 Like
#10

Hi, tested with admin rights, same issue

#11

@gerhardus_meyer the inspector doesn’t see the elements inside the application? Can you share the screenshot of how it looks?

#12

It is an internal system…can send you a screenshot privately