EyeAuras Pixel Based Automation

EyeAuras Pixel Based Automation Latest Stable version

I want to share information about what I've been working on over the past few weeks. Most of these changes will interest developers who strive to use EyeAuras as a framework for creating their own products. This update will not affect users who do not use CustomUI/ExecuteScript.

Two months ago, I implemented a new type of overlay, CustomUI, which allows creating a user interface using C# and Razor (HTML/CSS). This has opened up a wide range of possibilities for experienced developers, giving them the ability to create a custom interface for their bot/set of auras. It simplifies the process of understanding and using the EyeAuras interface for a user who imports your set of auras.
An important limitation was that developers are used to working in development environments like Visual Studio and Rider, but previously, the ability to work with C# code was only available through the built-in EyeAuras editor. This editor has its limitations and cannot compete in quality and speed with more powerful IDEs. This is what I decided to change.

As soon as the alpha test ends, the new CustomUI overlay will have the ability to export code and save it as a C# project. The created project will include EyeAuras.SDK, which allows development using all the features available in the program: input simulation, image search, AI object detection, and much more. It's important to note - the code still needs EyeAuras running to launch.

This project can be opened in any IDE (Visual Studio, Rider, SharpDevelop, or even VS Code) and get full auto-completion, the ability to write unit tests, and all the other benefits of modern development. It's important to note that the ability to connect external Nuget packages will appear in the future. By default, EyeAuras already includes about 50 different libraries, which should be enough in most cases. However, I will definitely add this feature.

In addition to the ability to import the project into EyeAuras, there is also a Live development mode, in which EyeAuras tracks all the changes you are making in the project right now, picks them up, and loads them in real-time. I.e., from the moment you changed the style of the button, added some new logic to your bot or anything else, until the moment you saw them on your screen in the form of a working product, it takes on average 2-3 seconds. And given that this code has access to any triggers, current captured images with and without applied effects, all input simulators, etc., the possibilities are huge.

A lot of changes in Wiki - https://wiki.eyeauras.com/en/home

Added information for all(almost) types of actions/triggers and overlays available in the program
Added info about coordinate system which is used in some actions/triggers to define capture region, clone region or click coordinates: https://wiki.eyeauras.com/en/coordinate-system
Added info on Text Match Expressions which are used to evaluate recognized text or received network/telegram message: https://wiki.eyeauras.com/en/text-match-expressions
Added info on Window Match Expressions whcih are used to specify window that should be picked as Target Window: https://wiki.eyeauras.com/en/window-matching-expressions
Take a peek at Dependencies Viewer, which is very often overlooked and allows to very easily debug complex set of auras: https://wiki.eyeauras.com/en/overlays/dependencies-viewer
Added some technical information about Custom UI: https://wiki.eyeauras.com/en/overlays/custom-ui

Some parts of the program are still not covered in Wiki and I'll work on it in the following week.
Bindings: mechanism that allows to bind properties of triggers/actions together, e.g. you can find inventory using Image Search and bind found region as a source region for another image search which will now search only in inventory area
Synchronization: mechanism that allows to more easily share set of auras which you're constantly working on

Added info about Aura Library https://wiki.eyeauras.com/en/aura-library , Export/Import functionality https://wiki.eyeauras.com/en/export-import and Bindings https://wiki.eyeauras.com/en/bindings
Top