Skip to content

Managing packages

Note

Similarly as the Open AEA framework, the Open Autonomy framework also works with the concept of package: a collection of files that implement a specific component or functionality, and which are named as vendor/package:version.

During the development of agents and services, users need to manage other packages, either developing them themselves or fetching already available ones. This guide will show you which are the relevant directories during development and how to get, use and publish packages.

The first thing you need to know is that there are different types of packages: services, agents, connections, contracts, protocols and skills. Services are composed of agents, and agents are composed of connections, contracts, protocols and skills. All these packages can live in different places:

  • Inside an agent if they are being used by that agent, with the exception of services which never live inside an agent.
  • In the local registry (packages folder), a local directory that stores packages classified by vendor.
  • In the remote registry, a remote machine that serves packages over IPFS or HTTP.

You can see that this setup is not that different from the one Git uses.

Overview of the package managing flows with the Open Autonomy framework

Packages should be developed independently from any agent, inside the local registry (packages folder) and later on they can be added to an agent for running them. This is the recommended method as it improves separation of concerns and offers the cleanest developer experience.

Creating your agents and services

The first thing a developer needs to do before they start writing code is setting up the project. Instead of starting from scratch, we recommend to clone our developer template. Once setup, it will generate a virtual environment with Open Autonomy installed, an empty local registry, some useful tools for checking packages and dummy tests. After this, in the same fashion Git asks to initialize its configuration using git config, Open Autonomy asks the user to set the user name, whether we are using a local or remote registry as well as the type of registry (IPFS by default). For example, initialize your registry running the following command:

autonomy init --reset --author john_doe --remote --ipfs --ipfs-node "/dns/registry.autonolas.tech/tcp/443/https"

Now we are in the position of creating our first agent:

autonomy create my_agent

This agent will have some dependencies: some packages might be already available in the remote registry and some will need to be developed. Let's say, for example, that it will need the ability to communicate using the ACN protocol. Since that package is already available on the Autonolas IPFS registry, we'll use the add command:

cd my_agent/
# Remote flag is not needed here as we initialized the default registry to remote
autonomy add protocol valory/acn:0.1.0:bafybeidetrrkvdgveu4ph5g6v53lbh7ardfspbkpstmjxctx647bzyosyy

You can find a list with all available packages here.

Now we might want to develop our own package, for example a skill. We could do it writing all the skill structure from scratch, but fortunately the CLI also provides a scaffolding option that will create a lot of boilerplate for us using its specification. For this example, we will use the specification from the hello world skill. Download it to the agent directory and run:

autonomy scaffold fsm my_skill --spec fsm_specification.yaml

This will add your skill's boilerplate code to my_agent/skills/my_skill and some dependencies to the vendor directory. You can learn more on scaffolding by reading the scaffolding guide.

Now that we have all we need, publish the new agent and all its dependencies to the local registry:

autonomy publish --local --push-missing

The agent and its dependencies live now in the local registry, so we can delete the temporary agent:

cd ..
autonomy delete my_agent

We will focus now on developing inside the local registry. First of all, it is useful to add other vendor paths to the .gitignore (for example packages/valory and packages/open-aea) so only your packages are tracked. Secondly, even if the skill is now in the local registry, there is another task we need to perform: update the packages/packages.json file. This file contains a list of all packages in the registry, as well as their hashes. It's useful to detect when packages change, are added or removed. If you open that file you will see it is empty. To reflect our latest changes, run:

autonomy packages lock

While developing, each change will make this hashes out of date. You can run the following to check whether you need to update autonomy packages lock again:

autonomy packages lock --check

Each time you need a new package, add its identifier to packages.json, run autonomy packages sync --update-packages to download it and then add it to the agent's configuration file.

The remote registry

We have been mostly working with the local registry, but for other developers to be able to fetch your packages you will need to push them to the remote registry: push, publish, add and fetch commands work with the --remote flag. When you specify it instead of the --local one, operations will be performed against a remote server. You can also push a package directly from the local registry to the remote one:

# Remove all cache files before running
autonomy push skill packages/john_doe/skills/my_skill/ --remote

Or maybe you prefer to push all your packages in one step:

# Remove all cache files before running
autonomy push-all --remote

Remember how we updated the package hashes when we edited packages in the local registry? It is good practice to keep your packages.json updated so it matches the state of your packages. This also applies to the remote registry. Sometimes you want to be sure that a package you have fetched has not been modified. When a package is out of sync, you have two options:

  • Update your local hashes to match the remote package:

    autonomy packages sync --update-hashes
    

  • Re-download the packages whose hashes do not match:

    autonomy packages sync --update-packages
    

Back to top