Demoders AO tools

[Demoder]

This thread is intended to be a summary of all the tools I've made, and am making, for Anarchy-Online. There's not many of them, but I figure I'd rather update one thread than to update several of them.

Towerwar Logging
Live records of tower battles, with some stats. Can browse in tower war history.

Premade Implants Search
Search through the implants in the premade implants booths.

Map upgrades - Which ones am I missing? (Updated 2010-04-29)
Which map (reader) upgrades are you missing? Which ones can you upload? How much more map navig do you need to get a given upgrade?

Anarchy-Online Map Compiler (C#) (Updated 2010-03-30)
A program to compile maps for AO.

Demoders Patcher (Depreciated)
A tool to patch AO planetmaps. Patching of AO GUI is incoming. (would simplify updating of custom GUIs)

And of course, the Sourceforge project page

[Demoder]

Towerwar Logging

The towerwar logging tool logs tower wars on RK1, RK2 and RK3.
You may see individual battles, tower battle outcomes, battles connected to a outcome, and some interesting stats, like which zerg was the biggest (successfull) zerg the past month.

The information is recorded and displayed live.

For any creatives:
There are CSV and AOML outputs available. (see links below).
CSV input may be imported with MS Excel or OpenOffice ORG Calc, separating each field by a comma.
AOML is a term I picked up from the vhabot site. This directly outputs the clickable links for direct use ingame, much like the way you would use the AOML output from VHA network items database.

I have also made a IGN plugin to utilize this system. Yes, If you use IGN, you should change to a difrent bot, preferably one year ago.
The reason I made a IGN plugin, is because that's the only "public" bot that I know to write a plugin to... and it should be easy for people to see what's done in it, and make one for their own bot.
Download IGNbot Plugin
AOML Example

There is also a gzip archive containing tower field information (SQL dump), and a PHP example for using the data in the dump.

The dumps for each dimension are updated daily.

Added 2010-01-26:
I've made a interface for querying tower location information.

URL: http://flw.nu/tools/twloc.php
Parameters:
output=csv|xml
zone=ZoneName
x=X coord we're looking up
y=Y coord we're looking up
dim=1|2|3 For 'current owner' information
sitenum=#  if you have the sitenum, but not a coordinate. Use this or x/y.

Example query: Clondyke x1


RK1
Towerwar Status
Battle Search (CSV, AOML, Dump)
Result Search (CSV, Dump)
Attack Graphs: Comparison, Everything, Yearly, Monthly
Result Graphs: Comparison, Everything, Yearly, Monthly

RK2
Towerwar Status
Battle Search (CSV, AOML, Dump)
Result Search (CSV, Dump)
Attack Graphs: Comparison, Everything, Yearly, Monthly
Result Graphs: Comparison, Everything, Yearly, Monthly

RK3
Towerwar Status
Battle Search (CSV, AOML, Dump)
Result Search (CSV, Dump)
Attack Graphs: Comparison, Everything, Yearly, Monthly
Result Graphs: Comparison, Everything, Yearly, Monthly

Logging information
RK1: Logging started: 2007.09.21
RK2: Logging started: 2006.09.01 (some gaps in logging due to bot downtimes, constant logging since 2007.09.21)
RK3: Logging started: 2007.09.21 (missing data in oct,nov 2007)

All dimensions: A big logging hole at 2010-08-15 10:00 to 17:00 GMT due to connectivity issues.
Known bugs
*If guild X side Y has multiple sites in zone Z, and two or more of them are attacked before the previous battles against this guild in this zone is settled, the result search will display the wrong site number information.
Fix: Work in progress

Work in progrss
Still working on the raw output feature.
Currently, it's implemented in a very limited form. It outputs the 2000 last tower battles. Save the file and/or open it in a program capable of intrepeting CSV fiels (Microsoft Excel or OpenOffice.Org Calc are two examples). Collumns are separated by semicolons, each row is separated by a CRLF (cartiege return+linefeed)

AOML output specification
This is the specification of the AOML output, ie. how to use this tool.
URL syntax:

URL: http://flw.nu/tools/tools_towers_battle_aoml.php Note: Colors are standard HTML colors, without the leading # Parameters: dimension=1|2|3 1=Atlantean, 2=Rimor, 3=DNW numresults=1...50 Number of results, between 1 and 50. start_offset=0....x Where to start the offset at. (offset of 5: Skips the 5 last tower battles, then displays numresults last tower battles after that point) mynick=bots_nickname The nickname of the bot. Defaults to "**(((mynick)))**" instead. cmdprefix=cmdprefix The CMD prefix of the bot. Defaults to "**(((cmdprefix)))**" instead. whois_command=COMMAND which command to be handed over to the bot in order to perform a whois. Default: whois. (without prefix!) color_omni=ABCDEF Color of OMNI attacker/defender color_neutral=ABCDEF Color of NEUTRAL attacker/defender color_clan=ABCDEF Color of CLAN attacker/defender color_info=ABCDEF Color of info text (ie. the site info, etc) color_header=ABCDEF Color of headers (ie. "Site:", "Defender:" etc) color_default=ABCDEF Color of default text (ie. the "fancy" ASCII art)

Output:
If cmdprefix and/or mynick is not set, you will have to replace **(((mynick)))** with the bots nick and **(((cmdprefix)))** with the bots cmdprefix.

[Demoder]

Premade Implants Search

This tool has a list of the available implants in the Premade Implants Shop in the basic stores.
Tool URL: http://flw.nu/tools/premadeimps.php
Example: search for implants that modify Computer Litracy, Stamina

To use:
1) Go to the tool.
2) You will see a complete list. To limit the search, enter criteria, eg. "treatment", in the top text fielt, and click "filter".



This tool is based on information from http://www.dd.org/~tale/ao/premade-implants.html.
Some changes to the list have been made, i.e. the keeper booth content.

CSV & XML output
By request of Wiznt1 (RK2) I've added CSV (botfriendly) output of the premade imps db. By request of Veremit, I've added XML output.
URL: http://flw.nu/tools/premadeimps.php

Usage:

Variable: q Value: version Example: premadeimps.php?q=version Result: Returns the version ID of the database in the format of PHPs date("YmdHis"). Variable: q Value: dumpdb Example: premadeimps.php?q=dumpdb Result: Returns the premadeimps db as a CSV file, semicolonseparated collumns, \r\n separated rows. Variable: q Value: dumpdb_xml Example: premadeimps.php?q=dumpdb_xml Result: Returns the premadeimps db as XML.

[Demoder]

Map upgrades - which ones am I missing?

And more importantly, which ones am I missing AND able to upload?
I have asked meself this many times, and ent up with a long, tiresome process of checking the map booth, one and one map, checking map navig requirements...
So, when I was going to upload maps to my newest toon, I just sat down to make a new tool for this.

Online version of the tool is available at: http://flw.nu/portal/?page=tools_maps
Offline version of the tool is available at Sourceforge (Source) (requires .Net 3.5 framework or compatible)

It works like this

• Retrieve your current maps&mapupgrades
  • Target yourself in AO, press T to get up the infowindow displaying your stats.
  • Copy the "Maps:" and "Map reader upgrades: " information, example:
    

    Maps: 4 Holes. Aegean. Athen Shire. Athen West. Lush Fields. Newland Desert. Omni Forest. Omni-1 Entertainment. Map reader upgrades: Monsters. Players. Machines. Arrow.

  • Paste this information into the top text field in the tool.
• Find your map navigation skill
  • Open skills view, go to "Navigation" and it's right there
  • Enter the Map Navigation skill to the second text field in the tool.
• Hit the "Apply" button.

Result: (online version)
Once this is done, it will give two lists of maps you do not have yet.
The first lists which maps you can upload, in alphabetical order, for shopping convience.
The second lists which maps you can NOT upload, ordered by map navig requirement.

Result: (offline version)
You'll have four tabs:

• Uploadable: These are maps & map reader upgrades which you can upload.
• Available: These are maps & map reader upgrades which you can not upload yet.
• Uploaded: These are maps & map reader upgrades which you have already uploaded
• Active PFs: This is a settings tab. Generally leave this alone; However, if some patch enable some of the zones that are marked as inactive, you can easily toggle them in this tab, and have the program check for them as well.

Oddities in the list?
Map information is taken from the ingame items, available in the map booth.
Those that did not have exact information (Borealis City, for instance), were checked towards auno.org.

If you find any information that is incorrect, please let me know.

[Demoder]

AOMC - Anarchy-Online Map Compiler

Please see the C# version anouncement.


Old compiler:
Website: http://aomc.flw.nu/


AOMC is a map compiler for Anarchy-Online. (Hence the name, Anarchy-Online Map Compiler).
Anarchy-Online doesn't use normal image files as map files.
Instead, if you want to make a map, you have to do some footwork to convert a image file into a format Anarchy-Online can understand.
To do this, AOMC has to split up the image file into slices. A slice is really just a 128x128 px image file.
Each slice is added to a "binfile", in serialized order.
Each slices "FilePos" (how many bytes into the binfile does the slice start?) is kept track of, and exported to a format which lets Anarchy-Online read and use it.

The main benefit of AOMC is that it is very customizable through a easy-to-understand config file.
Another benefit is that if you have multiple images that are mostly the same, they can be "compared", so that if slice X in the images are identical, it's added only once. This lets you have multiple similar versions of a map with a smaller size than if the images were just blindly added to the binfile.

AOMC supports multithreading, as long as your map has more than one layer.

AOMC is a php-based application, and requires PHP to run. PHP is boundled with the release, with PHP's license terms in "php\license.txt".
For more information about PHP, see http://www.php.net/.

AOMC supports the new (17.10.2) CoordsFile directive, which lets planetmaps specify their own mapcoords for character location tracking.

For more information, please see the website.

[Demoder]

Demoders Patcher

PHP version is dead & buried.
C# version incoming soon... hopefully with less bugs, and a better user experience.

Preview
Maps list: http://demoder.flw.nu/tools/Demoders...sPatcher_4.png

[Demoder]

FLWBot & The Relay Protocol

The relay protocol:


Dealing with the Relay Hub

All communication with the relay hub is via privatemessage. Commands: open Makes the hub invite you to its privategroup. close Makes the hub kick you from its privategroup. And that’s it. That’s all you need to know about making your bot compatible with the relay hub.

The Protocol

Many things are relayed. Protocols SHOULD be implemented in such a way that they are backward and forward-compatible. Everything in this list is communicated through the relayhubs privategroup. Your bot should always ‘register’ its tags and onlinelist when a new bot enters the channel. Please add a anti-flood system, making it delay for a few seconds to see if more bots join or not, to avoid flooding. (usefull for when the AO chat servers are acting up)

Tags

Instead of saying that “Person X logged on in guild *name of guild*”, the protocol use something called tags. If the tag is negative, the event is not occuring ingame, so there’s no point in trying to aquire whois information about the usernames from the AO database. Recommended: 0 for guild, 1 for guest. Storage information: Tags are unique to each bot. Make your bot store them as such. Example PHP array structure: $tags["hubname"]["botname"]["tagid"]["tagname"]; Syntax: tags “x.a:y.a” “x.b:y.b” “x.c:y.c” Example: tags “-1:IRC” “0:FLW” “1:FLW Guest” “2:CommandRelay” Recommended implementation: Deal anything between two quota marks as a entity. Split up each entity into subentities, based on the colon, meaning that the first subentity would be the tag id, second would be the guild name. Make sure that you allow for more subtags to be added, even though your bot won’t know how to use them. Recommended failsafe implementation: If your bot doesn’t know the ‘name’ of a given tagid, make it display hubname:botname:tagid instead.

Online lists

When a bot joions the channel, it doesn’t know who’s online untill the other bots tell it. Onlinelist is the way of doing this. Bots that let people hide themselves from the relay onlinelist or logon/off list, should sync the online list ever so often to make sure that people are not stuck as being shown as “online” after enabling the ‘hide me’ function. Storage information: Online lists are unique to each bot. Recommended PHP array: $onlinelist["hubname"]["botname"]["tagid"]["nickname"]; Syntax: onlinelist TAGID:nick:main TAGID2:nick2:main2 TAGID3:nick3:main3 Example: onlinelist 0:Cratine:Zoeiea 0:Demoder:Zoeiea 0:Zoeiea:Zoeiea -1:NickServ:NickServ Recommended implementation: Use spaces as separator between entities. Use colon to separate subentities. Allow for more subentities to be added, even if your bot doesn’t know how to process those.

Reporting that someone logs on/off

Instead of every bot tracking every guild roster in the relay, each bot tracks its own guilds roster. What: Report that someone logs on Syntax: logon TAGID nick main Example: logon 0 Demoder Zoeiea What: Report that someone logs off Syntax: logoff TAGID nick main Example: logoff 0 Cratine Zoeiea

Relaying a message

All messages should be sent as-is, without aditional formatting from your bots end. This means; Don’t add a color tag to the outgoing messages. If the user did, let it pass. It’s a part of the message. Syntax: msg TAGID nick MESSAGE GOES HERE Example: msg 0 Cratine Testing the relay system. This SHOULD hopefully show right. If not, that’s +1 to your unintended spamfilter.

PHP code example for handling incoming RelayProtocol messages
PHP syntax highlighting is terrible on this board (dark blue on dark green background), so posting a link instead: Clicky

[Nekrofiil]

Can I bump this?

[Joachim]

Originally Posted by Nekrofiil Can I bump this?

You can so not bump this, please go away.

[Nekrofiil]

3

[Demoder]

PoRKd is now live. See the above post for details.

[Demoder]

Bump.
Just released my patcher

[Demoder]

Bump.
Added support for updating GUIs.
Just tried this by making a patchserver for the Notum Dovvetech GUI, and patching a local AO installation.
See Demoders Patcher: Configuration Examples for more information.

[Demoder]

Released patch to "Demoders Patcher".
Version: 0.2.1.4 (20080921)
Fixed some minor bugs.
DP Changelog

Use the self-update function to get the latest version.

[Demoder]

Bump, AOMC supports the 17.10.2 CoordsFile directive.

[Demoder]

Released AOMC 2.1.0 (Anarchy-Online Map Compiler).
This is basically a rewrite of AOMC.

New/improved features:
Better support for comparing images
Better support for customizing map versions
Better support for the new (17.10.2) Coordsfile directive (can set per .txt file as opposted to previously per-map).
More sane disk I/O. AOMC will use more ram, but will cause a lot less stress on the harddrive, ultimately increasing performance.

Created a Discussion Forum for AOMC.
Please discuss/post AOMC-related stuff there. Bugreports, help requests, feature requests, etc.

[Demoder]

Bumping this one up here.
For those that are disapointed this is just a bump: Here's some news.

I've been working on learning C# in order to make a much more userfriendly, although windows-only, version of my patcher.
I will post more on this as I get closer to a alpha/beta release.

[Mawerick]

Originally Posted by Demoder I've been working on learning C# in order to make a much more userfriendly, although windows-only, version of my patcher.

http://www.mono-project.com/

[Demoder]

Thanks for the tip, I didn't realize they had gotten that far on the support.

[Comi]

Hey, with the shutdown of aotowers.com your site is the closest site with tower info. Personally, I really like how fast your site updates ! tho I find the interface a bit dull.

Something your site could REALLY use is to have some rankings, similar to what aotowers used to have. The best would be to have some sort of rankings page, separated from each server page.

Here are several rankings that come to my mind.

Most agressive orgs ( # of atks )
Most agressive characters ( # of atks )
Most victorious orgs ( # of site kills )
Most victorious characters ( # of atks that resulted in site kills)
Best tower rating ( (# of wins - # of loses)
Worst tower rating ( # of wins - # of loses)
Best defended orgs( # of succesfull defenses)
Top griefing orgs( # of atks that didnt end in site kill)

I really hope you can do some of these !