solver inventory: every reader we carry, counted

every reader, codec, record parser and fallback the non-web solvers carry into a race, one row each, with a count per table, per lane and for everything. the page is generated from the solver code itself, so the counts are the real registry sizes, not a hand tally. the capabilities page explains how the parts work.

how to read it:

  • 1202itemsevery table, every part
  • 371gradeda graded answer came from it
  • 816not yet gradednever graded in this event
  • 31%graded shareof the 1187 rated items
  • 6lanes covered5 solver lanes + cross-lane
  • 15race machinery parts6 roles, 9 fallback paths
graded and not yet graded items, by part
warmupswarmups: graded 82 (51%)51%warmups: not yet graded 79 (49%)49%mobilemobile: graded 46 (20%)20%mobile: not yet graded 181 (80%)80%metadatametadata: graded 74 (20%)20%metadata: not yet graded 289 (80%)80%scriptscript: graded 69 (70%)70%script: not yet graded 30 (30%)30%binarybinary: graded 51 (18%)18%binary: not yet graded 228 (82%)82%cross-lanecross-lane: graded 49 (84%)84%cross-lane: not yet graded 9 (16%)16%
  • graded
  • not yet graded

the race machinery counts items only and has no row.

in total: 1202 items, graded 371, not yet graded 816.

part items graded not yet graded
warmups 161 82 79
mobile 227 46 181
metadata 363 74 289
script 99 69 30
binary 279 51 228
cross-lane 58 49 9
race machinery 15 - -
everything 1202 371 816

warmups

warmups: graded 82, not yet graded 79.

  • 161items3 tables
  • 82graded
  • 79not yet graded
  • 51%graded share
graded 82 (51%)not yet graded 79 (49%)

one text file of numbered lines a day. each line is encoded with a codec (or a chain of two or three) and the answer is a slug hidden in the decoded message.

the solver reads every line with the day table first, then searches the transform table, single steps and then chains, and keeps the reading whose words are english. a prompt hint word switches on the keyed ciphers.

graded here means the codec was some day's line, so the grader has accepted an answer it decoded.

the transform table (decode.TRANSFORMS)

every codec a warmups line can be read with. a line is tried against these one by one, then in chains of up to three.

what the code calls it what it reads or does graded?
b65536 base65536: one unicode character per two bytes not yet graded
b2048 base2048: eleven bits a character not yet graded
digits5 rot5 on the digits only, letters left as they are not yet graded
ebcdic ebcdic bytes (the mainframe code page) to text not yet graded
binhex binhex 4.0, the classic macintosh encoding not yet graded
bin binary digit groups (7 or 8 bits) to characters yes
yenc yenc, the usenet binary encoding not yet graded
dna dna letters (a, c, g, t) as two-bit pairs, every letter order not yet graded
ternary base-3 digit groups, one group per byte not yet graded
upsidedown upside-down text flipped back not yet graded
zerowidth text hidden in zero-width characters not yet graded
unitags text hidden in unicode tag characters not yet graded
brainfuck runs a brainfuck program (bounded) and keeps its output yes
ook runs an ook! program (brainfuck in orangutan words) yes
oct octal numbers to characters yes
dec decimal character codes to characters yes
morse morse code (dots and dashes, any separator) yes
b64 standard base64 yes
b64url url-safe base64 (- and _) yes
b32 standard base32 yes
hex hex digit pairs to bytes yes
b85 base85 (the python / git alphabet) not yet graded
a85 ascii85, with or without the adobe <~ ~> frame yes
url percent-encoding (%41) yes
rot13 rot13 on letters yes
reverse the text read backwards yes
b58 base58 (the bitcoin alphabet) not yet graded
b45 base45 (the qr-code alphabet) not yet graded
b36 base36: the text as one big number not yet graded
b62 base62: the text as one big number not yet graded
b91 base91 not yet graded
a1z26 letter numbers: a=1 to z=26 not yet graded
atbash atbash: the alphabet mirrored yes
uu uuencode not yet graded
qp quoted-printable (=41) not yet graded
escapes backslash, unicode and html escapes, repeated until nothing changes yes
jsonstr a quoted json string literal yes
literals source-code literals: prefixed strings and char-code calls not yet graded
bytelist byte-array literals such as {0x4e, 0x69} not yet graded
netstring netstrings: length:payload, pieces yes
bencode bencode, the torrent encoding not yet graded
hexdump xxd / hexdump -C / od listings back to bytes not yet graded
roman roman numerals as character codes not yet graded
numberwords numbers spelled out in words as character codes not yet graded
rle run-length pairs (3a2b or a3b2) not yet graded
uniesc unicode code-point escapes (u+004e, \u{4e}) yes
cssesc css escapes (\4e ) not yet graded
nato nato phonetic words (alpha, bravo, ...) not yet graded
b64inflate base64 of a zlib or gzip stream, inflated yes
hexinflate hex of a zlib or gzip stream, inflated not yet graded
hexxor hex bytes under a single-byte xor, every key not yet graded
b64xor base64 bytes under a single-byte xor, every key not yet graded
z85 z85, the zeromq base85 alphabet not yet graded
b32hex base32 with the extended-hex alphabet not yet graded
punycode punycode (xn-- domain labels) not yet graded
utf7 utf-7 not yet graded
mime rfc 2047 encoded words from mail headers not yet graded
datauri a data: uri, base64 or percent-encoded not yet graded
braille braille letters, numbers and capitals not yet graded
braillebytes eight-dot braille cells as raw bytes not yet graded
nfkc fullwidth, math and circled letters folded to plain text not yet graded
bacon the 26-letter baconian cipher not yet graded
bacon24 the original 24-letter baconian cipher (i=j, u=v) not yet graded
baconhex baconian groups read as hex nibbles yes
b32alt base32 under the other alphabets (crockford, z-base-32 and more) not yet graded
rot13rot5 rot18: rot13 on letters and rot5 on digits not yet graded
b64alt base64 under non-standard alphabets not yet graded
b58alt base58 under the other alphabets (ripple, flickr) not yet graded
b100 base100: one emoji per byte not yet graded
xx xxencode not yet graded
b92 base92 not yet graded
hexebcdic hex of ebcdic bytes not yet graded
utf16lehex hex of utf-16 text (either byte order, bom or none) yes
utf16behex hex of big-endian utf-16 text yes
utf32hex hex of utf-32 text not yet graded
swapcase inverted case flipped back not yet graded
railfence keyless rail fence, 2 to 8 rails not yet graded
railfence3 a fixed three-rail fence yes
plain the line as written, no decoding not yet graded
columnar keyless columnar transposition, 2 to 8 columns not yet graded
polybius polybius square digit pairs not yet graded
tapcode tap code: groups of taps per row and column not yet graded
route route ciphers: inward spirals and column snakes not yet graded
bifid bifid (keyed or plain), periods 3 to 10 not yet graded
cow runs a cow program (brainfuck spelled in moos) not yet graded
whitespace runs a whitespace-language program (spaces, tabs, newlines) not yet graded
jsfuck evaluates jsfuck (javascript in six characters), capped at 5s not yet graded
deadfish runs a deadfish program not yet graded
bubblebabble bubble babble, the ssh fingerprint encoding not yet graded
nibbleswap each byte's two hex digits swapped not yet graded
b64ebcdic base64 of ebcdic bytes not yet graded
rot8000 to rot25 every other letter shift, one generated transform each (26 of them; rot13 has its own row) yes

117 items: graded 50, not yet graded 67.

the day table (decode.DAY_CODECS)

the codec each day's new line used, in day order. a numbered line k is read by day k's codec first, so a line seen before costs nothing.

what the code calls it what it reads or does graded?
b64 day 1: the line numbered 1 is read by b64 before any search yes
rot13 day 2: the line numbered 2 is read by rot13 before any search yes
hex day 3: the line numbered 3 is read by hex before any search yes
bin day 4: the line numbered 4 is read by bin before any search yes
dec day 5: the line numbered 5 is read by dec before any search yes
oct day 6: the line numbered 6 is read by oct before any search yes
url day 7: the line numbered 7 is read by url before any search yes
escapes day 8: the line numbered 8 is read by escapes before any search yes
jsonstr day 9: the line numbered 9 is read by jsonstr before any search yes
b32 day 10: the line numbered 10 is read by b32 before any search yes
b64url day 11: the line numbered 11 is read by b64url before any search yes
reverse day 12: the line numbered 12 is read by reverse before any search yes
atbash day 13: the line numbered 13 is read by atbash before any search yes
rot19 day 14: the line numbered 14 is read by rot19 before any search yes
rot47 day 15: the line numbered 15 is read by rot47 before any search yes
morse>hex day 16: the line numbered 16 is read by morse then hex before any search yes
baconhex day 17: the line numbered 17 is read by baconhex before any search yes
railfence3 day 18: the line numbered 18 is read by railfence3 before any search yes
utf16lehex day 19: the line numbered 19 is read by utf16lehex before any search yes
utf16behex day 20: the line numbered 20 is read by utf16behex before any search yes
b64inflate day 21: the line numbered 21 is read by b64inflate before any search yes
b64inflate day 22: the line numbered 22 is read by b64inflate before any search yes
a85 day 23: the line numbered 23 is read by a85 before any search yes
netstring day 24: the line numbered 24 is read by netstring before any search yes
uniesc day 25: the line numbered 25 is read by uniesc before any search yes
brainfuck day 26: the line numbered 26 is read by brainfuck before any search yes
ook day 27: the line numbered 27 is read by ook before any search yes
reverse>hex day 28: the line numbered 28 is read by reverse then hex before any search yes
rot13>b64 day 29: the line numbered 29 is read by rot13 then b64 before any search yes
url>url day 30: the line numbered 30 is read by url then url before any search yes
b64inflate>b32 day 31: the line numbered 31 is read by b64inflate then b32 before any search yes

31 items: graded 31, not yet graded 0.

keyed and searched readings (decode.HINT_FAMILIES, decode.HINT_KEYED)

ciphers outside the transform table: they need a key or a search, so they run only when the prompt's words hint at them, with the prompt's own words tried as keys.

what the code calls it what it reads or does graded?
adfgvx adfgvx and adfgx: keyed square under a keyed column transposition (prompt words: adfgvx, adfgx, fritz nebel) not yet graded
affine affine cipher, every valid key, the most english reading (prompt words: affine) not yet graded
autokey autokey vigenere with the prompt's words as keys not yet graded
beaufort beaufort with the prompt's words as keys not yet graded
foursquare four-square with one key or two (prompt words: four square, four-square, foursquare, four squares) not yet graded
keyboard keyboard shifts on a qwerty layout (prompt words: keyboard, qwerty, typing) not yet graded
nihilist nihilist: keyed square numbers plus an additive key (prompt words: nihilist) not yet graded
playfair playfair: the keyed 5x5 square read by digraphs (prompt words: playfair, digraph, pairs of letters, wheatstone) not yet graded
rot caesar search: every shift ranked by english, the shift words switch it on (prompt words: caesar, shift, rotat, took a) yes
trithemius trithemius: the progressive shift (tabula recta) (prompt words: trithemius, progressive, tabula recta) not yet graded
variant variant beaufort with the prompt's words as keys not yet graded
vigenere vigenere with the prompt's words as keys (prompt words: vigen, keyword, key word, polyalphabetic) not yet graded
xor repeating-key xor with the prompt's words as keys (prompt words: xor, exclusive) not yet graded

13 items: graded 1, not yet graded 12.

lane total 161: graded 82, not yet graded 79.

mobile

mobile: graded 46, not yet graded 181.

  • 227items4 tables
  • 46graded
  • 181not yet graded
  • 20%graded share
graded 46 (20%)not yet graded 181 (80%)

one android app a set. the app hides an ANS- code behind a puzzle json that names its codec, or computes the code in its own dex.

the solver reads the puzzle json, maps the codec word onto decoding steps and runs the chain with every key the app carries (json, resources, native strings, images). when there is no data, it runs the app's bytecode in its own dalvik interpreter.

graded here means a puzzle json in a graded app named that codec (the 15 words: analysis, base64, caesar, dynamic, hex, indexed, layered, native, packet, plain, reflection, reverse, split, table, xor).

puzzle codecs (apk.CODEC_ALIASES)

the codec word in the app's puzzle json, mapped onto a decoding step. 213 words lead to 61 steps; a codec like base64+xor is a chain of them, and any transform-table codec is accepted by its own name too.

what the code calls it what it reads or does graded?
plain, identity, none, raw, plaintext, cleartext, bytes, unwrap, quoted the data as written, no decoding yes
b64, base64 standard base64 yes
b64url, base64url url-safe base64 not yet graded
b32, base32 base32 not yet graded
b85, base85 base85 not yet graded
a85, ascii85 ascii85 not yet graded
hex, hexadecimal, base16, b16, hex-string hex digit pairs to bytes yes
rot13 rot13 on letters not yet graded
rot47 rot47 over printable ascii not yet graded
reverse the data read backwards yes
url, percent, percent-encoding, percent_encoding, urlencode, urlencoded, url-encoded, uri, percent-encoded, percent_encoded, urldecode, uri-component, unquote percent-encoding not yet graded
fernet a fernet token: aes-128-cbc under its url-safe base64 key not yet graded
rsa rsa (oaep sha1 / sha256, pkcs1 v1.5, raw) with a pem the app carries not yet graded
ecies, ecdh ecies: an ephemeral public key at the head, ecdh, then aes-256-gcm not yet graded
analysis, computed no data: the app's own dex computes the code, and the solver runs it in its dalvik interpreter yes
table, sbox, schedule, layered, layers, layer a per-byte key schedule fitted from the known ANS- prefix, and the layered peel (up to five layers, keyed ones anywhere) yes
nibble, nibbles, nibble-swap, swap-nibbles, nybble, nibswap, rol4, ror4, rotl4, rotr4 each byte's two nibbles swapped not yet graded
pairswap, pair-swap, swap-pairs, byteswap, byte-swap, bswap, swap16 each pair of bytes swapped not yet graded
rol1, rotl1, ror7, rotr7 each byte rotated left by 1 bit (right by 7) not yet graded
rol2, rotl2, ror6, rotr6 each byte rotated left by 2 bits (right by 6) not yet graded
rol3, rotl3, ror5, rotr5 each byte rotated left by 3 bits (right by 5) not yet graded
rol5, rotl5, ror3, rotr3 each byte rotated left by 5 bits (right by 3) not yet graded
rol6, rotl6, ror2, rotr2 each byte rotated left by 6 bits (right by 2) not yet graded
rol7, rotl7, ror1, rotr1 each byte rotated left by 7 bits (right by 1) not yet graded
not, bitnot, bitwise-not, invert, complement every bit inverted not yet graded
packet, packets, frame, frames, framed, framing, datagram, datagrams, envelope, wire, protocol, tlv framed packets (header, body, trailer, tlv) put back in sequence yes
dec, ascii, charcode, charcodes, decimal decimal character codes not yet graded
add, rot, caesar, shift a shift by the key: caesar on letters, add on bytes yes
bin, binary binary digit groups not yet graded
oct, octal octal numbers not yet graded
morse morse code not yet graded
atbash atbash not yet graded
b58, base58 base58 not yet graded
b45, base45 base45 not yet graded
b36, base36 base36 not yet graded
b62, base62 base62 not yet graded
b91, base91 base91 not yet graded
a1z26 letter numbers a=1 to z=26 not yet graded
escapes, html, unicode, html-entities, html_entities, html-entity, html_entity, entities, entity, htmlentities, unicode-escape, unicode_escape, js-escape, escape, escaped, backslash, hex-escape, hex-escapes, js, javascript, xml, char-ref html entities, unicode and backslash escapes not yet graded
nato, phonetic nato phonetic words not yet graded
cssesc, css, css-escape css escapes not yet graded
qp, quoted-printable quoted-printable not yet graded
uu, uuencode uuencode not yet graded
xor xor with the json's key, one byte or repeating; a missing key searched yes
sub, subtract the key subtracted from every byte not yet graded
rc4, arc4 rc4 with the json's key not yet graded
chacha20, chacha, xchacha20 chacha20 / xchacha20 with the json's key and nonce not yet graded
des3, 3des, tripledes, triple-des, des-ede3 triple des, the mode from the name, else cbc then ecb not yet graded
des3-cbc, des-ede3-cbc triple des in cbc mode not yet graded
des3-ecb triple des in ecb mode not yet graded
blowfish, bf blowfish, the mode from the name, else cbc then ecb not yet graded
blowfish-cbc, bf-cbc blowfish in cbc mode not yet graded
blowfish-ecb, bf-ecb blowfish in ecb mode not yet graded
vigenere vigenere with the json's key not yet graded
columnar, columnar-transposition, transposition, column keyed columnar transposition not yet graded
railfence, rail, rail-fence, zigzag rail fence not yet graded
caesar36, alnum-caesar, caesar-alnum, alphanumeric-caesar a caesar shift over letters and digits together not yet graded
subst, substitution, monoalphabetic, keyed-alphabet, alphabet a keyed substitution alphabet not yet graded
inflate, zlib, gzip, deflate zlib, gzip or raw deflate not yet graded
jsonstr, json, json-string, jsonstring, json-literal, json-unicode, json-escape, json-quoted, quoted-json, string-literal a quoted json string literal not yet graded
uniesc, code-point, code-points, codepoint, codepoints, js-unicode unicode code-point escapes not yet graded

61 items: graded 9, not yet graded 52.

codec paths outside the alias table (apk)

codecs the puzzle names that are a code path rather than one step (the five aes modes share a row and count five), and the key and data sources every step can draw on.

what the code calls it what it reads or does graded?
aes, aes-gcm, aes-cbc, aes-ctr, aes-ecb aes by name, the mode from the name or all four (ecb, cbc, ctr, gcm), the key as hex, base64, text or a passphrase hash, the iv from the json, the data's head or zeros not yet graded
split the code cut into parts with an order, joined (apk._split) yes
indexed one character per entry of an index order (apk._indexed) yes
dynamic the data names a member of the apk (a dex or asset), and the one ANS- string stored in it is the code (apk.member_code) yes
native, reflection a codec word no step knows: the data is tried as written and through every search, and the reading in the ANS- shape wins (apk.decode) yes
layered a stack of up to five layers peeled one by one, a keyed layer anywhere, its key fitted from the ANS- prefix (apk._peel_layers) yes
native keys keys from the dex, resources, json, xml, properties files and the strings of native libraries under lib/ (apk.app_keys) not yet graded
kdf a key derived the way the json says: pbkdf2-hmac (sha256, sha1, sha512) or scrypt, with its salt and cost (apk._kdf_keys) not yet graded
argon2 argon2 id / i / d keys at the json's cost (apk._argon2) not yet graded
mac a json mac: the reading that verifies wins (apk._mac_verdict) not yet graded
image codes qr codes and exif text in the app's images, used when the json has no data or names an image (apk.app_codes) not yet graded
answer scan a puzzle no decoding path reads: every ANS- string in the apk, ranked (apk.answer_scan) not yet graded

16 items: graded 5, not yet graded 11.

java and android classes the dalvik interpreter emulates (dex.HANDLERS)

when the code is computed by the app (the analysis codec), the solver runs the app's own bytecode. these are the framework classes it answers itself, one row per handler, counted by class. graded means a graded app's dex refers to one of the row's classes.

what the code calls it what it reads or does graded?
java.lang.CharSequence, java.lang.String strings: compare, slice, split, format, case, bytes and chars yes
java.lang.AbstractStringBuilder, java.lang.StringBuffer, java.lang.StringBuilder string builders: append, insert, reverse, delete yes
java.lang.Long the boxed long type: parse, value-of, compare, to-string yes
java.lang.Integer the boxed integer type: parse, value-of, compare, to-string not yet graded
java.lang.Short the boxed short type: parse, value-of, compare, to-string not yet graded
java.lang.Byte the boxed byte type: parse, value-of, compare, to-string not yet graded
java.lang.Character the boxed character type: parse, value-of, compare, to-string not yet graded
java.lang.Boolean the boxed boolean type: parse, value-of, compare, to-string not yet graded
java.lang.Float the boxed float type: parse, value-of, compare, to-string not yet graded
java.lang.Double the boxed double type: parse, value-of, compare, to-string not yet graded
java.lang.Math, java.lang.StrictMath math functions with java's integer and float rules not yet graded
java.lang.System array copies, identity hashes and the system properties a clean phone reports yes
java.util.Arrays array copy, fill, sort, compare and to-string yes
android.util.Base64 android's base64 with its flags not yet graded
java.util.Base64 java's base64 factory methods not yet graded
java.util.Base64$Decoder, java.util.Base64$Encoder java's base64 encoder and decoder objects not yet graded
java.lang.Object object identity, hash codes and to-string yes
android.app.Activity, android.app.Application, android.app.Service, android.content.Context, android.content.ContextWrapper, android.view.ContextThemeWrapper the app context: its package name, assets, resources and files yes
java.lang.Class class lookups by name and their methods and fields yes
java.lang.reflect.AccessibleObject, java.lang.reflect.Method reflective method calls yes
dalvik.system.BaseDexClassLoader, dalvik.system.DexClassLoader, dalvik.system.InMemoryDexClassLoader, dalvik.system.PathClassLoader, java.lang.ClassLoader class loaders, including a dex loaded from memory or an asset yes
java.nio.charset.Charset charsets by name not yet graded
java.util.Random java.util.random with its exact seeded sequence not yet graded
java.security.MessageDigest message digests (md5, sha-1, sha-256, ...) not yet graded
android.content.res.AssetManager the apk's assets opened by name yes
android.content.res.AssetFileDescriptor asset file descriptors not yet graded
android.content.res.Resources resources: strings, raw files and identifiers from the apk not yet graded
android.content.res.AssetManager$AssetInputStream, java.io.BufferedInputStream, java.io.ByteArrayInputStream, java.io.DataInputStream, java.io.FilterInputStream, java.io.InputStream input streams over assets and byte arrays yes
java.io.BufferedReader, java.io.InputStreamReader, java.io.Reader, java.io.StringReader readers and buffered line reading not yet graded
java.util.Scanner java.util.scanner over a stream not yet graded
java.io.ByteArrayOutputStream, java.io.OutputStream output streams into byte arrays not yet graded
java.util.stream.Collectors, java.util.stream.Stream java streams and collectors not yet graded
java.nio.ByteBuffer byte buffers with their byte order yes
java.util.jar.JarFile, java.util.zip.ZipEntry, java.util.zip.ZipFile zip and jar files and their entries not yet graded
java.io.Closeable, java.lang.AutoCloseable close calls (no effect) not yet graded
java.util.zip.Adler32, java.util.zip.CRC32, java.util.zip.Checksum crc32 and adler32 checksums not yet graded
java.util.zip.GZIPInputStream, java.util.zip.InflaterInputStream gzip and inflater input streams not yet graded
java.util.zip.Inflater the raw inflater not yet graded
javax.crypto.Cipher javax.crypto ciphers (aes, des, rc4, chacha) in their modes not yet graded
javax.crypto.Mac hmac not yet graded
javax.crypto.SecretKeyFactory, javax.crypto.spec.PBEKeySpec pbkdf2 key derivation not yet graded
java.security.Key, javax.crypto.SecretKey, javax.crypto.spec.GCMParameterSpec, javax.crypto.spec.IvParameterSpec, javax.crypto.spec.SecretKeySpec keys, ivs and gcm parameters not yet graded
java.lang.Iterable, java.util.AbstractCollection, java.util.AbstractList, java.util.AbstractMap, java.util.AbstractSet, java.util.ArrayDeque, java.util.ArrayList, java.util.Collection, java.util.Deque, java.util.HashMap, java.util.HashSet, java.util.Iterator, java.util.LinkedHashMap, java.util.LinkedHashSet, java.util.LinkedList, java.util.List, java.util.ListIterator, java.util.Map, java.util.Map$Entry, java.util.NavigableMap, java.util.NavigableSet, java.util.Queue, java.util.Set, java.util.SortedMap, java.util.SortedSet, java.util.Stack, java.util.TreeMap, java.util.TreeSet, java.util.Vector lists, maps, sets, queues and their iterators, in java 8's iteration order not yet graded
java.util.Collections the collections helpers (sort, reverse, shuffle) not yet graded
java.util.Comparator comparators not yet graded
java.math.BigInteger big integers not yet graded
org.json.JSONArray, org.json.JSONObject org.json objects and arrays not yet graded
android.os.Debug the debugger checks, answered as a clean phone not yet graded
android.os.SystemClock, java.lang.Thread the clock and thread sleeps, answered as a clean phone not yet graded

115 items: graded 31, not yet graded 84.

app fields by name (android.app_values)

manifest, signer and network-config fields read from any apk. any lane can ask for them: the metadata lane graded package_name on day 21.

what the code calls it what it reads or does graded?
activity_count how many activities the manifest declares not yet graded
allow_backup the manifest's allowbackup flag not yet graded
cleartext_domain the domain cleartext traffic is allowed to not yet graded
cleartext_domains every domain cleartext traffic is allowed to not yet graded
cleartext_permitted whether cleartext traffic is permitted in effect not yet graded
component_count how many components the manifest declares not yet graded
debuggable the manifest's debuggable flag not yet graded
deep_link_count how many deep links the intent filters declare not yet graded
dex_count how many dex files the apk holds not yet graded
exported_component_count how many components are exported not yet graded
exported_provider the exported content provider not yet graded
file_count how many files the apk holds not yet graded
grant_uri_permissions the provider's granturipermissions flag not yet graded
main_activity the launcher activity not yet graded
mechanic the challenge's mechanic label from the manifest meta-data not yet graded
min_sdk the minimum sdk version not yet graded
network_security_config the network security config file not yet graded
nsc_referenced whether the manifest references that config not yet graded
nsc_status the effective state of the network security config not yet graded
package_name the package name yes
permission_count how many permissions the app asks for not yet graded
permissions the permissions the app asks for not yet graded
provider_authority the content provider's authority not yet graded
provider_count how many content providers not yet graded
receiver_count how many broadcast receivers not yet graded
service_count how many services not yet graded
signer_count how many signer certificates not yet graded
signer_issuer the signing certificate's issuer not yet graded
signer_sha256 the signing certificate's sha-256 not yet graded
signer_subject the signing certificate's subject not yet graded
target_sdk the target sdk version not yet graded
user_cas_trusted whether user-installed certificates are trusted not yet graded
uses_cleartext_traffic the manifest's usescleartexttraffic flag not yet graded
version_code the version code not yet graded
version_name the version name not yet graded

35 items: graded 1, not yet graded 34.

lane total 227: graded 46, not yet graded 181.

metadata

metadata: graded 74, not yet graded 289.

  • 363items14 tables
  • 74graded
  • 289not yet graded
  • 20%graded share
graded 74 (20%)not yet graded 289 (80%)

a set of files (documents, images, executables, archives, captures, disk images) and a list of named properties to read from them: roster-md5, pe-coff-machine-u16-hex, relation-identical-sha256-groups.

the solver tries the exact property readers first, then the header structs, the family records, the other lanes' readers by exact name, and only then a guess that must cover every word of the property.

graded here means a graded field reached that reader by its name, or its family appeared in a graded set.

general properties (forensics.PROPERTIES)

properties registered directly: name, size, digests, text, image sizes and a few family fields. a field may put a member's name first (roster-md5).

what the code calls it what it reads or does graded?
filename the member's file name as stored yes
size-bytes the file size in bytes yes
md5 md5 of the file yes
sha1 sha-1 of the file yes
sha256 sha-256 of the file yes
text-utf8-bom-present whether the text utf8 bom is present yes
text-utf32le-bom-present whether the text utf32le bom is present not yet graded
text-utf32be-bom-present whether the text utf32be bom is present not yet graded
text-utf16le-bom-present whether the text utf16le bom is present not yet graded
text-utf16be-bom-present whether the text utf16be bom is present not yet graded
text-bom which byte-order mark the text starts with not yet graded
text-encoding the text encoding, read from the bom and the bytes not yet graded
text-valid-utf8 whether the bytes are valid utf-8 not yet graded
text-newline-style lf, crlf, cr or mixed line endings not yet graded
text-line-count how many lines the text has not yet graded
text-char-count how many characters the text has not yet graded
text-trailing-newline whether the text ends with a newline not yet graded
text-has-nul whether the text holds a nul byte not yet graded
jpeg-sof-dimensions-pixels width x height from the jpeg start-of-frame yes
pe-original-filename-arch the pe original filename arch not yet graded
pe-original-filename-arch-matches-machine the pe original filename arch matches machine not yet graded
pe-original-filename-arch-mismatch whether the pe original filename arch disagrees not yet graded
pe-filename, pe-file-name the pe's own file name, read two ways not yet graded
registry-hive-root-name the registry hive root name yes

24 items: graded 8, not yet graded 16.

zip archives (forensics.ZIP_PROPERTIES)

zip structure, totals and member lists.

what the code calls it what it reads or does graded?
zip-eocd-disk-number the zip eocd disk number not yet graded
zip-eocd-cd-disk the zip eocd cd disk not yet graded
zip-eocd-disk-entries the zip eocd disk entries not yet graded
zip-eocd-total-entries the zip eocd total entries yes
zip-eocd-cd-size the zip eocd cd size not yet graded
zip-eocd-cd-offset the zip eocd cd offset not yet graded
zip-eocd-comment-length the zip eocd comment length not yet graded
zip-central-directory-entries the zip central directory entries not yet graded
zip-central-directory-member-names member names from the central directory, sorted, then in directory order yes
zip-local-header-member-names every local file header's own name not yet graded
zip-total-uncompressed-bytes the zip total uncompressed in bytes not yet graded
zip-total-compressed-bytes the zip total compressed in bytes not yet graded
zip-local-header-count the zip local header count not yet graded
zip-file-entries the zip file entries not yet graded
zip-directory-entries the zip directory entries not yet graded
zip-empty-file-count the zip empty file count not yet graded
zip-nonempty-file-count the zip nonempty file count not yet graded
zip-entry-count-mismatch whether the zip entry count disagrees not yet graded
zip-host-os, zip-host-system, zip-made-by-host, zip-made-by-os, zip-version-made-by-host, zip-version-made-by-os, zip-creator-os the host os the zip records each entry was made on not yet graded
zip-host-os-id, zip-made-by-host-id, zip-version-made-by-host-id the numeric host os id not yet graded
zip-mixed-host-os, zip-host-os-mixed whether entries come from more than one host os not yet graded
zip-version-made-by, zip-made-by-version, zip-version-made-by-spec the zip version that made each entry not yet graded
zip-version-needed, zip-version-needed-to-extract the central record's and the local header's claims together not yet graded
zip-duplicate-names, zip-duplicate-entries entry names stored twice not yet graded
zip-has-duplicate-names, zip-duplicate-names-present whether the zip has duplicate names not yet graded
zip-case-collisions, zip-case-collision-names, zip-case-insensitive-collisions entry names that differ only by case not yet graded
zip-has-case-collisions, zip-case-collisions-present whether the zip has case collisions not yet graded
zip-comment, zip-archive-comment the archive comment not yet graded

28 items: graded 2, not yet graded 26.

pe files (forensics.PE_PROPERTIES)

pe headers, version resource and labels.

what the code calls it what it reads or does graded?
pe-section-names, pe-sections, pe-section-name-list, pe-section-table the pe section names not yet graded
pe-section-count, pe-number-of-sections, pe-sections-count the pe section count not yet graded
pe-entry-point-section, pe-entry-point-section-name, pe-entry-section the pe entry point section not yet graded
pe-import-dlls, pe-imported-dlls, pe-import-dll-names, pe-import-libraries, pe-imported-libraries, pe-imported-modules, pe-import-modules imported dll names as stored, then lowercased not yet graded
pe-import-dll-count, pe-imported-dll-count, pe-import-library-count the pe import dll count not yet graded
pe-import-function-count, pe-imported-function-count, pe-import-functions-count, pe-imported-functions-count the pe import function count not yet graded
pe-import-count, pe-imports-count how many imports not yet graded
pe-imphash, pe-import-hash the pe imphash not yet graded
pe-export-names, pe-exports, pe-exported-functions, pe-export-functions the pe export names not yet graded
pe-export-count, pe-exported-function-count the pe export count not yet graded
pe-subsystem, pe-subsystem-name, pe-subsystem-label the pe subsystem not yet graded
pe-timestamp-utc, pe-compile-time, pe-compile-time-utc, pe-build-time, pe-compile-timestamp-utc, pe-time-date-stamp-utc, pe-link-time, pe-time-date-stamp-iso the pe timestamp utc not yet graded
pe-timestamp, pe-compile-timestamp, pe-build-timestamp the pe timestamp not yet graded
pe-pdb-path, pe-debug-pdb-path, pe-pdb, pe-pdb-file-name the pe pdb path not yet graded
pe-is-dll whether the pe is a dll not yet graded
pe-is-dotnet, pe-is-managed, pe-is-net whether the pe is a managed .net assembly not yet graded
pe-signed, pe-is-signed, pe-has-signature, pe-authenticode-present, pe-has-authenticode, pe-has-digital-signature, pe-signature-present whether the pe carries an authenticode signature not yet graded
pe-rich-header-present, pe-has-rich-header whether the pe rich header is present not yet graded
pe-stored-checksum-hex, pe-header-checksum-hex the pe stored checksum as hex not yet graded
pe-computed-checksum-hex, pe-checksum-computed-hex the pe computed checksum as hex not yet graded
pe-checksum-valid, pe-checksum-matches, pe-checksum-correct whether the pe checksum is valid not yet graded
pe-overlay-size, pe-overlay-size-bytes, pe-overlay-bytes the pe overlay size not yet graded
pe-overlay-offset, pe-overlay-start the pe overlay offset not yet graded
pe-has-overlay, pe-overlay-present whether the pe has overlay not yet graded
pe-has-version-resource, pe-version-resource-present, pe-has-version-info whether the pe has version resource not yet graded

25 items: graded 0, not yet graded 25.

pdf files (forensics.PDF_PROPERTIES)

pdf versions, counts and info keys.

what the code calls it what it reads or does graded?
pdf-header-version the pdf header version yes
pdf-catalog-version the pdf catalog version not yet graded
pdf-effective-version the pdf effective version not yet graded
pdf-is-pdf, pdf-header-present whether the file is a pdf not yet graded
pdf-starts-with-header the pdf starts with header not yet graded
pdf-eof-present whether the pdf eof is present not yet graded
pdf-eof-count the pdf eof count not yet graded
pdf-object-count the pdf object count not yet graded
pdf-page-count the pdf page count not yet graded
pdf-encrypted whether the pdf is encrypted not yet graded
pdf-title the pdf title not yet graded
pdf-author the pdf author not yet graded
pdf-subject the pdf subject not yet graded
pdf-keywords the pdf keywords not yet graded
pdf-creator the pdf creator not yet graded
pdf-producer the pdf producer not yet graded
pdf-creationdate the pdf creationdate not yet graded
pdf-moddate the pdf moddate not yet graded
pdf-info-title the pdf info title not yet graded
pdf-info-author the pdf info author not yet graded
pdf-info-subject the pdf info subject not yet graded
pdf-info-keywords the pdf info keywords not yet graded
pdf-info-creator the pdf info creator not yet graded
pdf-info-producer the pdf info producer not yet graded
pdf-info-creationdate the pdf info creationdate not yet graded
pdf-info-moddate the pdf info moddate not yet graded
pdf-creation-date the pdf creation date not yet graded
pdf-mod-date the pdf mod date not yet graded
pdf-modification-date the pdf modification date not yet graded
pdf-info-creation-date the pdf info creation date not yet graded
pdf-info-mod-date the pdf info mod date not yet graded
pdf-info-modification-date the pdf info modification date not yet graded

32 items: graded 1, not yet graded 31.

png files (forensics.PNG_PROPERTIES)

the png chunk walk and ihdr fields.

what the code calls it what it reads or does graded?
png-ihdr-dimensions-pixels width x height from the png ihdr chunk yes
png-ihdr-width the png ihdr width not yet graded
png-ihdr-height the png ihdr height not yet graded
png-ihdr-bit-depth the png ihdr bit depth not yet graded
png-ihdr-color-type the png ihdr color type not yet graded
png-ihdr-interlace the png ihdr interlace not yet graded
png-chunk-count the png chunk count not yet graded
png-chunk-order the png chunk order not yet graded
png-chunk-types the png chunk types not yet graded
png-crc-valid whether the png crc is valid not yet graded
png-bad-crc-chunks the png bad crc chunks not yet graded
png-unexpected-chunks the png unexpected chunks not yet graded
png-trailing-bytes how many bytes follow the iend chunk not yet graded
png-trailing-data the bytes after the iend chunk not yet graded
png-geometry-valid whether the png geometry is valid not yet graded
png-text the png text not yet graded

16 items: graded 1, not yet graded 15.

executables (forensics.EXECUTABLE_PROPERTIES)

ranked labels for any executable: architecture, format, platform.

what the code calls it what it reads or does graded?
architecture, cpu-architecture, machine-architecture, target-architecture the cpu architecture, ranked spellings not yet graded
pe-architecture the pe architecture not yet graded
pe-cpu-architecture the pe cpu architecture not yet graded
pe-machine-architecture the pe machine architecture not yet graded
pe-arch the pe arch not yet graded
elf-architecture the elf architecture not yet graded
elf-cpu-architecture the elf cpu architecture not yet graded
elf-machine-architecture the elf machine architecture not yet graded
elf-arch the elf arch not yet graded
macho-architecture the macho architecture not yet graded
macho-cpu-architecture the macho cpu architecture not yet graded
macho-machine-architecture the macho machine architecture not yet graded
macho-arch the macho arch not yet graded
mach-o-architecture the mach o architecture not yet graded
mach-o-cpu-architecture the mach o cpu architecture not yet graded
mach-o-machine-architecture the mach o machine architecture not yet graded
mach-o-arch the mach o arch not yet graded
target-os, operating-system, target-operating-system, runs-on-os the operating system the executable targets not yet graded
platform, target-platform, runs-on, run-platform, runs-on-platform go's goos/goarch pair first (windows/amd64, what the prompt's "run where" means to a go-built drop), then the grader-vocabulary pair not yet graded
is-executable, is-runnable whether the file is an executable at all not yet graded
pe-format, pe-optional-magic-label, pe-optional-magic-name, pe-magic-label, pe-magic-name, pe-optional-header-format, pe-image-format the pe format not yet graded
pe-bits, pe-bitness the pe bits not yet graded
true-format, actual-format, real-format, detected-format, magic-format, content-format the format the bytes say, whatever the extension claims not yet graded
extension-matches, extension-matches-format, extension-matches-content, extension-matches-magic whether the extension matches not yet graded
extension-mismatch, extension-mismatches-content whether the extension disagrees not yet graded
is-decoy an executable extension the bytes do not back (a renamed text or zip, or another platform's binary) not yet graded

26 items: graded 0, not yet graded 26.

zip provenance checks (forensics.ZIP_CHECKS)

eight checks on how a zip was made, each answered in several shapes; one row per check, its spellings counted once.

what the code calls it what it reads or does graded?
zip-path-traversal, path-traversal, traversal, dot-dot-paths entries whose path climbs out with ..: as a yes / no, the names, the entries or a count (15 spellings) not yet graded
zip-absolute-path, absolute-path, absolute-paths entries with an absolute path: as a yes / no, the names, the entries or a count (10 spellings) not yet graded
zip-backslash-separator, backslash-separator, backslash-separators, backslashes entries named with backslash separators: as a yes / no, the names, the entries or a count (15 spellings) not yet graded
zip-drive-letter, drive-letter, drive-letters, drive-letter-paths entries named with a drive letter: as a yes / no, the names, the entries or a count (15 spellings) not yet graded
zip-encrypted, encrypted, encryption, encrypted-flag encrypted entries: as a yes / no, the names, the entries or a count (15 spellings) not yet graded
zip-data-descriptor, data-descriptor, data-descriptor-flag entries with the data-descriptor flag: as a yes / no, the names, the entries or a count (10 spellings) not yet graded
zip-unix-mode-non-unix-host, unix-mode-non-unix-host, unix-mode-on-non-unix-host, unix-mode-mismatch unix permission bits on an entry made on a non-unix host: as a yes / no, the names, the entries or a count (15 spellings) not yet graded
zip-timestamp-mismatch, timestamp-mismatch, time-mismatch, extended-timestamp-mismatch an extended timestamp that disagrees with the dos time: as a yes / no, the names, the entries or a count (15 spellings) not yet graded

8 items: graded 0, not yet graded 8.

header structs (forensics.STRUCTS)

fixed headers read field by field, named <family>-<struct>-<field>-<width>-<format> (pe-coff-machine-u16-hex); a missing width or struct word resolves when one field fits.

what the code calls it what it reads or does graded?
pe.dos 17 fields of the pe dos header (e_cblp, e_cp, e_cparhdr, ...) not yet graded
pe.nt 1 field of the pe nt header (signature) not yet graded
pe.coff 7 fields of the pe coff header (characteristics, machine, number_of_sections, ...) yes
pe.optional 30 fields of the pe optional header (address_of_entry_point, base_of_code, base_of_data, ...) yes
pe.fixed_file_info 13 fields of the pe fixed file info header (file_date_ls, file_date_ms, file_flags, ...) not yet graded
pe.translation 2 fields of the pe translation header (code_page, language) not yet graded
elf.ident 5 fields of the elf ident header (ei_abiversion, ei_class, ei_data, ...) not yet graded
elf.header 13 fields of the elf header (e_ehsize, e_entry, e_flags, ...) yes
macho.header 8 fields of the macho header (cpusubtype, cputype, filetype, ...) not yet graded
macho.fat 2 fields of the macho fat header (magic, nfat_arch) not yet graded
macho.fat_arch 5 fields of the macho fat arch header (align, cpusubtype, cputype, ...) not yet graded
dex.header 22 fields of the dex header (checksum, class_defs_off, class_defs_size, ...) not yet graded
class.header 4 fields of the class header (constant_pool_count, magic, major_version, ...) not yet graded
wasm.header 2 fields of the wasm header (magic, version) not yet graded
neko.header 4 fields of the neko header (codesize, magic, nfields, ...) not yet graded
tiff.header 3 fields of the tiff header (byte_order, ifd_offset, magic) not yet graded
gzip.header 7 fields of the gzip header (extra_flags, flags, id1, ...) not yet graded
gzip.trailer 2 fields of the gzip trailer (crc32, isize) not yet graded
png.ihdr 7 fields of the png ihdr header (bit_depth, color_type, compression_method, ...) not yet graded
jpeg.sof 5 fields of the jpeg sof header (components, height, length, ...) not yet graded
jpeg.app0 8 fields of the jpeg app0 header (length, units, version_major, ...) not yet graded
zip.eocd 8 fields of the zip eocd header (cd_disk, cd_offset, cd_size, ...) not yet graded
zip.central 17 fields of the zip central header (compressed_size, compression_method, crc32, ...) not yet graded
zip.local 11 fields of the zip local header (compressed_size, compression_method, crc32, ...) not yet graded
pdf.header 2 fields of the pdf header (major, minor) not yet graded
bmp.file_header 5 fields of the bmp file header (file_size, pixel_offset, reserved1, ...) not yet graded
bmp.dib 11 fields of the bmp dib header (bits_per_pixel, colors_important, colors_used, ...) not yet graded
gif.screen 5 fields of the gif screen header (background_color_index, height, packed, ...) not yet graded
wav.riff 1 field of the wav riff header (size) not yet graded
wav.fmt 6 fields of the wav fmt header (audio_format, bits_per_sample, block_align, ...) not yet graded
wav.data 1 field of the wav data header (size) not yet graded
7z.signature_header 7 fields of the 7z signature header (major_version, minor_version, next_header_crc, ...) not yet graded
cab.header 13 fields of the cab header (cabinet_index, cabinet_size, file_count, ...) not yet graded
dmg.koly 19 fields of the dmg koly header (data_checksum_size, data_checksum_type, data_fork_length, ...) not yet graded
minidump.header 7 fields of the minidump header (checksum, flags, signature, ...) not yet graded
ttf.offset_table 5 fields of the ttf offset table (entry_selector, num_tables, range_shift, ...) not yet graded
ico.header 3 fields of the ico header (count, reserved, type) not yet graded
ico.entry 8 fields of the ico entry (bits_per_pixel, color_count, height, ...) not yet graded
mft.record 13 fields of the mft record (allocated_size, base_record, first_attribute_offset, ...) not yet graded

39 items: graded 3, not yet graded 36.

record readers (records.READERS)

one reader per file family, returning one record whose keys answer fields by name. 9 of them are the disk and memory container headers of hlib.containers.

what the code calls it what it reads or does graded?
ole2 ole2 compound files: msi tables, outlook .msg streams, jump lists (hlib.records) yes
evtx windows event logs: header, records and event data (hlib.records) yes
registry-hive registry hives: root key, keys and values (hlib.records) yes
pcap packet captures: header and packets; on request the hosts, dns names, tls server names and http hosts (hlib.records) yes
pcapng pcapng captures: blocks, interfaces, packets and the same lists (hlib.records) not yet graded
sqlite sqlite databases: header, page size, tables and rows (hlib.records) yes
plist property lists, xml or binary (hlib.records) not yet graded
iso iso 9660 images: the volume descriptor and files (hlib.records) not yet graded
vhd vhd disk images: footer and geometry (hlib.records) not yet graded
vhdx vhdx disk images: headers and metadata (hlib.records) not yet graded
disk raw disks: mbr and guid partition table, partition columns, the partition an offset names and its filesystem (hlib.records) yes
torrent torrent files: name, trackers, pieces, files (hlib.records) not yet graded
x509 x509 certificates: subject, issuer, validity, fingerprints (hlib.records) yes
ini ini files: sections and keys (hlib.records) not yet graded
rar rar 4 and 5 archives: headers, flags, file names and sizes (hlib.records) not yet graded
ttf truetype fonts: offset table, head, maxp and name tables (hlib.records) not yet graded
otf opentype fonts: the same tables (hlib.records) not yet graded
ico icons: directory and entries (hlib.records) not yet graded
cur cursors: directory and entries (hlib.records) not yet graded
rtf rtf documents: control words, info group, fonts, embedded objects (hlib.records) not yet graded
ese ese databases: header and tables (hlib.records) not yet graded
tar tar archives: the ustar header and the member list (hlib.records) not yet graded
tiff tiff images: the first ifd's tags and dimensions (hlib.records) not yet graded
dex android dex files: header with verified checksum and signature (hlib.records) not yet graded
zip zip archives: members, totals and comment (hlib.records) yes
nupkg nuget packages: the zip record plus the nuspec (hlib.records) not yet graded
vsix vs code / visual studio extensions: the zip record plus the manifest (hlib.records) not yet graded
wheel python wheels: the zip record plus the wheel metadata (hlib.records) not yet graded
epub epub books: the zip record plus the package metadata (hlib.records) not yet graded
odf opendocument files: the zip record plus meta.xml (hlib.records) not yet graded
webext browser extensions: the zip record plus manifest.json (hlib.records) not yet graded
pyc python bytecode: magic, version, flags, source size and time (hlib.records) not yet graded
thumbcache windows thumbcache: header and carved entries (hlib.records) not yet graded
wim windows imaging archives: header and images (hlib.records) not yet graded
crashdump windows crash dumps (pagedump / pagedu64): header (hlib.containers) not yet graded
hiberfil windows hibernation files: header (hlib.containers) not yet graded
qcow2 qcow2 disk images: header (hlib.containers) not yet graded
vmdk vmdk disk images: descriptor and header (hlib.containers) not yet graded
ewf expert witness (e01) images: header (hlib.containers) not yet graded
ntfs ntfs volumes: boot sector (hlib.containers) not yet graded
exfat exfat volumes: boot sector (hlib.containers) not yet graded
fat fat12 / fat16 / fat32 volumes: boot sector (hlib.containers) not yet graded
ext ext2 / ext3 / ext4 volumes: superblock (hlib.containers) not yet graded
mft an ntfs $mft extract: every file record, names and counts (hlib.records) not yet graded
pdf pdf files: counts by risky key, uris, javascript (hlib.records) yes
png png files: chunks, text, idat totals, bad crcs (hlib.records) yes
7z 7z archives: the signature header (hlib.records) not yet graded
journal systemd journal files: header, ids and counters (hlib.records) not yet graded
pst outlook pst files: header (hlib.records) not yet graded

49 items: graded 10, not yet graded 39.

family records (forensics.RECORD_READERS)

the families other lanes parse every day, registered as records too, so a metadata question about an elf or an apk has a reader (pdf is in both registries and counted once, above).

what the code calls it what it reads or does graded?
lnk windows shortcuts: the full shell-link record, the target rebuilt from shell items yes
prefetch windows prefetch: executable name, run count, run times, files yes
eml email messages: every header as stored, threading, attachments yes
ooxml office open xml documents: core and app properties yes
apk android apps: manifest and signer fields yes
jar java archives: every manifest attribute and the class count yes
java-class a bare java class file: versions, names, members not yet graded
elf elf files: header, sections, symbols, stripped yes
pe pe files: header scalars, sections, imports, exports, .net columns yes
macho mach-o files: arches, cpu types, segments, sections yes
macho-fat fat mach-o files: every arch yes
wasm webassembly modules: version, sections, imports, exports yes

12 items: graded 11, not yet graded 1.

raw header parsers (headers.PARSERS)

the last structural guess: an unknown property's words against every raw header field of the file's format.

what the code calls it what it reads or does graded?
gzip raw <struct>.<field> readers of a gzip file, matched to a property's words not yet graded
tar raw <struct>.<field> readers of a tar file, matched to a property's words not yet graded
bmp raw <struct>.<field> readers of a bmp file, matched to a property's words not yet graded
gif raw <struct>.<field> readers of a gif file, matched to a property's words not yet graded
png raw <struct>.<field> readers of a png file, matched to a property's words yes
riff raw <struct>.<field> readers of a riff file, matched to a property's words not yet graded
sqlite raw <struct>.<field> readers of a sqlite file, matched to a property's words yes
id3 raw <struct>.<field> readers of a id3 file, matched to a property's words not yet graded
zip raw <struct>.<field> readers of a zip file, matched to a property's words yes
pdf raw <struct>.<field> readers of a pdf file, matched to a property's words yes
7z raw <struct>.<field> readers of a 7z file, matched to a property's words not yet graded
cab raw <struct>.<field> readers of a cab file, matched to a property's words not yet graded
minidump raw <struct>.<field> readers of a minidump file, matched to a property's words not yet graded
mft raw <struct>.<field> readers of a mft file, matched to a property's words not yet graded
dmg raw <struct>.<field> readers of a dmg file, matched to a property's words not yet graded

15 items: graded 4, not yet graded 11.

property routes outside the tables

readers a property reaches by its shape rather than its exact name, in the order the solver tries them after the exact readers.

what the code calls it what it reads or does graded?
split_field any property after a member's stem (roster-md5): the stem picks the member, the rest is the property (forensics.split_field) yes
record_guess a family whose reader returns one record answers the field its words name, most words wins, a tie never (forensics.record_guess) yes
struct_set_value a header field over every record of its struct (...-set), as a json list (forensics.struct_set_value) yes
bare_struct_value a header field named with no width or format word: decimal, then padded hex (forensics.bare_struct_value) not yet graded
synthesis a cross-member field the question spells out: named files, a per-file property and an order (synthesis.answer) yes
msi.value any msi-<property words> from a windows installer's property table (msi.value) yes
versioninfo a pe's version resource: every string key, the fixed block, the translation (versioninfo.read) yes
media.stream_value media-primary-<audio, video, subtitle>-<key> from ffprobe, with derived keys (dimensions, frame rate, duration) (media.stream_value) yes
media.container_value media-container-<key>: duration, size, brand, title (media.container_value) not yet graded
headers.guess an unknown property matched word by word to a raw header field (headers.guess) not yet graded
exif_guess the exiftool tag that covers every word of the property, never a tie (forensics.exif_guess) not yet graded

11 items: graded 7, not yet graded 4.

relation kinds (forensics.relation_value)

any relation-<words> field on a corpus of files: the words pick one of five kinds, first match wins. identical goes out in one form, the other four as ranked candidates.

what the code calls it what it reads or does graded?
relation-fabricated decoys: a claim the bytes contradict, a broken checksum (words such as borrowed, collision, collisions, decoy) not yet graded
relation-provenance a file and the source it claims or derives from (words such as ancestor, ancestors, ancestry, attribution) not yet graded
relation-containment one file inside another: archive members, mail attachments (words such as bundle, bundled, child, children) not yet graded
relation-semantic the same content in another encoding: perceptual image keys, decoded audio and video, crops found inside their original (words such as canonical, crop, cropped, crops) not yet graded
relation-identical byte-identical groups by digest (the graded rule, one form) (words such as byte, bytes, clone, cloned) yes

5 items: graded 1, not yet graded 4.

file kinds the sniffer names (forensics.sniff)

every kind the format sniffer can return from the bytes, and where it goes. a test keeps every kind routed.

what the code calls it what it reads or does graded?
7z read by a record reader, a header struct and a raw header parser not yet graded
apk read by a record reader yes
asf read by the media reader not yet graded
avi read by the media reader not yet graded
bmp read by a header struct and a raw header parser not yet graded
bzip2 a compression wrapper: the member inside is the evidence not yet graded
cab read by a header struct and a raw header parser not yet graded
compress a compression wrapper: the member inside is the evidence not yet graded
crashdump read by a record reader not yet graded
cur read by a record reader and a header struct not yet graded
dex read by a record reader and a header struct not yet graded
dmg read by a header struct and a raw header parser not yet graded
elf read by a record reader and a header struct yes
eml read by a record reader yes
epub read by a record reader not yet graded
ese read by a record reader not yet graded
evtx read by a record reader yes
ewf read by a record reader not yet graded
exfat read by a record reader not yet graded
ext read by a record reader not yet graded
fat read by a record reader not yet graded
flac read by the media reader yes
flv read by the media reader not yet graded
gif read by a header struct and a raw header parser not yet graded
gzip read by a header struct and a raw header parser not yet graded
hiberfil read by a record reader not yet graded
ico read by a record reader and a header struct not yet graded
jar read by a record reader yes
java-class read by a record reader and a header struct not yet graded
jpeg read by a header struct yes
lnk read by a record reader yes
macho read by a record reader and a header struct yes
macho-fat read by a record reader yes
memory a memory image, sent to the memory tools not yet graded
mft read by a record reader, a header struct and a raw header parser not yet graded
minidump read by a header struct and a raw header parser not yet graded
mkv read by the media reader not yet graded
mp3 read by the media reader yes
mp4 read by the media reader yes
neko_bytecode read by the binary lane's neko reader yes
ntfs read by a record reader and a header struct not yet graded
nupkg read by a record reader not yet graded
odf read by a record reader not yet graded
ogg read by the media reader yes
ole2 read by a record reader yes
ooxml read by a record reader yes
otf read by a record reader and a header struct not yet graded
pcap read by a record reader yes
pcapng read by a record reader not yet graded
pdf read by a record reader, a header struct and a raw header parser yes
pe read by a record reader and a header struct yes
png read by a record reader, a header struct and a raw header parser yes
prefetch read by a record reader yes
pyc read by a record reader not yet graded
qcow2 read by a record reader not yet graded
rar read by a record reader not yet graded
registry-hive read by a record reader yes
rtf read by a record reader not yet graded
sqlite read by a record reader and a raw header parser yes
tar read by a record reader and a raw header parser not yet graded
thumbcache read by a record reader not yet graded
tiff read by a record reader and a header struct not yet graded
ttf read by a record reader and a header struct not yet graded
vmdk read by a record reader not yet graded
vsix read by a record reader not yet graded
wasm read by a record reader and a header struct yes
wav read by a header struct and the media reader yes
webext read by a record reader not yet graded
wheel read by a record reader not yet graded
wim read by a record reader not yet graded
xz a compression wrapper: the member inside is the evidence not yet graded
zip read by a record reader, a header struct and a raw header parser yes
zstd a compression wrapper: the member inside is the evidence not yet graded

73 items: graded 26, not yet graded 47.

lane total 363: graded 74, not yet graded 289.

script

script: graded 69, not yet graded 30.

  • 99items7 tables
  • 69graded
  • 30not yet graded
  • 70%graded share
graded 69 (70%)not yet graded 30 (30%)

a bundle of script specimens a set, in one of more than thirty languages (powershell, batch, vbscript, python, bash, php, lua, perl, groovy, jsp and more). each hides an inert descriptor: its steps, role, indicators and the next stage.

the solver finds the descriptor in any language (material blocks, fragments, every string literal under every codec, an analysis header), decodes it, and answers each field from its suffix family. role and att&ck answers come from the graded label tables in the cross-lane section.

graded here means a graded field used that family, or a graded bundle held that language, header, layer or label.

answer families (suffix of the field name)

a script field is <member>-<family>: the family names what to read from that member's decoded descriptor or its code. the same few readers answer every family, so a family is one row whatever the language.

what the code calls it what it reads or does graded?
attack the att&ck technique id: the descriptor's own, else the label tables by role and language yes
campaign the campaign identifier in the decoded descriptor yes
campaign-token the unique token inside the campaign id, after the first hyphen yes
carrier the carrier profile: source, bytecode, frozen or protected yes
feature the advanced bash feature the specimen shows yes
file-path the file path in the descriptor yes
handoff-id the handoff id indicator yes
indicator the primary indicator: the first one present in the asked order yes
next-language the next script language in the inert handoff yes
obfuscation the obfuscation structure yes
path-leaf the last segment of the embedded file path yes
primitive the bash syntax primitive yes
role the specimen's role, from its ordered steps through the label tables yes
secondary the secondary indicator, which the role decides (a wallet, a staged file name, a recovery note) yes
stage-count how many stages the chain has yes
stage-profile the multi-stage relationship profile yes
steps the descriptor's ordered behaviour steps yes
style how the inspect function is emitted, and the composite style labels yes
tertiary the tertiary indicator, which the role decides (a mutex, a user agent, an encrypted-file extension) yes
url the url indicator yes
url-host the host of the url yes
adapter the windows adapter name the reconstructed plan references yes
control the control-flow form around the decode: a guard, a run-once loop, a dispatch yes
representation how the material is written: base64 chunks, decimal or hex lists yes
transform the reversible byte transform on the material yes
next-stage the next-stage file name yes
upload-url the upload url indicator yes
host-id the host identifier in the descriptor yes
note-name the recovery-note file name in the descriptor yes
registry the registry path in the descriptor not yet graded
unsupported members whose adapter names a network primitive none of their steps touch not yet graded
missing members whose claimed next stage the bundle never ships not yet graded
delivered shipped members that a fetching stage claims as its next not yet graded
filter wmi persistence: the event filter's query, name and namespace not yet graded
consumer wmi persistence: the consumer's class, command and name not yet graded
binding wmi persistence: which filter-to-consumer binding resolves not yet graded
subscription wmi persistence: which subscription survives a reboot not yet graded
namespace wmi persistence: the namespace the subscription lives in not yet graded

38 items: graded 29, not yet graded 9.

language readers

one reader per language family; anything else goes to the generic reader, which is how thirty languages were read with no per-language code. graded means a graded bundle held a member of that language.

what the code calls it what it reads or does graded?
powershell powershell specimens: descriptor, indicators, scenario (script.ps_answers) yes
jscript jscript and node specimens: the descriptor read in an empty node vm, the inspect-function style (script.js_answers) yes
python python specimens: the descriptor and the obfuscation structure, never running the code (python.py_answers) yes
batch batch specimens: fragment reconstruction, expansion and control forms (batch.bat_answers) yes
vbscript vbscript specimens: codec and material decode, block-stack control (vbscript.vbs_answers) yes
any other language the generic reader for a language never seen: the descriptor from material, fragments, every literal under every codec (specimen.answers) yes
wmi mof wmi filters, consumers and bindings built in any way (mof text, powershell, wmic, batch echo) (wmi.fields) yes
compiled carriers compiled scripts to text: applescript, luac listings, autoit, else printable strings; never executed (carriers.to_text) not yet graded

8 items: graded 7, not yet graded 1.

analysis header codecs (specimen.HEADER_CODECS)

a specimen may carry its descriptor in an analysis header line; the codec word says how the payload is written. an unknown codec goes through every decoder, reversed too.

what the code calls it what it reads or does graded?
FRAG HUNTRESS_ANALYSIS_V1:FRAG-<payload>: fragments joined back into the payload yes
HB64 HUNTRESS_ANALYSIS_V1:HB64-<payload>: hex of base64 yes
HEX HUNTRESS_ANALYSIS_V1:HEX-<payload>: hex digits yes
B64 HUNTRESS_ANALYSIS_V1:B64-<payload>: base64 yes
B32 HUNTRESS_ANALYSIS_V1:B32-<payload>: base32 not yet graded
B85 HUNTRESS_ANALYSIS_V1:B85-<payload>: base85 not yet graded
LYR HUNTRESS_ANALYSIS_V1:LYR-<payload>: a payload under named layers (<layers>-<payload>), undone in turn yes
SPLIT no payload: the next array's string literals join into <codec>-<payload>, both orders, any joiner (specimen.split_pieces) yes

8 items: graded 6, not yet graded 2.

header layers (specimen.LAYERS)

the layer names a LYR- header stacks, undone right to left.

what the code calls it what it reads or does graded?
b64, base64 base64 yes
b32, base32 base32 yes
hex, base16 hex yes
rev, reverse, reversed reversed yes
frag, fragment, fragments fragments joined yes
hb64 hex of base64 not yet graded
b85 base85 not yet graded
zlib zlib inflate not yet graded
gzip, gz gzip not yet graded
deflate, inflate raw deflate not yet graded
bz2 bzip2 not yet graded
xz xz not yet graded

12 items: graded 5, not yet graded 7.

material transforms (vbscript.TRANSFORMS)

the reversible byte transforms a specimen applies to its material, read in any language; the key comes from the known v=N prefix.

what the code calls it what it reads or does graded?
identity no transform yes
subtract_modulo_256 subtract the key, mod 256 yes
add_modulo_256 add the key, mod 256 yes
reverse_bytes bytes reversed yes
single_byte_xor xor with one key byte yes
repeating_key_xor xor with a repeating key yes
rolling_xor xor with a key that changes every byte yes
reverse_then_xor reversed, then xor yes
index_xor xor with the byte's index not yet graded
add_index_modulo_256 add the byte's index, mod 256 not yet graded
subtract_index_modulo_256 subtract the byte's index, mod 256 not yet graded
rotate_left_bits bits rotated left not yet graded
rotate_right_bits bits rotated right not yet graded
bitwise_not every bit inverted not yet graded
nibble_swap nibbles swapped not yet graded
add_then_xor add, then xor not yet graded
xor_then_add xor, then add not yet graded

17 items: graded 8, not yet graded 9.

batch expansion forms (batch.EXPANSION_FORMS)

how a batch specimen expands the variable that rebuilds its statement.

what the code calls it what it reads or does graded?
call_double call set with doubled percent signs yes
for_indirect a for loop variable read indirectly yes
delayed delayed expansion with !var! yes
percent plain %var% expansion yes

4 items: graded 4, not yet graded 0.

languages named by extension (specimen.EXTENSION_LANGUAGES)

the language a member is read as when the question does not name one.

what the code calls it what it reads or does graded?
powershell named from the member's extension: .ps1, .psm1 yes
batch named from the member's extension: .bat, .cmd yes
jscript named from the member's extension: .js yes
nodejs named from the member's extension: .mjs, .cjs yes
vbscript named from the member's extension: .vbs yes
python named from the member's extension: .py, .pyw yes
bash named from the member's extension: .sh yes
applescript named from the member's extension: .scpt not yet graded
autoit named from the member's extension: .au3, .a3x yes
lua named from the member's extension: .luac not yet graded
perl named from the member's extension: .pl yes
ruby named from the member's extension: .rb yes

12 items: graded 10, not yet graded 2.

lane total 99: graded 69, not yet graded 30.

binary

binary: graded 51, not yet graded 228.

  • 279items15 tables
  • 51graded
  • 228not yet graded
  • 18%graded share
graded 51 (18%)not yet graded 228 (82%)

a bundle of builds a set, tagged by day (d01 .. d30): elf, pe, mach-o, wasm, jar, .net, neko. each tag asks a list of fields about its members, and new days ask new fields of old tags.

the solver reads the question's own recipe first, else answers by field name from the producers below, on each member's real format. a field no producer names goes to the dynamic trace, then to the other lanes' readers by exact name.

graded here means a graded field of some tag used that name.

core producers (compound.PRODUCERS)

fields of any build: headers, sections, symbols, the hcfg config record and its carriers, packed overlays, go / rust / autoit build facts and runtime markers.

what the code calls it what it reads or does graded?
format the member's real format: elf, pe, mach-o, wasm, jar, neko yes
hcfg_offset where the hcfg config record sits in the file yes
hcfg_storage how the config is stored: base64, a raw section, a const array, ranked by the carrier yes
hcfg_section, hcfg_section_name the section that holds the config record yes
hcfg_virtual_address, hcfg_vaddr, hcfg_va, hcfg_address, hcfg_memory_address, hcfg_load_address the config record's virtual address not yet graded
hcfg_rva the config record's relative virtual address not yet graded
overlay_offset where a packed overlay starts yes
overlay_size the packed overlay's size yes
overlay_magic the packed overlay's four-byte magic not yet graded
unpacked_sha256 sha-256 of the unpacked payload, proven by its header not yet graded
hcfg_resource_size, hcfg_resource_length the size of the hcfg resource the overlay header lays out yes
hcfg_resource_offset the offset of that resource not yet graded
scratch_size, scratch_length the size of the scratch area the overlay header lays out not yet graded
scratch_sha256 sha-256 of the scratch area not yet graded
machine the cpu the header names yes
architecture the architecture label, ranked spellings yes
metadata_version the .net metadata version string yes
section_names the section names in table order yes
symbols the symbol table names yes
disassembly the disassembly of the asked function yes
interpreter the elf program interpreter not yet graded
linkage static or dynamic linking not yet graded
stripped whether the symbol table was stripped not yet graded
build_id the gnu build id not yet graded
go_version the go toolchain version from the build info not yet graded
language the source language: autoit, pyinstaller, go, rust, nim, zig, swift, c++, sixteen runtimes by marker, else c not yet graded
subsystem the pe subsystem not yet graded
imphash the pe import hash not yet graded
pdb_path the pe debug pdb path not yet graded
timestamp the pe link timestamp not yet graded
image_base the pe image base not yet graded
main_functions the program's own functions, language-aware not yet graded
function_count how many of the program's own functions not yet graded
go_path, main_path the go main package path not yet graded
goos go build setting goos not yet graded
goarch go build setting goarch not yet graded
cgo_enabled go build setting cgo_enabled not yet graded
build_mode go build setting -buildmode not yet graded
trimpath go build setting -trimpath not yet graded
rustc_commit the rustc commit hash left in the binary not yet graded
crate_name, rust_crate, crate the rust crate name not yet graded
mangling, mangling_scheme, symbol_mangling the rust symbol mangling scheme (legacy or v0) not yet graded
trait_impls, trait_objects, traits rust trait implementations from the symbols not yet graded
autoit_version the autoit script version not yet graded
compression_methods the compression methods a jar's members use yes
has_cpp_vtable whether the build carries c++ vtables yes
has_cpp_typeinfo whether the build carries c++ typeinfo yes
typeinfo_symbol the c++ typeinfo symbol of the class yes
typeinfo_name_symbol the c++ typeinfo-name symbol of the class not yet graded
vtable_symbol the c++ vtable symbol of the class yes
has_go_runtime whether the go runtime is present yes
has_rust_mangled_symbol whether any rust-mangled symbol is present yes
has_coroutine_runtime whether the kotlin coroutine runtime is present yes
has_hcfg_section whether an hcfg section exists yes
section_count how many sections yes
symbol_count how many symbols yes
cli_runtime the .net runtime version a managed build targets yes
has_nim_runtime whether the nim runtime is present yes
has_fpc_runtime whether the free pascal runtime is present yes
has_gnat_runtime whether the gnat (ada) runtime is present yes
has_decoy_branch whether the code carries a decoy branch yes
conditional_branch_opcode_count how many conditional branch opcodes in .text yes
has_objc_runtime whether the objective-c runtime is present not yet graded
call_count how many calls the code makes not yet graded

64 items: graded 30, not yet graded 34.

crash reports (compound.CRASH_PRODUCERS)

the crash json a jvm build writes.

what the code calls it what it reads or does graded?
crash_fault_method, crash_faulting_method, crash_top_frame, crash_frame the crash fault method yes
crash_entry_method, crash_bottom_frame, crash_root_frame the crash entry method not yet graded
crash_frame_count, crash_frames_count, crash_depth, crash_stack_depth the crash frame count not yet graded
crash_frames, crash_stack, crash_stack_frames the crash frames not yet graded
crash_frames_match_methods, crash_frames_in_methods, crash_frames_declared, crash_frames_are_methods the crash frames match methods yes
crash_kind, crash_exception, crash_exception_kind, crash_type the crash kind not yet graded

6 items: graded 2, not yet graded 4.

jvm, kotlin and dex builds (compound.JVM_PRODUCERS)

class files, kotlin metadata, coroutines and dex classes.

what the code calls it what it reads or does graded?
constant_pool_count, constant_pool_size, cp_count the constant pool count not yet graded
main_class the main class not yet graded
method_names_sha256 the sha256 digest of the method names yes
access_flags the access flags yes
field_count the field count not yet graded
invoked_methods, invocations, method_refs, method_references, methodrefs the invoked methods not yet graded
string_constants, strings, string_literals the string constants not yet graded
superclass, super_class, superclass_name the superclass not yet graded
interfaces the interfaces not yet graded
source_file, sourcefile the source file not yet graded
major_version, class_major_version the major version not yet graded
minor_version the minor version not yet graded
class_version, class_file_version, bytecode_version the class version not yet graded
java_version, target_java_version, jvm_target, target_jvm the java version not yet graded
kotlin_metadata_version, kotlin_metadata the kotlin metadata version not yet graded
metadata_kind the metadata kind not yet graded
kotlin_class_kind, class_kind the kotlin class kind not yet graded
kotlin_functions, declared_functions, functions the kotlin functions not yet graded
public_functions the public functions not yet graded
private_functions the private functions not yet graded
internal_functions the internal functions not yet graded
protected_functions the protected functions not yet graded
inline_functions the inline functions not yet graded
kotlin_properties, properties the kotlin properties not yet graded
const_properties the const properties not yet graded
var_properties, mutable_properties the var properties not yet graded
lateinit_properties the lateinit properties not yet graded
constructor_count the constructor count not yet graded
data_classes the data classes not yet graded
objects, object_declarations the objects not yet graded
dex_version the dex version not yet graded
string_ids_size the string ids size not yet graded
type_ids_size the type ids size not yet graded
proto_ids_size the proto ids size not yet graded
field_ids_size the field ids size not yet graded
method_ids_size the method ids size not yet graded
class_defs_size the class defs size not yet graded
suspend_functions, suspend_funs, suspend_methods the suspend functions not yet graded
suspend_function, suspend_fun, suspend_method the suspend function not yet graded
continuation_classes the continuation classes not yet graded
state_machine_classes, coroutine_classes the state machine classes not yet graded
continuation_class, state_machine_class, coroutine_class the continuation class not yet graded
state_count, coroutine_states, coroutine_state_count, state_machine_states, states_count the state count not yet graded
state_labels, coroutine_labels the state labels not yet graded
suspension_points, suspension_point_count, suspend_points the suspension points not yet graded
suspension_lines, debug_lines, line_numbers, debug_line_numbers the suspension lines not yet graded
spilled_variables, spilled_locals, local_names, spilled_variable_names the spilled variables not yet graded
spilled_fields the spilled fields not yet graded

48 items: graded 2, not yet graded 46.

swift builds (compound.SWIFT_PRODUCERS)

swift reflection metadata.

what the code calls it what it reads or does graded?
swift_module, module_name, swift_module_name the swift module not yet graded
protocols, swift_protocols, protocol_names the protocols not yet graded
protocol, protocol_name the protocol not yet graded
types, type_names, swift_types the types not yet graded
structs the structs not yet graded
enums the enums not yet graded
conformances, protocol_conformances, swift_conformances the conformances not yet graded

7 items: graded 0, not yet graded 7.

class sweeps (compound.SHARED_PRODUCERS)

class and field name sweeps shared by the jvm and objective-c readers.

what the code calls it what it reads or does graded?
field_names the field names not yet graded

1 item: graded 0, not yet graded 1.

objective-c builds (compound.OBJC_PRODUCERS)

the objective-c runtime tables, read by section, never by symbol.

what the code calls it what it reads or does graded?
objc_classes, objc_class_names, objective_c_classes the objc classes not yet graded
objc_class_count, objective_c_class_count the objc class count not yet graded
objc_class_name, objc_class, objective_c_class the objc class name not yet graded
selectors, selector_names, objc_selectors, objc_selector_names the selectors not yet graded
selector_count, objc_selector_count the selector count not yet graded
selectors_sha256, selector_names_sha256, objc_selectors_sha256 the sha256 digest of the selectors not yet graded
objc_methods, objc_method_names, objc_instance_methods the objc methods not yet graded
objc_method_count the objc method count not yet graded
objc_strings, objc_constant_strings, constant_strings the objc strings not yet graded
class_count the class count yes
class_name the class name yes
method_names the method names not yet graded
methods the methods yes
method_count the method count yes
class_names the class names not yet graded
classes the classes not yet graded

16 items: graded 4, not yet graded 12.

.net p/invoke (compound.PINVOKE_PRODUCERS)

a managed build's p/invoke rows and module references.

what the code calls it what it reads or does graded?
pinvokes, pinvoke_targets, pinvoke_imports, pinvoke_map, implmap, implmap_rows, native_imports the p/invoke rows: member, import name and module not yet graded
pinvoke_entry_points, pinvoke_entries, pinvoke_functions, pinvoke_names, implmap_import_names, implmap_names the pinvoke entry points not yet graded
pinvoke_methods, pinvoke_method_names the pinvoke methods not yet graded
pinvoke_count, implmap_count the pinvoke count not yet graded
pinvoke_modules, pinvoke_libraries, pinvoke_dlls, native_libraries, native_modules the modules the rows import from, first use order not yet graded
module_refs, moduleref_names, module_ref_names, modulerefs the module refs not yet graded
module_ref_count, moduleref_count the module ref count not yet graded
has_pinvoke whether the artifact has pinvoke not yet graded

8 items: graded 0, not yet graded 8.

compiler signatures (compound.SIGNATURE_PRODUCERS)

the compiler and its .comment strings.

what the code calls it what it reads or does graded?
compiler, toolchain, compiler_name, toolchain_name, compiler_family, toolchain_family, compiler_id the compiler not yet graded
comment, comment_strings, comment_section, elf_comment, compiler_comment, compiler_string, comment_section_strings the comment not yet graded

2 items: graded 0, not yet graded 2.

techniques (compound.TECHNIQUE_PRODUCERS)

dynamic-link symbols, call-graph edges and template expansions.

what the code calls it what it reads or does graded?
natdynlink_symbols, natdynlink_functions, dynlink_symbols the natdynlink symbols not yet graded
call_edges, call_graph, call_graph_edges, edges the call edges not yet graded
call_edge_count, call_graph_edge_count, edge_count the call edge count not yet graded
template_expansions, template_instances, template_instantiations, template_symbols the template expansions not yet graded
template_expansion_count, template_instance_count, template_instantiation_count, template_symbol_count the template expansion count not yet graded
template_names, template_bases, templates the qualified template names, then their last identifiers not yet graded

6 items: graded 0, not yet graded 6.

webassembly doors (compound.WASM_DOORS)

imports, exports, memories, tables, segments and indirect calls of a wasm module, by a decoder (one wrapper per name, so each name counts).

what the code calls it what it reads or does graded?
imports, import_names, imported_names the imports not yet graded
import_count, imports_count, num_imports the import count not yet graded
imported_functions, function_imports the imported functions not yet graded
import_modules, imported_modules the import modules not yet graded
exports, export_names, exported_names the exports not yet graded
export_count, exports_count, num_exports the export count not yet graded
exported_functions, function_exports the exported functions not yet graded
memory_pages, memory_initial_pages, memory_min_pages, initial_memory_pages, memory_initial, memory_min the memory pages not yet graded
memory_max_pages, memory_maximum_pages, max_memory_pages, memory_max, memory_maximum the memory max pages not yet graded
memory_bytes, initial_memory_bytes the memory in bytes not yet graded
memory_exported, exports_memory, exported_memory the memory exported not yet graded
memory_imported, imports_memory, imported_memory the memory imported not yet graded
memory_count the memory count not yet graded
table_size, table_min, table_initial, table_initial_size, table_min_size the table size not yet graded
table_max, table_max_size, table_maximum the table max not yet graded
table_count the table count not yet graded
element_functions, element_targets, table_functions, indirect_call_targets, indirect_targets, indirect_functions the element functions not yet graded
element_segment_count, elem_segment_count the element segment count not yet graded
element_count, elem_count how many element segments, counted the way wasm-objdump counts them not yet graded
element_function_count, table_function_count, indirect_target_count, indirect_call_target_count the element function count not yet graded
indirect_call_count, call_indirect_count, indirect_call_sites, call_indirect_sites the indirect call count not yet graded
start_function, start_func, start the start function not yet graded
data_segment_count, data_count, data_segments_count the data segment count not yet graded

71 items: graded 0, not yet graded 71.

whole-tag producers (compound.TAG_PRODUCERS)

fields about every member a tag carries at once: counts, ordered digests, the family and the member that does not belong (by its decoded config), and the plugin handshake between two members.

what the code calls it what it reads or does graded?
handshake_symbol, handshake_export, handshake_symbol_name, plugin_header_symbol, handshake_export_symbol the symbol one member exports and another names: the plugin handshake not yet graded
handshake_importer, handshake_function, handshake_caller the member that calls into the handshake not yet graded
handshake the handshake as a whole: symbol and both sides not yet graded
artifact_count how many artifacts carry the tag yes
ordered_set_sha256 sha-256 over the members' digests in order yes
family_members, cluster_members, family_member_basenames the members of the family, matched by decoded config not yet graded
family_member_count, cluster_member_count, family_size how many members the family has not yet graded
false_friend, false_friend_basename, false_friend_member, false_friend_name, false_friend_member_basename, outlier, outlier_basename, outlier_member, outlier_name, outlier_member_basename, stranger, stranger_basename, stranger_member, stranger_name, stranger_member_basename, odd_one_out, odd_one_out_basename, odd_one_out_member, odd_one_out_name, odd_one_out_member_basename the member whose decoded config does not match the family not yet graded

8 items: graded 2, not yet graded 6.

producers by pattern (compound._pattern_producer)

families of field names no table lists one by one: the name itself carries the argument.

what the code calls it what it reads or does graded?
has_<x>_section whether a section named x exists (elf, pe, mach-o, wasm) yes
crash_<key> any key of a jvm crash json, by name yes
callers_of_<name>, callees_of_<name> who calls a function and what it calls, from the call graph not yet graded
the bounds pair a guarded index pair (index, guard, sentinel, trigger), read from the class-file pools and routed by the field's words yes
packing_key_<n>_hex the n-th key byte of a packed overlay's header yes
mangled_<word>_symbol the c++ mangled symbol whose name holds the word yes
elf_class the elf class as an integer, for an integer-kind field yes

7 items: graded 6, not yet graded 1.

source languages (native.language)

the languages the language field can name, from build info, symbols, read-only data and runtime markers, most specific first.

what the code calls it what it reads or does graded?
autoit compiled autoit scripts not yet graded
python pyinstaller bundles not yet graded
go go builds, from the build info not yet graded
rust rust builds, from mangled symbols and std crates not yet graded
nim nim builds not yet graded
zig zig builds not yet graded
swift swift builds not yet graded
c++ c++, including stripped static and msvc builds not yet graded
d built in d, found by its runtime markers not yet graded
haskell built in haskell, found by its runtime markers not yet graded
ocaml built in ocaml, found by its runtime markers not yet graded
crystal built in crystal, found by its runtime markers not yet graded
dart built in dart, found by its runtime markers not yet graded
pascal built in pascal, found by its runtime markers not yet graded
delphi built in delphi, found by its runtime markers not yet graded
v built in v, found by its runtime markers not yet graded
odin built in odin, found by its runtime markers not yet graded
kotlin built in kotlin, found by its runtime markers not yet graded
dotnet built in dotnet, found by its runtime markers not yet graded
fortran built in fortran, found by its runtime markers not yet graded
ada built in ada, found by its runtime markers not yet graded
c the fallback when nothing else matches not yet graded

22 items: graded 0, not yet graded 22.

compiler signatures (compound.TOOLCHAINS)

the compiler the compiler field names, from its signature in the bytes, most specific first.

what the code calls it what it reads or does graded?
tcc found by tcc_backtrace, __bt_init not yet graded
go found by \xff Go buildinf: not yet graded
rustc found by rustc version not yet graded
swiftc found by swiftlang/llvm-project, Swift version not yet graded
zig found by ziglang/zig-bootstrap not yet graded
clang found by clang version not yet graded
gcc found by GCC: (, GNU Ada not yet graded

7 items: graded 0, not yet graded 7.

member formats and unpackers (compound.NEXT_RUNTIMES, UNPACKERS)

formats beyond elf and pe that a tag's main member can be, and the registered overlay unpackers.

what the code calls it what it reads or does graded?
dex a dex member read as a tag's main member not yet graded
macho a macho member read as a tag's main member yes
macho-fat a macho-fat member read as a tag's main member yes
wasm a wasm member read as a tag's main member yes
neko_bytecode a neko bytecode member read as a tag's main member yes
PK19 a packed overlay undone by its registered byte steps (xor k2, ror 3, xor k1); any other magic goes to the key search yes

6 items: graded 5, not yet graded 1.

lane total 279: graded 51, not yet graded 228.

cross-lane

cross-lane: graded 49, not yet graded 9.

  • 58items4 tables
  • 49graded
  • 9not yet graded
  • 84%graded share
graded 49 (84%)not yet graded 9 (16%)

readers every lane shares: another lane's parser by exact name, fixes one lane published for the others, the located solver for tokens nobody parses, and the label tables the script answers lean on.

cross-lane readers (crosslane.READERS)

a field a lane's own readers cannot name is offered to the other lanes' readers under exactly its name, never a similar one; two lanes that disagree raise instead of picking.

what the code calls it what it reads or does graded?
metadata every exact metadata property, its words joined by - (forensics.exact_value) not yet graded
binary every binary producer, its words joined by _, on an elf, pe, mach-o or jar (compound.PRODUCERS) not yet graded
dotnet the one-row module and assembly columns of a managed build by their ecma-335 names, assembly attributes and references (dotnet.named) yes
mobile every app field by name, on an apk (android.app_values) yes

4 items: graded 2, not yet graded 2.

published fixes (sessions/fixes/)

a solver-local override (fixes.replace) that won a correct is published here; any lane's dry run that hits the same crash shows it as an available fix, and the end of the day moves it into the library.

what the code calls it what it reads or does graded?
apk.decode a solver's own replacement of apk.decode for the crash ValueError: no decoding path found in N readings, published when it won yes

1 item: graded 1, not yet graded 0.

the located solver (hlib.locate)

for an answer stored as a token in the bytes with no reader, and for a single won by hand that the lane solver cannot reproduce: the routes it learns and reads by, one function each.

what the code calls it what it reads or does graded?
locate.sweep, locate.ranked a guid or hex token stored in the bytes, ranked by the field's words just before it not yet graded
locate.learn, locate.located the words before a graded value and its position, learned from a won single and read again on fresh bytes not yet graded
locate.spelled_json the json member the question names by path, its key by the question's words, an ordinal or a count of a list not yet graded
locate.assembled small members' pieces joined two or three to the asked shape not yet graded
locate.derived all of the above together with the stored tokens not yet graded

7 items: graded 0, not yet graded 7.

graded label tables (hlib.graded)

append-only tables of labels the grader taught us, counted by row; a confirmed row is the default answer, an unconfirmed one only a candidate.

what the code calls it what it reads or does graded?
script-roles a specimen's ordered steps to its role: 16 rows, 16 confirmed by the grader yes
script-attacks a role to its att&ck technique: 11 rows, 11 confirmed by the grader yes
script-interpreters a script language to its att&ck interpreter technique: 19 rows, 6 confirmed by the grader, the rest late candidates yes

46 items: graded 46, not yet graded 0.

section total 58: graded 49, not yet graded 9.

race machinery

not readers but the parts that carry a reader's answer to the grader: the roles and the fallback paths a task can take between release and flag.

roles

who does what on race day, from the architecture page.

what the code calls it what it reads or does where it runs
kickoff pins the edge at t-65s, warms the route and starts one autopilot slot per lane at t-20s, sends the hedged list from t-0.3s, writes the plan and the live marker tools/comp/kickoff.py, one per day
autopilot claims the single, scaffolds solve.py from the lane's newest solver, downloads the bytes, dry-runs the solver on them with no game-master call, and when every field is answered and confident submits once; on correct it starts the time trial and then the mastery itself auto.<lane>, one slot per lane (tools/comp/autopilot.py), no model in the loop
lane fixer reads its lane brief before the release, then waits on coord.py wait-live --next <lane> fixer, one per lane, a model
helper idle until coord.py next hands it work in no solver lane, or an assist on a held single <runner>.wN, a model
parent spawns the fixers from the printed prompts, runs the spawn watcher, keeps kickoff.py alive, then polls wait-live for assists only <runner>.main, a model
plumbing the shared plumbing every role goes through coord.py (claims, intel, mail, board, locks), gm.py (the one game-master client), ctfkit.hlib (the readers every lane shares)

6 items.

fallback paths

the mechanisms beside the clean path, each with its own trigger, from the architecture page.

what the code calls it what it reads or does where
gaps, then the fixer a crash or an unsure field in the dry run: accepted fields banked, a gaps row with each crash's file:line, the claim released tools/comp/autopilot.py, 7.8, 7.9
slow dry run still running after 3s: autopilot posts that it is still searching and releases the claim autopilot.early_handoff (10)
a probe-won single anyone wins the single by hand with gm.py guess: autopilot follows it and runs the tiers once solve.py reproduces every graded field 7.7, 4.3
a timed crash or rejection a set crashes or a submit comes back incorrect: the run is saved under files/runs/<run>/ 7.2, 8.2
ranked start refused the game master will not open a ranked attempt: the regular untimed pool (WARNING unranked attempt): no deadline, a wrong submit leaves the attempt open gm.py start, ctfkit.hlib.runner
gm incident the first 5xx on a timed start: no timed start goes out into it 10
rate-limit window 429s inside the release minute: the window is per team and clears at the next :00 3.5
fixer cut short a fixer exits before its lane is done: coord.py stopped <name> frees the name 6.4
stall 90s with no new grader-confirmed field: coord.py pivot <id> mails a state note and a fresh agent on the other runner starts from it with a different method STALL_S, 4.3

9 items.

section total 15.

what we expected on day 31

day 31 was the last day. from the day 30 prompt review, ranked by how likely each was to be graded and what a miss would cost. these were expectations, not readers, so they are not counted.

  1. metadata relation fields beyond identical (semantic, containment, provenance, fabricated) on a corpus shaped like day 30's: the day 30 prompt named them without grading them. forensics.relation_value answers each as ranked candidates; the answer's shape (groups, pairs or one cluster) is the risk. covered.
  2. relation words from the earlier metadata prompts (transcoded, renamed, cropped, repackaged, impostor, clone, rebuild, ancestry) on a corpus of older file families: each word routes to one of the five kinds; the media and identity keys are the open part. partly covered.
  3. a third binary sweep: two new fields per earlier tag over the techniques no sweep has graded (objective-c selectors, wasm doors, call-graph edges, the plugin handshake, p/invoke, the bounds pair, the toolchain, optimization, graph roles). a spelled recipe goes through hlib.recipe; by name, some are still open. partly covered.
  4. a new binary carrier or record magic, like day 30's appended record: any named record magic goes through recipe.RecordProperty, and every carrier stage is magic-free (the carrier work). covered.
  5. a script capstone graph ("the edge that holds everything together"): the suffix families read generically over a new carrier, but a graph or edge field has no known shape; the question text will decide it. not covered.
  6. the mobile capstone: the layered chain that won day 30 covers it. covered.
  7. a warmups composition ("happened twice"): chained rows such as a>b in the day table. covered.

grand total: 1202 items, graded 371, not yet graded 816.

{generated by a clanker}