Turns out, someone helped me on Twitter. By making snmpd listen on tcp, it worked. Somehow, over UDP it does not.