We replayed 200 observed LLM calls against the rules RuleChef learned from your traffic. Rules answered 62% of them, agreeing with your LLM on 98% of the calls they took over. Every rule is inspectable: what it matches, what it answered, and where it disagrees.
| rule | calls | share | agreement |
|---|---|---|---|
| pending_cash_withdrawal_relaxed | 22 | 11% | 100% |
My cash in the ATM is still pending → pending_cash_withdrawal My transaction is still showing that is pending from my cash withdrawal. → pending_cash_withdrawal Why does it say pending cash withdrawal on my statement? → pending_cash_withdrawal | |||
| exchange_rates_priority | 20 | 10% | 100% |
What are your international exchange rates? → exchange_rate what are exchange rates based on → exchange_rate How often do your exchange rates change → exchange_rate | |||
| exchange_rate_explicit | 18 | 9% | 100% |
What foreign exchange rate will you use? → exchange_rate The exchange rate would be? → exchange_rate Can you tell me the foreign exchange rate? → exchange_rate | |||
| pending_card_payment_relaxed | 10 | 5% | 90% |
I bought some stuff this morning but the payment shows as pending → pending_card_payment I have waited 15 days, but my payment still hasn't cleared. → pending_card_payment I bought some things this morning but the payment shows that it is pending → pending_card_payment | |||
| card_payment_pending_explicit | 7 | 4% | 100% |
When will my card payment be done pending? → pending_card_payment Why is my card payment showing as pending? → pending_card_payment My card payment is pending. → pending_card_payment | |||
| pending_card_payment_loose | 7 | 4% | 100% |
I have a pending payment from stuff I bought this morning. → pending_card_payment Why would I have a pending payment? → pending_card_payment Why is my payment pending? → pending_card_payment | |||
| transfer_blocked | 4 | 2% | 100% |
Why did I receive an error message saying that my transfer was not possible? → beneficiary_not_allowed Why did I get a message saying that my transfer is not possible? I have done this before no problem. Please fix. → beneficiary_not_allowed I've transferred money before without issue but now I am encountering an error stating that it isn't possible. Why is that? → beneficiary_not_allowed | |||
| need_multiple_disposable_cards | 4 | 2% | 100% |
If I have more than one disposable card, can I make five payments on each of them? → disposable_card_limits Can I have more than one disposable card? → disposable_card_limits What if I need multiple disposable cards? → disposable_card_limits | |||
| transactions_on_disposable | 3 | 2% | 100% |
Is there a limit to how many transactions I can make on one disposable card? → disposable_card_limits Tell me how many transactions I can do with a disposable card. → disposable_card_limits How many transactions can I do with one disposable card? → disposable_card_limits | |||
| disposable_card_limits_synonyms | 3 | 2% | 100% |
What are the limits for disposable virtual cards? → disposable_card_limits What is the limit to disposable cards you can have? → disposable_card_limits What are the limits to using disposable virtual cards? → disposable_card_limits | |||
| transfer_refusal_broad | 2 | 1% | 100% |
I want to transfer money to a beneficiery. Why can't I? → beneficiary_not_allowed I had a transfer blocked → beneficiary_not_allowed | |||
| disposable_card_usage_count | 2 | 1% | 100% |
How many times can I use a disposable card? → disposable_card_limits How many times can I use the disposable virtual card I have? → disposable_card_limits | |||
| cash_withdrawal_status | 2 | 1% | 100% |
Are you sure when the withdrawal will show? → pending_cash_withdrawal I am still waiting for a cash withdrawal to show → pending_cash_withdrawal | |||
| pending_cash_withdrawal_progress | 2 | 1% | 100% |
Hi! I was wondering if you can help me. I used the city centre ATM to get some cash, but the machine declined my card. My account shows that transaction is still pending. I didn't receive the money, so please cancel that transaction. → pending_cash_withdrawal Hi,I tried to get some money out but the machine was not working .The transaction still seems in progress! Can you please check what's going on.I don't want to be charged for money that I did not received. → pending_cash_withdrawal | |||
| disposable_card_limits_relaxed | 2 | 1% | 100% |
what is the disposable cards limit? → disposable_card_limits How many disposable cards is the limit? → disposable_card_limits | |||
| payment_pending_general | 2 | 1% | 100% |
Why are my payments showing pending? → pending_card_payment I recently made a payment, and it is showing up in my account as "pending". What does that mean? → pending_card_payment | |||
| transfer_refusal_relaxed | 2 | 1% | 100% |
A transfer to an account was not allowed → beneficiary_not_allowed Why was a transfer to an account not allowed? → beneficiary_not_allowed | |||
| pending_cash_withdrawal_generic | 1 | 0% | 100% |
I received cash from the ATM earlier, but this shows up as pending in the app. I've got the cash already. How can this be still pending? → pending_cash_withdrawal | |||
| pending_payment_meaning | 1 | 0% | 0% |
What's a pending transaction? My card was declined at an ATM, but my account says it's still pending. Can I cancel the payment? → pending_card_payment ≠ LLM | |||
| beneficiary_not_allowed | 1 | 0% | 100% |
My beneficiary is not allowed, please may I have answer as to why this is? → beneficiary_not_allowed | |||
| disposable_card_stipulations | 1 | 0% | 100% |
Do you know what the restriction of the disposable cards are? → disposable_card_limits | |||
| pending_card_payment_go_through | 1 | 0% | 100% |
How long does it take for a payment to go thru? I made one a few days ago and it has not been cleared yet. → pending_card_payment | |||
| disposable_card_limits_broad | 1 | 0% | 100% |
I need to use my disposable card multiple times a day, is there a cutoff limit? → disposable_card_limits | |||
| disposable_card_transaction_limit | 1 | 0% | 100% |
What is the limit to number of transactions I can do with a disposable card? → disposable_card_limits | |||
| pending_cash_withdrawal_ATM | 1 | 0% | 100% |
I tried taking money from the ATM but no money came out, but the transaction is still pending? How is this possible? → pending_cash_withdrawal | |||
| pending_payment_not_gone_thru | 1 | 0% | 100% |
Why has my payment not gone through? → pending_card_payment | |||
| pending_payment_meaning_general | 1 | 0% | 100% |
What does a pending transaction mean? → pending_card_payment | |||
| pending_cash_withdrawal_withdrawals | 1 | 0% | 100% |
My withdrawl is still pending. Why? → pending_cash_withdrawal | |||
| pending_card_payment_processed | 1 | 0% | 100% |
My payment still hasn't processed! → pending_card_payment | |||
| beneficiary_rules_on | 1 | 0% | 100% |
What are the rules for transferring to a beneficiary? → beneficiary_not_allowed | |||
Fidelity is agreement with the observed LLM outputs on calls the rules answered; the rules inherit the LLM's own error rate on those calls. Rules abstain on everything else, which continues to flow to the LLM. Generated by rulechef · github.com/KRLabsOrg/rulechef.