OUR METHODOLOGY

How We Test
Expert Advisors

Most EA reviews online are marketing dressed up as testing. Here's exactly what we check, in what order, before an EA ever appears on this site - including the ones that don't pass.

Two Routes, Two Questions

Which route applies depends on the question being asked. Only the first can lead to a verdict.

Route 1

Live Track Record

For an Expert Advisor with a real-money live record of at least 24 months and 300 closed trades, or at least 12 months for an Early Review, which cannot be Recommended. We run our full checklist against the record and no backtest is required.

The record does not have to be third-party verified for us to review it. For a Recommended verdict it must be: Myfxbook, FXBlue, Show My Trades, or an MQL5 Signal tracked on MQL5's own servers.

Route 2

Rule-Conformance Tests

Whether one specific configuration survives one external rule set, such as a prop firm's daily and overall loss limits.

The result is a conformance finding, never a verdict on the Expert Advisor. The tests we have run are published in our prop firms section.

We do not review an Expert Advisor whose only evidence is a backtest, however good. Backtests are used only in rule-conformance tests (Route 2), never as the basis of a review.

Automatic Fails

What Disqualifies An
EA Automatically

Any one of these rules out a Recommended verdict. The review still publishes, and it names the point failed and why:

  • No independent verification of any kind — screenshots and PDFs are not evidence.

  • Guaranteed profit language or unrealistic marketing claims.

  • A martingale, grid, averaging or recovery strategy, disclosed or not: shown in the trade history, or set as the default by the developer where no history can be read. This one is more than a bar to Recommended: it is rated Not Recommended.

  • Collapsing backtests indicating curve-fitting or structural fragility.

  • A real-money live record shorter than 24 months or 300 closed trades. From 12 months we publish an Early Review, which cannot be Recommended. Below 12 months or 300 closed trades, we do not review an Expert Advisor at all.

Verdict System

Three Possible Verdicts

Passing our checklist and evidence review does not automatically mean an outright recommendation. We use three verdicts, and we hold ourselves to a genuinely high bar before using the top one. Every Expert Advisor that currently holds it is listed on Best Expert Advisors, and the verdict can be withdrawn: Perceptrader AI held it until we checked every real account its developer publishes, not only the one she features. We choose which Expert Advisors to review by what readers ask about. Every eligible Expert Advisor we choose is reviewed and published, whatever the verdict.

Recommended

Passed our full checklist, has a genuine live record verified by a third party, and either a long, high-volume track record or real independent corroboration — with no significant unresolved concerns. A long record can carry a recommendation on its own; where it does, we say openly that there is no outside coverage. A backtest alone, even one we re-run ourselves, cannot earn it.

Inconclusive

Passed our checklist with no violations, but the evidence is not yet strong enough for a confident recommendation — usually a short record, a withdrawn signal, or no independent coverage to cross-check the live record. Inconclusive is not a finding of wrongdoing. It means we could not reach a verdict on the evidence available.

Not Recommended

Failed our checklist outright, uses a grid, averaging, martingale or recovery strategy, or re-verification found the evidence did not support what had been claimed for it. We have reversed two of our own Recommended verdicts this way: Quantum Queen X and Perceptrader AI. A Not Recommended verdict always names the specific criterion that was failed, with sources.

We revisit verdicts as new evidence emerges, including Expert Advisors we have already published, and including our own recommendations. Every published review is re-verified each quarter, and sooner after a material event, such as a vendor changing its settings or a monitored account being deleted or made private. When our view changes we update the review, date the change, and state exactly what we got wrong — in a visible notice on the page itself, not quietly. Every review carries its verification history, so you can see what was checked, when, and what changed since. Rule-conformance tests sit outside this system entirely: where we test one configuration against an external rule set, such as a prop firm's loss limits, the outcome is a conformance result and never one of the three verdicts above. How we run those tests is set out below.
Two Review Tiers

Full Reviews And Early Reviews

Some Expert Advisors are searched for long before they have two years of real-money trading behind them. Rather than say nothing until then, we review them early, with a lower ceiling.

Full Review. A real-money live record of at least 24 months and 300 closed trades. Any of the three verdicts is possible.

Early Review. A real-money live record of at least 12 months and 300 closed trades. The verdict can be Inconclusive or Not Recommended, never Recommended, because a year of trading can miss the market conditions that break a strategy.

Every other rule on this page applies to both. A disqualifying problem, such as positions added to a losing trade, shows in a short record as clearly as in a long one, so an Early Review can end in Not Recommended. An Early Review is labelled on the review itself, on Best Expert Advisors and in every summary we publish. Each quarter we check every Early Review's record. Once it reaches 24 months, we assess it against the full record on the same page and remove the label.

Below 12 months or 300 closed trades, we do not review an Expert Advisor at all.

Reviews published before these minimums were adopted stay published as dated records. They are not Early or Full Reviews, and when a verdict rule changes, their verdicts change at once.

Pass / Fail Criteria

The Thresholds, In Full

These are the objective criteria an Expert Advisor must clear. Failing any one of them means no Recommended verdict, regardless of headline returns. They are published here in full, on the page, because a standard you cannot read is not a standard.

Evidence integrity

Before any figure is assessed, we establish that the evidence describes the product being sold.

  • ❌ The track record must belong to the product under review. Where a developer markets an older product's live signal alongside a newer release, that record evidences the older product. The newer one is treated as unverified, however long the signal has run.
  • ⚠️ To be reviewed at all, an Expert Advisor needs a real-money live record of at least 12 months and 300 closed trades, and every criterion on this page must be assessable from it. Under 24 months it is an Early Review and cannot be Recommended. The record does not have to be third-party verified for us to review it. It does have to be verified for a Recommended verdict.
  • ❌ A growth figure distorted by deposits and withdrawals is not published. Where an account's cash flows are large relative to its balance, a percentage return measures the funding pattern rather than the strategy, and we say so instead of reproducing the number.
  • ❌ The same account shown on two platforms is not independent corroboration. It is one record displayed twice.

Risk

Drawdown is the figure we lead on, because it is the one that describes what happens to your money.

  • ❌ A martingale, grid, averaging or recovery strategy is Not Recommended, disclosed or not. Where the trade history shows positions added to a losing trade, or sizes raised to win back a loss, the verdict is Not Recommended whatever the profit, because a sustained move against the position can take the account with it. Where no trade history can be read, the developer's own description of such a mode as the default decides the verdict for the product as sold.
  • ❌ A drawdown materially larger than the marketing implies is an automatic fail. There is no universal acceptable number — but a gap between what a buyer is told and what the record shows is a failure of disclosure, not of performance. This applies to live-verified and backtested evidence alike, and it extends to affiliate and reseller marketing the seller benefits from, not only to the seller's own pages.
  • ❌ A wipeout or near-wipeout is disqualifying. Poor performance during a stress period is not automatically fatal; losing substantially all of an account is.
  • ❌ A floating loss still open and unrecovered 90 days after it began rules out a Recommended verdict, even if it later recovers, because anyone running the Expert Advisor would have had to sit through it. An average holding time can hide a few positions held open in loss for months, so every review publishes the longest time a trade or basket stayed open and the longest open drawdown. Where a record cannot show this, a Recommended verdict cannot rest on it.
  • ⚠️ Both drawdown measures are published wherever a platform reports them — by balance and by equity, each labelled. The gap between the two is where a grid or averaging system's real exposure sits, and quoting only one is always a choice about which to show you.
  • ⚠️ Where a seller publishes several accounts at different risk settings, we publish the range across their real accounts rather than the best one.

Whether the edge is real

  • ❌ A high win rate with a poor payoff ratio is treated as a warning, not a strength. Very high win rates frequently conceal tail risk that the win rate itself cannot show. We have reviewed a real account that won 57 of its 58 trades and still lost 96% of its capital. We therefore never publish a win rate without the profit factor or the average-win-to-average-loss ratio beside it, and we never rank Expert Advisors by win rate.
  • ❌ Performance concentrated in a handful of trades fails. If removing a few exceptional trades collapses profitability, the strategy is not robust.
  • ❌ A profit factor at or near 1.0 across a large sample indicates an edge that has decayed to breakeven, and will not earn a recommendation however long the record.
  • ⚠️ Recovery factor is used as a discriminator; the Sharpe ratio is recorded where a platform reports it but is never a pass or fail criterion and never appears in our reasoning. Across differing monitoring periods and trade counts, platform-reported Sharpe is not comparable, and at two decimal places the differences are noise.
  • ⚠️ A suspiciously smooth equity curve with no visible drawdown is treated as a likely sign of curve-fitting or an undisclosed martingale or grid mechanism, both of which can look flawless for a long stretch before one catastrophic loss.

Claims and sourcing

  • ❌ No claim without a retrievable source. Every assertion we make about a third party carries a link to where we read it, with the date. Where a source has since disappeared, we say so and place no weight on its specific claims.
  • ⚠️ A critic's interests are disclosed as readily as a seller's. Criticism published by someone selling a competing product is cited for transparency, never used as support for a verdict.
  • ⚠️ Every figure is a dated snapshot carrying its source and measurement period. We never silently refresh figures to track current values — doing so would let a verdict ride on numbers that were never the ones assessed.

Two routes, and which one applies to what.

Route 1 — live record review. Applies where an Expert Advisor has a real-money live record of at least 24 months and 300 closed trades, or at least 12 months for an Early Review. We run the full checklist against the record, so no backtest is required. For a Recommended verdict the record must be monitored by a third party: Myfxbook, FXBlue, Show My Trades, or an MQL5 Signal tracked on MQL5's own servers in real time. A broker investor-password login on its own does not count as verification, because it is not a public record that readers can check.

Backtest-only products are not reviewed. We do not review an Expert Advisor whose only evidence is a backtest, however good. Backtests are used only in rule-conformance tests (Route 2), never as the basis of a review.

Route 2 — rule-conformance tests. A different question entirely: whether one specific configuration survives one specific external rule set, such as whether a developer's prop firm settings file, or its default settings where it supplies none, would pass a firm's challenge. A conformance test is not a review and produces no verdict on the Expert Advisor. It can apply even to a product reviewed under Route 1, because a live signal for the standard configuration tells you nothing about a different one. The full method is set out below.

The full regime, including exact environment settings and everything a test must document to be reproducible, is in the methodology document below.

Download the Full Methodology (PDF) — no email required →

Version 2.5, published 28 October 2026. Section 9 of the document sets out what changed in each version and why.

Prop Firm Conformance Tests

How We Test EAs Against Prop Firm Rules

A conformance test asks one question: would this configuration, exactly as supplied, have passed one prop firm’s published challenge rules? The answer is a Pass, Fail or Inconclusive result, never one of the three verdicts above. Every result so far is on Best EA for a Prop Firm Challenge.

The test environment

Every test runs the same way, so the results can be compared with each other.

  • ✅ One firm, tested on its own data. We test against FTMO’s rules in the MetaTrader 5 Strategy Tester logged into an FTMO Free Trial account, so the price history, spreads and commission are FTMO’s own, not a stand-in broker’s. Anyone with a free FTMO trial can repeat a test.
  • ✅ Real ticks only: every tick based on real ticks at 99% history quality or above, a £10,000 GBP account at FTMO’s leverage cap of 1:100, and one common window for every test, currently 1 January 2025 to 1 October 2026.
  • ✅ Commission is always charged. Every report must show FTMO’s commission. If a server ever charges none in the tester, we add it afterwards from the trade list at FTMO’s rate.
  • ⚠️ Orders fill without delay in the tester. Slippage is not modelled, which flatters every result slightly. We say so rather than add a figure we cannot measure.

Which settings we test

  • ✅ Only where the developer makes a prop firm claim. We run a conformance test only on an Expert Advisor whose developer says it can pass a prop firm challenge, or supplies prop firm settings. No claim, no test.
  • ✅ The developer’s own prop firm settings file, supplied by the developer or published by them, including in their MQL5 product comments, tested unmodified. Altering it before establishing a baseline would destroy the only claim worth making.
  • ✅ If none exists, the developer’s default settings, with any prop firm feature built into the EA switched on at the developer’s own value. We say that no prop firm settings were available. The only other change we make is to symbol names, to match the firm’s own. Where an EA ships with a prop firm feature switched off, such as a daily drawdown limiter, we switch it on, because the developer presents it for prop firm trading. We never set the level ourselves, and we always publish the run as installed alongside it. A built-in feature that has no setting, such as a trade randomiser, runs as built. (Rule added 31 October 2026.)
  • ❌ Never a third party’s settings file, and never settings we built ourselves. Neither can be traced to the developer, so a result on them proves nothing about the product.
  • ✅ The Expert Advisor is the free MQL5 Market demo wherever the product is listed there. Nothing is bought for a test.

How a result is decided

  • ❌ A breached limit is a Fail, and so is a profit target never reached over the full test window. Every limit is reported separately with its margin; a near miss is reported as a near miss, with the figure.
  • ⚠️ A challenge phase ends when the profit target is reached with all trades closed, so we judge the limits from the start of the test, or of the out-of-sample part, up to the end of that day. Anything later is reported for information only. Where a developer re-optimised inside the test window, we judge the trades from that date as a rebased comparison of the same run: measured from that day’s balance against the starting account’s target and limits, and only when trade sizes did not grow with the balance. (Rule added 1 November 2026.)
  • ⚠️ The daily loss limit is measured on equity, including losses on open trades, and the tester reports closed results only. A closed loss above the limit is a breach. Otherwise we publish the worst closed day and record the daily limit as not established, never as passed.
  • ⚠️ We separate what a developer could have tuned from what they could not. Every test records the version tested, the settings file’s date and the date the developer last re-optimised the strategy, from their own release notes; bug fixes do not count. The window is split at that date: before it is in-sample, after it is out-of-sample. If the last re-optimisation predates the window, all of it is out-of-sample.

A pass over the full window is judged on the out-of-sample part alone. A configuration tuned to the history it is tested on can pass in-sample without having an edge, so:

Fewer than 100 out-of-sample trades: Inconclusive — not enough unseen data.

100 or more that meet the pass criteria on their own: Pass.

100 or more that lose money, or breach a limit before the profit target is reached: Fail. The in-sample pass is reported, but the result is the out-of-sample one.

100 or more that are profitable with no breach but have not yet had time to reach the profit target: Inconclusive — a slow but sound configuration is not marked down for time alone.

A fail anywhere in the judged period, up to the end of the day the target is reached, stands: tuning can only flatter a result, so failing on data a configuration could have been fitted to is conclusive.

What changed on 2 October 2026. Our first conformance tests used another broker’s price data and charged no commission. We re-ran every one on FTMO’s own data with FTMO’s commission, and replaced the published results. Every result is still a fail, but most of the figures moved: the same unmodified settings file can make money on one broker’s prices and lose it on another’s, which is why the test now runs on the firm’s own data. The in-sample and out-of-sample split was adopted the same day. It was in place before the first test it applied to had been analysed; the wording that separates Fail from Inconclusive was settled after that result, and we say so here.
Independent Corroboration

Beyond The Seller's Own Evidence

A live track record on Myfxbook, FXBlue, Show My Trades or MQL5 tells us the seller's own numbers are real. It does not tell us what other traders actually experienced. So for every Expert Advisor we also check independent platforms — ForexPeaceArmy, Trustpilot, the MQL5 community and its Traders' Blogs, and the buyer reviews on the product's own listing — for anything the seller's marketing would not show us.

One record on two sites is not corroboration. Where the same trading account appears on both MQL5 and Myfxbook, that is one record displayed twice, and we do not present it as independent confirmation. We have made this mistake ourselves and corrected it on the page. Real corroboration means an independent party's experience of the product: buyer reviews, a review platform's record, or documented third-party testing.

We do not take any single review at face value in either direction. This space has real competitor smear campaigns and real fake positive reviews, so we weigh specific, detailed complaints more heavily than vague ones and look for patterns across multiple independent sources rather than isolated one-offs. When a review platform itself documents a history of manipulated reviews for a product, we treat that as citable evidence — and we cite it, with the link.

A critic's interests matter as much as a seller's. We have encountered criticism of an Expert Advisor published by someone selling a competing product in the same post. We cite sources like that for transparency and we disclose the conflict, but we never let them carry a verdict. The same test we apply to a glowing endorsement applies to a damaging one: who benefits from believing it?

If an Expert Advisor has no independent footprint at all — common for newer products — we say so plainly. That absence is not a red flag on its own. Combined with a short record, it is usually enough to hold back a Recommended verdict until more evidence exists either way. And where a long, high-volume record earns a recommendation without outside coverage, we state that there is none rather than implying corroboration we do not have.

Our Rule on
Conflicts of Interest

We check every Expert Advisor against these criteria on its merits. Affiliate availability is never a search criterion or part of the verdict: we apply to a programme only after a review is published, and only if the Expert Advisor passed. Where a programme already exists, for example from a developer we already partner with, the review says so, and a verdict against it stands. If we ever run an Expert Advisor on one of our own live accounts, that only happens after it has passed on its own merits, it is always disclosed, and if the verdict changes we stand the account down.

We Publish The
Failures Too

Most review sites only show you the winners. When an EA doesn't pass our checklist or backtesting regime, we publish exactly why — tied directly to which specific criterion it failed, not vague opinion. If you're searching for an honest answer on a specific EA, that's exactly what you'll find here, pass or fail.

Want The Full
Methodology?

Want the full technical methodology, including exact backtest parameters and pass/fail thresholds?

The Robotic Trader Logo

© 2026 The Robotic Trader. All rights reserved.