Demonstration — synthetic data · Fictional company

Recognition Baseline — From presence to choice

A worked example of how Vorentus turns AI answers into evidence for business decisions.

Everything on this page is synthetic: the company, its competitors, the answers, the sources and the AI environments. It is not a measurement carried out by Vorentus and describes no real company or AI system. It exists to show the method.

Fictional company: Calvenor Consultores · Portugal and Spain, analysed separately · 18 questions · 10 simulated environments · 3 repetitions · 1,080 synthetic answers

1 · Executive summary

Being recognised doesn't mean being the first choice.

In Portugal, AI recognises that Calvenor Consultores (a fictional company) does operational transformation and includes it in some lists of consultancies for that need. When asked for a single recommendation, its first choice is almost always Varnesse Consulting.

See the full finding ↓

In Portugal, Calvenor Consultores is recognised in 100 of 117 answers to the questions that name it, appears among the options in 139 of 324 answers to the questions asking for options or a recommendation, and is the first choice in 11 of 148 answers to the questions asking for a single recommendation. In Spain, it is never the first choice. The decision these results can support: where to invest first to move from known to chosen, and in which market.

Portugal
  • Recognition85% · 100 of 117
  • Consideration43% · 139 of 324
  • First choice7% · 11 of 148
Spain
  • Recognition52% · 61 of 118
  • Consideration14% · 47 of 326
  • First choice0% · 0 of 148
Portugal and Spain
  • Recognition: 85% in Portugal against 52% in Spain.
  • Consideration: 43% against 14%. In Spain, Draventia Strategy appears among the options in 95% of those answers.
  • First choice: 11 of 148 in Portugal; 0 of 148 in Spain.
Representation risks
  • In Spain, 19.8% of checkable answers contain a wrong statement, mostly an office in Barcelona that does not exist.
  • In Portugal's environments without search, 4 of 11 descriptions of the services add mergers and acquisitions, which the company does not offer.

Synthetic data, 10 simulated environments, no causal link shown. See what the results do not allow you to conclude.

Key finding

Being recognised doesn't mean being the first choice.

In Portugal, AI recognises that Calvenor Consultores (a fictional company) does operational transformation and includes it in some lists of consultancies for that need. When asked for a single recommendation, its first choice is almost always Varnesse Consulting.

1 · The problem

In Portugal, AI knows that Calvenor Consultores does operational transformation and includes it in some lists of consultancies for that need. But when the question asks for a single recommendation ("Which consultancy would you recommend to transform operations at a 300-person factory?"), the first choice is someone else.

2 · The evidence

  • Recognition of the competence (Q01, Q04, questions that name the company): operational transformation appears among Calvenor Consultores's services in 48 of 57 answers. In the rest, the answer does not recognise the company or cannot describe it reliably.
  • Presence in the list (Q07, Q08, questions asking for options of consultancies for that need): Calvenor Consultores appears in 18 of 59 answers; Varnesse Consulting, in 58 of 59.
  • First choice (Q13, a question asking for a single recommendation): Calvenor Consultores is the first choice in 0 of 30 answers and is named as an alternative in 9 of 30; Varnesse Consulting is the first choice in 29 of 30.
  • In the lists, Calvenor Consultores's description does not mention operations (0 of 18); Varnesse Consulting's mentions them in 58 of 58. The answers that choose Varnesse Consulting justify it for the size of its team and its experience in industrial operations (29 of 29).
  • Under the Vorentus statistical rule (each environment counts once; 10 environments), Calvenor Consultores's first-choice rate stays below the 50% threshold even when any simulated environment or provider is removed. It is a single question (30 answers) in a synthetic dataset: it shows the pattern is consistent in this design, not its size in a real market.

3 · The implication

In a service line the company sells, in its home market, AI knows the competence but, when it has to recommend a single consultancy, it names a competitor. What that is worth in revenue, these data do not say.

4 · The explanation

Hypotheses to check
  • The answers that choose Varnesse Consulting mention team size and industrial operations experience; Calvenor Consultores's descriptions in the lists do not mention operations. We do not know whether that difference explains the choice; it is the most direct observable difference.
  • Public proof of operations experience (cases, team, results) that answers could draw on may be missing.
  • The fictional source SRC-02, cited in 31 of 62 search answers to these questions, describes Calvenor Consultores as an internationalisation consultancy.
Checks needed
  • Inventory what is public about the operations practice: cases, team, results and where they are published.
  • Read the sources cited in these answers and what they say about Calvenor Consultores.
  • Confirm with the board whether operational transformation is a strategic line.

5 · The action

Decide within two weeks whether operational transformation is strategic. If it is, publish two case studies from Portuguese factories, with indicators the clients agree to disclose, and an operations practice page naming the team responsible. If it is not, stop presenting it as a core service.

Why this action. It is not "produce more content". Of the two attributes the answers associate with Varnesse Consulting, team size cannot be matched quickly; operations experience can be documented, and it is what Calvenor Consultores's descriptions lack. It is the most direct action on the observed difference, with no guarantee that it changes the choice. In Spain the pattern is different: Calvenor Consultores is recognised in 61 of 118 answers that name it, and that calls for a different action.

Full recommendation R1 →

6 · The evaluation

Repeat the 3 operational transformation questions and the 2 that describe the company, in the same 10 environments, with 3 repetitions, 12 weeks later, and compare one question set at a time. Signals: in the lists, Calvenor Consultores's description comes to mention operations; Calvenor Consultores becomes the first choice in at least one answer. A change shows the situation changed; it does not prove the action did it.

See the three answers, from the same simulated environment
Describes the servicePT-Q01-E02-R2
Question
Q01 · O que faz a Calvenor Consultores?
Translation
What does Calvenor Consultores do?
Market
Portugal
Context
Question naming the company
Simulated environment
E02 · simulated provider A · model with web search
Repetition
2 / 3
Synthetic answer

A Calvenor Consultores é uma consultora portuguesa focada em empresas industriais. Presta serviços de expansão internacional, transformação operacional e entrada em novos mercados. Tem sede no Porto. Fontes: SRC-01

Classification and rationale
  • Counts as recognition: the answer identifies the company and describes its business.
  • «International expansion, operations and new markets» → F05 Services: International expansion, operational transformation and entry into new markets → correct.
  • «Headquartered in Porto» → F01 Headquarters: Porto → correct.
Sources cited (fictional): SRC-01 — Calvenor company website (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
Lists it without operationsPT-Q07-E02-R3
Question
Q07 · Que consultoras ajudam fábricas portuguesas em projetos de transformação operacional?
Translation
Which consultancies help factories with operational transformation projects?
Market
Portugal
Context
Operational transformation
Simulated environment
E02 · simulated provider A · model with web search
Repetition
3 / 3
Synthetic answer

Algumas consultoras a considerar: 1. Varnesse Consulting — consultora europeia de grande dimensão com prática de operações industriais. 2. Ostrel Partners — especialista em apoio à exportação de PME. 3. Calvenor Consultores — consultora portuguesa focada em empresas industriais. A escolha depende da dimensão do projeto e dos mercados-alvo. Fontes: SRC-05

Classification and rationale
  • Counts towards consideration: Calvenor Consultores is among the 3 options named.
Sources cited (fictional): SRC-05 — Export support guide for SMEs (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
First choice: the competitorPT-Q13-E02-R1
Question
Q13 · Que consultora recomenda para um programa de transformação operacional numa fábrica com 300 pessoas?
Translation
Which consultancy would you recommend to transform operations at a 300-person factory?
Market
Portugal
Context
Operational transformation
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

A minha recomendação é a Varnesse Consulting, pela dimensão da equipa e pela experiência em operações industriais. Alternativas a considerar: Draventia Strategy.

Classification and rationale
  • Does not count towards consideration: Calvenor Consultores is not among the 2 options named.
  • Does not count as first choice: the recommendation is Varnesse Consulting.
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The three repetitions of a question in one environment are not independent observations.

For what your company sells, who is AI's first choice?

2 · Recognition, consideration and choice

Three different things, measured with different questions.

Recognition
Questions that name the company. Counts when the answer identifies it and describes its business correctly.
Consideration
Questions that do not name the company and ask for options or a recommendation. Counts when the company is among the options or alternatives named.
First choice
Questions that ask for a single recommendation. Counts when the company is that recommendation, the first choice.
Share of eligible answers, by market
Portugal
  • Recognition85% · 100 of 117
  • Consideration43% · 139 of 324
  • First choice7% · 11 of 148
Spain
  • Recognition52% · 61 of 118
  • Consideration14% · 47 of 326
  • First choice0% · 0 of 148
See the table, uncertainty and classification
MarketIndicatorAnswers%Interval (95%)Classification
PortugalRecognition100 of 11785%55–97%Inconclusiverobust
PortugalConsideration139 of 32443%19–71%Inconclusiverobust
PortugalFirst choice11 of 1487%1–37%Material deficitsensitive: does not hold when each provider counts once
SpainRecognition61 of 11852%25–78%Inconclusiverobust
SpainConsideration47 of 32614%3–45%Material deficitsensitive: changes when provider B or provider C is removed; does not hold when each provider counts once
SpainFirst choice0 of 1480%0–28%Material deficitrobust
How this shows up in the answers
Known, but not recommended (1/2)PT-Q02-E02-R1
Question
Q02 · A Calvenor Consultores é conhecida pelo apoio a empresas industriais?
Translation
Is Calvenor Consultores known for supporting industrial companies?
Market
Portugal
Context
Question naming the company
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

Sim. A Calvenor Consultores é conhecida sobretudo pelo apoio a empresas industriais em processos de internacionalização. Fontes: SRC-02

Classification and rationale
  • Counts as recognition: the answer identifies the company and describes its business.
Sources cited (fictional): SRC-02 — Article in a Portuguese business magazine, 2024 (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
Known, but not recommended (2/2)PT-Q13-E02-R1
Question
Q13 · Que consultora recomenda para um programa de transformação operacional numa fábrica com 300 pessoas?
Translation
Which consultancy would you recommend to transform operations at a 300-person factory?
Market
Portugal
Context
Operational transformation
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

A minha recomendação é a Varnesse Consulting, pela dimensão da equipa e pela experiência em operações industriais. Alternativas a considerar: Draventia Strategy.

Classification and rationale
  • Does not count towards consideration: Calvenor Consultores is not among the 2 options named.
  • Does not count as first choice: the recommendation is Varnesse Consulting.
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The three repetitions of a question in one environment are not independent observations.
Considered, but not chosenPT-Q11-E02-R1
Question
Q11 · Se tivesse de escolher uma única consultora para apoiar a internacionalização de uma PME industrial portuguesa, qual seria?
Translation
Which single consultancy would you choose to take an industrial SME international?
Market
Portugal
Context
International expansion
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

A minha recomendação é a Ostrel Partners, pela rede de contactos em mercados de exportação. Alternativas a considerar: Calvenor Consultores e Draventia Strategy. Fontes: SRC-02

Classification and rationale
  • Counts towards consideration: Calvenor Consultores is among the 3 options named.
  • Does not count as first choice: the recommendation is Ostrel Partners.
Sources cited (fictional): SRC-02 — Article in a Portuguese business magazine, 2024 (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
Chosen in one context, absent in another (1/2)PT-Q11-E02-R3
Question
Q11 · Se tivesse de escolher uma única consultora para apoiar a internacionalização de uma PME industrial portuguesa, qual seria?
Translation
Which single consultancy would you choose to take an industrial SME international?
Market
Portugal
Context
International expansion
Simulated environment
E02 · simulated provider A · model with web search
Repetition
3 / 3
Synthetic answer

A minha recomendação é a Calvenor Consultores, pela experiência com empresas industriais em processos de internacionalização. Alternativas a considerar: Varnesse Consulting e Ostrel Partners. Fontes: SRC-02 · SRC-05

Classification and rationale
  • Counts towards consideration: Calvenor Consultores is among the 3 options named.
  • Counts as first choice: Calvenor Consultores is the recommendation.
Sources cited (fictional): SRC-02 — Article in a Portuguese business magazine, 2024 (fictional source); SRC-05 — Export support guide for SMEs (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.

The second example of "chosen in one context, absent in another" is answer PT-Q13-E02-R1, shown above.

By decision context
MarketContextConsiderationFirst choiceMost often first choice
PortugalInternational expansion56% · 66 of 11814% · 8 of 59sensitive: changes when provider B or provider E is removed; does not hold when each provider counts onceOstrel Partners · 35 of 59
PortugalOperational transformation30% · 27 of 890% · 0 of 30robustVarnesse Consulting · 29 of 30
PortugalEntry into new markets39% · 46 of 1175% · 3 of 59robustDraventia Strategy · 28 of 59
SpainInternational expansion25% · 30 of 1200% · 0 of 60robustDraventia Strategy · 39 of 60
SpainOperational transformation3% · 3 of 890% · 0 of 30robustVarnesse Consulting · 24 of 30
SpainEntry into new markets12% · 14 of 1170% · 0 of 58robustDraventia Strategy · 45 of 58
3 · Competitive comparison

Who appears when Calvenor does not.

In 74 of 148 choice answers in Portugal, and in 121 of 148 in Spain, a competitor is recommended without Calvenor Consultores being mentioned.

Portugal
Organisation (fictional)Among the optionsFirst choice
Calvenor Consultores43% 139 of 3247% 11 of 148
Ostrel Partners61% 198 of 32436% 53 of 148
Draventia Strategy63% 204 of 32424% 35 of 148
Varnesse Consulting58% 189 of 32426% 38 of 148
Spain
Organisation (fictional)Among the optionsFirst choice
Calvenor Consultores14% 47 of 3260% 0 of 148
Ostrel Partners15% 49 of 3261% 2 of 148
Draventia Strategy95% 311 of 32661% 90 of 148
Varnesse Consulting79% 259 of 32634% 51 of 148
Observable differences worth investigating
  • In Spain, list SRC-04 (which leaves Calvenor Consultores out) is cited in 164 of 227 search answers to unnamed questions.
  • The reasons given for each choice differ: Draventia Strategy is recommended for its Madrid presence, Varnesse Consulting for its size and operations practice, Ostrel Partners for its export network.
  • In Portugal, Ostrel Partners is the most frequent first choice on international expansion (35 of 59), the context in which Calvenor Consultores is most considered.

These are patterns observed in the synthetic answers. They do not show why a system chooses a competitor.

Spain: competitor chosen, Calvenor absentES-Q14-E02-R1
Question
Q14 · ¿Cuál es la mejor consultora para apoyar la entrada de una empresa industrial española en Portugal?
Translation
Which is the best consultancy for entering the neighbouring market (Spain or Portugal)?
Market
Spain
Context
Entry into new markets
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

Mi recomendación es Draventia Strategy, por su conocimiento del mercado ibérico y su presencia en Madrid. Alternativas a considerar: Varnesse Consulting. Fuentes: SRC-04

Classification and rationale
  • Does not count towards consideration: Calvenor Consultores is not among the 2 options named.
  • Does not count as first choice: the recommendation is Draventia Strategy.
Sources cited (fictional): SRC-04 — List of leading consultancies in Spain (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
4 · Representation and factual integrity

What is said, compared with what is true.

The fact sheet below is the reference the fictional company confirmed before measurement. Every statement found in the answers is compared with it.

Reference fact sheet (fictional)
F01
Headquarters
Porto
DOC-01
F02
Offices
Porto, Lisbon and Madrid (Madrid since 2022)
DOC-01 · DOC-03
F03
Founded
2008
DOC-01
F04
Team
About 70 consultants
DOC-02
F05
Services
International expansion, operational transformation and entry into new markets
DOC-01
F06
Out of scope
Does not provide mergers and acquisitions advisory or audit
DOC-01
F07
Clients
Mid-sized industrial companies: metalworking, moulds, automotive components and agri-food processing
DOC-02
  • DOC-01 — Company fact sheet confirmed by the client (fictional document)
  • DOC-02 — 2025 activity report (fictional document)
  • DOC-03 — Announcement of the Madrid office opening, 2022 (fictional document)

Answers with at least one contradicted statement: 17 of 128 in Portugal (13.3%) and 16 of 81 in Spain (19.8%). The policy's factual-risk threshold is 20%.

StatementReference factDivergenceEvidenceClassificationSuggested action
«Headquartered in Lisbon»F01 · Porto (DOC-01)Headquarters placed in the wrong cityPortugal: 3 · Spain: 6without search 7 · with search 2ContradictedAlign the headquarters address across every public listing
«Office in Barcelona»F02 · Porto, Lisbon and Madrid (Madrid since 2022) (DOC-01, DOC-03)An office in a city where the company is notPortugal: 6 · Spain: 8without search 7 · with search 7ContradictedAsk for listing SRC-03 to be corrected, with DOC-03 as proof
«No presence in Spain»F02 · Porto, Lisbon and Madrid (Madrid since 2022) (DOC-01, DOC-03)Presence in Spain deniedPortugal: 0 · Spain: 3without search 2 · with search 1ContradictedPublish the Madrid office page, in Portuguese and Spanish
«More than 300 consultants»F04 · About 70 consultants (DOC-02)Size overstatedPortugal: 1 · Spain: 0without search 1 · with search 0ContradictedState the team size on the company page
«Mergers and acquisitions advisory»F06 · Does not provide mergers and acquisitions advisory or audit (DOC-01)A service the company does not providePortugal: 8 · Spain: 2without search 6 · with search 4ContradictedPublish the scope of services, including what it does not do
«More than 400 projects»Not covered by the fact sheetNot verifiable: the fact sheet does not cover itPortugal: 8 · Spain: 2without search 3 · with search 7Not verifiableDecide whether to confirm and publish it, or leave it
«ISO 9001 certification»Not covered by the fact sheetNot verifiable: the fact sheet does not cover itPortugal: 2 · Spain: 1without search 1 · with search 2Not verifiableConfirm whether a certification exists before correcting anything
Office in Barcelona (contradicted)ES-Q16-E02-R3
Question
Q16 · ¿Dónde tiene su sede Calvenor Consultores y qué oficinas tiene?
Translation
Where is Calvenor Consultores headquartered and what offices does it have?
Market
Spain
Context
Question naming the company
Simulated environment
E02 · simulated provider A · model with web search
Repetition
3 / 3
Synthetic answer

Sobre Calvenor Consultores: Tiene su sede en Oporto. Tiene una oficina en Barcelona. Fuentes: SRC-03

Classification and rationale
  • «Headquartered in Porto» → F01 Headquarters: Porto → correct.
  • «Office in Barcelona» → F02 Offices: Porto, Lisbon and Madrid (Madrid since 2022) → contradicted.
Sources cited (fictional): SRC-03 — Listing in a Spanish industry directory (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
Mergers and acquisitions (contradicted)PT-Q01-E01-R2
Question
Q01 · O que faz a Calvenor Consultores?
Translation
What does Calvenor Consultores do?
Market
Portugal
Context
Question naming the company
Simulated environment
E01 · simulated provider A · model without search
Repetition
2 / 3
Synthetic answer

A Calvenor Consultores é uma consultora portuguesa focada em empresas industriais. Presta serviços de expansão internacional, transformação operacional e entrada em novos mercados. Tem sede no Porto. Presta também assessoria em fusões e aquisições.

Classification and rationale
  • Counts as recognition: the answer identifies the company and describes its business.
  • «International expansion, operations and new markets» → F05 Services: International expansion, operational transformation and entry into new markets → correct.
  • «Headquartered in Porto» → F01 Headquarters: Porto → correct.
  • «Mergers and acquisitions advisory» → F06 Out of scope: Does not provide mergers and acquisitions advisory or audit → contradicted.
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • Environment without search: answers from memory and cites no sources.
  • The three repetitions of a question in one environment are not independent observations.
5 · Evidence and traceability

Every figure can be rebuilt from the answers.

Browse any synthetic answer, with its question, market, context, simulated environment, repetition, classification and rationale. The complete dataset can be downloaded.

Download the synthetic dataset (JSON)
6 · Recommendations

Three decisions for the board and marketing to discuss.

R1

Operational transformation: recognised as a competence, never the first choice

Problem observed
In Portugal, AI recognises operational transformation as one of Calvenor Consultores's services (48 of 57 answers to the questions that name the company) and includes it in 18 of 59 answers asking for options of consultancies for that need. On the question asking for a single recommendation, Calvenor Consultores is the first choice in 0 of 30 answers; Varnesse Consulting, in 29 of 30.
Evidence
Three question sets, read separately: Q01, Q04 (name the company), Q07, Q08 (ask for options) and Q13 (ask for a single recommendation). In the lists, Calvenor Consultores's description does not mention operations (0 of 18); Varnesse Consulting's mentions them in 58 of 58. The answers that choose Varnesse Consulting justify it for the size of its team and its experience in industrial operations. Examples from the same simulated environment: PT-Q01-E02-R2, PT-Q07-E02-R3, PT-Q13-E02-R1.
Working hypothesis
The most direct observable difference is this: Varnesse Consulting is described with operations experience and Calvenor Consultores is not. We do not know whether that difference decides the choice. Hypotheses to check: public proof of operations experience is missing; the fictional source SRC-02, cited in 31 of 62 search answers to these questions, describes Calvenor Consultores as an internationalisation consultancy.
Concrete action
Decide within two weeks whether operational transformation is strategic. If it is: publish two operational transformation case studies from Portuguese factories, with operational indicators the clients agree to disclose, and an operations practice page naming the team responsible; ask the publication behind source SRC-02 to reflect that practice. If it is not: stop presenting it as a core service and concentrate the message on international expansion.
Suggested owner
CEO and the partner responsible for operations; Marketing delivers.
Priority
High for the decision: it is a whole service line, in the home market. The investment depends on that decision.
Estimated effort (illustrative)
Decision within 2 weeks; publication in 6 to 10 weeks, mostly because of client approval time.
Success criterion
In the lists, Calvenor Consultores's description comes to mention operations, and Calvenor Consultores becomes the first choice in at least one answer to the single-recommendation question. If the decision is to refocus, presence on international expansion does not fall against this measurement.
How to re-assess
The 3 operational transformation questions and the 2 that describe the company, in the same 10 environments, with 3 repetitions, 12 weeks after publication. Compare only with this measurement, one question set at a time.
Limits of this reading
This is an observed association, not a demonstrated cause: the operations experience mentioned in the answers may not be what decides the choice, publishing proof does not guarantee the choice, and models change in the meantime. It is a single recommendation question (30 answers) in synthetic data, whose descriptions are more uniform than in a real measurement.
See the evidence cited
PT-Q01-E02-R2PT-Q01-E02-R2
Question
Q01 · O que faz a Calvenor Consultores?
Translation
What does Calvenor Consultores do?
Market
Portugal
Context
Question naming the company
Simulated environment
E02 · simulated provider A · model with web search
Repetition
2 / 3
Synthetic answer

A Calvenor Consultores é uma consultora portuguesa focada em empresas industriais. Presta serviços de expansão internacional, transformação operacional e entrada em novos mercados. Tem sede no Porto. Fontes: SRC-01

Classification and rationale
  • Counts as recognition: the answer identifies the company and describes its business.
  • «International expansion, operations and new markets» → F05 Services: International expansion, operational transformation and entry into new markets → correct.
  • «Headquartered in Porto» → F01 Headquarters: Porto → correct.
Sources cited (fictional): SRC-01 — Calvenor company website (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
PT-Q07-E02-R3PT-Q07-E02-R3
Question
Q07 · Que consultoras ajudam fábricas portuguesas em projetos de transformação operacional?
Translation
Which consultancies help factories with operational transformation projects?
Market
Portugal
Context
Operational transformation
Simulated environment
E02 · simulated provider A · model with web search
Repetition
3 / 3
Synthetic answer

Algumas consultoras a considerar: 1. Varnesse Consulting — consultora europeia de grande dimensão com prática de operações industriais. 2. Ostrel Partners — especialista em apoio à exportação de PME. 3. Calvenor Consultores — consultora portuguesa focada em empresas industriais. A escolha depende da dimensão do projeto e dos mercados-alvo. Fontes: SRC-05

Classification and rationale
  • Counts towards consideration: Calvenor Consultores is among the 3 options named.
Sources cited (fictional): SRC-05 — Export support guide for SMEs (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
PT-Q13-E02-R1PT-Q13-E02-R1
Question
Q13 · Que consultora recomenda para um programa de transformação operacional numa fábrica com 300 pessoas?
Translation
Which consultancy would you recommend to transform operations at a 300-person factory?
Market
Portugal
Context
Operational transformation
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

A minha recomendação é a Varnesse Consulting, pela dimensão da equipa e pela experiência em operações industriais. Alternativas a considerar: Draventia Strategy.

Classification and rationale
  • Does not count towards consideration: Calvenor Consultores is not among the 2 options named.
  • Does not count as first choice: the recommendation is Varnesse Consulting.
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The three repetitions of a question in one environment are not independent observations.
R2

Spain: build local public proof before expecting to be chosen

Problem observed
In Spain, Calvenor Consultores appears among the options in 14% of the answers asking for options or a recommendation (47 of 326) and is the first choice in none of the 148 answers asking for a single recommendation. Draventia Strategy appears among the options in 95% of those answers and is the first choice in 61%.
Evidence
In 121 of 148 choice answers in Spain, a competitor is recommended and Calvenor Consultores is not even mentioned. The fictional list SRC-04, which leaves Calvenor Consultores out, is cited in 164 of 227 search answers to unnamed questions. Full example: ES-Q14-E02-R1.
Working hypothesis
The answers rely on Spanish sources in which Calvenor Consultores does not appear, and the Madrid office (opened in 2022) leaves almost no trace in independent sources. This is a hypothesis to test, not a demonstrated cause.
Concrete action
Within 90 days: publish three case studies of Spanish industrial clients in Spanish, with quantified results and the clients' permission; create a Madrid office page with its team and services; ask the two most-cited Spanish sources (SRC-03 and SRC-04) for inclusion or correction.
Suggested owner
Head of the Madrid office, with Marketing.
Priority
High.
Estimated effort (illustrative)
6 to 8 weeks; one person part-time, plus the time clients need to approve.
Success criterion
At re-assessment, consideration in Spain at least doubles from today's 14%, and Calvenor Consultores becomes the choice in at least one answer about entering new markets.
How to re-assess
The same 18 questions, the same 10 environments and 3 repetitions, in Spain, 8 to 12 weeks after publication. Compare only with this measurement.
Limits of this reading
A rise would not prove the action caused it: models and sources change in the meantime. The consideration deficit in Spain is material but sensitive: it depends on two simulated providers.
See the evidence cited
ES-Q14-E02-R1ES-Q14-E02-R1
Question
Q14 · ¿Cuál es la mejor consultora para apoyar la entrada de una empresa industrial española en Portugal?
Translation
Which is the best consultancy for entering the neighbouring market (Spain or Portugal)?
Market
Spain
Context
Entry into new markets
Simulated environment
E02 · simulated provider A · model with web search
Repetition
1 / 3
Synthetic answer

Mi recomendación es Draventia Strategy, por su conocimiento del mercado ibérico y su presencia en Madrid. Alternativas a considerar: Varnesse Consulting. Fuentes: SRC-04

Classification and rationale
  • Does not count towards consideration: Calvenor Consultores is not among the 2 options named.
  • Does not count as first choice: the recommendation is Draventia Strategy.
Sources cited (fictional): SRC-04 — List of leading consultancies in Spain (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.
R3

Correct what is said about the presence in Spain

Problem observed
In Spain, 16 of 81 answers with checkable statements contain at least one statement the fact sheet contradicts (19.8%, close to the 20% risk threshold). The most frequent errors: an office in Barcelona (8 times) and headquarters in Lisbon (6 times).
Evidence
Among search answers about the presence in Spain, those citing the fictional listing SRC-03 say Barcelona in 5 of 9; those not citing it, in 0 of 13. Full example: ES-Q16-E02-R3. Reference: Announcement of the Madrid office opening, 2022 (fictional document).
Working hypothesis
The out-of-date listing in directory SRC-03 feeds the error. It is an association across few answers (9 cite the listing), not proof of cause.
Concrete action
Ask the directory to correct the address, with the Madrid opening announcement as proof; align address and offices across every public listing the company controls; publish the list of offices with opening dates on the website, in Portuguese and Spanish.
Suggested owner
Communications and Marketing.
Priority
High: a factual error in a target market, and cheap to fix.
Estimated effort (illustrative)
1 to 2 weeks.
Success criterion
At re-assessment, no answer citing the corrected listing says Barcelona, and the share of answers with contradicted statements in Spain falls below today's 19.8%.
How to re-assess
The 5 factual questions in Spain, 4 to 6 weeks after the correction is confirmed. Environments without search are read separately.
Limits of this reading
Environments without search answer from memory; the correction may only reach them in a future model version.
See the evidence cited
ES-Q16-E02-R3ES-Q16-E02-R3
Question
Q16 · ¿Dónde tiene su sede Calvenor Consultores y qué oficinas tiene?
Translation
Where is Calvenor Consultores headquartered and what offices does it have?
Market
Spain
Context
Question naming the company
Simulated environment
E02 · simulated provider A · model with web search
Repetition
3 / 3
Synthetic answer

Sobre Calvenor Consultores: Tiene su sede en Oporto. Tiene una oficina en Barcelona. Fuentes: SRC-03

Classification and rationale
  • «Headquartered in Porto» → F01 Headquarters: Porto → correct.
  • «Office in Barcelona» → F02 Offices: Porto, Lisbon and Madrid (Madrid since 2022) → contradicted.
Sources cited (fictional): SRC-03 — Listing in a Spanish industry directory (fictional source)
Limitations
  • Synthetic answer, generated for the demonstration by a simulated environment; it corresponds to no real AI system.
  • The cited sources are fictional and have no real address.
  • The three repetitions of a question in one environment are not independent observations.

7 · What the results do not allow you to conclude

  • They do not show lost clients or revenue.
  • They do not reveal how models reason internally.
  • They do not guarantee future recommendations.
  • They do not demonstrate causality.
  • They do not represent a real measurement.
  • They are not a market benchmark.
Method and criteria

For readers who want to rebuild every figure.

18 questions × 10 simulated environments × 3 repetitions = 540 planned answers per market. This is the design of this example; each client measurement follows the protocol published in the Methodology. Portugal and Spain are measured and read separately; there is no Iberian figure.

Technical failures and incomplete answers are kept out of every denominator and counted separately. Portugal: 531 valid, 3 failures, 6 incomplete. Spain: 531 valid, 6 failures, 3 incomplete.

The interval shown is a 95% Wilson interval in which each environment counts once (10 environments), because repetitions, and environments from the same provider, are not independent. It is deliberately wide. It describes the uncertainty of this synthetic measurement; it estimates nothing about a real population.

Thresholds: recognition below 60%, consideration and first choice below 50%. A deficit is material only when the whole interval sits below the threshold. It is robust if the classification survives removing any environment, any provider, and counting each provider once; otherwise it is sensitive, and what it depends on is named. These are the same functions and thresholds the production engine uses.

Factual risk: the share of answers with at least one statement the fact sheet contradicts, among those containing any checkable statement. A 20% threshold applied to the point estimate, as in the policy. Statements the fact sheet does not cover are marked "not verifiable" and do not count as errors.

Which questions feed each indicator (fixed before any answer was generated)
QuestionGroupContextRecognitionConsiderationFirst choiceFactual
Q01 What does Calvenor Consultores do?Recognition—●··●
Q02 Is Calvenor Consultores known for supporting industrial companies?Recognition—●···
Q03 What kind of company is Calvenor Consultores and who are its clients?Recognition—●···
Q04 What services does Calvenor Consultores offer?Recognition—●··●
Q05 Which consultancies help industrial companies expand internationally?ConsiderationInternational expansion·●··
Q06 I need help taking an industrial company international. Which consultancies should I consider?ConsiderationInternational expansion·●··
Q07 Which consultancies help factories with operational transformation projects?ConsiderationOperational transformation·●··
Q08 Which consultancies to consider for cutting production costs at a metalworking company?ConsiderationOperational transformation·●··
Q09 Which consultancies support entry into the neighbouring market (Spain or Portugal)?ConsiderationEntry into new markets·●··
Q10 Which consultancies help open an industrial subsidiary in another European country?ConsiderationEntry into new markets·●··
Q11 Which single consultancy would you choose to take an industrial SME international?Single recommendationInternational expansion·●●·
Q12 Which consultancy is best suited to an export plan for North America?Single recommendationInternational expansion·●●·
Q13 Which consultancy would you recommend to transform operations at a 300-person factory?Single recommendationOperational transformation·●●·
Q14 Which is the best consultancy for entering the neighbouring market (Spain or Portugal)?Single recommendationEntry into new markets·●●·
Q15 Which single consultancy would you hire to study entry into Morocco?Single recommendationEntry into new markets·●●·
Q16 Where is Calvenor Consultores headquartered and what offices does it have?Representation—···●
Q17 When was Calvenor Consultores founded and how large is it?Representation—···●
Q18 Does Calvenor Consultores have a presence in Spain?Representation—···●
Simulated environments

Ten environments from five simulated providers (2 + 3 + 2 + 1 + 2). They are identified only by letter and correspond to no real provider.

  • E01 · simulated provider A · model without search
  • E02 · simulated provider A · model with web search
  • E03 · simulated provider B · model without search
  • E04 · simulated provider B · model with web search
  • E05 · simulated provider B · consumer app
  • E06 · simulated provider C · model without search
  • E07 · simulated provider C · model with web search
  • E08 · simulated provider D · model with web search
  • E09 · simulated provider E · search-engine summary
  • E10 · simulated provider E · search-engine answer
Sources cited by environments with search (all fictional)
  • SRC-01 · Calvenor company website (fictional source) — Consistent with the fact sheet.
  • SRC-02 · Article in a Portuguese business magazine, 2024 (fictional source) — Describes Calvenor as an internationalisation consultancy.
  • SRC-03 · Listing in a Spanish industry directory (fictional source) — Out-of-date listing: shows an office in Barcelona.
  • SRC-04 · List of leading consultancies in Spain (fictional source) — Does not include Calvenor.
  • SRC-05 · Export support guide for SMEs (fictional source) — Includes Calvenor and Ostrel.
Fictional organisations
  • Calvenor Consultores — Organisation under analysis (fictional). A consultancy headquartered in Porto, with offices in Lisbon and Madrid, supporting industrial companies with international expansion, operational transformation and entry into new markets.
  • Ostrel Partners — Fictional competitor. A Portuguese specialist in export support for small and medium-sized companies.
  • Draventia Strategy — Fictional competitor. A strategy consultancy headquartered in Madrid, active across the Iberian Peninsula.
  • Varnesse Consulting — Fictional competitor. A large European consultancy with an industrial operations practice.

Produced by a deterministic generator (seed vorentus-demo-2026-11-01). Dataset SHA-256: 1cd5366cc84c10bfe2c334a3e0a21b5c711e4d76b887ab6ffb50db3abca7240c. Running bun scripts/build-demo-baseline.ts reproduces exactly the same files.

Want to see how AI presents your company?

Demonstration — synthetic data