I am currently working on a Conversion Modelling implementation. As recommended, I have used the EngagementAndConversionTemplate strategy to build our conversion modelling strategy.
In the template strategy, the Settings Set Property component initializes:
- pyModelPositives = 1000
- pyModelEvidence = 10000
- pyChampionPercentage = 0.75
These values appear to be used in the Restore E Model Metadata component logic to override the engagement model metadata values(Refer: 2,2a,2b ).
I have a couple of questions regarding this design:
1. Why are the Engagement Model values overridden?
The template initializes pyModelPositives and pyModelEvidence with fixed values and later uses them to override Engagement model values in the Restore E Model Metadata component.
Could you please explain:
- What issue this override is intended to address?
- How these default values influence the Engagement and Conversion model interaction?
- Why the actual Engagement model metadata cannot be used directly throughout the strategy?
2. Why is ChampionPercentage initialized to 0.75?
I noticed that the strategy starts with: ChampionPercentage = 0.75
Could you please clarify:
- Why 75% (75% customers use Engagement model and 25% uses Conversion Model)was chosen as the default value?
- Whether this represents an exploration/exploitation balance between the Engagement and Conversion models?
- What are the implications of changing this percentage, and under what circumstances should it be adjusted?
Any additional documentation or design rationale behind these settings would be very helpful.