For an onboarding journey which will have about 5,000 subscribers entering daily, what is the best practise in setting up the entry source DE? - Answers - Salesforce Trailblazer Community
Trailblazer Community
Ask Search:
Gaurav ShresthaGaurav Shrestha 

For an onboarding journey which will have about 5,000 subscribers entering daily, what is the best practise in setting up the entry source DE?

Hi there,

I am currently working on a Onboarding Journey. Approximately, 5000 records will be entering into this Journey everyday on a daily basis.

To get the required audience for this journey, I have an automation running in automation studio that populates two DEs. One DE stores the list of sign-ups from yesterday
(with a query that overwriting the list on a daily basis) and the other DE is the kind of the History DE that stores the list of all records that have previously entered the
journey (with a import activity that appends new records  on a daily basis). In terms of best practise and performance considerations, which DE  out of the two should l select
as the entry source for the Journey? Please note that i won't be needing any journey data for personalisation/DC in the emails in the journey.

What would you recommend as best practise? Thanks for your help.


Regards,
Gaurav
Andrei BaranyAndrei Barany
Hi Gaurav,

5,000 is such a low number, that it doesn't really matter.
I usually use overwrite for my entry DE's and grabbing everyone from the DE daily.  I also use a Historical DE, but the way I do it, I just select all from the Entry DE once it was created and place it in a History DE.

Hope this helps,
Andrei
Gaurav ShresthaGaurav Shrestha
Hi Andrei, Thank you very much for your reply, really appreciate it! Your answer confirms my understanding which is great! Can I also ask a another question linked to this same journey? So, there is an another DE extension that we need to use in a decision path activity which is linked through contact builder and so we want to access the contact data from this DE. This DE is currently being updated through a daily import with the import type as “Overwrite”, is this going to cause issues? I heard from someone that overwriting DEs can cause issues, so is it better to do “add and update”? Is this correct? Thanks for your help. Cheers, Gaurav
Andrei BaranyAndrei Barany
Hmm, i'm not sure what issue could it cause, the values are evaluated when a person gets to that step. 
If you have to remove entries from that DE (let's say today's file contain fewer entries then yesterdays) then you will have to use overwrite. Otherwise, i would stick to add/update as well.

Hope this helps,
andrei
Gaurav ShresthaGaurav Shrestha
Hi Andrei, There is salesforce stack exchange link below which states that everytime there is a overwrite on Des, something called _CustomObjectKey changes which might cause issues in using the data in journeys. https://salesforce.stackexchange.com/questions/235794/overwriting-a-data-extension-with-new-records-does-it-affect-a-currently-runni Do you know if that is true? Thanks, Gaurav