The olive tree from which Moses heard the words of God speaking to him, was not an idol or totem.
None prayed from it, or vowed to it .or asked his needs from it or sought its assistance or help.
So Moses heard the words of God speaking to him from the olive tree, but God - be glorified - was not in the tree; He sent His words to the olive tree which Moses heard from the tree, as you hear the news from the Radio set, while the man reading the news is not in the radio set, but he is in London or Cairo.
That is because God is Highly Proud and does not speak directly to any creature, unless from behind a veil and the veil here was the olive tree.
Wasn't talking about that but...
That olive tree certainly IS a Totem.
If God supposedly spoke through it, it's become a totem.
If your people recognize that God spoke through that tree, it's a totem.
You don't need to pray or vow or anything to an object for it to be a totem. A totem is a symbolic religious symbol.
Like your olive tree.
People don't pray or look to the burning bush of the Moses story either, yet that it still a totem.
"That is because God is Highly Proud and does not speak directly to any creature, unless from behind a veil and the veil here was the olive tree."
Irony here is, that people who look to Totems to help them worship say the EXACT SAME THING.
It's not the object, it's what the object represents.
It's a focus.
Irony is, pagan beliefs also have such things, which is where the Religious stole them from.
Because in order to help the pagans switch to the "new religion" whatever that way, it's easier to take established faith practices and blend them to the 'new'.
That goes for all religions.
Even yours.