Idolatry is very dangerous and deceitful. Moses was a powerful intercessor and mediator who pre-figured Christ. Paul provides comment on this incident in 1 Corinthians 10:1-13
This is not about making a reasoned judgment but about hypocritical fault finding. Jesus encourages us to intercede. There are only 2 choices. about our lifestyle