Ka’bah is the Holy place in Makkah and the the Qiblah (direction Muslims face during prayers). Muslims worship and bow down only to Allah and facing the Ka’bah does not in any way signify worshipping it.
Facing the Ka’bah is an instruction from Allah (swt) to Muslims, as it is stated in the Holy Qur’an:
“Verily, We have seen the turning of your face towards the heaven. Surely, We shall turn you to a Qiblah (prayer direction) that shall please you, so turn your face in the direction of Al-Masjid –Al-Haram (the sanctuary at Makkah). And wheresoever you people are, turn your faces (in prayer) in that direction.
Qur’an 2:144
Facing the Ka’bah while praying is a symbolic act of fostering unity among Muslims. Wherever they may be, all Muslims praying facing one direction is an immense act of unity in worshipping God