The Tesla and Twitter boss has seen his fortune fall by $165bn (£135bn) since November 2021.