The soon-to-be-formed BJP government will take key decisions on cleaning the Yamuna River in its first cabinet meeting, amid a political battle with AAP over water contamination.