You will want to repot it into a new container/pot with succulent soil that has good drainage and a pot with drainage holes. Those leaves are most likely dead or dying leaves that are part of the plant's growth cycle; you can cut them off or leave them until you can pull them off naturally