Energy-efficient resource allocation and scheduling in wireless networks and systems, cross-layer design, Markov decision processes, reinforcement learning