Simulation code for the paper:  "AoI Minimization in Energy Harvesting and Spectrum Sharing Enabled 6G Networks" 

we use a neural network to approximate the Q-value function. The state is given as the input and the Q-value of all possible actions is generated as the output.