The black rubber covered device by the motor mount is the evap purge solenoid. It can cyclically click under certain conditions. Just unplug the electrical connector to see if it stops the clicking noise.
As far as the other noise, it does sound like the belt tensioner pulley bearing. You could temporarily slip off the serpentine belt and see if that stops the noise. While the belt is off ( if the engine's cool ) you can reach down and spin the tensioner pulley and see if it rotates smoothly or feels loose or rough. Ditto for the A/C belt and it's adjustment pulley
I suspect that whatever the noise is that it's coming from something external on the engine.
As far as the other noise, it does sound like the belt tensioner pulley bearing. You could temporarily slip off the serpentine belt and see if that stops the noise. While the belt is off ( if the engine's cool ) you can reach down and spin the tensioner pulley and see if it rotates smoothly or feels loose or rough. Ditto for the A/C belt and it's adjustment pulley
I suspect that whatever the noise is that it's coming from something external on the engine.