What's wrong with my sudachi (citrus)?

The fruits have started to pale and the leaves to curl. I'm pretty new to citrus.

Edit: Thanks to everyone! I'm going to try to make a couple of changes based on your suggestions.