Jason, Welcome to APC
With a 2.5 gallon tank you will need to go with small equipment... Lighting:
AquaLight for AquaVase & filter:
Nano Hang-on filter for Aquavase
You will need to stick with low light plants like: Crypts, Java Moss/Fern, Anubias. I don't think that Dwarf Hairgrass or Riccia would be a good choice.
For such a small tank I would not waste money on a bag of Fluorite, you will have a lot of leftover. I would go with a small bag of 2-3mm natural gravel.
For ferts: Seachem Flourish/micros & Excel. Get small bottles for you will not use very much at all. I would not try injecting C02 in such a small tank, Excel will be the carbon source.
You will also need a
heater for shrimp, unless you live where it stays warm year round.