They would be wrong--GAR is not the only justification when meeting them size test. You also can utilize SBIC or SBDC to determine eligible size. But, because this loan is greater than 1MM it no longer falls under small business, and is now considered under the lending test, or community development test.
Banks making 504 loans may qualify for CRA consideration. In most cases, loans of $1
million or less qualify as small business loans and may be considered under the CRA
lending test for banks of all sizes.15 Intermediate-small banks may choose to have small
business loans of $1 million or less, which meet the regulatory definition of community
development, evaluated as community development loans.16 Loans of greater than $1
million made under the 504 program are considered community development loans17
either under the lending test18 or the community development test,19 depending on the
bank’s size.
https://www.occ.gov/topics/community-affairs/publications/insights/insights-occdmrm-504.pdf (Page 7)