The only Indigenous MP in the federal government’s caucus has threatened to cross the floor if Attorney-General George Brandis’s plan to water down anti-racism laws goes too far. He joi…