From a third worldist perspective, many would argue that Trotskyists with the theory of "permanent/world revolution" put the cart before the horse so to speak, in that they do not accept the limitations of "building socialism in one country" and the reality of where many third world/global south/periphery countries start from, which is a rock bottom capitalist economy structured for exploitation by the imperial core/centre - see Micheal Parenti "not poor but over exploited" - and the contradictions that will occur because of this, when on a path towards socialism and dismantling this form of capitalism, contradictions such as stagism/two stage theory/new democracy.

In the countries of the (Global) South, most people are victims of the system, whereas in the (Global) North, the majority are its beneficiaries. Both know it perfectly well, although often they are either resigned to it (in the South) or welcome it (in the North). It is not by accident, then, that radical transformation of the system is not on the agenda in the North whereas the South is still the “zone of storms,” of continual revolts, some of which are potentially revolutionary. Consequently, actions by peoples from the South have been decisive in the transformation of the world.

Taking note of this fact allows us to contextualize class struggles in the North properly: they have been focused on economic demands that generally do not call the imperialist world order into question. For their part, revolts in the South, when they are radicalized, come up against the challenges of underdevelopment. Their “socialisms,” consequently, always include contradictions between initial intentions and the reality of what is possible...There is no “world revolution” on the agenda whose center of gravity would be found in the advanced centers. Lenin, Mao, Ho Chi Minh, and Castro understood that and accepted the challenge of “constructing socialism in one country.” Trotsky never understood that. The limits of what was achievable in these conditions, beginning with the heritage of the “backward” capitalism found in the peripheries, accounts for the later history of the twentieth century’s great revolutions, including their deviations and failures.

• Samir Amin, Revolution from North to South

I personally have no problem with Trotskyists as long as they are not overly sectarian or overly critical of states actually attempting to build socialism. It's perfectly fine to have theoretical disagreements. As long as they're still on the left, it's all good.