Memes

You are absolutely correct, but to add on to that even more:

When we talk about space, we usually think about 3D euclidean space. That means that straight lines are the shortest way between two points, parallel lines stay the same distance forever, and a whole bunch of other nice features.

Another way of thinking about objects like the earth is to think of them as 2D spherical manifolds. That means we concern ourself only to the surface of the earth, with no concept of going below the surface or flying up into the sky. In S2 (that's what you call a 2D spherical manifold), and in spherical geometry in general, parallel straight lines will eventually cross, and further on loop back and form a closed loop. Sounds weird, right? Well, we do it all the time. Look at lines of Longitude, for example.

We call the shortest line connecting two points in curved manifolds geodesics, as you said, and for all intents and purposes, they are straight. Remember, there is no concept of leaving the sphere, these two coordinates is all there is.

What one can do, if one wants to, is embed any manifold into a higher-dimensional euclidean one. Geodesics in the embedded manifold are usually not straight in higher-dimensional euclidean space. Geodesics on a sphere, for example, look like great circles in 3D.