Combine white fish, lime juice, orange juice, oil, and chile pepper in a glass or ceramic bowl. Cover with plastic wrap and refrigerate for 90 minutes.
Mix in mangoes and green onions, cover, and chill for 10 minutes more.
Gently fold in tomatoes and cilantro. Season with salt and pepper and serve immediately.