Casinos determine the house edge in blackjack by assessing the probabilities of various outcomes based on game rules and player strategies. This involves analyzing factors such as dealer rules, the number of decks used, and potential player actions like hitting or standing. By calculating the likelihood of winning, losing, or pushing, casinos can establish a mathematical advantage, ensuring long-term profitability from the game.