Jonathan Turley, the attorney for the family, explained the appeal.

“This has been an extended and difficult struggle for the Brown family but they have never wavered in their commitment to defending the important principles of religious freedom in this case,” he said, according to the Associated Press. “Utah is a state that was founded by courageous citizens seeking these very protections from government abuse and religious inequality. This lawsuit is true to the original dream of those seeking freedom in Utah.”

But Kacsmaryk suggested that the already well-established constitutional and statutory rights of women and children would stand against the argument for religious freedom in the case.

Brown is legally married to one wife and claims “spiritual marriage” to his other wives. The family now lives in Las Vegas, Nevada. They said they fled their home in Lehi, Utah in 2011 because local authorities opened an investigation after their television show debuted in 2010.

The investigation was closed without charges but the family said they can still face prosecution.

Kacsmaryk served as assistant U.S. Attorney for the Northern District of Texas when it prosecuted polygamists from the Fundamentalist Church of Jesus Christ of Latter-Day Saints, whose claim that they were practicing the free exercise of religion was rejected in court.

He said that constitutional rights “are often balanced against other constitutional rights to achieve something like an Aristotelian ‘golden mean’.”

Kacsmaryk said it is unsurprising that the plaintiffs would invoke arguments made in recent Supreme Court precedents mandating that all states recognize “gay marriage” and strike down morals legislation on the grounds of “radical self-definition” and self-actualization.

In his view, the court has never explained an adequate principle limiting its standard of consenting adults to simply two people.

At the same time, the Brown plaintiffs cannot make any constitutional arguments unless the Supreme Court agrees to hear their case.

The Church of Jesus Christ of Latter-day Saints, colloquially known as Mormons, renounced the practice of polygamy in 1890, though splinter groups still practice plural marriage. U.S. anti-polygamy laws have been upheld in several Supreme Court decisions.