Kaze No Stigma

Ayano is the heir to the house of Kannagi, a house with ties to the spirit of fire, whose members are all fire users. All except for her cousin, Kazuma. After he was defeated by Ayano, his father banished him from the house in disgrace. Kazuma ran off and changed his surname to Yagami. He formed a contract with the spirit of wind and becomes a powerful wind user. Four years later, he returned.
Four years ago, Kazuma Kannagi was defeated by his cousin Ayano Kannagi for the right to be the successor of Enraiha, a sword passed down in the Kannagi family. His defeat, along with his lack of talent for En-Jutsu, the fire arts, the Kannagis' specialty, resulted in his banishment from the family. Now, Kazuma returns as Kazuma Yagami, a skilled master of Fu-Jutsu, the wind arts.