Gilani was born in Karachi, He belongs to an influential political family from Multan. His father was a descendant of Syed Musa Pak,

Gilani was born in Karachi. He belongs to an influential political family from Multan. His father was a descendant of Syed Musa Pak, a spiritual figure of the Qadiri Sufism order which traces its origins to Abdul-Qadir Gilani of the Gilan province of Iran. Gilani is married and has four sons, one daughter, and one grandson. His eldest son, Syed Makhdoom Abdul Qadir Gilani, started his own political career from Multan, and in 2008 he married the granddaughter of Pir Pagara, an influential political figure of Sindh. His three other sons -- Ali Qasim, Ali Musa and Ali Haider -- are currently studying abroad. His daughter is named Fiza. Gillanis are the major landowners of Multan who owned about 200 acres of land.