This was Ian Maxtone-Graham's first episode. He previously worked as a consultant on the show.
This was one of the few times where Homer did something stupid unwillingly, as Homer pointed out (quite correctly) the flaws about leaving and escorting Larry Burns from the house in daybreak and while cops are outside when Marge tells him to take Larry out of the house immediately.
There is a portrait of a Scottish man wearing kilt with a sign "Angus Burns" above a fireplace in the living room in the Burns Manor. It refers to his family's Scottish descent. However, there are many theories about their origin (German, Mexican...).
When Homer was explaining to Mr. Burns that Larry was only trying to get his father's love, he describes his children as obnoxious (Bart's reckless behavior), boring (the idea that Lisa's lectures, thoughts, activities, actions and trip ideas are dumb and boring), and stinky (referring to Maggie, who wears diapers). Upon hearing this, the kids get angry at Homer because of the way he described them.
Several elements of the episode parody the film Caddyshack, which featured Dangerfield. These include Larry trying to fit in with Burns' associates and the party at the end, accompanied by Journey's "Any Way You Want It."
Homer brushes off an almost completed puzzle of Snoopy on his doghouse from his workstation after he finds out Larry is working there. The piece where Snoopy's nose should be is intentionally missing in order to avoid infringing copyright.
The title is a reference to "Burn, baby, Burn!", a lyric from the song "Disco Inferno", by The Trammps.
The same lyric is parodied in the PC game Shadow Warrior by 3D Realms, in which, in MAP03, protagonist Lo Wang mockingly sings "Burn, baby, burn! Flames are gettin' higher!" as a captured green demon is being lowered upside-down into a well full of fire to be roasted alive and generate of the keys needed to proceed in the game.