Psalms 137:4 Commentary: The Exiles' Refusal to Sing

Psalm 137 opens with the exiles “by the rivers of Babylon.” Keil and Delitzsch identify these as the Euphrates with its canals, the Tigris, the Chebar (where Ezekiel saw visions), and the Ulai (where Daniel received visions). The Hebrew sham (“there”) underscores the shock of location: there, on alien soil, under the power of the world. Calvin notes that synagogues were often built near rivers for the convenience of washing before prayer; in Babylon, without synagogues, the captives may have gathered in the open air along the waterways. Chrysostom conjectured that the Jews were initially forbidden to live in towns, forced to build cottages along the rivers, making solitude their constant companion.

The willows (‘aravah) were indigenous to Babylon’s lowlands. Hanging their harps on them was a deliberate act of silence, music was for seasons of joy, and this was not such a season (Ecclesiastes 3:4). The captors’ demand for “one of the songs of Zion” was not a polite request but a mockery, intended to humiliate a conquered people by forcing them to sing of a ruined city and a defeated God. The exiles were caught between two impossibilities: to sing would betray their grief and profane what was holy; to refuse would invite punishment. Their response, “How can we sing Yahweh’s song in a foreign land?” is less a question than a protest, a refusal rooted in faith, not defiance.

The consulted sources note no significant textual variants for Psalm 137:4. The Hebrew text is stable across manuscripts. The main variation in English versions is the divine name: Yahweh, Jehovah, or the Lord, reflecting translation preferences rather than textual differences.

Psalm 137 has been read through the ages as a model of honest lament. Jewish tradition associates it with the mourning of exile, and the Targum (as cited by Gill) attributes the refusal specifically to the Levites, who were the temple singers. Early Christian interpreters, including Chrysostom, saw in the exiles’ silence a reverence for holy things that should not be profaned. Calvin used the psalm to teach that the church in times of oppression must guard its worship from mockery. The Geneva Bible notes frame the refusal as a protest against the enemy’s scorn. In modern times, the psalm has been set to music in spirituals and hymns, often used by communities who know displacement, enslaved Africans in America, for instance, found their own voice in the words “How shall we sing the Lord’s song in a strange land?” The verse continues to resonate with those who feel their faith is mocked by the powerful.

Three-point outline

1. The pain of displacement. The exiles sat by rivers in a foreign land, weeping as they remembered Zion (v.1). The land of Babylon was not just far away, it was the land of a foreign god, a place where the temple lay in ruins and the covenant seemed broken. The community’s grief was corporate, not merely personal.
2. The weight of holy song. The “Lord’s song” was not entertainment. It was the song of Yahweh, the God of Israel, sung in temple worship and in festivals at Jerusalem. Wesley calls it “appointed by God to be sung only in his service.” To sing it in Babylon would be to cast pearls before swine (Matthew 7:6, as Gill notes) and to treat sacred words as casual.
3. The integrity of lament. The exiles refused to fake joy. There is a time to weep (Ecclesiastes 3:4), and this was it. Their refusal honoured God more than a forced smile would have. Lament is not faithlessness, it is the language of trust when the world falls apart.

Five-point outline

1. The setting: by Babylon’s rivers, under the taunts of captors (vv. 1-3).
2. The question: “How shall we sing Yahweh’s song in a foreign land?” (v.4).
3. The reason: emotional sorrow made singing feel like betrayal; the song was too holy for a mocking audience.
4. The vow: “If I forget you, Jerusalem…” (vv. 5-6), a commitment to remember.
5. The cry for justice: the imprecation against Edom and Babylon (vv. 7-9) as a plea for God to act.

Illustration hooks

• Being told to smile at work when your heart is breaking. The demand to pretend joy when you are grieving is a kind of violence; Psalm 137 gives language for that pressure.
• When someone asks you to sing a worship song at a party where God is mocked. You feel the tension between witness and exposure; the exiles faced the same.
• Having a precious memory mocked by someone who doesn’t understand. The captors didn’t know what Zion meant to the exiles. Authenticity sometimes means staying silent.

Questions your congregation is asking

• Is it wrong to refuse to worship when I don’t feel like it?
  
• How do I protect sacred things from being treated as casual?
  
• What do I do when my suffering feels mocked by others?
  

This verse lands in the middle of one of the Bible’s most raw laments. The exiles are not debating doctrine, they are asking whether they can open their mouths at all. As you read through Psalm 137, notice how the mood shifts from weeping to a vow of remembrance, then to a cry for justice. This chapter gives language for seasons when joy feels impossible.

Discussion questions

1. Read verses 1-4. What details tell you about the exiles’ emotional state? Which phrase hits you hardest?
2. The captors demanded “one of the songs of Zion.” Why would that request be hurtful beyond the obvious?
3. Look at the Hebrew word ‘eikh (“how”). Clarke says it is a deep sigh. How does tone of voice change the meaning of a question?
4. What does the refusal to sing say about the exiles’ view of their own songs? Were they simply sad, or was there a kind of reverence at work?
5. Compare verse 4 with Lamentations 5:14-15 (“the joy of our heart has ceased”). How does the Bible handle the clash between expected worship and genuine grief?
6. What would it look like in your own life to “hang up your harp” instead of pretending everything is fine?
7. The Psalm ends with harsh words against Babylon. How do you hold together this refusal to sing and the later cry for judgment? What does it tell you about the people who prayed this?