| A heart made clean by Thy rich blood | 422 Burdette 
 | 
| All things were made by Him | 553 Anthem on the Beginning 
 | 
| And by his men of war? | 101b Holy City 
 | 
| And conquer or die by the American Star. | 346 The American Star 
 | 
| And guides them safely by His word | 99 Gospel Trumpet 
 | 
| And I hope, by Thy good pleasure | 135 Olney 
154 Rest For the Weary 
 | 
| And Jesus by redeeming blood | 99 Gospel Trumpet 
 | 
| And leads by streams that never die. | 558 Living Streams 
 | 
| And now the poor by Him redeemed | 322 Man’s Redemption 
 | 
| And pensively stood by his tomb. | 341 The Lone Pilgrim 
 | 
| And said to me as He passed by | 484 Heavenly Union 
 | 
| And sail by faith upon that flood | 99 Gospel Trumpet 
 | 
| And tell the world I’m saved by grace | 482 Mulberry Grove 
 | 
| And the world was made by Him. | 553 Anthem on the Beginning 
 | 
| And thousands by faith are now climbing it still. | 551 Jacob’s Vision 
 | 
| As warmed by the hearts of the family band | 165 Family Bible 
 | 
| Be unto the earth by reason of the trumpet | 250 Heavenly Vision 
 | 
| Because conferred by Thee. | 143 Pleyel’s Hymn 
 | 
| Bleeding hearts defiled by sin | 497 Natick 
 | 
| Built by the God of love. | 101b Holy City 
 | 
| But we arise by grace divine | 47t Primrose 
 | 
| By and by. | 35 Saints Bound For Heaven 
 | 
| By Babel’s streams we sat and wept | 126 Babel’s Streams 
 | 
| By faith its delights I explore | 449 Fatherland 
 | 
| By faith we know a world above | 206 Christian’s Hope 
 | 
| By fleeting time or conqu’ring death | 204 Mission 
404 Youth Will Soon Be Gone 
436 Morning Sun 
 | 
| By love dissolved away! | 67 Columbus 
 | 
| By my complaint is bitter now | 67 Columbus 
 | 
| By the cross are satisfied | 532 Peace and Joy 
 | 
| By the prophet Esaias, saying | 232 Baptismal Anthem 
 | 
| By the roes, and by the hinds of the field | 254 Rose of Sharon 
 | 
| By the Son of God was wrought | 322 Man’s Redemption 
 | 
| By the Spirit stroke for its evil deeds | 41 Home in Heaven 
 | 
| By this are sinners snatched from hell | 569t Emmaus 
 | 
| By Thy resistless grace | 354t Lebanon 
 | 
| By which we are directed | 115 Edmonds 
 | 
| By yonder shining star. | 461 Shining Star 
 | 
| Caused by my blinded eyes to see | 491 Oh, What Love 
 | 
| Close seated by my Savior’s side. | 170 Exhilaration 
 | 
| Come lay your carnal weapons by | 404 Youth Will Soon Be Gone 
 | 
| Contemned by haughty Herod | 101b Holy City 
 | 
| E’er since by faith I saw the stream | 397 The Fountain 
 | 
| Ev’ry burden to lay by | 448b The Grieved Soul 
 | 
| For Jesus will stand by you | 157 Essay 
 | 
| For mercy by day and for safety at night. | 165 Family Bible 
 | 
| Gently lead us by the hand | 510 Corley 
 | 
| Hail Him who saves you by His grace | 63 Coronation 
314 Cleburne 
 | 
| He formed us by His word. | 34b St. Thomas 
169 Dartmouth 
 | 
| He guides me day by day | 490 My Shepherd Guides 
 | 
| He saw me ruined by the fall | 424 Sweet Union 
 | 
| Hither, by Thy help, I’m come | 135 Olney 
154 Rest For the Weary 
 | 
| Impelled by His love. | 109 Carnsville 
 | 
| Informed by the gospel for such there is room | 496 The Rock That is Higher Than I 
 | 
| It is by little steps we move | 207 Louisiana 
 | 
| Kept by a Father’s hand, love cannot die | 354b Happy Land 
 | 
| Lord, prepare us by Thy grace | 523 Pleyel’s Hymn 
 | 
| Moreover, by them is Thy servant warned. | 518 Heavenly Anthem 
 | 
| My comfort by day and my song in the night | 571 Penitence 
 | 
| No burning heats by day | 216 Delight 
 | 
| None richer possessed by the angels above | 125 Expression 
 | 
| Nor tread the rough paths of the world by thy side | 158 Funeral Thought 
 | 
| Oh can I yet be saved by grace? | 482 Mulberry Grove 
 | 
| Oh Lord, give me strength by day | 531 Dura 
 | 
| Oh Lord, prevent it by Thy grace | 96 Few Happy Matches 
 | 
| Oh may my heart, by grace renewed | 205 Pleasant Hill 
 | 
| Others by Thy grace are saved | 56b Villulia 
 | 
| “Others by Thy Word are saved | 52b Charlestown 
458 Friendship 
 | 
| Peace He brings you by His death | 108t Weeping Sinners 
 | 
| Praise Him by whose almighty word | 394 The Messiah’s Praise 
 | 
| Rise, brethren, rise, your souls by faith ascending | 167 Pray, Brethren, Pray 
 | 
| Saints by the pow’r of God are kept | 500 Living Hope 
 | 
| Sat down by proud Euphrates’ stream: | 504 Wood Street 
 | 
| See, He lays His glory by | 81b Cookham 
 | 
| Straight he saw, and, won by kindness | 56b Villulia 
 | 
| Sung by flaming tongues above | 135 Olney 
312b Restoration 
333 Family Circle 
 | 
| Supported by His power | 109 Carnsville 
 | 
| Supported by Thy word. | 57 Christian Soldier 
513 Joyful 
 | 
| The time is soon coming, by the prophets foretold | 130 Millennium 
 | 
| Though by begging used to live | 56b Villulia 
 | 
| Though now divided by the stream | 285t Arnold 
 | 
| Though sundered far, by faith they meet | 470 The Mercy Seat 
 | 
| Through ev’ry land, by ev’ry tongue. | 192 Schenectady 
276 Bridgewater 
377 Eternal Praise 
 | 
| ’Tis by Thy strength the mountains stand | 344 Rainbow 
 | 
| ’Tis He, by His almighty grace | 418 Reese 
 | 
| To guard my head by night or noon. | 216 Delight 
 | 
| To see her by his side | 115 Edmonds 
 | 
| To us the high boon, by the gods has been granted | 346 The American Star 
 | 
| Unmeasured by the flight of years | 499 At Rest 
 | 
| Unpierced by human thought | 47b Idumea 
 | 
| Upheld by my righteous, omnipotent hand. | 72b Bellevue 
 | 
| Waked by the trumpet sound | 47b Idumea 
428 World Unknown 
 | 
| Was called by death’s cold hand away. | 37t Ester 
 | 
| Was rejected by His own | 355 Anthem on the Savior 
 | 
| We’ll anchor by and by. | 378t Heavenly Port 
 | 
| We’re bound by the cords of His love. | 376 Help Me to Sing 
 | 
| We lay our garments by | 209 Evening Shade 
 | 
| We walk by faith as strangers here | 500 Living Hope 
 | 
| What have I gained by sin, he said | 113 The Prodigal Son 
 | 
| When I shall lay my armor by | 285b Land of Rest 
390 New Prospect 
 | 
| When man by transgressions was lost | 104 The Lovely Story 
 | 
| While shepherds watched their flocks by night | 186 Sherburne 
461 Shining Star 
 | 
| Yet, oh! by faith I see | 77t The Child of Grace 
 |