5 /5 Mary Elizabeth Enrile: Always strolling Downtown Lawrenceville after Deskwork & during holiday events. Lawrenceville First Baptist Church is in Gwinnett County city of Lawrenceville in the Historic Downtown area. A cathedral probably being around since the 1900s like most historically preserved monuments in the area. Never really had the time to check it out but seems like a very neat historical landmark.