In his first inaugural address, Daniel Coit Gilman cited the need, in well populated areas, for civic or municipal engineers. While acknowledging the importance of a preparatory program in this field, he warned: "... we must beware ... lest we make our schools technical instead of liberal.... we may have an excellent Polytechnicum, but not a University." There was criticism in the early years of the university that civil engineering did not offer a practical education, and that the great need in Baltimore was for elementary technical training and not for research carried on by the few. In 1910, the State of Maryland offered to finance the addition of a school of engineering, while the campus was being removed to Homewood. The trustees agreed, and a bill was passed in 1912, which also provided for 129 full scholarships to the school for residents of Maryland.

In 1913, Charles J. Tilden arrived from the University of Michigan to be the professor of Civil Engineering, and a laboratory for Civil Engineering was built and equipped at Homewood in 1916. Instruction in Civil Engineering began in the academic year 1913-1914. Professor Tilden taught three undergraduate courses: Engineering Drawing; Civil Engineering I: Structural Mechanics, Theory of the Strength of Materials, and Elements of Structural Design; and Surveying, a one month summer course. Tilden devoted much of his time to evaluating and procuring surveying equipment, machines for the materials testing laboratory at Homewood, and books, magazines, and photographs to form a library. By the 1916-1917 academic year, the department had developed a four-year course of classes, and had begun its first research project, an investigation of cement mortars and concretes which can be made from materials in Maryland.

In 1919, Tilden resigned to accept the chair of Engineering Mechanics at Yale. During his tenure at Hopkins, Tilden wrote an article justifying the institution of an engineering school in the university, pointing out that an engineer must possess such qualities as creativity which are best developed in the atmosphere of a university.

Beginning in 1919, students were taken on inspection trips to municipal structures, such as water filtration and purification works and bridges, and to industrial and power plants. The Second World War curtailed these visits, which were recommenced in 1949 by the student chapter of the American Society of Civil Engineers; the department itself seems never to have resumed this activity. The war had significant consequences for the department, including heavy enrollment, emphasis on graduate education, and an increased demand for civil engineers at all levels.

The department had always prided itself on the well-rounded education it offered. Its course requirements allowed the student a good number of electives, both within the department, to develop his own emphasis, and in other departments, particularly the Humanities and Social Sciences. In his 1914 article, Tilden remarked that in the program of Civil Engineering at Johns Hopkins, 24% of the requirements fell into the categories of the Humanities and Social Sciences, more than at any other school in the United States. It seems that this proportion of non-engineering classes gradually declined, but the emphasis on a liberal education was renewed after World War II; in the decades of the 1950s and 1960s other universities followed Hopkins's example in this regard.

In 1960, a proposal was approved to merge the Departments of Civil Engineering, Mechanics, and Aeronautics into a single Department of Mechanics with George S. Benton as chair. From 1979 to 1983 there was a Department of Civil Engineering/Materials Science and Engineering. The Department of Civil Engineering was re-established in the fall of 1983.