It is unlawful for any person, who has been granted a special permit, whether under any special code or not, to continue to operate under the terms of the permit after the date on which the special permit, by its terms, expires. All persons to whom such a special permit has been granted by the Council shall come within the terms of this provision and comply herewith immediately after the expiration of the special permit by ceasing the operations allowed under the terms of the special permit.