[Answered ]-How can I filter time by using Django_Filters

Since you filter on the __hour lookup, these are integers, so you filter with:

start_time = django_filters.NumberFilter(lookup_expr='gte', field_name='created_at__hour')
end_time = django_filters.NumberFilter(lookup_expr='lte', field_name='created_at__hour')